The black community prefers to him as a "new black," so I wouldn't say he is racist, just more supportive of black athletes than others. I agree, better yet, I know that if Cam Newton or any other black player had half of Brady's stats and success, he wouldn't be trying to discredit them while boosting up some lesser player.
Smith could careless about that supposed bad man Aaron Rodgers, probably never even watched his games. He only brings up Rodgers because its arguable amongst fan bases that Brady isn't the best "right now." He only brings up Montana because it arguable that Brady may not be the GOAT. His choices are popular opinions amongst doubters and he uses them to defend his "I'm not trying to take anything away from Brady, but..." argument.