In my opinion Brady and Rodgers are the only true elite QBs in the league right now. For me elite is a level where a player is playing at an very high level, not just compared to current players, but also comparing to past players.
Peyton and Brees has both been there, but declined from there. I think Brees could return to that level. But I very much doubt that Peyton can because his very steep decline in arm strength. He can still throw a beautifuly arched long ball on fades. But he just doesn't have that fast ball anymore.
Luck has the tools to get there. But he makes to many bad decisions right now. He makes too many really risky throws that gets intercepted, or close to it, instead of just taking a sack.
