Yeah, you don't pass to colors. If both teams wore the exact same colors it wouldn't be confusing at all. Brady would just pass to Moss, Welker or whomever...he wouldn't have any trouble finding them on the field given that everyone was wearing the exact same uniform.
Both teams wouldn't be wearing the same colours. Way to disagree with a post using hypothetical reasoning. Even if a clash of colours did exist (taking into account why it doesn't), unless your throwing to random people in red like some rattled kid you can still identify people. If Brady is throwing to random colours and can't identify his own teamates whatever colour they're in, Belichick and the Patriots have got problems.