To me, when I have looked back at that game, the thing that stands out to me was that there were numerous times, in the teens, where Brady had a play, and he was hit while in the throwing motion sending the ball off target. The sacks weren't the game, in fact, this offense is the best in history at converting first downs after early down sacks or penalties put them in a hole (see 3rd and 18 to amendola last Sunday) and in most cases 3rd down sacks we allow are coverage sacks and Brady chooses to take it rather than throw into danger.
In the secondary in that SB we had a 30 point game, and if Brady had a split second longer to throw without being shoved during the pass, we would have romped.