I think sometimes the offensive line gets the blame for things, that in reality are inefficiencies with the whole operation. If the protection is set assuming the ball is coming out quickly, but a new receiver isn't where he's supposed to be and Brady has to hold the ball longer than expected, it looks bad for the line, but really it was the receiver. In fairness, this can work the opposite way too, where Brady's ability to read defenses and get the ball out quick has made the OL's job easier.
There's been a lot of in-season turnover, both on the line and in the skill positions this year. I'm not with PFF in saying they're the 9th best OL right now (far from it), but I think if we could get 3 straight weeks of relative stability in the personnel, we'd start to see a much smoother looking operation across the board.