Not meaning to pile on the Debbie Downer stuff, but what's way more concerning is the fact that we're allowing these kinds of point totals despite only turning the ball over ONCE through the first 4 games.
To me, that's a bad sign. At least with turnovers, you can point to an obvious root cause. In comparison, go to years of poorly Belichick coached defenses and examine the turnover ratios.
For instance, looking at what are normally considered to be 3 of the "poorer" defenses in the Bill Belichick era, which include 2002, 2005, and 2009, we see that the Patriots only lost to ONE team when they didn't turn the ball over when combining all 3 seasons (DEN--twice). This sample even includes the postseason games for those years.
In comparison, they've already lost twice this year without committing a single turnover, and they almost lost to HOU when committing only one. Since we can assume that they're not going to be able to continue playing perfect, turnover-free football, this bears keeping an eye on, moving forward.