I beg to differ.
Whether the excuse is valid or not while it makes you feel good it is irrelevant. The record is what it is no matter who you played on the road. So you should be worried because the fact is we are not good on the road according to our record on the road. If we are to be a good team we have to beat good teams so who we played is irrelevant.
Parcells used the phrase "you are only as good as your record" in a broad sense to mean look at the standings and see where you team sits in the overall win and loss column, and that tells you if you are a good team or not. The "woulda, coulda, shoulda" and "what ifs" mean nothing in the face of that record. Teams with a losing record cannot claim to be a good team. The Pats are 7-4, which currently makes it a good team and a playoff team.
I have not heard that phrase employed on subsets of schedules, whether home/away, natural grass/turf, or dome/outdoor. Under that logic, you can break it down to throwback jerseys or modern away jerseys. An 8-2 team does not blow because it goes 6-0 at home and 0-2 on the road, nor is a team that throttles teams like the Lions and Browns on the road necessarily a good team, despite the undefeated road record.
It does "matter" that the Pats lost to two teams with 11-0 records. It does "matter" that all 4 losses are to teams that are playoff locks or still in the playoff hunt with 5 games remaining. Otherwise, if the Pats beat the Browns, Lions and Seahawks and Rams, by your logic, it would be a phenomenal away team, as good as its record. A team does not become championship caliber by beating dregs, thus that snippet of an overall record means nothing other than the team won games it should have won, regardless of where they were played.
Teams with loud stadiums with 8-0 records (like the successful version of the Lions from the 1990s) and poor road record end up as marginal playoff teams with a decent overall record because they need the noise and disruption from a home stadium to win. First, the home field advantage for the Pats is elements, not noise (the Razor is not loud in comparison to KC, Indy, or recently NO), and only one game this season I can recall involved the elements. Second, the road losses have not been attributable to an inability to cope with a hostile environment (penalties/miscommunication) but rather poor execution, play calling, etc. that allowed three games to slip away (NO was never in doubt and the Pats were never in that game). The issue thus is not home or away but rather whether the Pats can beat the 3 teams (they beat the Jets) they lost to on any field, home, away or neutral site.