While your points are very well noted and extremely reasonable, I think the concern is the way that the team has been playing for quite awhile now. The defense is giving up an average of 27+ point per game since September. Does that sound like a "good" team to you? It really doesn't to me, but I definitely agree with your advice to try and enjoy the ride as much as possible. Unfortunately, the standard is set higher due to so much hype, having arguably the best QB in the history of the NFL, along with the best head coach. We should in theory, be making deep playoff runs every year, and although that's happened in the past 2, it had been 2007 prior to that.
In 6 of our last 7 games, we've either been down by double digits+, or have lost the game (or both). That, not to mention all of the other weaknesses are likely what is keeping people from lumping us in with the Saints, Panthers, and 49'ers of the world. In other words, you can't just look at records, but you have to be able to look at the entire team, its strengths, and also its weaknesses.
It's a shame when some people are overly negative and take that too far. There's no reason to think that we cannot make a playoff run, but first we have to get into the playoffs. We'll know more about that in the next week or so. With a loss at BAL, we'd be looking at a 3-5 road record on the year, so having a first round bye is extremely important in my opinion. As you said, we should try and enjoy it as much as possible, and I would certainly never count this team out for any reason whatsoever. There are however, some very glaring issues that may indeed prevent us from doing too much this season, but as a fanbase we're very unfortunate.