I definitely see your point of view.
The way I saw it being a teenage sports fan in 1976 who favored the Boston teams despite being in the NY media market in CT was that the Patriots of this era went from not moving the needle at all to moving it a little bit. With players like Plunkett and coaches like Fairbanks you at least had a few reasons to want to become a Patriots fan.
OTOH, the vibe I got from people I knew who went to Schaefer Stadium was not good. Ankle deep mud in the parking lots, cold aluminum seats, fans drunk out of their minds on cheap Schaefer beer, vomit and fist fights everywhere. Billy Sullivan wasn't going to pay for things like paved parking lots and large numbers of trained security guards. He was there to make a buck off of ticket and beer sales.
Say what you want about Krafty Bob, but we should all remember that he literally is the reason the team didn't leave for St Louis. He built a much better facility than Schaefer Stadium and cared more about fan experience than the Sullivans ever did.
It's one reason I laugh when people call him out for being cheap. If he was cheap he would have sold out to the Orthweins and pocketed tens of millions of dollars. Instead he invested $172M, a lot more than anyone else ever had in buying a NFL team, to keep it here. Then a few years later he built a new stadium, largely out of funds he raised.
Of course he knew he could probably end up making money if he kept investing in the product, but I doubt he was thinking some day this team will be worth six billion dollars. It's a story that should make everyone happy, yet it seems some have some pretty ugly reasons to not like how it all went down.