2004 Pats got a lot better on offense from 2003 but lost so many defensive starters to injuries that it’s amazing that the team as a whole held up.
2003 offense: Brady, Smith, Faulk, Pass, Brown, Branch, Givens, Graham, Fauria, Light, Woody, Koppen, Andruzzi, Ashworth
2004 offense: Brady, Dillon, Faulk, Pass, Brown, Branch, Givens, Graham, Fauria, Light, Koppen, Andruzzi, Neal, Ashworth/Gorin
2003 defense: Harrison, Wilson, Law, Poole, Samuel, Bruschi, Pfifer, McGinest, Vrabel, Chatham, Johnson, Hamilton, Seymour, Washington, Warren
2004 defense: Harrison, Wilson, Law, Poole/Gay, Samuel, Bruschi, McGinest, Vrabel, Chatham, Johnson, Colvin, Seymour, Traylor, Warren
So, while it wasn't quite Bucs 2020-2021, it was largely the same team coming back.