In 2003, the Pats lost 31-0 to a team that went 6-10 while the Pats went 14-2 and won the Super Bowl. In 2007, the Giants got blown out 41-17 to an 8-8 Vikings team on the way to a Super Bowl win. In 2006, the Colts got blown out 44-17 to an 8-8 Jags team on the way to a Super Bowl win. In 2004, the Pats lost to a 4-12 Dolphins on their way to a 14-2 season and Super Bowl win.
Losing big to a bad team (and the Browns are better than their record) doesn't eliminate you from Super Bowl contention. Several Suoer Bowl team over the last decade including the Pats have gotten blown out by teams without winning records only to go on to win the Super Bowl. Besides, eight weeks from now, the Browns might be an 8 or 9 win team.