It doesn't matter. If Brown blocks him, it's offensive pass interference.
I was always under the impression that a defensive player was allowed to "jam" a WR under 5 yards, and that an offensive player was allowed to push off of that jam under 5 yards.
Is this incorrect?