I get the assumption you are making, but don't think it is actually accurate. If you take many of the top 20 sports in the world you often find current or recent male superstars with shorter statures around 5 foot 6 etc.
In football you have Messi or Maradona.
In cricket the legendary Tendulkar. Pacquaio in boxing or Aldo in mma. For motor sports Lewis Hamilton in F1 or Kyle Larson in Nascar. In long distance running Gebrsallasie or Sawe. Pidcock in cycling. You have Altruve in baseball. Luc Steins in handball. Chong Wri in Badminton or Zhang Jike in table tennis. Not many golfers that height these days but Gary Player was 5 foot 6. Kerbe or Fleury in ice hockey. Even in the hardest team collision sports certain positions can lend to shorter players, there are Kolbe or Shane Williams on the wing in rugby, Sproles at RB in the NFL, or the legendary Rob Burrow at halfback in rugby league for example.
I agree some sports do require substantial height or length for the increased leverage needed to be elite, for example swimming, basketball, tennis, throwing and jumping athletics events, volleyball (libero position could be a lot shorter). I agree do many team collision sports that involve carrying the ball require elite height, length or weight in the majority of positions, but there are exceptions
For soccer. Goalkeepers especially need height and length, as do central defenders to deal with any aerial threat. With attacking skill players it can sometimes be an advantage to be short as the ball is on the ground by their feet in possession. The low centre of gravity can make it incredibly difficult to get the ball off them. Maradona being probably the best example, he was short, sturdy and lethal once running in possession of the ball.