I think Hotator is closest to the solution.
All, or nearly all, belt pulleys on tractors are domed slightly, or in some cases, quite a lot.
Years ago, there was a lot of belt work with tractors and farmers had few problems with alignment. Flat belts often had a huge amount of sag but still stayed on at about 2600 feet per minute - a bit slower than the belt run here.
Some pulleys were machined with sides, to control flat belt tracking, only on the smaller of the pair.
This installation might even be better tensioning from the inside the belt as long as it is near the engine, as the contact area would not be particularly compromised by pulling the belt outwards. The idler could then be grooved and track with the belt.
Regards, RAB