With the distance you see the crowd from the golfers I would have thought the
10-400L IS was a must.
If you didn't need IS then the
Sigma 120-300 f/2.8 would have given you some extra speed with the lens, which might be more important if light conditions are poor & you want to catch the swing of the golfer.