Incidence Geometries and the Pass Complexity of Semi-Streaming Set Cover