How The Brain Infers Causal Structure Across Saccades