Below is the image describing their ladder configuration of the IPU network. Strong connections on the rungs, and a 64Gb/s vertical “rail” connection. Note that this is not a torus.
The most important key to note from this section is that proximity matters. The tiles are arranged on islands, and columns and inter-island communication is shown to be faster than across.