If you're running things in Infiniband mode, is there a subnet manager running on the network?
This kind of sounds like what happens when you run without a subnet manager. If you're not sure, try running the OpenSM service and see if the network cables suddenly start showing up as connected.