Hi,
I would suggest confirming;
If your machines meet the requirements that bring out the best ability of the adapters (ConnectX-3 requires at least PCIe 3.0 w/ 8 Lanes for the best capability).
If the latest version of MLNX_OFED run on your systems.
And results of these commands may helpful to anybody to troubleshoot the issue.
- # uname -a; cat /etc/issue
- # ofed_info | head -n 1
- # lspci -v | grep -i "mellanox"
- [Result of the benchmark]
Thanks,
Masa