Crazy Infiniband errors
Everything on my network was running great, until about 2 months ago. I have (3) windows servers running 2012R2. 2 server have ConnectX cards, one server has a connectx-2 card. Main Problem: I can...
View ArticleLab Setup Question
Hello all, I have a Dell PowerEdge C6100 at home which I am currently running (2) ESXi 5.x Servers along with (1) Windows 2012 node which is hosting my iSCSI server (20TB = 4TB x6) along with a number...
View ArticleClik here to view.
Link speed limited to 10gbps
Hi, two 40gbps MCX313A-BCBT, Rev A5, connected back-to-back (not sure that it's approved fiber/QSFP combo) - and my iperf bandwidth is strictly limited by 10gbps line rate. PCIe slots in the x86...
View ArticleClik here to view.
Error /hca_self_test.ofed: line 165: [: too many arguments
I am running Centos 6.5 x86_64 I have installed the Mellanox driver (MLNX_OFED_LINUX-2.2-1.0.1-rhel6.5-x86_64) when running the following hca_self_test.ofed I receive the following output...
View ArticleRe: Remove infiniband related drivers?
udev is the best place to rename devices. Use line like this one, just sync with real device id, type, PCI number,SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{dev_id}=="0x0", ATTR{type}=="32",...
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
Output Below modinfo mlx4_corefilename: /lib/modules/2.6.32-431.20.3.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.koversion: 1.1license: Dual...
View ArticleRe: Link speed limited to 10gbps
Did you installed HCA into the correct port? What is the output of lspci -s 02:00.0 -xxxibv_devinfo -vvvCould you use small switch instead of connecting back-to-back and check if the issue still happens?
View ArticleRe: HP ConnectX cards identifying as ConnectX EN
It is possible to force firmware to be burned with incorrect PSID. Usually HP hardware has HP_XXXXXXXX prefix. The firmware on the second hard is differ from 2.7.0 vs 2.8.0. I would like to recommend...
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
and what is the output ofrpm -qf /lib/modules/2.6.32-431.20.3.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko If should return the RPM nameAnd could you check if...
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
Output follows rpm -qf /lib/modules/2.6.32-431.20.3.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.kofile...
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
It is strange. There should be RPM. Could you re-install MOFED by executing mlnxofedinstall script and check that there is no errors during installation?
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
I will try this in about an hour Sent from my iPhone
View ArticleRe: Error /hca_self_test.ofed: line 165: [: too many arguments
Reran install as you asked and saw the following, not sure these warnings will be a problem, while I had time I also ran the install on another machine with the same specs and it worked normally after...
View ArticleClik here to view.
Re: Error /hca_self_test.ofed: line 165: [: too many arguments
Hi, Yes. this script simply check basic code revisions and link connectivity. which can be queried by other commands coming from the driver / infiniband-diags package
View ArticleRe: Link speed limited to 10gbps
Howdy, Aleksey, thank you a lot for replying. Mellanox NICs (MCX313A-BCBT) are 40gbps Ethernet cards not IB HCAs. I don't use OFED but rather native Linux ethernet drivers provided by Mellanox....
View ArticleRe: Remove infiniband related drivers?
Ok, so i downloaded the package above that you mentioned and also looked over the pdf manual you listed. I ran ./install.sh (had to do it a few times as there are numerous dependencies I had to install...
View ArticleRe: Remove infiniband related drivers?
Edit. I reinstalled again with "./install.sh --disable-kmp" and that seemed to solve the issue with the nics not loading. Woo hoo! Now to see if I can get the udev rules to consistently name these...
View ArticleRe: Link speed limited to 10gbps
Just wondering, how can you see the firmware report 10gpbs?Did you try go through tunning guide - Mellanox Products: Mellanox OpenFabrics Enterprise Distribution for Linux (MLNX_OFED)?
View ArticleRe: Remove infiniband related drivers?
Well shoot, it seems these cards dont work with the mii-tool, thus i cant really even bond them them as bond-miimon is used. Right? root@stor2:~# mii-tool eth2SIOCGMIIPHY on 'eth2' failed: Operation...
View ArticleClik here to view.
Re: Link speed limited to 10gbps
Hi Phillip: We use the embedded chip and experienced limitations (10Gbps, others) with the Linux Mellanox driver. We were also testing in a cross connect circumstance like you. We switched to OFED...
View Article