Re: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
This is mostly exactly the current question I am trying to answer for myself.We have a few ESXi hosts currently on v5.5 with dual port VPI adapters.We want to run SRP/iSER on one port back to our SAN...
View ArticleClik here to view.
Re: MCX354A-FCBT & Switch Speed Issue
Sorry for the lack of response on this - I have been so busy lately this project has got delayed due to more important commitments.At this stage I think the FDR vs. FDR10 answer is the most likely...
View ArticleRe: Question about stacking
Hi Craig, The SX1012 switches don't support Stacking, it does support MLAG, can you try reviewing the below article (if you haven't reviewed it already). HowTo Configure MLAG on Mellanox Switches Also...
View ArticleRe: Question about stacking
Well i have it configured to talk over the port that the stacking cable is connected into, but if you are saying that it can't use a stacking cable, that is probably my issue. I will further investigate.
View ArticleRe: MCX354A-FCBT & Switch Speed Issue
Hi,MSX6015T-1SFSMSX6015T-1BRS These two models can only do FDR10. Its a hardware limitation.Normally there is a sticker on the switch with a part number and serial number. Try this:If you have a...
View ArticleClik here to view.
mlnx_tune does not detect the BIOS I/O non-posted prefetch settings?
I have four AIC SB122A-PH 1U all NVMe storage servers. Two of them have Intel E5-2620v3 2.4Ghz CPUs, 8 x 16GiB 1833Mhz DDR4 DIMMs, 2 x DC S3510 SATA SSDs, 8 x DC P3700 NVMe SSDsTwo of them have Intel...
View ArticleClik here to view.
How to setup IPoIB correctly?
We have a small network for testing. Its layout is shown below. The orange-colored IP addresses are the current IPoIB setup. They are done with /etc/sysconfig/network-scripts/ifcfg0-ib0 using IP...
View ArticleRe: dma_map_single not able to receive capsules on ARM with mellanox card
Hello, I advise you to contact Mellanox Support (support@mellanox.com) and describe your project, configuration and further elaborate on what you're trying to do with Mellanox NICs over ARM platforms.
View ArticleCan multiple versions of mlnx-ofed exist in the same IB fabric?
Hi, we have installed compute nodes with RHELS6.3 and MLNX_OFED_LINUX-2.0-2.0.5 using an Infiniband network. We intend to upgrade to RHELS6.7 and mlnx-ofed 3.x.In a rolling upgrade scenario, can we...
View ArticleRe: Windows, TCP/IP - lowest possible latency?
Should I expect any difference between ConnectX 3 Pro and ConnectX 4 EN in this case?
View ArticleI have 2 colocation sites located 6-7km apart. I can rent a 10gb wave between...
Title says about all; We are starting our cloud-hosting company at 2 sites, in the future it will be 3 sites in total. For now however, we start at 2 sites. I have a SX1036 with dual PSU that I am...
View ArticleRe: VMware ESXi 6.0 virtual ib_ipoib interfaces
Hi David, 1) Driver version 2.4.0 is an Ethernet driver only so if you have a VPI card, please make sure the port protocol is configured as 2 which is Ethernet. #/opt/mellanox/bin/mlxconfig -d...
View ArticleRe: ConnectX-3 RoCE fails send WRs when running multiple QPs
I afraid it is tricky to understand without debugging and source code, but most likely there is a problem there. Try to print the values of lkey/rkey, QP numbers, protection domains, other related data...
View ArticleRe: 'State: Initializing' but works
Thank you eddie.notz for your response. Yes.Both port 1 and port 2 status had been 'active' till then. (I did not apply any updates etc in recent and all updates are always manually installed to avoid...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
7 days later and no reply from Mellanox... Seriously?
View ArticleClik here to view.
Re: VMware ESXi 6.0 virtual ib_ipoib interfaces
Hi Sopie we don't want to use it as Ethernet card but as IB over IP. That's the problem that I can't get it to work as a 40GB IBoIP card in ESX 6 anymore, which worked perfectly with ESX 5.5 and the...
View ArticleHow to change speed from FDR to QDR using ibportstate command in centos 6.2
We have Mellanox Infiniband FDR cards and cables supporting it. We want to reduce the speed of the adapters from 56 Gbps to 40 Gbps. We tried using ibportstate <base lid> <port id> of the...
View ArticleRe: How to change speed from FDR to QDR using ibportstate command in centos 6.2
ibportstate <lid > <port> fdr10 0 espeed 30 ibportstate <lid> <port> reset
View ArticleIs it possible to connect 2 ethernet switches (sx1036) located up to 10km...
Hi guys, I have a question that is real important for me; How can I connect my two sites so that I am able to use RDMA between them? I have 2 racks, each located in a different datacenter. Each rack...
View ArticleRe: How to setup IPoIB correctly?
I have been kept digging, and here is what I have observed: I just did a [root@sc2u0n0 ~]# lsinitrd /boot/initramfs-3.10.0-327.28.2.el7.x86_64.img|less[...] drwxr-xr-x 5 root root 0 Aug...
View Article