Mellanox ofed 2.1 Centos 6.x system-config-firewall-tui hangs
Ive encountered an issue where system-config-firewall-tui hangs after installing Mellanox ofed 2.1 on just about every system i have (being several) , you can see modprobe going wild in top.Ive found...
View ArticleClik here to view.
Re: ib_srp disconnect on ESXi 5.0 with H:0x5 D:0x0 P:0x0 error
Hello everyone, Thank you very much for the time you've spent trying to help. I'm not 100% sure, but I've probably found the solution for the "H:0x0 D:0x8 P:0x0" errors and weird HCA behaviour, where...
View ArticleRe: 40Gb Ethernet in VMWare ESX 5.5?
The cards on both ends are: [root@basement mnt]# ibv_devinfohca_id: mlx4_0 transport: InfiniBand (0) fw_ver: 2.30.8000 node_guid:...
View ArticleRe: ib_srp disconnect on ESXi 5.0 with H:0x5 D:0x0 P:0x0 error
Sounds good my friend! Happy to see you were able to workaround the issue.
View ArticleMAC shown incorrectly in OFED 2.1? How to fix?
We updated from OFED 1.5.4.1 to Mellanox OFED 2.1 (everything on CentOS 6.3 64bit). The installation went smooth, but now ipconfig ib0 shows the same MAC (different from before) on all nodes:HWaddr...
View ArticleRe: 40Gb Ethernet in VMWare ESX 5.5?
Hi,Could you please run the following and provide the output:#esxcli network nic list
View ArticleRe: 40Gb Ethernet in VMWare ESX 5.5?
~ # esxcli network nic listName PCI Device Driver Link Speed Duplex MAC Address MTU Description ------------ ------------- -------...
View ArticleLow Throughput
I recently bought two Connectx-3 FDR Infiniband + 40GigE cards (model CX535A) I am not seeing the expected through put from the cards. I am using NTTCP (ver 5.28) to test the performance of the cards....
View Articlemlx4 Changing Time Stamp configuration
Every five minutes this happens: Jan 30 18:50:04 server kernel: mlx4_en: eth1: Changing Time Stamp configurationJan 30 18:50:04 server kernel: mlx4_en: eth1: Link DownJan 30 18:50:08 server kernel:...
View ArticleClik here to view.
Re: 40Gb Ethernet in VMWare ESX 5.5?
Hello, The card you have displayed MT_1090110028 is capable of 40gbps InfiniBand and 10gbps Ethernet. it is not capable of 40gbps Ethernet. Though we do have cards that are capable of 40gbps...
View ArticleRe: Low Throughput
Could be server/NUMA settings. I suggest to check http://www.mellanox.com/related-docs/prod_software/Performance_Tuning_Guide_for_Mellanox_Network_Adapters_v1.10.pdf
View ArticleRe: 40Gb Ethernet in VMWare ESX 5.5?
Thanks for pointing that out! I hadn't realized that there were so many variants of the card. So if I were to get a different card that was 40GbE capable, would ESX detect it correctly using the stock...
View Articleflexboot failed to join
Hi all, I'm having a go at getting nodes on our cluster to boot over IB. I'm setting up the server with Bright Cluster Manager and that side of things seems OK. The problem I get is that the node...
View ArticleRe: Issues with SRP and unexplainable "ibping" behaviour.
Hi! What the firmware of Mellanox MHGH28-XTC (MT25418) cards? I think you must use firmware 2.9.1200.
View Article10G SFP+ ports not always working in SX1024 switch
Hi all, I have some problems with connecting switch SX1024 to other devices. I have Mellanox SR SFP+ modules inside switch cages and I am using SR cables (checked with other devices and they are ok). I...
View ArticleRe: Mellanox Voltaire 4036 VLT-3011s way to reflash OS / reset password
Thanks for your help. I returned the defective item.They are offering another one in exchange or full refund. However, there is a red led inside the case of the other unit blinking/turned on. Is that...
View ArticleNo way to login to a 4036
Hello everyone, I'm trying to connect to a 4036 Mellanox Switch IB to change the password. The connection is running through a serial to USB cable and with a Linux ( I do the command : cu -l...
View ArticleeIPoIB configuration/performance issue?
Trying to configure eIPoIB so that a guest VM running under KVM on a compute node can access a storage node on the Infiniband network. Both the compute host and storage node are running Ubuntu 12.04...
View ArticleClik here to view.
Re: eIPoIB configuration/performance issue?
Er, update here. After a restart, it works, am now getting about 15Gb/s from guest to storage (slightly better than compute to storage, go figure). Not entirely sure what I had screwed up, but looks...
View ArticleClik here to view.
Re: Mellanox eSwitchd issue on Openstack Havana nova-compute
I was able to successfully restart the nova-compute service by adding the correct mac address to the correct iov ports in the following way.find the MAC address of the VM using nova list and neutron...
View Article