F5F Stay Refreshed Power Users Networks Only 10GB connection available for 40GB model.

Only 10GB connection available for 40GB model.

Only 10GB connection available for 40GB model.

W
Wolfyyy_
Senior Member
Find
358
03-27-2017, 07:04 PM
#1
I'm just starting with Mellanox, so I expected a few hiccups along the way. The positive side is my peripherals are performing well at 10Gbps, but my Windows setups are only getting through at 10Gbps in full-duplex mode using a direct Ethernet connection without a switch. I'm running the MCX353A-FCBT ConnectX-3 cards on both machines, and the drivers were updated to version 5.50.14688.0. I'm connecting with the MC2206130-003 cable from fs.com, which claims support for 10G/40Gb Ethernet. You can find it here: Mellanox MC2206130-003 40G QSFP+ DAC Cable New Hardware/systems.

My systems are set up as follows:
System 1 – Threadripper 1950x, 64GB RAM, x399 M.2 slot, Samsung 970 Evo Plus, Windows 10 Education (essentially Enterprise). Installed in a PCIe 16 slot.
System 2 – Xeon W2102m with 16GB RAM, Supermicro X11SRA-F M.2 slot, Samsung 970 Evo Plus, Windows Server 2019. Also in a PCIe x16 slot.

I noticed Mellanox is running in a PCIe x16 port, but I’m not sure if that’s the issue. My internet searches haven’t turned up much help, though I read about Linux tuning tools and couldn’t find any for Windows. Using MST utilities, I see my Device ID is 4099 (ConnectX-3) and PSID is MT_1100120019. It looks like my firmware version (2.42.5000) is the latest available. RDMA is active on both machines, which might be relevant.

I ran a command via mlxtool and got these details:
- Bus 65, Device 0, Function 0
- Operational Info for Port#1: Speed 10Gbps, no issues detected
- TroubleShoot Info for Port#2: Disabled, no issues, but port closed by command – check interface status.

Thanks for the info!
Reply
Reply
W
Wolfyyy_
03-27-2017, 07:04 PM #1

I'm just starting with Mellanox, so I expected a few hiccups along the way. The positive side is my peripherals are performing well at 10Gbps, but my Windows setups are only getting through at 10Gbps in full-duplex mode using a direct Ethernet connection without a switch. I'm running the MCX353A-FCBT ConnectX-3 cards on both machines, and the drivers were updated to version 5.50.14688.0. I'm connecting with the MC2206130-003 cable from fs.com, which claims support for 10G/40Gb Ethernet. You can find it here: Mellanox MC2206130-003 40G QSFP+ DAC Cable New Hardware/systems.

My systems are set up as follows:
System 1 – Threadripper 1950x, 64GB RAM, x399 M.2 slot, Samsung 970 Evo Plus, Windows 10 Education (essentially Enterprise). Installed in a PCIe 16 slot.
System 2 – Xeon W2102m with 16GB RAM, Supermicro X11SRA-F M.2 slot, Samsung 970 Evo Plus, Windows Server 2019. Also in a PCIe x16 slot.

I noticed Mellanox is running in a PCIe x16 port, but I’m not sure if that’s the issue. My internet searches haven’t turned up much help, though I read about Linux tuning tools and couldn’t find any for Windows. Using MST utilities, I see my Device ID is 4099 (ConnectX-3) and PSID is MT_1100120019. It looks like my firmware version (2.42.5000) is the latest available. RDMA is active on both machines, which might be relevant.

I ran a command via mlxtool and got these details:
- Bus 65, Device 0, Function 0
- Operational Info for Port#1: Speed 10Gbps, no issues detected
- TroubleShoot Info for Port#2: Disabled, no issues, but port closed by command – check interface status.

Thanks for the info!

Reply
Reply