High-performance computing network at 10G speed but with an extra feature
High-performance computing network at 10G speed but with an extra feature
You need to create an HPC cluster with a 10Gb network, but the existing motherboards only support 1Gb. You can use 10G NICs, but the PCIe slots are already packed with GPUs because of their size—no room for additional cards. To keep GPU performance high for machine learning tasks, consider alternatives like adding more GPUs or upgrading to a higher-speed interface if possible.
Based on @Kilrah's advice, using a riser is the optimal choice. My setup includes a dual 10 gig Intel NIC and USB 3 Gen 2 card connected via a bifurcated x16 to dual x8 riser cable, which has performed well so far. However, my x1 riser could negatively impact performance.
Often discouraged yet with limited PCIe slots and just one Gigabit onboard, it’s a viable choice to use two USB-C > 5Gbps adapters and combine them. I’m not aware of any 10Gbps adapters, but the specs suggest it could work. Consider devices like the Aquantia (Marvell) AQC112U, AQC111U, or AQC111U. USB NICs can present problems too, but it’s worth trying here.
I was considering keeping the GPUs in their standard setup, but using a riser to relocate one slot you can't reach elsewhere for the NIC might free up space. You could connect the riser to a cooler-compatible slot and place the NIC at the opposite end. This assumes you have sufficient slots and a compatible lane layout. It's possible the riser is designed for an M.2 port as well. If none of these options work, it may not be a viable workaround except to consider giving up on the GPU or switching to better hardware suited for your needs.
I require 10 grams and Thunderbolt 10G ports but I’m not sure USB-C handles 10G speeds
I considered it as well, but with USB 3.0 connectors, I don't believe I can achieve 10g output.