The network speed between your Ryzen cluster is nearly 100 Gbps.
The network speed between your Ryzen cluster is nearly 100 Gbps.
I own two AMD Ryzen machines, both equipped with the Ryzen 9 5950X chipset. One uses an Asus X570 TUF Gaming Pro WiFi board while the other features an Asus ROG STRIX X570-E Gaming WiFi II board. Recently, I was investigating a problem with my 100 Gbps network link between the two Ryzen nodes and the microcluster headnode. When I executed ib_send_bw, the speed dropped to roughly 14 Gbps. After removing the discrete GPUs from each system, my micro HPC cluster is now delivering about 96.58 Gbps. Yay! (It’s hard to believe there aren’t many with Ryzen setups and 100 Gbps networking.)
I'm using standard network interface cards for connectivity. The cluster is designed to enhance processing power and data handling capabilities.
Hmm... curious? That caught my attention right away. First, I realized there weren’t enough PCI-e lanes. Then I recalled the 5950X provides 24 PCI-e 4.0 ports. That’s 4 from the chipset plus 16 from the CPU. Even with just 4 PCI-e 3.0 lanes, you’d still get about 32Gbit/s. The 14Gbit/s figure seems off. I’m not sure what’s happening here. I hope it serves its best practical use.