You were suggested a card with two PCIe 3.0 x8 slots and one PCIe 3.0 x4 slot, all without sharing.
You were suggested a card with two PCIe 3.0 x8 slots and one PCIe 3.0 x4 slot, all without sharing.
Hey there! I'm getting ready to launch my first server and need to pick the right motherboard. I'm planning to install a dual 10G SFP+ PCI-E 3.0 2.0 1.1 compliant slot (8 slots), an 8-port 6Gbps SAS HBA (also 8 slots), and eight NVMe SSDs. I want to use all the SATA ports on the motherboard for the HDDs, but they can't share lanes with the PCIe slots. I'm not using ECC RAM because it adds extra complexity. I'm looking for a good option that fits any LGA-1150, LGA-1151O, or AM4 socket. Regular RAM is fine, even older models are acceptable. I used PC Part Picker but it didn't work well since the selection is limited to 16x and 8x slots. Now I found a second-hand ASUS ROG MAXIMUS VI EXTREME with four 16-pin slots. Let me know what you think!
Many platforms satisfy those needs. The biggest challenge is locating one that accommodates four NVMe drives—they exist but aren’t widespread beyond the latest hardware. On AM4, the MSI X570S Ace Max stands out as a solid choice. It’s impressive but costly, and it shares half its SATA ports with M.2 slots (though it has eight, so it should be fine). Spotting this configuration on older models is common for higher-end boards, often available at fair prices. A few notable examples include the ASRock Z170 OC Formula (no shared lanes, use 1st, 3rd for x8 devices, 4th for M.2), Gigabyte Z170X-Gaming G1 (PLX chip ensures all four PCIe slots run at x8), Gigabyte Z270X Gaming 9, Z170X SOC Force, and Z270X SOC Force (these share bandwidth in the x4 slot with one M.2). If you prefer a straightforward search, look for PLX chips and prioritize boards supporting 4-way SLI. Both PLX and newer options work well—newer models simplify the M.2 demand. Choosing MSI dual x8 boards like Z690/Z790 Ace, Z690 Unify (X), or Z690 Force/Carbon would be ideal. Gigabyte’s Z690 Aero D and Xtreme also fit. AMD current-gen support would narrow it down to the X670E Ace and X670E Carbon, both pricey. If you’re unsure about Z97 models, they lack strong NVMe backing, making them less recommended. Edit: May 30, 2023 – RONOTHAN##
I checked the local market and here’s what I found: ASRock Z170 EXTREME4 with three PCIe x16 slots (PCIe2/PCIe4/PCIe6 configurations). The prices are around 1.7 million, 1.8 million, and 3.5 million respectively. For best performance, install the graphics card in the PCIe16 slot if only one is used. The other slots share bandwidth with different cards. There’s also a mention of M.2 sharing lanes at 1.3 million, but no details on the price or specs.
Regarding the CPU, the i5-12400 is listed as a suitable option for this build. It should work well with the system, especially since you’re planning to upgrade to a newer processor later if needed.
That alternative (without ACE) isn't going to work. I'll look into the ACE version. Edit: The ACE version costs 8.2 million.
This setup suits your needs only if you have 1-2 NVMe drives. For more than that, the connectivity isn't sufficient for all your M.2 devices. If you meant just four lanes for your M.2 cards, there are many compatible boards available (B550 Taichi, X570 Ultra, any Z170 with SLI support, etc.). The issue is similar to Extreme4 and UD5. With the Z690-A Pro, it lacks the x8/x8 support needed for your HBA and network card. None of the Z690 DDR4 models support that configuration. MSI offered several boards with x8/x8 compatibility; any of them would work well, though they’re mostly in a reasonable price range. They all require DDR4, not DDR5.
The M.2 slot on the board isn't a major upgrade, it's mainly for booting. An 8x PCIe M.2 card will handle the NVMe storage. These older boards now make more sense. There are some future plans in mind. This model comes from the Gigabyte GA-Z170X-UD5 TH with three PCIe x16 slots (PCIe2/4/6 configurations). It supports AMD and NVIDIA technologies, and uses a 15μ Gold contact in a VGA PCIe slot. The PCIe6 lane is dedicated to NVMe SSDs. If you need a boot drive, you could opt for a SATA SSD instead. This shared lane setup doesn't appear on the GA-Z270X-Gaming K5.
Thanks for breaking it down. The setup looks solid with clear lane allocations. The chipset handles all the lanes without conflicts, so no bottlenecks here. A CPU with more than 20 lanes wouldn’t offer extra benefit in this case. Appreciate the guidance!
Technically, yes. There are four DMI 3.0 lanes (similar to PCIe 3.0) linking the CPU to the chipset. Anything passing through the chipset will be constrained to that speed at most. Unless all lanes are active simultaneously, the chipset can handle the combined bandwidth, though individual components may not reach full potential. Data transfers between devices on the chipset should operate at maximum speed, while CPU-bound tasks are limited by the network card—typically around 2GB/s for both ports combined. In reality, it's usually less of a concern than connectivity issues.