F5F Stay Refreshed Power Users Networks Sun ATLS2XGF 10GbE paired with Ubuntu OS via PowerConnect 6224, using 10GbE XFP interface.

Sun ATLS2XGF 10GbE paired with Ubuntu OS via PowerConnect 6224, using 10GbE XFP interface.

Sun ATLS2XGF 10GbE paired with Ubuntu OS via PowerConnect 6224, using 10GbE XFP interface.

P
Postinq
Member
222
01-07-2021, 12:35 PM
#1
So I got 2 Sun ATLS2XGF dual 10gbe xfp NIC's for ~ 30USD. I figured they were just some rebrand like Sun raid controllers. Windows refuse's to find a driver, but that's no big deal. I got these for a ubuntu server. So I plop 1 in my server and everything seem good. A little complaining about a bad xfp, so i take one from the second card and wait for the fiber to arrive. It came in yesterday and I hooked everything up and I get links @ 10gb full duplex. So I added entries for the interfaces in my /etc/network/interfaces file like so: auto enp133s0f0 iface enp133s0f0 inet dhcp auto enp136s0f0 iface enp136s0f0 inet dhcp No address after restarting the network, so i reboot just to make sure. I try a static address. I get an address, but cant ping the switch. lspci show's it as 4 Ethernet controller: Oracle/SUN Multithreaded 10-Gigabit Ethernet Network Controller (rev 01) dmesd | grep niu (the driver) Spoiler [ 1.322261] niu: niu.c:v1.1 (Apr 22, 2010) [ 1.322733] niu 0000:88:00.0 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 1.322795] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 1.323032] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 1.323222] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 1.323800] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 1.324148] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 1.325375] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 1.325518] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 1.325567] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 1.325701] niu: niu0: Found PHY 00206033 type PMA/PMD at phy_port 8 [ 1.325914] niu: niu0: Found PHY 00206033 type PCS at phy_port 8 [ 1.326186] niu: niu0: Found PHY 00206033 type PMA/PMD at phy_port 9 [ 1.329509] niu: niu0: Found PHY 00206033 type PCS at phy_port 9 [ 1.336801] niu: niu0: Port 0 [8 RX chans] [12 TX chans] [ 1.336880] niu: niu0: Port 1 [8 RX chans] [12 TX chans] [ 1.336957] niu: niu0: Port 0 RDC tbl(0) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337039] niu: niu0: Port 0 RDC tbl(1) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337123] niu: niu0: Port 0 RDC tbl(2) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337208] niu: niu0: Port 0 RDC tbl(3) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337294] niu: niu0: Port 1 RDC tbl(4) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 1.337405] niu: niu0: Port 1 RDC tbl(5) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 1.337513] niu: niu0: Port 1 RDC tbl(6) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 1.337621] niu: niu0: Port 1 RDC tbl(7) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 2.609347] niu: Port 0 PMA_PMD(MII_STAT1000) [0001] [ 2.610314] niu: Port 0 USER_DEV3(0x20) [1005] [ 2.611207] niu: Port 0 PHYXS(MII_NWAYTEST) [0000] [ 2.879376] niu: eth1: NIU Ethernet 00:21:28:84:d5:10 [ 2.879377] niu: eth1: Port type[XMAC] mode[10G:FIBER] XCVR[XPCS] phy[xgf] [ 2.879945] niu 0000:88:00.1 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 2.880006] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 2.880260] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 2.880450] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 2.881029] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 2.881373] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 2.882599] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 2.882742] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 2.882791] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 4.089342] niu: Port 1 PMA_PMD(MII_STAT1000) [0001] [ 4.090035] niu: Port 1 USER_DEV3(0x20) [1005] [ 4.090569] niu: Port 1 PHYXS(MII_NWAYTEST) [0000] [ 4.168860] niu: eth0: NIU Ethernet 00:21:28:84:d5:11 [ 4.169531] niu: eth0: Port type[XMAC] mode[10G:FIBER] XCVR[XPCS] phy[xgf] [ 4.170719] niu 0000:88:00.2 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 4.170780] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 4.171016] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 4.171206] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 4.171784] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 4.172131] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 4.173359] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 4.173502] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 4.173551] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 4.173555] niu 0000:88:00.2 (unnamed net_device) (uninitialized): niu_put_parent() port[2] [ 4.174120] niu 0000:88:00.3 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 4.174180] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 4.174417] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 4.174606] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 4.175184] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 4.175527] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 4.176759] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 4.176901] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 4.176950] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 4.176953] niu 0000:88:00.3 (unnamed net_device) (uninitialized): niu_put_parent() port[3] [ 4.179410] niu 0000:88:00.0 enp136s0f0: renamed from eth1 [ 4.200598] niu 0000:88:00.1 enp136s0f1: renamed from eth0 [ 315.293446] niu 0000:88:00.0 enp136s0f0: Link is up at 10Gb/sec, full duplex [ 495.068363] niu 0000:88:00.0 enp136s0f0: Link is up at 10Gb/sec, full duplex [ 609.461609] niu: Port 0 PMA_PMD(MII_STAT1000) [0001] [ 609.461678] niu: Port 0 USER_DEV3(0x20) [1005] [ 609.461746] niu: Port 0 PHYXS(MII_NWAYTEST) [0000] [ 737.134734] niu: Port 0 PMA_PMD(MII_STAT1000) [0001] [ 737.134802] niu: Port 0 USER_DEV3(0x20) [1005] [ 737.134868] niu: Port 0 PHYXS(MII_NWAYTEST) [0000] [ 748.274763] niu: Port 1 PMA_PMD(MII_STAT1000) [0001] [ 748.274831] niu: Port 1 USER_DEV3(0x20) [1005] [ 748.274897] niu: Port 1 PHYXS(MII_NWAYTEST) [0000] The PowerConnect show's a 10gb link and the port is set to access. The only other settings ive changed from factory default is 2 lacp lag's where the server connects currently, and the login. It's the most recent firmware as of last last month. Are the Sun cards not just a rebrand but a custom with only SUN and RHEL drivers? Am I missing something simple? Any thoughts? Edit This is my first time setting up a fiber interface, so I could be missing something simple
P
Postinq
01-07-2021, 12:35 PM #1

So I got 2 Sun ATLS2XGF dual 10gbe xfp NIC's for ~ 30USD. I figured they were just some rebrand like Sun raid controllers. Windows refuse's to find a driver, but that's no big deal. I got these for a ubuntu server. So I plop 1 in my server and everything seem good. A little complaining about a bad xfp, so i take one from the second card and wait for the fiber to arrive. It came in yesterday and I hooked everything up and I get links @ 10gb full duplex. So I added entries for the interfaces in my /etc/network/interfaces file like so: auto enp133s0f0 iface enp133s0f0 inet dhcp auto enp136s0f0 iface enp136s0f0 inet dhcp No address after restarting the network, so i reboot just to make sure. I try a static address. I get an address, but cant ping the switch. lspci show's it as 4 Ethernet controller: Oracle/SUN Multithreaded 10-Gigabit Ethernet Network Controller (rev 01) dmesd | grep niu (the driver) Spoiler [ 1.322261] niu: niu.c:v1.1 (Apr 22, 2010) [ 1.322733] niu 0000:88:00.0 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 1.322795] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 1.323032] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 1.323222] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 1.323800] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 1.324148] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 1.325375] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 1.325518] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 1.325567] niu 0000:88:00.0 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 1.325701] niu: niu0: Found PHY 00206033 type PMA/PMD at phy_port 8 [ 1.325914] niu: niu0: Found PHY 00206033 type PCS at phy_port 8 [ 1.326186] niu: niu0: Found PHY 00206033 type PMA/PMD at phy_port 9 [ 1.329509] niu: niu0: Found PHY 00206033 type PCS at phy_port 9 [ 1.336801] niu: niu0: Port 0 [8 RX chans] [12 TX chans] [ 1.336880] niu: niu0: Port 1 [8 RX chans] [12 TX chans] [ 1.336957] niu: niu0: Port 0 RDC tbl(0) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337039] niu: niu0: Port 0 RDC tbl(1) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337123] niu: niu0: Port 0 RDC tbl(2) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337208] niu: niu0: Port 0 RDC tbl(3) [ 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 ] [ 1.337294] niu: niu0: Port 1 RDC tbl(4) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 1.337405] niu: niu0: Port 1 RDC tbl(5) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 1.337513] niu: niu0: Port 1 RDC tbl(6) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 1.337621] niu: niu0: Port 1 RDC tbl(7) [ 8 9 10 11 12 13 14 15 8 9 10 11 12 13 14 15 ] [ 2.609347] niu: Port 0 PMA_PMD(MII_STAT1000) [0001] [ 2.610314] niu: Port 0 USER_DEV3(0x20) [1005] [ 2.611207] niu: Port 0 PHYXS(MII_NWAYTEST) [0000] [ 2.879376] niu: eth1: NIU Ethernet 00:21:28:84:d5:10 [ 2.879377] niu: eth1: Port type[XMAC] mode[10G:FIBER] XCVR[XPCS] phy[xgf] [ 2.879945] niu 0000:88:00.1 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 2.880006] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 2.880260] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 2.880450] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 2.881029] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 2.881373] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 2.882599] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 2.882742] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 2.882791] niu 0000:88:00.1 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 4.089342] niu: Port 1 PMA_PMD(MII_STAT1000) [0001] [ 4.090035] niu: Port 1 USER_DEV3(0x20) [1005] [ 4.090569] niu: Port 1 PHYXS(MII_NWAYTEST) [0000] [ 4.168860] niu: eth0: NIU Ethernet 00:21:28:84:d5:11 [ 4.169531] niu: eth0: Port type[XMAC] mode[10G:FIBER] XCVR[XPCS] phy[xgf] [ 4.170719] niu 0000:88:00.2 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 4.170780] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 4.171016] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 4.171206] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 4.171784] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 4.172131] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 4.173359] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 4.173502] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 4.173551] niu 0000:88:00.2 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 4.173555] niu 0000:88:00.2 (unnamed net_device) (uninitialized): niu_put_parent() port[2] [ 4.174120] niu 0000:88:00.3 (unnamed net_device) (uninitialized): niu_get_invariants() VPD offset [00016e00] [ 4.174180] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: start[16e14] end[16f94] [ 4.174417] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [local-mac-address] len[6] [ 4.174606] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [version] len[41] [ 4.175184] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [model] len[15] [ 4.175527] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [board-model] len[12] [ 4.176759] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [num-mac-addresses] len[1] [ 4.176901] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: Reading in property [phy-type] len[4] [ 4.176950] niu 0000:88:00.3 (unnamed net_device) (uninitialized): VPD_SCAN: FCODE major(3) minor(20) [ 4.176953] niu 0000:88:00.3 (unnamed net_device) (uninitialized): niu_put_parent() port[3] [ 4.179410] niu 0000:88:00.0 enp136s0f0: renamed from eth1 [ 4.200598] niu 0000:88:00.1 enp136s0f1: renamed from eth0 [ 315.293446] niu 0000:88:00.0 enp136s0f0: Link is up at 10Gb/sec, full duplex [ 495.068363] niu 0000:88:00.0 enp136s0f0: Link is up at 10Gb/sec, full duplex [ 609.461609] niu: Port 0 PMA_PMD(MII_STAT1000) [0001] [ 609.461678] niu: Port 0 USER_DEV3(0x20) [1005] [ 609.461746] niu: Port 0 PHYXS(MII_NWAYTEST) [0000] [ 737.134734] niu: Port 0 PMA_PMD(MII_STAT1000) [0001] [ 737.134802] niu: Port 0 USER_DEV3(0x20) [1005] [ 737.134868] niu: Port 0 PHYXS(MII_NWAYTEST) [0000] [ 748.274763] niu: Port 1 PMA_PMD(MII_STAT1000) [0001] [ 748.274831] niu: Port 1 USER_DEV3(0x20) [1005] [ 748.274897] niu: Port 1 PHYXS(MII_NWAYTEST) [0000] The PowerConnect show's a 10gb link and the port is set to access. The only other settings ive changed from factory default is 2 lacp lag's where the server connects currently, and the login. It's the most recent firmware as of last last month. Are the Sun cards not just a rebrand but a custom with only SUN and RHEL drivers? Am I missing something simple? Any thoughts? Edit This is my first time setting up a fiber interface, so I could be missing something simple

H
Hodilon
Junior Member
3
01-09-2021, 02:14 PM
#2
I don't have that information. Could you provide the list of SFP+ transceivers you're referring to?
H
Hodilon
01-09-2021, 02:14 PM #2

I don't have that information. Could you provide the list of SFP+ transceivers you're referring to?

Z
zMadeus
Posting Freak
755
01-09-2021, 04:53 PM
#3
Everything came with the adapters. The Sun card includes Sun-branded 375-3301-01 XFP's for the 6224. I recently received a 6248 via mail, which has a XFP module from Dell FTLX8511D3 that I haven’t tested yet. All devices use SR 850nm connectors and come with LC connectors. I’m planning to plug in the 6248, reset it, and see if it works.
Z
zMadeus
01-09-2021, 04:53 PM #3

Everything came with the adapters. The Sun card includes Sun-branded 375-3301-01 XFP's for the 6224. I recently received a 6248 via mail, which has a XFP module from Dell FTLX8511D3 that I haven’t tested yet. All devices use SR 850nm connectors and come with LC connectors. I’m planning to plug in the 6248, reset it, and see if it works.

F
Fritztech
Member
218
01-15-2021, 04:51 AM
#4
The updated uplink module from Dell resolved the issue!!! 🎉 Now I just have to wait for my workstation card. I need to figure out whether it's the uplink module or the SFP+ cards. Probably start by ordering some Dell-branded SFP+s—they're much cheaper than the $46 uplink module, and the HBA and switch ports were quite strict about transceivers. I suspect the Cisco SFP+s are meant for connecting to Cisco switches. Thanks for your time, Falconevo!
F
Fritztech
01-15-2021, 04:51 AM #4

The updated uplink module from Dell resolved the issue!!! 🎉 Now I just have to wait for my workstation card. I need to figure out whether it's the uplink module or the SFP+ cards. Probably start by ordering some Dell-branded SFP+s—they're much cheaper than the $46 uplink module, and the HBA and switch ports were quite strict about transceivers. I suspect the Cisco SFP+s are meant for connecting to Cisco switches. Thanks for your time, Falconevo!

B
boher01
Junior Member
40
01-15-2021, 09:35 AM
#5
Hey there, just came back from work. They’re really picky about transceivers—they need to check compatibility first before anything else.
B
boher01
01-15-2021, 09:35 AM #5

Hey there, just came back from work. They’re really picky about transceivers—they need to check compatibility first before anything else.