25G switch question

Introduce yourself to us and other members here, or share your own product reviews, suggestions, and tips and tricks of using QNAP products.
Post Reply
Bob Zelin
Experience counts
Posts: 1374
Joined: Mon Nov 21, 2016 12:55 am
Location: Orlando, FL.
Contact:

25G switch question

Post by Bob Zelin »

Hi -
I am not holding my breath, as I think I am one of the few people working with QNAP and 25G - I hope I am wrong.

I have been using the QNAP 25G cards (rebranded Mellanox cards) on larger installations with Enterprise QNAP Systems, going into the SFP28 Ports of Ubiquiti Enterprise XG24 10G switch, that have two SFP28 uplink ports. It works great.

On 4 occasions, I have had the opportunity to do all 25G systems, and I use the QNAP QSW-M5216-1T, and it works great, coming from the QNAP 25G (Mellanox) cards.

SO - the other day, I was doing an installation - customer now has FOUR 24 bay QNAP Systems, all with 25G card, and about 20 10G clients that connect to the Ubiquiti Enterprise XG24 10G switch. But now that they have added the 2 additional 24 bay QNAP Systems with 25G cards, I don't have enough ports - so I got a QSW-M5216-1T 25G switch. When I plug in the SFP28 port of the Ubiquti XG24 into any of the SFP28 ports on the QNAP QSW-5216-1T - it DOES NOT WORK. But if I plug any of the QNAP 25G cards (from the QNAP's) into either switch - everything works.

The only thing that does NOT work is the direct DAC connection from the Ubiquiti SFP28 ports to the QNAP QSW-M5216 SFP 28 ports.

WHY ? Any ideas ?

Thanks !
Bob Zelin
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com
User avatar
Toxic17
Ask me anything
Posts: 6469
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: 25G switch question

Post by Toxic17 »

Might be worth posting over on the Unifi forums too. what DAC cable are you using? I just took a look over on the forums and seems to be a few complaining of connectivity and firmware too. at least UI-Glenn could take a look at the support file and logs from the Ubiquity XG24 and see what's going on.

https://community.ui.com/questions

https://help.ui.com/hc/en-us/articles/2 ... -Log-Files
Regards Simon

Qnap Downloads
MyQNap.Org Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-673A QuTS hero h5.1.2.2534 • TS-121 4.3.3.2420 • APC Back-UPS ES 700G
Network: VM Hub3: 500/50 • UniFi UDM Pro: 3.2.9 • UniFi Network Controller: 8.0.28
USW-Aggregation: 6.6.61 • US-16-150W: 6.6.61 • 2x USW Mini Flex 2.0.0 • UniFi AC Pro 6.6.62 • UniFi U6-LR 6.6.62
UniFi Protect: 2.11.21/8TB Skyhawk AI • 3x G3 Instants: 4.69.55 • UniFi G3 Flex: 4.69.55 • UniFi G5 Flex: 4.69.55
Bob Zelin
Experience counts
Posts: 1374
Joined: Mon Nov 21, 2016 12:55 am
Location: Orlando, FL.
Contact:

Re: 25G switch question

Post by Bob Zelin »

I am using DAC cables - and not "junk" ones - I have the "official" Ubiquiti DAC's and QNAP DAC twinax cables - both work when connected to a QNAP 25G card in a QNAP NAS (to either switch) -
but when you go "switch to switch" - nothing !

I will try the Ubiquiti forums. Thank you !
Bob
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com
User avatar
QNAPJames
QNAP Staff
Posts: 1498
Joined: Fri Jun 13, 2008 3:12 pm
Location: Irvine, California

Re: 25G switch question

Post by QNAPJames »

Maybe try to disable FEC on Ubiquiti? QSW-M5216 does not support FEC.
NAS: QNAP TS-464T4 Special Edition + Seagate IronWolf 125 3.84TB SATA SSD * 4 (RAID5)
Backup: QNAP TR-002 + Seagate IronWolf 10TB SATA HDD *2 (RAID0)
Networking: QNAP QSW-1108-8T 2.5GbE Network Switch
Bob Zelin
Experience counts
Posts: 1374
Joined: Mon Nov 21, 2016 12:55 am
Location: Orlando, FL.
Contact:

Re: 25G switch question

Post by Bob Zelin »

Hello Toxic17 and QNAPJames -

I have read all the UI-Glenn articles, and all the other stuff that you find via Google, on these forums. I got this to work today. I am going to detail exactly what I have done to get a QNAP QSW-M5216-1T to talk to a Ubiquiti Enterprise XG24 via the SFP28 25G ports.

this is not a QNAP issue -

ssh into the Ubiquti Enterprise XG24 - you have to SSH to get telnet to work
type this in -
telnet 127.0.0.1
(UBNT) >enable
(UBNT) >configure
(UBNT) (Config) #interface 0/26
UBNT) (Interface 0/26)# no fec

now without doing anything else, both SFP28 ports will become active. To see that FEC has been disabled on the Ubiquiti XG24 - type this in -

show interface 0/26 fec

and you will see
0/26. fec disabled

my current little issue now, is that this will not survive a reboot, and I currently do not know how to save the running config of the Ubiquiti to the System Config of the Ubiquiti.
That is my next little project.

I am holding my breath for QNAP to release a larger, more professional switch with both 10G and SFP28 ports (at least like the Enterprise XG24).

Thank you very much for your information. I would have never figured any of this out, without your help

Bob Zelin
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com
User avatar
QNAPJames
QNAP Staff
Posts: 1498
Joined: Fri Jun 13, 2008 3:12 pm
Location: Irvine, California

Re: 25G switch question

Post by QNAPJames »

Hi Bob,

Thanks for the update about how you get it to work. :-)
Regarding the little issue, looks like ppl have been requesting this feature from UBNT about keeping changes after a reboot.
NAS: QNAP TS-464T4 Special Edition + Seagate IronWolf 125 3.84TB SATA SSD * 4 (RAID5)
Backup: QNAP TR-002 + Seagate IronWolf 10TB SATA HDD *2 (RAID0)
Networking: QNAP QSW-1108-8T 2.5GbE Network Switch
User avatar
Toxic17
Ask me anything
Posts: 6469
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: 25G switch question

Post by Toxic17 »

hmm seems strange the FEC disable setting wont survive a reboot. I'm sure someone will find a way.
Regards Simon

Qnap Downloads
MyQNap.Org Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-673A QuTS hero h5.1.2.2534 • TS-121 4.3.3.2420 • APC Back-UPS ES 700G
Network: VM Hub3: 500/50 • UniFi UDM Pro: 3.2.9 • UniFi Network Controller: 8.0.28
USW-Aggregation: 6.6.61 • US-16-150W: 6.6.61 • 2x USW Mini Flex 2.0.0 • UniFi AC Pro 6.6.62 • UniFi U6-LR 6.6.62
UniFi Protect: 2.11.21/8TB Skyhawk AI • 3x G3 Instants: 4.69.55 • UniFi G3 Flex: 4.69.55 • UniFi G5 Flex: 4.69.55
phonitor
Getting the hang of things
Posts: 61
Joined: Mon Jan 14, 2019 9:46 pm

Re: 25G switch question

Post by phonitor »

I too have the QNAP QSW-M5216-1T (25 GbE) switch successfully connected to an Arista DCS-7060CX-32S (100 GbE) switch via Trunk Port, under pfsense NETGATE 1541 firewall.

I am using the following 10Gtek WADQS-28 QSA Adapter - 100G QSFP28 to 25G SFP28 Converter Module, for Dell, Juniper, Arista, Extreme, H3C and More,
https://www.amazon.com/dp/B07QK6R5JD

connected to (2) FS.com Arista Networks SFP-25G-SR Compatible 25GBASE-SR SFP28 850nm 100m DOM Duplex LC MMF Optical Transceiver Module #70299, equivalent 25GbE transceivers on each end,
https://www.fs.com/products/70299.html

via FLYPROFiber 10M/33ft OM5 LC to LC Fiber Patch Cable, Length Options: 0.2m-20m, 40Gb/100GB Multimode Jumper Duplex 50/125um LSZH Fiber Optic Cords - 10M(33ft)
https://www.amazon.com/dp/B08B3DX3XB

The Arista specific commands are as follows:
enable
conf t
int e7/1 (my chosen port of course)
no error-correction encoding
show int e7/1 error-correction (to verify settings)
The "no error-correction encoding" is the Arista equivalent to "no fec", that is, disable fec (Forward Error Correction).
As mentioned above, the QNAP QSW-M5216-1T switch does not support FEC, requiring disabling FEC on the Arista switch port to get the connection up and running.
Rich
Bob Zelin
Experience counts
Posts: 1374
Joined: Mon Nov 21, 2016 12:55 am
Location: Orlando, FL.
Contact:

Re: 25G switch question

Post by Bob Zelin »

Hi Rich -
yea, but you can save your running-config on your Arista. I can't save it on the Ubiquiti.

Jealous ! (I can't afford an Arista - how much was that ? $15,000 ? )

Bob
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com
phonitor
Getting the hang of things
Posts: 61
Joined: Mon Jan 14, 2019 9:46 pm

Re: 25G switch question

Post by phonitor »

Hi Bob,
I paid about $7000 refurbished off of ebay.
Take care,
Rich
phonitor
Getting the hang of things
Posts: 61
Joined: Mon Jan 14, 2019 9:46 pm

Re: 25G switch question

Post by phonitor »

phonitor wrote: Fri Feb 03, 2023 9:44 pm I too have the QNAP QSW-M5216-1T (25 GbE) switch successfully connected to an Arista DCS-7060CX-32S (100 GbE) switch via Trunk Port, under pfsense NETGATE 1541 firewall.

I am using the following 10Gtek WADQS-28 QSA Adapter - 100G QSFP28 to 25G SFP28 Converter Module, for Dell, Juniper, Arista, Extreme, H3C and More,
https://www.amazon.com/dp/B07QK6R5JD

connected to (2) FS.com Arista Networks SFP-25G-SR Compatible 25GBASE-SR SFP28 850nm 100m DOM Duplex LC MMF Optical Transceiver Module #70299, equivalent 25GbE transceivers on each end,
https://www.fs.com/products/70299.html

via FLYPROFiber 10M/33ft OM5 LC to LC Fiber Patch Cable, Length Options: 0.2m-20m, 40Gb/100GB Multimode Jumper Duplex 50/125um LSZH Fiber Optic Cords - 10M(33ft)
https://www.amazon.com/dp/B08B3DX3XB

The Arista specific commands are as follows:
enable
conf t
int e7/1 (my chosen port of course)
no error-correction encoding
show int e7/1 error-correction (to verify settings)
The "no error-correction encoding" is the Arista equivalent to "no fec", that is, disable fec (Forward Error Correction).
As mentioned above, the QNAP QSW-M5216-1T switch does not support FEC, requiring disabling FEC on the Arista switch port to get the connection up and running.
Rich
Update 12-22-23:
After updating QNAP switch QSW-M5216-1T with new firmware 1.4.2.1167863,
https://drive.google.com/file/d/1MSk1O9 ... view?pli=1
I was able to successfully negotiate a 25GbE connection (25 Gbps FDX, BASE-R FEC) without disabling FEC on my Arista 7060CX-32S 100 GbE switch (default settings) as mentioned above. It took about a minute for the negotiation and now seems to be working well. Now it works with default settings on both switches.

I'll update more regarding switch's stability and integrity in the coming days. So far, very happy with firmware update.
Thanks QNAP team and Daniel Lei,
Rich
You do not have the required permissions to view the files attached to this post.
Bob Zelin
Experience counts
Posts: 1374
Joined: Mon Nov 21, 2016 12:55 am
Location: Orlando, FL.
Contact:

Re: 25G switch question

Post by Bob Zelin »

Hi Rich -
I was just notified by QNAP about this critical update to the QSW-M5216-1T, and firmware 1.4.2.
This is incredible news, so THANK YOU to the QNAP team that finally made this happen.
And thank you Rich for posting this.

Bob Zelin
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com
Post Reply

Return to “Users' Corner”