QM2 Card 10Gbe - can't achieve high transfer speeds

[impy1980]

I'm a relative noob when it comes to networking and I wondered if you guys could help point me in the right direction, as I can not achieve expected high transfers, in fact there is no difference since using 10 Gbe cards, I've included an image of how I currently have my network / devices setup to help.

So I wanted to get a 10Gbe connection between my PC and TS-464 NAS for video editing directly from the NAS, so I've invested in the QNAP QM2-2P10G1TB expansion card for the NAS and got a used HP 561T Intel X%40-T2 card for the PC. My router is a pfSense mini PC which is in another room due to where the telephone/broadband line comes in, and I'm running powerlines to where the PC and NAS are into a Zyxel XGS1250-12 switch which then allows me to distribute the internet in the room and obviously gives me the 10Gbe link.

My DCHP leases are done on the pfSense router (e.g. 10.10.0.1), for example IP addresses are switch 10.10.0.3, PC 10.10.0.9, NAS 2.5Gbe 10.10.0.5 and NAS QM2 card 10.10.0.7, it is my understanding the switch will handle the 10Gbe traffic without the need to route traffic back through the powerline & router, while I get the impression from reading that if the switch had it's own IP address such as 10.10.2.1 and was the "local" DCHP leaser then traffic would have to be negotiated with the router and therefore fall back to the 1Gbe connection between router and switch, but I may be wrong in my assumptions as I couldn't really find a definitive answer.

So for context both NAS and PC were plugged into their 2.5Gbe ports previously, and my Windows 10 transfers would be between 140-220 Mbps depending on file size, I didn't do an iPerf test prior, it never occurred to me, I install both cards and did a 40GB file transfer expecting 600-900 Mbps, only to get 180 Mbps, like zero difference and disappointment. I am aware of the limitations of the TS-464 and it's Gen3 x1 PCIe slot, but that should still give me close to 1Gbps speeds, and 500 Mbps even if it just split the brandwidth between network and drives on the WM2 card.

My PC says I have a 10Gbe connection, the NAS reports the QM2 NIC has a 10GB connection, the Zyxel switch physically shows 10Gbe light colour (dark blue) and also 2.5Gbe light colour (light blue), while the connection over powerline back to the router shows the standard green, the web GUI also reports the same connection link speeds.

I did an iperf test to both NAS 10Gbe and 2.5Gbe IP addresses, 10.10.0.7 (10Gbe) gives me 1.5 Gbits/sec, and 10.10.0.5 (2,5Gbe) gives me 291 Mbits/sec, looking at others who have done 10Gbe and 2.5Gbe tests, I should be seeing about 9 Gbits/sec and 2.5 Gbits/sec results.

This made me think the switch wasn't working correctly, so I directly connected the PC and NAS setting up IP addresses 192.168.2.1 and 192.168.2.2, same Windows transfer speed of 180 Mbps and iPerf 1,5 Gbps.

I thought maybe one of the 10Gbe cards wasn't functioning right, but then surely I'd still see iPerf showing a 2.5Gbe speed test of 2.5Gbits/sec.

Another weird thing I saw was if I did an iPerf test with the PC plugged into the switch's 1Gbe port I'd get an iPerf result of about 600 Mbps.

So being a network novice I'm sort of at a lose as why I'm not seeing at least an increase in transfer speeds, if not similar iPerf results that others have seen with 10Gbe NICs, as far as I've seen it should be plug and play.

d5ZDigp.png

LfYIiKT.png

[dolbyman]

So when you say the transfer was 180Mbps you mean effective 22.5MB\s ?

Even a low powered Celeron unit should give you full 2.5GbE speeds (don't even dream about 10GbE speeds)

My 951x tops out around 350MB\s via SMB (even though it's connected via 10Gbe).
My 1288X can saturate 10GbE without a problem (but it's not a Celeron unit)

Also please attach pictures to the posts and not 3rd party hosters (I fixed that for you)

[Bob Zelin]

https://www.bhphotovideo.com/c/product/ ... sktop.html

sorry - you are not going to be using this QNAP model to edit with Adobe Premiere, AVID Media Composer, or Davinci Resolve.

And with only 4 drives, you are never going to achieve 1000 MB/sec, over a 10G network.

get this model (if you are a single user) -
https://www.bhphotovideo.com/c/product/ ... 12100.html

add in two M.2 NVMe drives to run the QuTS operating system -
https://www.bhphotovideo.com/c/product/ ... _plus.html

use this 10G card in the QNAP -
https://www.amazon.com/QXG-10G2T-Suppor ... B0CJQHRPLY

put a 10G card in a x4 lane in your Win PC, and connect directly with a Cat 6 ethernet cable. Assign STATIC IP addresses to the QNAP 10G port (192.168.2.3, 255.255.255.0)
and a static IP address to the 10G card in your PC (192.168.2.11, 255.255.255.0)
Mount the QNAP with
\\192.168.2.3
run AJA System Test or Blackmagic Disk Speed Test for your speed tests, not iPerf. You will get close to 1000 MB/sec.

What can you get for a budget of $589 ? Nothing.

Bob Zelin

[Toxic17]

have you enabled jumbo frames (NAS, PC, Switch) since your using 10Gb connections? dont forget when copying to your PC its a write speed on your PC's Hard disk that can also top out.

try running the internal disk speed tests from SSH.

Code: Select all

sudo qcli_storage -t force=1

Code: Select all

sudo qcli_storage -T force=1

post the results back here. you could also run the performance tests on the disks in storage and snapshot application on the NAS.

Also run in SSH:

Code: Select all

smb2status

and post back the findings. SMB versions would have differences in speed too. viewtopic.php?t=169262

I'm running a 4 disk NAS and have no problem copying from NAS to Desktop or Desktop to NAS at 1.1GB/s to a raid5 array

[Bob Zelin]