Slow write speed over 10gbe with Raid 5

Questions about SNMP, Power, System, Logs, disk, & RAID.
Post Reply
wiffola
New here
Posts: 4
Joined: Tue Jan 25, 2022 1:30 am

Slow write speed over 10gbe with Raid 5

Post by wiffola »

Hi Everyone,

We have a 10gbe network and we're running the following spec in a creative CGI studio:

- TVS-471 / 4gb RAM / 2x 10gbe cards with port trunking / 4x Samsung 860 PRO 4TB / Raid 5 / No Cache / Firmware 4.3.6.1070
- NETGEAR 16-Port 10G Ethernet Smart Managed Pro Switch (XS716T)
- Quality CAT6a cables all round
- 10gbe cards in the workstations (SSDs system drives / windows 10 / generally high spec)

Currently we seem to have bottleneck where all computers can only write at 200mb and read at 450-500mb from the QNAP.

If we network from one computer to another (from desktop to desktop) we get 500mb+ up and down. And if I go to and from my m.2 EVO, it's more like 700-800mb.

So why only 200mb write to the QNAP?

Is the CPU on the QNAP too old and rubbish to deliver the RAID 5 properly? Is Raid 5 just not capable?

The options I am considering would be to go for a new QNAP TVS-672XT-i5-8G or QNAP TVS-872XT-i5-16G, add another 2x 4TB 860's and run at RAID 10 (i.e. to maintain the storage size), but thats very costly and loads of hassle in a busy studio. And what if it's something else? If feel like this QNAP should be able to deliver better speeds, but maybe not?

Please help guys!!
wiffola
New here
Posts: 4
Joined: Tue Jan 25, 2022 1:30 am

Re: Slow write speed over 10gbe with Raid 5

Post by wiffola »

Here is a screenshot of running AJA with resource monitor open...
NAS AJA.png
You do not have the required permissions to view the files attached to this post.
User avatar
Moogle Stiltzkin
Guru
Posts: 11448
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: Slow write speed over 10gbe with Raid 5

Post by Moogle Stiltzkin »

try ask bob zelin, he probly knows
search.php?author_id=270185&sr=posts
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
wiffola
New here
Posts: 4
Joined: Tue Jan 25, 2022 1:30 am

Re: Slow write speed over 10gbe with Raid 5

Post by wiffola »

Please see some speed tests below:

Images attached and text file below - can anyone help??

-------------

iPref via SSH

iperf3.exe" -c ***.***.***.*** -P 4 -l 320k -t 30 -p 5202

[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 283 MBytes 2.38 Gbits/sec
[ 6] 0.00-1.00 sec 283 MBytes 2.38 Gbits/sec
[ 8] 0.00-1.00 sec 282 MBytes 2.36 Gbits/sec
[ 10] 0.00-1.00 sec 280 MBytes 2.35 Gbits/sec
[SUM] 0.00-1.00 sec 1.10 GBytes 9.46 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 282 MBytes 2.36 Gbits/sec
[ 6] 1.00-2.00 sec 278 MBytes 2.33 Gbits/sec
[ 8] 1.00-2.00 sec 278 MBytes 2.33 Gbits/sec
[ 10] 1.00-2.00 sec 282 MBytes 2.37 Gbits/sec
[SUM] 1.00-2.00 sec 1.09 GBytes 9.39 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 283 MBytes 2.38 Gbits/sec
[ 6] 2.00-3.00 sec 280 MBytes 2.35 Gbits/sec
[ 8] 2.00-3.00 sec 278 MBytes 2.33 Gbits/sec
[ 10] 2.00-3.00 sec 282 MBytes 2.37 Gbits/sec
[SUM] 2.00-3.00 sec 1.10 GBytes 9.42 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 281 MBytes 2.36 Gbits/sec
[ 6] 3.00-4.00 sec 281 MBytes 2.36 Gbits/sec
[ 8] 3.00-4.00 sec 273 MBytes 2.29 Gbits/sec
[ 10] 3.00-4.00 sec 278 MBytes 2.33 Gbits/sec
[SUM] 3.00-4.00 sec 1.09 GBytes 9.34 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 282 MBytes 2.37 Gbits/sec
[ 6] 4.00-5.00 sec 279 MBytes 2.34 Gbits/sec
[ 8] 4.00-5.00 sec 282 MBytes 2.37 Gbits/sec
[ 10] 4.00-5.00 sec 282 MBytes 2.36 Gbits/sec
[SUM] 4.00-5.00 sec 1.10 GBytes 9.44 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 284 MBytes 2.38 Gbits/sec
[ 6] 5.00-6.00 sec 278 MBytes 2.33 Gbits/sec
[ 8] 5.00-6.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 5.00-6.00 sec 280 MBytes 2.35 Gbits/sec
[SUM] 5.00-6.00 sec 1.09 GBytes 9.40 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 283 MBytes 2.37 Gbits/sec
[ 6] 6.00-7.00 sec 275 MBytes 2.31 Gbits/sec
[ 8] 6.00-7.00 sec 275 MBytes 2.31 Gbits/sec
[ 10] 6.00-7.00 sec 280 MBytes 2.35 Gbits/sec
[SUM] 6.00-7.00 sec 1.09 GBytes 9.34 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 283 MBytes 2.37 Gbits/sec
[ 6] 7.00-8.00 sec 280 MBytes 2.35 Gbits/sec
[ 8] 7.00-8.00 sec 278 MBytes 2.33 Gbits/sec
[ 10] 7.00-8.00 sec 284 MBytes 2.38 Gbits/sec
[SUM] 7.00-8.00 sec 1.10 GBytes 9.43 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 281 MBytes 2.36 Gbits/sec
[ 6] 8.00-9.00 sec 277 MBytes 2.33 Gbits/sec
[ 8] 8.00-9.00 sec 272 MBytes 2.28 Gbits/sec
[ 10] 8.00-9.00 sec 285 MBytes 2.39 Gbits/sec
[SUM] 8.00-9.00 sec 1.09 GBytes 9.35 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 282 MBytes 2.37 Gbits/sec
[ 6] 9.00-10.00 sec 280 MBytes 2.35 Gbits/sec
[ 8] 9.00-10.00 sec 283 MBytes 2.37 Gbits/sec
[ 10] 9.00-10.00 sec 279 MBytes 2.34 Gbits/sec
[SUM] 9.00-10.00 sec 1.10 GBytes 9.42 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 10.00-11.00 sec 285 MBytes 2.39 Gbits/sec
[ 6] 10.00-11.00 sec 279 MBytes 2.34 Gbits/sec
[ 8] 10.00-11.00 sec 278 MBytes 2.34 Gbits/sec
[ 10] 10.00-11.00 sec 283 MBytes 2.37 Gbits/sec
[SUM] 10.00-11.00 sec 1.10 GBytes 9.44 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 11.00-12.00 sec 277 MBytes 2.32 Gbits/sec
[ 6] 11.00-12.00 sec 278 MBytes 2.33 Gbits/sec
[ 8] 11.00-12.00 sec 277 MBytes 2.32 Gbits/sec
[ 10] 11.00-12.00 sec 280 MBytes 2.35 Gbits/sec
[SUM] 11.00-12.00 sec 1.09 GBytes 9.32 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 12.00-13.00 sec 279 MBytes 2.34 Gbits/sec
[ 6] 12.00-13.00 sec 280 MBytes 2.35 Gbits/sec
[ 8] 12.00-13.00 sec 285 MBytes 2.39 Gbits/sec
[ 10] 12.00-13.00 sec 280 MBytes 2.35 Gbits/sec
[SUM] 12.00-13.00 sec 1.10 GBytes 9.43 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 13.00-14.00 sec 280 MBytes 2.35 Gbits/sec
[ 6] 13.00-14.00 sec 283 MBytes 2.37 Gbits/sec
[ 8] 13.00-14.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 13.00-14.00 sec 283 MBytes 2.38 Gbits/sec
[SUM] 13.00-14.00 sec 1.10 GBytes 9.44 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 14.00-15.00 sec 280 MBytes 2.35 Gbits/sec
[ 6] 14.00-15.00 sec 283 MBytes 2.37 Gbits/sec
[ 8] 14.00-15.00 sec 280 MBytes 2.35 Gbits/sec
[ 10] 14.00-15.00 sec 284 MBytes 2.38 Gbits/sec
[SUM] 14.00-15.00 sec 1.10 GBytes 9.46 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 15.00-16.00 sec 283 MBytes 2.37 Gbits/sec
[ 6] 15.00-16.00 sec 282 MBytes 2.36 Gbits/sec
[ 8] 15.00-16.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 15.00-16.00 sec 281 MBytes 2.36 Gbits/sec
[SUM] 15.00-16.00 sec 1.10 GBytes 9.43 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 16.00-17.00 sec 281 MBytes 2.35 Gbits/sec
[ 6] 16.00-17.00 sec 281 MBytes 2.36 Gbits/sec
[ 8] 16.00-17.00 sec 281 MBytes 2.35 Gbits/sec
[ 10] 16.00-17.00 sec 283 MBytes 2.37 Gbits/sec
[SUM] 16.00-17.00 sec 1.10 GBytes 9.44 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 17.00-18.00 sec 282 MBytes 2.36 Gbits/sec
[ 6] 17.00-18.00 sec 280 MBytes 2.35 Gbits/sec
[ 8] 17.00-18.00 sec 283 MBytes 2.38 Gbits/sec
[ 10] 17.00-18.00 sec 283 MBytes 2.37 Gbits/sec
[SUM] 17.00-18.00 sec 1.10 GBytes 9.46 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 18.00-19.00 sec 280 MBytes 2.35 Gbits/sec
[ 6] 18.00-19.00 sec 280 MBytes 2.35 Gbits/sec
[ 8] 18.00-19.00 sec 274 MBytes 2.29 Gbits/sec
[ 10] 18.00-19.00 sec 280 MBytes 2.35 Gbits/sec
[SUM] 18.00-19.00 sec 1.09 GBytes 9.33 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 19.00-20.00 sec 285 MBytes 2.39 Gbits/sec
[ 6] 19.00-20.00 sec 279 MBytes 2.34 Gbits/sec
[ 8] 19.00-20.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 19.00-20.00 sec 283 MBytes 2.37 Gbits/sec
[SUM] 19.00-20.00 sec 1.10 GBytes 9.45 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 20.00-21.00 sec 284 MBytes 2.38 Gbits/sec
[ 6] 20.00-21.00 sec 282 MBytes 2.36 Gbits/sec
[ 8] 20.00-21.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 20.00-21.00 sec 283 MBytes 2.37 Gbits/sec
[SUM] 20.00-21.00 sec 1.10 GBytes 9.46 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 21.00-22.00 sec 286 MBytes 2.40 Gbits/sec
[ 6] 21.00-22.00 sec 277 MBytes 2.32 Gbits/sec
[ 8] 21.00-22.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 21.00-22.00 sec 284 MBytes 2.38 Gbits/sec
[SUM] 21.00-22.00 sec 1.10 GBytes 9.44 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 22.00-23.00 sec 281 MBytes 2.36 Gbits/sec
[ 6] 22.00-23.00 sec 285 MBytes 2.39 Gbits/sec
[ 8] 22.00-23.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 22.00-23.00 sec 282 MBytes 2.37 Gbits/sec
[SUM] 22.00-23.00 sec 1.10 GBytes 9.45 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 23.00-24.00 sec 281 MBytes 2.36 Gbits/sec
[ 6] 23.00-24.00 sec 281 MBytes 2.36 Gbits/sec
[ 8] 23.00-24.00 sec 280 MBytes 2.35 Gbits/sec
[ 10] 23.00-24.00 sec 285 MBytes 2.39 Gbits/sec
[SUM] 23.00-24.00 sec 1.10 GBytes 9.46 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 24.00-25.00 sec 279 MBytes 2.34 Gbits/sec
[ 6] 24.00-25.00 sec 282 MBytes 2.37 Gbits/sec
[ 8] 24.00-25.00 sec 280 MBytes 2.35 Gbits/sec
[ 10] 24.00-25.00 sec 283 MBytes 2.38 Gbits/sec
[SUM] 24.00-25.00 sec 1.10 GBytes 9.43 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 25.00-26.00 sec 279 MBytes 2.34 Gbits/sec
[ 6] 25.00-26.00 sec 271 MBytes 2.27 Gbits/sec
[ 8] 25.00-26.00 sec 275 MBytes 2.31 Gbits/sec
[ 10] 25.00-26.00 sec 271 MBytes 2.28 Gbits/sec
[SUM] 25.00-26.00 sec 1.07 GBytes 9.20 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 26.00-27.00 sec 288 MBytes 2.42 Gbits/sec
[ 6] 26.00-27.00 sec 277 MBytes 2.32 Gbits/sec
[ 8] 26.00-27.00 sec 274 MBytes 2.30 Gbits/sec
[ 10] 26.00-27.00 sec 276 MBytes 2.32 Gbits/sec
[SUM] 26.00-27.00 sec 1.09 GBytes 9.35 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 27.00-28.00 sec 281 MBytes 2.36 Gbits/sec
[ 6] 27.00-28.00 sec 280 MBytes 2.35 Gbits/sec
[ 8] 27.00-28.00 sec 281 MBytes 2.35 Gbits/sec
[ 10] 27.00-28.00 sec 284 MBytes 2.38 Gbits/sec
[SUM] 27.00-28.00 sec 1.10 GBytes 9.44 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 28.00-29.00 sec 279 MBytes 2.34 Gbits/sec
[ 6] 28.00-29.00 sec 279 MBytes 2.34 Gbits/sec
[ 8] 28.00-29.00 sec 283 MBytes 2.37 Gbits/sec
[ 10] 28.00-29.00 sec 286 MBytes 2.40 Gbits/sec
[SUM] 28.00-29.00 sec 1.10 GBytes 9.45 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 29.00-30.00 sec 280 MBytes 2.35 Gbits/sec
[ 6] 29.00-30.00 sec 279 MBytes 2.34 Gbits/sec
[ 8] 29.00-30.00 sec 279 MBytes 2.34 Gbits/sec
[ 10] 29.00-30.00 sec 282 MBytes 2.36 Gbits/sec
[SUM] 29.00-30.00 sec 1.09 GBytes 9.40 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-30.00 sec 8.26 GBytes 2.36 Gbits/sec sender
[ 4] 0.00-30.00 sec 8.26 GBytes 2.36 Gbits/sec receiver
[ 6] 0.00-30.00 sec 8.19 GBytes 2.35 Gbits/sec sender
[ 6] 0.00-30.00 sec 8.19 GBytes 2.35 Gbits/sec receiver
[ 8] 0.00-30.00 sec 8.17 GBytes 2.34 Gbits/sec sender
[ 8] 0.00-30.00 sec 8.17 GBytes 2.34 Gbits/sec receiver
[ 10] 0.00-30.00 sec 8.25 GBytes 2.36 Gbits/sec sender
[ 10] 0.00-30.00 sec 8.25 GBytes 2.36 Gbits/sec receiver
[SUM] 0.00-30.00 sec 32.9 GBytes 9.41 Gbits/sec sender
[SUM] 0.00-30.00 sec 32.9 GBytes 9.41 Gbits/sec receiver

iperf Done.

iperf3.exe" -c ***.***.***.*** -P 4 -l 320k -t 30 -p 5202 -R

[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 91.2 MBytes 765 Mbits/sec
[ 6] 0.00-1.00 sec 85.4 MBytes 716 Mbits/sec
[ 8] 0.00-1.00 sec 90.9 MBytes 762 Mbits/sec
[ 10] 0.00-1.00 sec 91.2 MBytes 765 Mbits/sec
[SUM] 0.00-1.00 sec 359 MBytes 3.01 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 93.4 MBytes 784 Mbits/sec
[ 6] 1.00-2.00 sec 85.4 MBytes 716 Mbits/sec
[ 8] 1.00-2.00 sec 85.5 MBytes 717 Mbits/sec
[ 10] 1.00-2.00 sec 93.4 MBytes 783 Mbits/sec
[SUM] 1.00-2.00 sec 358 MBytes 3.00 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 90.8 MBytes 761 Mbits/sec
[ 6] 2.00-3.00 sec 84.6 MBytes 710 Mbits/sec
[ 8] 2.00-3.00 sec 90.8 MBytes 762 Mbits/sec
[ 10] 2.00-3.00 sec 90.4 MBytes 759 Mbits/sec
[SUM] 2.00-3.00 sec 357 MBytes 2.99 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 92.3 MBytes 774 Mbits/sec
[ 6] 3.00-4.00 sec 84.2 MBytes 707 Mbits/sec
[ 8] 3.00-4.00 sec 92.0 MBytes 772 Mbits/sec
[ 10] 3.00-4.00 sec 84.7 MBytes 710 Mbits/sec
[SUM] 3.00-4.00 sec 353 MBytes 2.96 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 90.3 MBytes 758 Mbits/sec
[ 6] 4.00-5.00 sec 82.9 MBytes 695 Mbits/sec
[ 8] 4.00-5.00 sec 89.7 MBytes 753 Mbits/sec
[ 10] 4.00-5.00 sec 90.1 MBytes 756 Mbits/sec
[SUM] 4.00-5.00 sec 353 MBytes 2.96 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 87.6 MBytes 735 Mbits/sec
[ 6] 5.00-6.00 sec 91.0 MBytes 764 Mbits/sec
[ 8] 5.00-6.00 sec 90.7 MBytes 761 Mbits/sec
[ 10] 5.00-6.00 sec 91.9 MBytes 771 Mbits/sec
[SUM] 5.00-6.00 sec 361 MBytes 3.03 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 90.7 MBytes 760 Mbits/sec
[ 6] 6.00-7.00 sec 84.0 MBytes 705 Mbits/sec
[ 8] 6.00-7.00 sec 90.5 MBytes 759 Mbits/sec
[ 10] 6.00-7.00 sec 90.6 MBytes 760 Mbits/sec
[SUM] 6.00-7.00 sec 356 MBytes 2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 91.3 MBytes 766 Mbits/sec
[ 6] 7.00-8.00 sec 84.9 MBytes 712 Mbits/sec
[ 8] 7.00-8.00 sec 91.1 MBytes 764 Mbits/sec
[ 10] 7.00-8.00 sec 91.1 MBytes 764 Mbits/sec
[SUM] 7.00-8.00 sec 358 MBytes 3.01 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 87.2 MBytes 731 Mbits/sec
[ 6] 8.00-9.00 sec 86.1 MBytes 723 Mbits/sec
[ 8] 8.00-9.00 sec 89.8 MBytes 754 Mbits/sec
[ 10] 8.00-9.00 sec 89.4 MBytes 750 Mbits/sec
[SUM] 8.00-9.00 sec 353 MBytes 2.96 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 90.6 MBytes 760 Mbits/sec
[ 6] 9.00-10.00 sec 85.8 MBytes 720 Mbits/sec
[ 8] 9.00-10.00 sec 90.0 MBytes 755 Mbits/sec
[ 10] 9.00-10.00 sec 90.2 MBytes 756 Mbits/sec
[SUM] 9.00-10.00 sec 356 MBytes 2.99 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 10.00-11.00 sec 90.6 MBytes 760 Mbits/sec
[ 6] 10.00-11.00 sec 84.9 MBytes 712 Mbits/sec
[ 8] 10.00-11.00 sec 90.7 MBytes 761 Mbits/sec
[ 10] 10.00-11.00 sec 90.4 MBytes 759 Mbits/sec
[SUM] 10.00-11.00 sec 357 MBytes 2.99 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 11.00-12.00 sec 90.5 MBytes 759 Mbits/sec
[ 6] 11.00-12.00 sec 84.7 MBytes 710 Mbits/sec
[ 8] 11.00-12.00 sec 86.8 MBytes 728 Mbits/sec
[ 10] 11.00-12.00 sec 90.4 MBytes 758 Mbits/sec
[SUM] 11.00-12.00 sec 352 MBytes 2.96 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 12.00-13.00 sec 89.9 MBytes 754 Mbits/sec
[ 6] 12.00-13.00 sec 83.4 MBytes 700 Mbits/sec
[ 8] 12.00-13.00 sec 89.9 MBytes 754 Mbits/sec
[ 10] 12.00-13.00 sec 89.3 MBytes 749 Mbits/sec
[SUM] 12.00-13.00 sec 352 MBytes 2.96 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 13.00-14.00 sec 84.8 MBytes 711 Mbits/sec
[ 6] 13.00-14.00 sec 84.7 MBytes 711 Mbits/sec
[ 8] 13.00-14.00 sec 92.8 MBytes 778 Mbits/sec
[ 10] 13.00-14.00 sec 92.9 MBytes 780 Mbits/sec
[SUM] 13.00-14.00 sec 355 MBytes 2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 14.00-15.00 sec 87.3 MBytes 732 Mbits/sec
[ 6] 14.00-15.00 sec 82.5 MBytes 692 Mbits/sec
[ 8] 14.00-15.00 sec 87.9 MBytes 737 Mbits/sec
[ 10] 14.00-15.00 sec 87.3 MBytes 733 Mbits/sec
[SUM] 14.00-15.00 sec 345 MBytes 2.89 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 15.00-16.00 sec 83.4 MBytes 700 Mbits/sec
[ 6] 15.00-16.00 sec 83.4 MBytes 700 Mbits/sec
[ 8] 15.00-16.00 sec 91.5 MBytes 767 Mbits/sec
[ 10] 15.00-16.00 sec 91.4 MBytes 767 Mbits/sec
[SUM] 15.00-16.00 sec 350 MBytes 2.93 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 16.00-17.00 sec 90.7 MBytes 761 Mbits/sec
[ 6] 16.00-17.00 sec 86.5 MBytes 726 Mbits/sec
[ 8] 16.00-17.00 sec 90.9 MBytes 763 Mbits/sec
[ 10] 16.00-17.00 sec 91.1 MBytes 764 Mbits/sec
[SUM] 16.00-17.00 sec 359 MBytes 3.01 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 17.00-18.00 sec 84.3 MBytes 707 Mbits/sec
[ 6] 17.00-18.00 sec 84.3 MBytes 707 Mbits/sec
[ 8] 17.00-18.00 sec 92.6 MBytes 777 Mbits/sec
[ 10] 17.00-18.00 sec 91.9 MBytes 771 Mbits/sec
[SUM] 17.00-18.00 sec 353 MBytes 2.96 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 18.00-19.00 sec 84.6 MBytes 709 Mbits/sec
[ 6] 18.00-19.00 sec 84.6 MBytes 710 Mbits/sec
[ 8] 18.00-19.00 sec 92.6 MBytes 777 Mbits/sec
[ 10] 18.00-19.00 sec 92.7 MBytes 778 Mbits/sec
[SUM] 18.00-19.00 sec 354 MBytes 2.97 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 19.00-20.00 sec 89.6 MBytes 751 Mbits/sec
[ 6] 19.00-20.00 sec 83.9 MBytes 704 Mbits/sec
[ 8] 19.00-20.00 sec 89.2 MBytes 748 Mbits/sec
[ 10] 19.00-20.00 sec 89.2 MBytes 748 Mbits/sec
[SUM] 19.00-20.00 sec 352 MBytes 2.95 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 20.00-21.00 sec 84.8 MBytes 711 Mbits/sec
[ 6] 20.00-21.00 sec 84.8 MBytes 711 Mbits/sec
[ 8] 20.00-21.00 sec 93.0 MBytes 780 Mbits/sec
[ 10] 20.00-21.00 sec 92.8 MBytes 778 Mbits/sec
[SUM] 20.00-21.00 sec 355 MBytes 2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 21.00-22.00 sec 91.4 MBytes 767 Mbits/sec
[ 6] 21.00-22.00 sec 84.4 MBytes 708 Mbits/sec
[ 8] 21.00-22.00 sec 88.5 MBytes 742 Mbits/sec
[ 10] 21.00-22.00 sec 91.4 MBytes 767 Mbits/sec
[SUM] 21.00-22.00 sec 356 MBytes 2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 22.00-23.00 sec 85.5 MBytes 717 Mbits/sec
[ 6] 22.00-23.00 sec 85.8 MBytes 720 Mbits/sec
[ 8] 22.00-23.00 sec 93.6 MBytes 785 Mbits/sec
[ 10] 22.00-23.00 sec 93.5 MBytes 784 Mbits/sec
[SUM] 22.00-23.00 sec 358 MBytes 3.01 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 23.00-24.00 sec 90.1 MBytes 756 Mbits/sec
[ 6] 23.00-24.00 sec 84.1 MBytes 706 Mbits/sec
[ 8] 23.00-24.00 sec 89.9 MBytes 754 Mbits/sec
[ 10] 23.00-24.00 sec 89.2 MBytes 748 Mbits/sec
[SUM] 23.00-24.00 sec 353 MBytes 2.96 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 24.00-25.00 sec 86.9 MBytes 729 Mbits/sec
[ 6] 24.00-25.00 sec 86.9 MBytes 729 Mbits/sec
[ 8] 24.00-25.00 sec 95.2 MBytes 799 Mbits/sec
[ 10] 24.00-25.00 sec 95.1 MBytes 798 Mbits/sec
[SUM] 24.00-25.00 sec 364 MBytes 3.05 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 25.00-26.00 sec 87.2 MBytes 732 Mbits/sec
[ 6] 25.00-26.00 sec 82.8 MBytes 695 Mbits/sec
[ 8] 25.00-26.00 sec 90.4 MBytes 758 Mbits/sec
[ 10] 25.00-26.00 sec 89.7 MBytes 753 Mbits/sec
[SUM] 25.00-26.00 sec 350 MBytes 2.94 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 26.00-27.00 sec 89.5 MBytes 750 Mbits/sec
[ 6] 26.00-27.00 sec 85.0 MBytes 713 Mbits/sec
[ 8] 26.00-27.00 sec 90.2 MBytes 756 Mbits/sec
[ 10] 26.00-27.00 sec 90.1 MBytes 756 Mbits/sec
[SUM] 26.00-27.00 sec 355 MBytes 2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 27.00-28.00 sec 84.8 MBytes 711 Mbits/sec
[ 6] 27.00-28.00 sec 87.8 MBytes 736 Mbits/sec
[ 8] 27.00-28.00 sec 90.4 MBytes 759 Mbits/sec
[ 10] 27.00-28.00 sec 91.0 MBytes 764 Mbits/sec
[SUM] 27.00-28.00 sec 354 MBytes 2.97 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 28.00-29.00 sec 87.4 MBytes 733 Mbits/sec
[ 6] 28.00-29.00 sec 85.3 MBytes 715 Mbits/sec
[ 8] 28.00-29.00 sec 88.8 MBytes 745 Mbits/sec
[ 10] 28.00-29.00 sec 88.9 MBytes 746 Mbits/sec
[SUM] 28.00-29.00 sec 350 MBytes 2.94 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 29.00-30.00 sec 84.7 MBytes 711 Mbits/sec
[ 6] 29.00-30.00 sec 84.8 MBytes 711 Mbits/sec
[ 8] 29.00-30.00 sec 92.9 MBytes 780 Mbits/sec
[ 10] 29.00-30.00 sec 92.8 MBytes 778 Mbits/sec
[SUM] 29.00-30.00 sec 355 MBytes 2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-30.00 sec 2.59 GBytes 742 Mbits/sec 0 sender
[ 4] 0.00-30.00 sec 2.59 GBytes 742 Mbits/sec receiver
[ 6] 0.00-30.00 sec 2.49 GBytes 713 Mbits/sec 0 sender
[ 6] 0.00-30.00 sec 2.49 GBytes 713 Mbits/sec receiver
[ 8] 0.00-30.00 sec 2.66 GBytes 760 Mbits/sec 0 sender
[ 8] 0.00-30.00 sec 2.66 GBytes 760 Mbits/sec receiver
[ 10] 0.00-30.00 sec 2.66 GBytes 762 Mbits/sec 0 sender
[ 10] 0.00-30.00 sec 2.66 GBytes 762 Mbits/sec receiver
[SUM] 0.00-30.00 sec 10.4 GBytes 2.98 Gbits/sec 0 sender
[SUM] 0.00-30.00 sec 10.4 GBytes 2.98 Gbits/sec receiver

iperf Done.
You do not have the required permissions to view the files attached to this post.
wiffola
New here
Posts: 4
Joined: Tue Jan 25, 2022 1:30 am

Re: Slow write speed over 10gbe with Raid 5

Post by wiffola »

Can anyone help?
User avatar
Moogle Stiltzkin
Guru
Posts: 11448
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: Slow write speed over 10gbe with Raid 5

Post by Moogle Stiltzkin »

beyond me, no first hand experience with troubleshooting 10gbe.

but in regards to iperf, i noted one youtuber who explained how exactly to use iperf to troubleshooting networking issues, so maybe check that out to get an idea where the problem is (specifically the first video). basically he talks about based on the results how you can identify where the issue may be stemming from based on the results. and also how to properly use iperf to troubleshoot correctly

https://www.youtube.com/watch?v=p-7Hf-61g0A&t=278s

https://www.youtube.com/watch?v=rRUC_x42-fQ


not sure if this will help but i found this as well for you

Why your home grown 10 GB network is not working at full speed
https://www.youtube.com/watch?v=2W5JN1bkbuw
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
Bob Zelin
Experience counts
Posts: 1375
Joined: Mon Nov 21, 2016 12:55 am
Location: Orlando, FL.
Contact:

Re: Slow write speed over 10gbe with Raid 5

Post by Bob Zelin »

Hi Wiffola -
stop using an old cheap QNAP. No TVS-471. I don't care what cache, M.2, 10G cards, SSD's and Cat 6a cables you have.

Buy a QNAP TVS-h1288X. Put in 2 500 Gig SSD's in slots 1 and 2 for the OS (QuTS) and eight matching 7200 RPM drives in the 8 drive bays. Create a single RAID 6 thin provisioned volume with the 6 drives. This is storage pool 2. You will now have 1000 MB/sec read and write to all your computers via your Netgear XS716T 10G switch.

It always comes down to money. "But I don't want to spend $2700 for a QNAP !". And who is using QTS 4.3.6 in 2022 ?

Bob Zelin
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com
Post Reply

Return to “System & Disk Volume Management”