Wildly Fluctuating Transfer Speeds

Don't miss a thing. Post your questions and discussion about other uncategorized NAS features here.
Post Reply
nasnoob
Starting out
Posts: 48
Joined: Sun Jun 21, 2009 4:31 pm

Wildly Fluctuating Transfer Speeds

Post by nasnoob » Thu Sep 05, 2019 4:14 pm

I keep seeing fluctuating transfer speeds when transferring large files 4gb+ from my TS-453B 8G NAS ( 4 x 4TB WD RED Harddrives in RAID10) to my SSD on my Windows 10 PC. Attached is a screenshot of the transfer graph for a single large file.

I have a Gigabit network and is fully wired with Cat6 cable. I have tested all the cables to make sure they arent damaged.

I've posted the settings I currently have below:

Router Settings:
NAT Acceleration On
Jumbo Frames Disabled

NAS Settings:
MTU: 1500
Max SMB Version 2.1

PC Network Adapter Settings Attached in Screenshots from TCP Optimizer
Jumbo Frames Disabled
Broadband Speed is 150Mbps

I thought maybe its do with the WD RED cache, but ive never had these transfer issues on my previous NAS (253 Pro) with the same hardrives.

I would greatly appreciate any suggestions here and recommendations on any of the settings I have posted.

Thank you for you time!
You do not have the required permissions to view the files attached to this post.

User avatar
Toxic17
Ask me anything
Posts: 5158
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: Wildly Fluctuating Transfer Speeds

Post by Toxic17 » Thu Sep 05, 2019 6:56 pm

So do you have Antivirus? I would guess your Windows OS AV is scanning ahead of the actual writing of data to the hard disk. turn it off and do a test again. see if it is that.
NAT Acceleration On
Broadband Speed is 150Mbps
is your PC not on the same LAN as you nas? are you downloading this data over the internet? not sure what you think NAT or broadband speed has to do with copy files directly to your PC over LAN.
Regards Simon

QTS 4.x User Guidex

QNAP Club Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-473-32GB QM2-2P QXG-10G1T 4.4.1.1064 • TVS-463-16GB 4.4.1.1064 QM2-2S10G1TB • TS-459 Pro 2GB 4.2.6 • TS-121 4.3.3.0998 • APC Back-UPS ES 700G •
QPKG's: TwonkyServer 8.51 • Apache73 • QSonarr 3.0.1.503 • QNBZGet 21.0 • phpMyAdmin 4.9.0.1 • Qmono 5.20.1.19 • McAfee 2.2.1 • Lychee 3.2.15 • HBS 3.0.190802 • LEgo v3.0.0
Network: VM Hub 3.0 <500/35> • UniFi USG Pro 4 • UniFi USW-16-150W • UniFi USW-8-60W • UniFi CloudKey Gen2+• UniFi G3-Flex • UAP AC Pro • UAP AC Lite • SLM2008 • Dell 7050 MFF •

User avatar
Toxic17
Ask me anything
Posts: 5158
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: Wildly Fluctuating Transfer Speeds

Post by Toxic17 » Thu Sep 05, 2019 7:02 pm

next this is lets do some diagnostics in SSH on the nas.

SSH to your NAS.

then type in the following commands, cut and paste the results into a post (use the BBcode quotes/code) to make them readable in a post.

Code: Select all

qcli_storage -d

Code: Select all

qcli_storage -T force=1

Code: Select all

qcli_storage -t force=1
Also what spec of PC do you have? CPU, RAM and and HDDs?
Regards Simon

QTS 4.x User Guidex

QNAP Club Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-473-32GB QM2-2P QXG-10G1T 4.4.1.1064 • TVS-463-16GB 4.4.1.1064 QM2-2S10G1TB • TS-459 Pro 2GB 4.2.6 • TS-121 4.3.3.0998 • APC Back-UPS ES 700G •
QPKG's: TwonkyServer 8.51 • Apache73 • QSonarr 3.0.1.503 • QNBZGet 21.0 • phpMyAdmin 4.9.0.1 • Qmono 5.20.1.19 • McAfee 2.2.1 • Lychee 3.2.15 • HBS 3.0.190802 • LEgo v3.0.0
Network: VM Hub 3.0 <500/35> • UniFi USG Pro 4 • UniFi USW-16-150W • UniFi USW-8-60W • UniFi CloudKey Gen2+• UniFi G3-Flex • UAP AC Pro • UAP AC Lite • SLM2008 • Dell 7050 MFF •

User avatar
Trexx
Experience counts
Posts: 4907
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota
Contact:

Re: Wildly Fluctuating Transfer Speeds

Post by Trexx » Fri Sep 06, 2019 2:28 am

Also depending on your QNAP config, you can get some ext4 caching on the QNAP itself. Could also be an issue potentially on the router.

Try doing the same test with PC direct connected to the QNAP (bypassing router) using static IP on PC. Also try turning off NIC offloading as that caused some perf issues in certain builds/drivers.
Paul

Model: TS-877-1600 FW: 4.4.1.x
QTier (HDD): [RAID-5] 6 x 3TB HGST DeskStar NAS QTier (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
(SSD): [RAID-1] 2 x 500GB Evo 860
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060, ACX 2.0(1 Fan), 6GB
UPS: CyberPower AVR1350 Ext. Backup: USB 3.0 Seagate 5TB
Media Boxes: Nvidia ShieldTV Pro, AppleTV 4k, Various Roku's

Model: TVS-673 32GB FW: 4.4.1.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

nasnoob
Starting out
Posts: 48
Joined: Sun Jun 21, 2009 4:31 pm

Re: Wildly Fluctuating Transfer Speeds

Post by nasnoob » Fri Sep 06, 2019 3:37 am

My PC Spec is as follows:
Windows 10 Pro
CPU: i7 920 Clocked at 3.4ghz
RAM: 6GB
SSD: Crucial M4 256GB

Thank you both for your suggestions, here is what I have tried:

1. Disabled Antivirus, Firewall, Windows Defender - NO CHANGE, same issue as before i.e. after 30 seconds into the transfer at 112mb/s the rate then drops to almost 0 and hovers at around 30mb/s until finishing
2. Disabled NIC Offloading - NO CHANGE, same as above

@Toxic17 - Apologies for any confusion, I just listed all the advanced parameter options on my LAN config screen. I have a standard LAN setup and the NAS and PC are both connected directly to the router. Here is the log from the performance tests you suggested:

# qcli_storage -d

Code: Select all

Enclosure  Port  Sys_Name     Type      Size      Alias          Signature   Partitions  Model
NAS_HOST   1     /dev/sdc     HDD:data  3.64 TB   --             QNAP FLEX   5           WDC WD40EFRX-68N32N0
NAS_HOST   2     /dev/sdd     HDD:data  3.64 TB   --             QNAP FLEX   5           WDC WD40EFRX-68WT0N0
NAS_HOST   3     /dev/sda     HDD:data  3.64 TB   --             QNAP FLEX   5           WDC WD40EFRX-68N32N0
NAS_HOST   4     /dev/sdb     HDD:data  3.64 TB   --             QNAP FLEX   5           WDC WD40EFRX-68WT0N0
# qcli_storage -T force=1

Code: Select all

[~]
fio test command for physical disk: /sbin/fio --filename=test_device --direct=1 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for RAID: /sbin/fio --filename=test_device --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
Enclosure  Port  Sys_Name      Throughput    RAID        RAID_Type    RAID_Throughput   Pool
NAS_HOST   1     /dev/sdc      141.06 MB/s   /dev/md1    RAID 10      237.10 MB/s       288
NAS_HOST   2     /dev/sdd      124.58 MB/s   /dev/md1    RAID 10      237.10 MB/s       288
NAS_HOST   3     /dev/sda      138.57 MB/s   /dev/md1    RAID 10      237.10 MB/s       288
NAS_HOST   4     /dev/sdb      119.95 MB/s   /dev/md1    RAID 10      237.10 MB/s       288
# qcli_storage -t force=1

Code: Select all

[~]
fio test command for LV layer: /sbin/fio --filename=test_device --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for File system: /sbin/fio --filename=test_device/qcli_storage --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 --size=128m &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
VolID   VolName             Pool     Mapping_Name            Throughput      Mount_Path                    FS_Throughput
1       Main                288      /dev/mapper/cachedev1   295.56 MB/s     /share/CACHEDEV1_DATA         193.35 MB/s

User avatar
Trexx
Experience counts
Posts: 4907
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota
Contact:

Re: Wildly Fluctuating Transfer Speeds

Post by Trexx » Fri Sep 06, 2019 7:58 am

I would suggest trying direct connection between the PC & NAS to rule out any router impact.
Paul

Model: TS-877-1600 FW: 4.4.1.x
QTier (HDD): [RAID-5] 6 x 3TB HGST DeskStar NAS QTier (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
(SSD): [RAID-1] 2 x 500GB Evo 860
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060, ACX 2.0(1 Fan), 6GB
UPS: CyberPower AVR1350 Ext. Backup: USB 3.0 Seagate 5TB
Media Boxes: Nvidia ShieldTV Pro, AppleTV 4k, Various Roku's

Model: TVS-673 32GB FW: 4.4.1.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

nasnoob
Starting out
Posts: 48
Joined: Sun Jun 21, 2009 4:31 pm

Re: Wildly Fluctuating Transfer Speeds

Post by nasnoob » Tue Sep 10, 2019 3:51 am

Thanks Trexx, I tried connecting directly to my pc and again same issue. At my wits end with this now :( Any other ideas?

User avatar
Trexx
Experience counts
Posts: 4907
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota
Contact:

Wildly Fluctuating Transfer Speeds

Post by Trexx » Tue Sep 10, 2019 5:19 am

Do you have snapshots enabled? If you have all data backed up, you could try running raid-5 to see if see similar behavior.

Also try using smb3 to see if that makes any difference.

I would also try using something like Aja for testing. https://www.aja.com/products/aja-system-test

Sent from my iPad using Tapatalk
Paul

Model: TS-877-1600 FW: 4.4.1.x
QTier (HDD): [RAID-5] 6 x 3TB HGST DeskStar NAS QTier (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
(SSD): [RAID-1] 2 x 500GB Evo 860
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060, ACX 2.0(1 Fan), 6GB
UPS: CyberPower AVR1350 Ext. Backup: USB 3.0 Seagate 5TB
Media Boxes: Nvidia ShieldTV Pro, AppleTV 4k, Various Roku's

Model: TVS-673 32GB FW: 4.4.1.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

User avatar
Toxic17
Ask me anything
Posts: 5158
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: Wildly Fluctuating Transfer Speeds

Post by Toxic17 » Tue Sep 10, 2019 5:27 am

do you have the same issue copying from your PC to the NAS?
Regards Simon

QTS 4.x User Guidex

QNAP Club Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-473-32GB QM2-2P QXG-10G1T 4.4.1.1064 • TVS-463-16GB 4.4.1.1064 QM2-2S10G1TB • TS-459 Pro 2GB 4.2.6 • TS-121 4.3.3.0998 • APC Back-UPS ES 700G •
QPKG's: TwonkyServer 8.51 • Apache73 • QSonarr 3.0.1.503 • QNBZGet 21.0 • phpMyAdmin 4.9.0.1 • Qmono 5.20.1.19 • McAfee 2.2.1 • Lychee 3.2.15 • HBS 3.0.190802 • LEgo v3.0.0
Network: VM Hub 3.0 <500/35> • UniFi USG Pro 4 • UniFi USW-16-150W • UniFi USW-8-60W • UniFi CloudKey Gen2+• UniFi G3-Flex • UAP AC Pro • UAP AC Lite • SLM2008 • Dell 7050 MFF •

nasnoob
Starting out
Posts: 48
Joined: Sun Jun 21, 2009 4:31 pm

Re: Wildly Fluctuating Transfer Speeds

Post by nasnoob » Thu Sep 12, 2019 4:59 am

Performance is more stable when directly connecting PC to NAS.

I enabled Jumbo Frames and set MTU to 9k on PC and NAS, this seemed to up the throughput and make the transfer more stable.

Writing back to the NAS I get 118mb/s and copying from NAS to PC I get 105mb/s, not sure why theres a difference but its better than it was

Bob Zelin
Been there, done that
Posts: 590
Joined: Mon Nov 21, 2016 12:55 am
Location: Orlando, FL.
Contact:

Re: Wildly Fluctuating Transfer Speeds

Post by Bob Zelin » Thu Sep 12, 2019 6:50 am

yea - I am guessing at some point, you have thousands of tiny files, which are very different than copying large blocks of 500 Gig files. When you have 60,000 500 KB files, that takes a lot longer than a few files that are 30 GB. Tiny files are exactly what caching is all about. I deal with video editing systems, and when I have people that have huge transfers of large video clips, it goes quickly. But if you have animation sequences of
tiny files with thousands or tens of thousands of individual frames which are tiny, yea - this takes a long time. It's dramatically slower than simply copying a single 30 gig file.

Bob Zelin
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com

Post Reply

Return to “Miscellaneous”