I narrowed this down to a network performance issue I think.
7 seven 12 tb EXOS drives
Will try again when last drive is installed bringing the test to 8 drives.
Server name QNAS-8
Model name TVS-872XT
CPU Intel(R) Core(TM) i5-8400T CPU @ 1.70GHz (6 cores)
Serial number Q218I02509
BIOS version Q016AT17
Total memory 16 GB (16 GB usable)
Dual channel supported NIC_VIEW_YES
Memory slots 2 (8 GB / 8 GB)
Firmware version 4.5.4.1800 Build 20210923
System up time 0 Days 6 Hour 54 Minute(s)
Time zone (GMT-08:00) Pacific Time(US & Canada); Tijuana
Filename encoding English
Raid 0 optimizing, no cache AJA (16GB,AJA RAW) test against mounted drive o:
Read Write
690 334
Enabled two 1TB EVO 960 cache raid 0 cache, optimizing complete
Read Write
672 544
Raid 10, optimizing, no cache
Read Write
391 204
Raid 10, optimizing, cache
read 624 write 545
Raid 5, still syncing, cache enabled. This should be 600 to 900+ MB/second at least. Will retry after sync is done in 14 hours.
I get 202 MB/sec write on an empty volume
Read Write
757 535
After sync completed but before a reboot:
Read Write
635 534
After reboot, same
OpenSpeedTest on 10G internal test: Obviously this NIC interface is limited to 2.5G what is wrong with this system? Should see 10,000 MBPS
Removed thunderbolt card, did not help, system thinks this is 10GB interface and local tests show max 2.5G
TXS-835XT 10G local interface limited to 2.5G
-
- New here
- Posts: 7
- Joined: Sun Dec 05, 2021 12:35 am
TXS-835XT 10G local interface limited to 2.5G
You do not have the required permissions to view the files attached to this post.
-
- New here
- Posts: 7
- Joined: Sun Dec 05, 2021 12:35 am
Re: TXS-835XT 10G local interface limited to 2.5G
I opened a case 4 days ago is the support for this company really bad?
-
- New here
- Posts: 7
- Joined: Sun Dec 05, 2021 12:35 am
Re: TXS-835XT 10G local interface limited to 2.5G
Still need help on performance issue with this NAS.
This system is empty (There is a single 830GB file in it ) and if I cannot get the performance I am expecting, I will return this NAS. (6 days into amazon out of 30).
If I can get this working, I will start copying over my data...
Removed thunderbolt card. System Identifies without the "T" in PID
I have TWO over 5 year old synology 8 bay NAS system all copy over 550MB to 700 MB/Sec on 10G SFP+. The actual specs for this 872XT are not what is published.
I chose static volume with all the space it the one volume as the posts indicated this is the best performance. I don't use multiple snapshots.
There are two 1TB EVO 960 NVME in raid 0. Cache set to R/W.
All users admin privilege
There was a new automatic system update: from 4.5.4.1800 to 5.0.0.1870 build 20211201 so now I am on the latest 5.0 build
After app updates I rebooted:
Unifi 10g 16 port switch. 10G port connected to same unifi 10G switch for all 10G SFP and SFP+ ports. All switching local. All jumbo frames 9K. SMB set to 3.0, tls 1.2
so restarted 10G NIC interface tests and still getting 2545 down and 2720 up.
memory less than 15% used, cpu less than 10%, swap 0%
Local file copy slower than 4.5 firmware. 830GB file transfers at a rate of 250MB/sec, should be 1200+ MB/sec with caching enabled.
Turned off caching, removed the cache volume, reboot, local copy: 333 to 375MB/SEC (faster than with cache) (10g Ethernet still same speed)
recreated raid 0 cache with no reserve, applied to existing large volume
Local copy: 250mb/sec which is slower than direct I/O
reset NAS to factory defaults and keep volume, try again... start with 5.0 software base.
delete NVME, re add raid 0 all I/O. Over provisioning 10% reserve
dropped apple networking for now
SMB 3.0 only
TLS 1.2
10G NIC: same speed on open speedtest
windows file transfer: increased to 400MB/sec, far below what it should be. local transfer: Source file is on a local computer NVME drive
local NAS file copy/paste 830GB file: 250MB/sec should be 1000MB+/sec
[jbrandt@QNAP8 ~]$ qcli_storage -T
fio test command for physical disk: /sbin/fio --filename=test_device --direct=1 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for RAID: /sbin/fio --filename=test_device --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
Enclosure Port Sys_Name Throughput RAID RAID_Type RAID_Throughput Pool
NAS_HOST 1 /dev/sdf @ /dev/md2 RAID 5 288
NAS_HOST 2 /dev/sdg @ /dev/md2 RAID 5 288
NAS_HOST 3 /dev/sdd @ /dev/md2 RAID 5 288
NAS_HOST 4 /dev/sdc @ /dev/md2 RAID 5 288
NAS_HOST 5 /dev/sdb @ /dev/md2 RAID 5 288
NAS_HOST 6 /dev/sda @ /dev/md2 RAID 5 288
NAS_HOST 7 /dev/sde @ /dev/md2 RAID 5 288
NAS_HOST 9 /dev/nvme0n1 @ /dev/md1 RAID 0 256
NAS_HOST 10 /dev/nvme1n1 @ /dev/md1 RAID 0 256
[jbrandt@QNAP8 ~]$ qcli_storage -t
fio test command for LV layer: /sbin/fio --filename=test_device --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for File system: /sbin/fio --filename=test_device/qcli_storage --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 --size=128m &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
VolID VolName Pool Mapping_Name Throughput Mount_Path FS_Throughput
1 DataVol2 288 /dev/mapper/cachedev1 212.20 MB/s /share/CACHEDEV1_DATA 1.09 GB/s
This system is empty (There is a single 830GB file in it ) and if I cannot get the performance I am expecting, I will return this NAS. (6 days into amazon out of 30).
If I can get this working, I will start copying over my data...
Removed thunderbolt card. System Identifies without the "T" in PID
I have TWO over 5 year old synology 8 bay NAS system all copy over 550MB to 700 MB/Sec on 10G SFP+. The actual specs for this 872XT are not what is published.
I chose static volume with all the space it the one volume as the posts indicated this is the best performance. I don't use multiple snapshots.
There are two 1TB EVO 960 NVME in raid 0. Cache set to R/W.
All users admin privilege
There was a new automatic system update: from 4.5.4.1800 to 5.0.0.1870 build 20211201 so now I am on the latest 5.0 build
After app updates I rebooted:
Unifi 10g 16 port switch. 10G port connected to same unifi 10G switch for all 10G SFP and SFP+ ports. All switching local. All jumbo frames 9K. SMB set to 3.0, tls 1.2
so restarted 10G NIC interface tests and still getting 2545 down and 2720 up.
memory less than 15% used, cpu less than 10%, swap 0%
Local file copy slower than 4.5 firmware. 830GB file transfers at a rate of 250MB/sec, should be 1200+ MB/sec with caching enabled.
Turned off caching, removed the cache volume, reboot, local copy: 333 to 375MB/SEC (faster than with cache) (10g Ethernet still same speed)
recreated raid 0 cache with no reserve, applied to existing large volume
Local copy: 250mb/sec which is slower than direct I/O
reset NAS to factory defaults and keep volume, try again... start with 5.0 software base.
delete NVME, re add raid 0 all I/O. Over provisioning 10% reserve
dropped apple networking for now
SMB 3.0 only
TLS 1.2
10G NIC: same speed on open speedtest
windows file transfer: increased to 400MB/sec, far below what it should be. local transfer: Source file is on a local computer NVME drive
local NAS file copy/paste 830GB file: 250MB/sec should be 1000MB+/sec
[jbrandt@QNAP8 ~]$ qcli_storage -T
fio test command for physical disk: /sbin/fio --filename=test_device --direct=1 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for RAID: /sbin/fio --filename=test_device --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
Enclosure Port Sys_Name Throughput RAID RAID_Type RAID_Throughput Pool
NAS_HOST 1 /dev/sdf @ /dev/md2 RAID 5 288
NAS_HOST 2 /dev/sdg @ /dev/md2 RAID 5 288
NAS_HOST 3 /dev/sdd @ /dev/md2 RAID 5 288
NAS_HOST 4 /dev/sdc @ /dev/md2 RAID 5 288
NAS_HOST 5 /dev/sdb @ /dev/md2 RAID 5 288
NAS_HOST 6 /dev/sda @ /dev/md2 RAID 5 288
NAS_HOST 7 /dev/sde @ /dev/md2 RAID 5 288
NAS_HOST 9 /dev/nvme0n1 @ /dev/md1 RAID 0 256
NAS_HOST 10 /dev/nvme1n1 @ /dev/md1 RAID 0 256
[jbrandt@QNAP8 ~]$ qcli_storage -t
fio test command for LV layer: /sbin/fio --filename=test_device --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for File system: /sbin/fio --filename=test_device/qcli_storage --direct=0 --rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio --iodepth=32 --size=128m &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
VolID VolName Pool Mapping_Name Throughput Mount_Path FS_Throughput
1 DataVol2 288 /dev/mapper/cachedev1 212.20 MB/s /share/CACHEDEV1_DATA 1.09 GB/s
- qrusher
- Know my way around
- Posts: 143
- Joined: Thu Mar 15, 2018 9:51 pm
- Location: R/U/serious
- Contact:
Re: TXS-835XT 10G local interface limited to 2.5G
use ssd for system init and system pool
raid1
then try tests
dont use cache
dont use 2 first drives in system for data pool inn hdd only system
raid1
then try tests
dont use cache
dont use 2 first drives in system for data pool inn hdd only system
crush qnaps like a thanos crushing planets
Updates are compromise between old bug patches and new bugs introduced.
do you backup..then kill it with fire
stuff:mikrotik Crs309-1g-8s+in & s+rj10 x4
Updates are compromise between old bug patches and new bugs introduced.
do you backup..then kill it with fire
stuff:mikrotik Crs309-1g-8s+in & s+rj10 x4
-
- New here
- Posts: 7
- Joined: Sun Dec 05, 2021 12:35 am
Re: TXS-835XT 10G local interface limited to 2.5G
did the setup and got some improvement not lots
created new MVME 1.8 TB system volume drive raid 0 but performance not that much better.
deleted old hard drive volume, created new raid 0 (don't want to wait for the sync) with all 8 volumes.
AJA 681/611
Windows write 480 to 520MB/sec
10G NIC speed test same 2.5 G
Local file transfer rate: 333mb/sec (Improved but not 1200 mb/sec I was expecting on a local copy.
Ordered 2 port SFP+ 10G card and will try that this weekend
I am setting up raid 1 on 8 drives with mvne cache 1.8TB raid 0. will take a day to get back to that config.
I still think the issue is 10G NIC.
Jim
created new MVME 1.8 TB system volume drive raid 0 but performance not that much better.
deleted old hard drive volume, created new raid 0 (don't want to wait for the sync) with all 8 volumes.
AJA 681/611
Windows write 480 to 520MB/sec
10G NIC speed test same 2.5 G
Local file transfer rate: 333mb/sec (Improved but not 1200 mb/sec I was expecting on a local copy.
Ordered 2 port SFP+ 10G card and will try that this weekend
I am setting up raid 1 on 8 drives with mvne cache 1.8TB raid 0. will take a day to get back to that config.
I still think the issue is 10G NIC.
Jim
Last edited by jimbrandt2000 on Wed Dec 08, 2021 12:31 pm, edited 2 times in total.
-
- New here
- Posts: 7
- Joined: Sun Dec 05, 2021 12:35 am
Re: TXS-835XT 10G local interface limited to 2.5G
I am also now getting Warning 2021-12-08 02:18:45 admin 127.0.0.1 Network & Virtual Switch Infrastructure [Network & Virtual Switch] Interface "Adapter 1" disconnected.
then it reconnects. Happens once every few hours.
MANY others are seeing this as well.
When I get my 2 port 10GB PCIE card I will set it to trunking mode so the interface stays up.
what the heck. This box is looking worse every day.
then it reconnects. Happens once every few hours.
MANY others are seeing this as well.
When I get my 2 port 10GB PCIE card I will set it to trunking mode so the interface stays up.
what the heck. This box is looking worse every day.
-
- New here
- Posts: 7
- Joined: Sun Dec 05, 2021 12:35 am
Re: TXS-835XT 10G local interface limited to 2.5G
Here are today's tests comparing internal 10G with 2 separate SFP+ adapters.
Support took a log archive over a week ago and never got back to me.
Support very bad for this product.
Support took a log archive over a week ago and never got back to me.
Support very bad for this product.
You do not have the required permissions to view the files attached to this post.
-
- Experience counts
- Posts: 1374
- Joined: Mon Nov 21, 2016 12:55 am
- Location: Orlando, FL.
- Contact:
Re: TXS-835XT 10G local interface limited to 2.5G
Hi Jim -
what 10G card do you have in your PC? A nice boring QNAP QXG-10G1T ($109) or ASUS XG-C100C ($89) in a x4 lane slot will work great. Use EIGHT DRIVES in a RAID 5 or a RAID 6 configuration - single static volume. Drives must be 7200 RPM, not 5400 RPM. If you don't have a x4 lane slot in your PC, then GET ANOTHER PC, and do the test. You are wasting so much time with all these tests. Do your speed tests with AJA System Test or Blackmagic Disk Speed Test. Ethernet port 1 (10G) static IP 192.168.2.3. 255.255.255.0. MTU 9000. Your card in your PC - static IP 192.168.2.11. 255.255.255.0. MTU 9000.
Create a single static volume. You don't need to wait for full synchronization for the RAID to finish for READ speed. You should see 800 - 900 MB/sec READ right away. You will see at least 500 - 600 MB/sec write when the synchronization is done. Forget the Cache. Don't overthink this.
Bob Zelin
what 10G card do you have in your PC? A nice boring QNAP QXG-10G1T ($109) or ASUS XG-C100C ($89) in a x4 lane slot will work great. Use EIGHT DRIVES in a RAID 5 or a RAID 6 configuration - single static volume. Drives must be 7200 RPM, not 5400 RPM. If you don't have a x4 lane slot in your PC, then GET ANOTHER PC, and do the test. You are wasting so much time with all these tests. Do your speed tests with AJA System Test or Blackmagic Disk Speed Test. Ethernet port 1 (10G) static IP 192.168.2.3. 255.255.255.0. MTU 9000. Your card in your PC - static IP 192.168.2.11. 255.255.255.0. MTU 9000.
Create a single static volume. You don't need to wait for full synchronization for the RAID to finish for READ speed. You should see 800 - 900 MB/sec READ right away. You will see at least 500 - 600 MB/sec write when the synchronization is done. Forget the Cache. Don't overthink this.
Bob Zelin
Bob Zelin / Rescue 1, Inc.
http://www.bobzelin.com
http://www.bobzelin.com
-
- New here
- Posts: 7
- Joined: Sun Dec 05, 2021 12:35 am
Re: TXS-835XT 10G local interface limited to 2.5G
So it took them months to help with getting this to a point I can debug this. The internal 10G card would not mount, turned out to be a firewall app problem. I disabled firewall, and then they had me create a new case to start the debugging. This week (6/17/22)
The first pass of debugging from the team was horrible, and they did not know what to do to figure this out. Finally after months someone had me turn off firewall and it was mountable.
iperf3 shows about 1.3G on 10 G internal IF card, where as either 10G SFP+ are between 5G and 10G rates for file transfer.
Internal NAS card is: QXG-10G2SF-CX4 https://www.qnap.com/en-us/product/qxg- ... s/hardware
Laptop using dual 10G SFP copper through a sonnet thunderbolt 3 connection off of laptop T73. I can get 10G rates over these LAN IF just fine as long as it goes to one of the SFP+ ports.
Topology of the setup is ALL NAS and Computer IF connect directly to either SFP or SFP+ to a Unifi 10G switch. So port to port switching. NAS connects to SFP+ fiber on 2 ports and the internal 10G to SFP port on same switch.
So when I "iperf3 -c <ipaddr>" to the NAS it goes through unifi SFP 10G port to SFP+ 10G port on the NAS. Getting line rate on various tests for the NAS SFP+ ports just fine. Same tests are around 1.2G for the 10G SFP connection.
So after months I am just starting to debug the real problem.
I wish I bought a synology NAS.
Jim
The first pass of debugging from the team was horrible, and they did not know what to do to figure this out. Finally after months someone had me turn off firewall and it was mountable.
iperf3 shows about 1.3G on 10 G internal IF card, where as either 10G SFP+ are between 5G and 10G rates for file transfer.
Internal NAS card is: QXG-10G2SF-CX4 https://www.qnap.com/en-us/product/qxg- ... s/hardware
Laptop using dual 10G SFP copper through a sonnet thunderbolt 3 connection off of laptop T73. I can get 10G rates over these LAN IF just fine as long as it goes to one of the SFP+ ports.
Topology of the setup is ALL NAS and Computer IF connect directly to either SFP or SFP+ to a Unifi 10G switch. So port to port switching. NAS connects to SFP+ fiber on 2 ports and the internal 10G to SFP port on same switch.
So when I "iperf3 -c <ipaddr>" to the NAS it goes through unifi SFP 10G port to SFP+ 10G port on the NAS. Getting line rate on various tests for the NAS SFP+ ports just fine. Same tests are around 1.2G for the 10G SFP connection.
So after months I am just starting to debug the real problem.
I wish I bought a synology NAS.
Jim