How does HBS handle this ?

Backup, Restore, Netbak Replicator, Cloud Storage Services
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

How does HBS handle this ?

Post by spikemixture »

I back up my media from my Qnap to a Synology using Rsync.

I have a 10GBE connection between the 2
Qnap 10.10.10.10 and Syno 10.10.10.17

I also have gigibit connections
Qnap 192.168.1.112 and syno 192.168.1.117

I have about 10 schedule jobs
movies, home videos, other videos, kids etc
What i want to know is what ip is the Qnap using

I can set the Synology to receive on either 10.10.10.17 (10GBE) or 192.168.1.117 (1G)
Obviously i would like the Qnap to send via the 10GBE connection.

How does Qnap decide which ip to send FROM

I have open qnap on 192.168.1.112 and set up jobs

Then I have opened the Qnap on 10.10.10.10 and created a job.
Hard to really tell but it appears a little faster!

Am I dreaming ?
Does it make any difference ?

The reason I ask is am upgrading drives on both boxes. ( and yes I know things are going on in the background)
The syno I had to start from scratch so am copying 28TB from the qnap to the syno.
The speeds are terrible !
It doesn't make any difference if I run 1 job or 6 the speeds hardly change!

I am getting like 5 MB/s at the best and that is from 10.10.10.10 (qnap 10GBE) to 10.10.10.17(Syno 10GBE)
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
User avatar
Moogle Stiltzkin
Guru
Posts: 11445
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: How does HBS handle this ?

Post by Moogle Stiltzkin »

spikemixture wrote: Thu Jul 25, 2019 12:17 pm I back up my media from my Qnap to a Synology using Rsync.

I have a 10GBE connection between the 2
Qnap 10.10.10.10 and Syno 10.10.10.17

I also have gigibit connections
Qnap 192.168.1.112 and syno 192.168.1.117

I have about 10 schedule jobs
movies, home videos, other videos, kids etc
What i want to know is what ip is the Qnap using

I can set the Synology to receive on either 10.10.10.17 (10GBE) or 192.168.1.117 (1G)
Obviously i would like the Qnap to send via the 10GBE connection.

How does Qnap decide which ip to send FROM

I have open qnap on 192.168.1.112 and set up jobs

Then I have opened the Qnap on 10.10.10.10 and created a job.
Hard to really tell but it appears a little faster!

Am I dreaming ?
Does it make any difference ?

The reason I ask is am upgrading drives on both boxes. ( and yes I know things are going on in the background)
The syno I had to start from scratch so am copying 28TB from the qnap to the syno.
The speeds are terrible !
It doesn't make any difference if I run 1 job or 6 the speeds hardly change!

I am getting like 5 MB/s at the best and that is from 10.10.10.10 (qnap 10GBE) to 10.10.10.17(Syno 10GBE)
does this help?
viewtopic.php?f=182&t=149605


someone was asking how to make the traffic use the 10gbe cables for the transfers.
Toxic17 wrote: Tue Jul 23, 2019 5:17 pm My understanding is, if the 10GbE card is on the same subnet, then nas will use the "default" gateway port of the NAS for data transfer.

As dolbyman stated it is better to have both 1GB ports on one Subnet and the 10GbE card on another subnet. that way both subnets will and can have different Gateways. Also if you use protocol binding, you need to have two subnets for it to work correctly.
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

Re: How does HBS handle this ?

Post by spikemixture »

Isn't that what I am doing?

the 10gbe is 10.10.10.*
and the 1g is 192.168.1.*
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
User avatar
Toxic17
Ask me anything
Posts: 6478
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: How does HBS handle this ?

Post by Toxic17 »

what version of HBS are you using. the HBS 3 (beta) allows for faster transfer of data.

https://www.qnap.com/solution/hbs3/en/

using it here. you wont see that actual files on your backup NAS as these have been Deduped. which converts them to .qdff files. you can however extract them using the QuDedup Extract Tool.

you need to setup your jobs again as I found no way of using an existing v2 backup task and enabling QuDedup in the task. it was greyed out.
Regards Simon

Qnap Downloads
MyQNap.Org Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-673A QuTS hero h5.1.2.2534 • TS-121 4.3.3.2420 • APC Back-UPS ES 700G
Network: VM Hub3: 500/50 • UniFi UDM Pro: 3.2.9 • UniFi Network Controller: 8.0.28
USW-Aggregation: 6.6.61 • US-16-150W: 6.6.61 • 2x USW Mini Flex 2.0.0 • UniFi AC Pro 6.6.62 • UniFi U6-LR 6.6.62
UniFi Protect: 2.11.21/8TB Skyhawk AI • 3x G3 Instants: 4.69.55 • UniFi G3 Flex: 4.69.55 • UniFi G5 Flex: 4.69.55
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

Re: How does HBS handle this ?

Post by spikemixture »

I am on Version 2.1 190709

I want identical folders/files on the receiving NAS as i use that as a backup server - so it need to see the files the a same as the Qnap.

Does V3 do that or it leaves then as the qdff files - if that is the case no good for me.

So back to my question!

How does Qnap decide which ip to send FROM
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
User avatar
Toxic17
Ask me anything
Posts: 6478
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: How does HBS handle this ?

Post by Toxic17 »

spikemixture wrote: Thu Jul 25, 2019 6:24 pm
How does Qnap decide which ip to send FROM
the quick answer - via routing tables, just like most devices.

ssh into your NAS.

type

route
Regards Simon

Qnap Downloads
MyQNap.Org Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-673A QuTS hero h5.1.2.2534 • TS-121 4.3.3.2420 • APC Back-UPS ES 700G
Network: VM Hub3: 500/50 • UniFi UDM Pro: 3.2.9 • UniFi Network Controller: 8.0.28
USW-Aggregation: 6.6.61 • US-16-150W: 6.6.61 • 2x USW Mini Flex 2.0.0 • UniFi AC Pro 6.6.62 • UniFi U6-LR 6.6.62
UniFi Protect: 2.11.21/8TB Skyhawk AI • 3x G3 Instants: 4.69.55 • UniFi G3 Flex: 4.69.55 • UniFi G5 Flex: 4.69.55
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

Re: How does HBS handle this ?

Post by spikemixture »

Toxic17 wrote: Thu Jul 25, 2019 7:41 pm
spikemixture wrote: Thu Jul 25, 2019 6:24 pm
How does Qnap decide which ip to send FROM
the quick answer - via routing tables, just like most devices.

ssh into your NAS.

type

route
/mnt/HDA_ROOT/.config$ route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
default 192.168.1.1 0.0.0.0 UG 100 0 0 eth0
10.0.3.0 * 255.255.255.0 U 0 0 0 lxcbr0
10.0.5.0 * 255.255.255.0 U 0 0 0 docker0
10.10.0.0 * 255.255.0.0 U 0 0 0 eth4
127.0.0.0 * 255.0.0.0 U 0 0 0 lo
192.168.1.0 * 255.255.255.0 U 0 0 0 eth0
192.168.1.0 * 255.255.255.0 U 0 0 0 eth3
192.168.1.0 * 255.255.255.0 U 0 0 0 qvs1
192.168.1.0 * 255.255.255.0 U 0 0 0 qvs0

None of those I recognize!

And
I am on Version 2.1 190709

I want identical folders/files on the receiving NAS as i use that as a backup server - so it need to see the files the a same as the Qnap.

Does V3 do that or it leaves then as the qdff files - if that is the case no good for me.
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
User avatar
Toxic17
Ask me anything
Posts: 6478
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: How does HBS handle this ?

Post by Toxic17 »

you have the choice of using qdff files or not in HBS3 jobs.
Regards Simon

Qnap Downloads
MyQNap.Org Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-673A QuTS hero h5.1.2.2534 • TS-121 4.3.3.2420 • APC Back-UPS ES 700G
Network: VM Hub3: 500/50 • UniFi UDM Pro: 3.2.9 • UniFi Network Controller: 8.0.28
USW-Aggregation: 6.6.61 • US-16-150W: 6.6.61 • 2x USW Mini Flex 2.0.0 • UniFi AC Pro 6.6.62 • UniFi U6-LR 6.6.62
UniFi Protect: 2.11.21/8TB Skyhawk AI • 3x G3 Instants: 4.69.55 • UniFi G3 Flex: 4.69.55 • UniFi G5 Flex: 4.69.55
User avatar
Trexx
Ask me anything
Posts: 5388
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

Re: How does HBS handle this ?

Post by Trexx »

Also depending on how your jobs are configured (compression, etc.) the "computational overhead" of the job itself may be throttling your backup more so than the NW bandwidth.
Paul

Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350

Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
User avatar
Moogle Stiltzkin
Guru
Posts: 11445
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: How does HBS handle this ?

Post by Moogle Stiltzkin »

QuDedup technology unveiled: Data deduplication, data size reduction & deduped data direct view @9:17. @17:55, @20:00, @23:38, @29:15
https://www.youtube.com/watch?v=OM--u98cPv8
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

Re: How does HBS handle this ?

Post by spikemixture »

Ok running V3 and looks to be an improvement.

Doing a straight sync and it does none of the new fancy name change stuff .

BUT It clearly shows my qnap is NOT using my 10.10.10.10 10GBE ip

But my default 192.168.1.112

My receiving IP Syno shows the 10.10.10.17 correct 10GBE IP.

How do I get Qnap to use the 10gbe ip ?
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

How does HBS handle this ? [Solved but not really]

Post by spikemixture »

Here is the answer

Login using your 10GBE ip (but it must be from a PC on same subnet - in my case my PC on 10.10.10.100)

For me the usual is 192.168.1.112 and my 10GBE is 10.10.10.12
So I opened a new page with that IP and all the jobs in HBS V3 show 10.10.10.12 as the source.

Tests show no speed increase !!

Although HBS V3 show 10.10.10.12 when i open from that IP and 192.168.1.112 shows that IP(192.168.1.112) if opened at the same time it seems to make no difference to anything !
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

Re: How does HBS handle this ?

Post by spikemixture »

Has anyone connected two 10gbe adapters using HBSv3?
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
User avatar
Toxic17
Ask me anything
Posts: 6478
Joined: Tue Jan 25, 2011 11:41 pm
Location: Planet Earth
Contact:

Re: How does HBS handle this ?

Post by Toxic17 »

Yep.
Regards Simon

Qnap Downloads
MyQNap.Org Repository
Submit a ticket • QNAP Helpdesk
QNAP Tutorials, User Manuals, FAQs, Downloads, Wiki
When you ask a question, please include the following


NAS: TS-673A QuTS hero h5.1.2.2534 • TS-121 4.3.3.2420 • APC Back-UPS ES 700G
Network: VM Hub3: 500/50 • UniFi UDM Pro: 3.2.9 • UniFi Network Controller: 8.0.28
USW-Aggregation: 6.6.61 • US-16-150W: 6.6.61 • 2x USW Mini Flex 2.0.0 • UniFi AC Pro 6.6.62 • UniFi U6-LR 6.6.62
UniFi Protect: 2.11.21/8TB Skyhawk AI • 3x G3 Instants: 4.69.55 • UniFi G3 Flex: 4.69.55 • UniFi G5 Flex: 4.69.55
User avatar
spikemixture
Been there, done that
Posts: 890
Joined: Wed Mar 07, 2018 11:04 pm
Location: 3rd World

Re: How does HBS handle this ?

Post by spikemixture »

Toxic17 wrote: Sat Aug 10, 2019 7:51 pmYep.
Do u have the 10GBE as the only ethernet adapter in each of the 2 boxes?
Qnap TS-1277 1700 (48gb RAM) 8x10TB WD White,- Raid5, 2x M.2 Crucial 1TB (Raid 1 VM),
2x SSD 860 EVO 500gb (Raid1 QTS), 2x SSD 860 EVO 250GB (Cache), 2x M.2 PCIe 970 500gb NVME (Raid1 Plex and Emby server)
GTX 1050 TI
Qnap TVS-1282 i7 (32GB RAM) 6x8TB WD White - JBOD, 2x M.2 Crucial 500gb (Raid1 VM),
2x SSD EVO 500gb (Raid1 QTS), 2x SSD EVO 250gb (Raid1 Cache), 2x M.2 PCIe Intel 512GB NVME (Raid1-Servers)
Synology -1817+ - DOA
Drobo 5n - 5x4TB Seagate, - Drobo Raid = 15TB
ProBox 8 Bay USB3 - 49TB mixed drives - JBOD
All software is updated asap.
I give my opinion from my experience i.e. I have (or had) that piece of equipment/software and used it! :roll:
Post Reply

Return to “Backup & Restore”