Hybrid Backup Sync 2.1.170630 test worklog

[Moogle Stiltzkin]

*note: HBS is considered beta for now. Use backup station by default or only unless qnap support asks you to use HBS instead of bs. I only verified HBS working for me using the mentioned qts firmware, this particular qnap model, this HBS version, and only for this specific rtrr one way sync configuration only. If your doing the same but on different setup than what i tested, then you may have a different result, it's a beta. If you understood that, continue reading


My HBS test worklog

I did a very recent test back in June 2017 actually from a ts-653a to a ts-659 Pro II. Did not see any issues with it, but now there's a newer hbs version out hm.... so time to test that

Hybrid Backup Sync 2.1.170630
( 2017/07/05 )
[Fixes]
-SMB connections no longer fail with error code:-133.
-HBS no longer says that a bucket has been created successfully, after trying to create a bucket with the same name as an existing bucket on Amazon S3.
-Hybrid Backup Sync no longer takes too long to launch.
-Hybrid Backup Sync no longer repeatedly resends files with special characters in their file names when uploading to OneDrive for Business.
-Fixed bugs that prevented HBS restoring data from cloud backups.

Backup method: RTRR one way sync to remote NAS, folder to folder

Source: TS-653A ( Firmware 4.3.3.0238 Build 20170703 ) raid5 4x4tb Hgst Deskstar NAS
Destination: TS-509 Pro ( Firmware 4.2.6 build 20170628 ) raid5 4x1tb Western digital black


currently setting up the ts-509 pro so will take a while before i can proceed to test will update this thread when thats ready.


Till then, here is a simple video guide how to use HBS
[youtube=]4dyvuzTtEv0[/youtube]



Notes: For the test i'll be posting images, you can browse them on my gallery here
http://imgur.com/a/Ydp3k

[Moogle Stiltzkin]

Step1

update QTS to latest firmware
https://www.qnap.com/en/product_x_down/

Source NAS: TS-653A ( 4.3.3.0238 build 20170703 )

Destination NAS: TS-509 pro ( 4.2.6 build 20170628 )


Step2
Go app center install latest Hybrid Backup Sync 2.1.170630. This does 2 things. It replaces the default backup station which is now no longer available. It auto bundle includes cloud backup sync as well.

*note: HBS is considered beta for now. Use backup station by default or only unless qnap support asks you to use HBS instead of bs. I only verified HBS working for me using the mentioned qts firmware, this particular qnap model, this HBS version, and only for this specific rtrr one way sync configuration only. If your doing the same but on different setup than what i tested, then you may have a different result, it's a beta.




Step3
Setup RTRR server credentials first on destination NAS. So i go to TS-509 Pro to set that up.

For some reason the hbs can't start. i tried the shortcut on qts, then in app center, doesn't work. I tried closing the browser and relogin that didn't work either.


All this unit was doing recently was sync raid after a reinit which it already completed. Then went idle ( i had disabled the spin down on idle because it was preventing completion for scan bad block on hdds earlier). Anyway i rebooted the unit hoping it will work after.

Nope, still doesn't work. Now i'll try remove HBS then reinstall it. Didn't work either.

Installed helpdesk then tried to click that i get error



so then i tried to enable webserver but thats is not available



Now i'm stuck not able to use HBS, or use the helpdesk to create remote session to support

Anyway went to appcenter remove HBS, then it reverts back to the default backup station. I try open that and it works.


But doing that i can't test with HBS run on both qnaps


had to manually create a helpdesk support ticket from their site instead
https://helpdesk.qnap.com/index.php

Hybrid backup sync does not seem to be listed under appcenter, or backup station so i select report as backup station issue.




I may have to switch from testing backup to 509 Pro to ts-659 Pro II at this rate. I'll have to delete all previous backup i did last month just to run this test ....

#EEL-742-11805 for this issue


anyway.... using backup station to setup rtrr server



then in security include my ts-653a device in allowed as well

[Moogle Stiltzkin]

at this point now we can begin configuring hbs on the ts-653a


this is my usual favorite backup method. Sync one way, from local to remote, rtrr, folder to folder







To setup folder to folder, i backtrack to the ts-509 Pro to make a share called "Storage2" which is essentially the source folder for ts-653a. So i can easily know the contents of the backup by keeping the same file structure.




so then back to ts-653a. Unfortunately there is no refresh icon, the share is not updated in the list. So i had to click back and re-do again this part.









Also i could not untick sync now.... i only wanted to setup the job, not to run as soon as i hit apply... doing no schedule does not stop the job from running at least once after you click apply. i had to manually stop once i applied the settings. Then i click edit on the job, only now is there an option to tick or untick sync now. a bit late.... this should have been available during the job creation is this an oversight?



Anyway i stopped here. Because the TS-653a is currently running a raid scrub, so i don't intend to perform backup during that process It's almost done anyway. Once that completes i'll resume running the test.

[Moogle Stiltzkin]

Running the backup job, the background task and event did not update to indicate any backup process is ongoing.....



overview shows nothing either even when clicking refresh icon. only system logs indicates a backup was started



In the ts-509 pro you can see from there the backup in progress which seems to work correctly as both background and event show an active running backup taking place. as well as in backup station incoming.








*update

after my ts-653a went idle to login page. i logged back in and notice only now that the background task is updated as follows



event log still shows empty and does not know any rtrr task is in process though.

[Moogle Stiltzkin]

While waiting for that to finish ...

[youtube=]NeUGxKi9Keo[/youtube]

[Moogle Stiltzkin]

Okay backup completed

Click on download diagnostic report

Code: Select all

Total number of the folders: 1358. 
Total number of the files: 34618. 
Total updated size: 1.65 TB. 
Average updating speed: 67.90 (MB/sec). 
Time elapsed: 7 hours 5 minutes 16 seconds
[2017/07/07 20:59:51] Job finished.

ts-653a


ts-509 pro



destination has less files and folders, but the data backed up is 1.65tb matching. The discrepancy for folders and files is most likely thumbnails and system generated junk based on the filter i set earlier not to copy over. so probably okay.

browsed the share via smb windows 10, and did a random file check, no corrupted file detected. played a few files they work fine.




that concludes the testing for HBS ts-653a to a backupstation ts-509 pro

[Moogle Stiltzkin]

Suggestions other than bugs and issues highlighted already

Make the folder selection headers show NAS names similar to qfiling.






summary of issues so far

1. hbs doesn't run on ts-509 pro for a reason. default backup station works, had to use that to setup rtrr server. ts-653a hbs works.

2. background task and event on ts-653a which ran the hbs job does not indicate any active running job. only in system log or in hbs remote jobs is there any indication of activity. in comparison, the ts-509 pro is correctly showing activity in background tasks and in event (which should also have been shown in the ts-653a imho)

3. sync now cannot be untick while creating a job task for the first time. Only can untick after it was created. A bit late because i want to create a job without actually running, but it would not let me do that. Had to quickly pause as soon as it auto ran, but then had to go to the ts-509 pro folder to clean up what was already sync copied over.

4. creating a support ticket has no hybrid backup sync under either apps or backup station. May want to add that in as a sub category selection for when people want to report an issue.

5. destination and source folder i recommend you make the listing similar to Qfiling. The NAS name is included in the header, making it easier to identify nas selected and avoid mistakes. Because both my NAS use the same share names to maintain file structure. Adding a calculator too wouldn't hurt. Why not let user know if destination may not have sufficient space to backup source, BEFORE they run the backup job?

6. the hbs overview job type icons seem a bit too repetitive to me. maybe change the design of it?

7. Maybe overview should also display outgoing jobs? Currently it's only shown in the remote jobs under all jobs, which is okay. But isn't overview where you'd normally see the summary over all activity involving hbs?

8. background task does not update to show running HBS activity on source NAS, UNTIL AFTER you relogin qts.

[Toxic17]

Suggestions other than bugs and issues highlighted already

1. hbs doesn't run on ts-509 pro for a reason.

hmm My 459 Pro uses HBS 1.2.161226. it works, just it is not the latest version. it is also available for Your 509. does it not work at all?

[Moogle Stiltzkin]

Suggestions other than bugs and issues highlighted already

1. hbs doesn't run on ts-509 pro for a reason.

hmm My 459 Pro uses HBS 1.2.161226. it works, just it is not the latest version. it is also available for Your 509. does it not work at all?

if i had the older hbs version qpkg i could try installing that to see if the issue is latest hbs not working on unit (if only to narrow down the problem), or whether the problem is something specific to my unit only.


this combination didn't work for me.

Hybrid Backup Sync 2.1.170630
( 2017/07/05 )
[Fixes]
-SMB connections no longer fail with error code:-133.
-HBS no longer says that a bucket has been created successfully, after trying to create a bucket with the same name as an existing bucket on Amazon S3.
-Hybrid Backup Sync no longer takes too long to launch.
-Hybrid Backup Sync no longer repeatedly resends files with special characters in their file names when uploading to OneDrive for Business.
-Fixed bugs that prevented HBS restoring data from cloud backups.


Destination: TS-509 Pro ( Firmware 4.2.6 build 20170628 )

but my unit also doesn't have webserver to enable. Also can't use helpdesk either (because it request to enable webserver but i can't). tried reinstalling hbs, and rebooting qnap, nothing worked

This is a ts-509 pro i booted up (from being offline for years) that still had a 2015 firmware which i updated to latest 2017 (using qfinder pro), then factory reset, then reinit, then ran smart extended hdd test, bad block scan. Later i misconfigured security and got locked out because forgot to add my workstation ip. So i click reset button 3 seconds for 1 beep to reset the setting so i could enter back to QTS. thats all i did with this unit

Not sure if that is because of the qts firmware i installed intentionally disabling those services with unintended consequence, or whether it's merely only my unit not other users having this issue. I already reported to help desk, just waiting for clarification from them on this matter.

Right now i'm testing hbs running on the ts-653a, but on the ts-509 pro i'm using the default backup station to setup the rtrr server. Seems to work, just waiting for the backup to complete.

[Toxic17]

did your 509 come from firmware 3.8.2 or below to 4.x?

I know there is an issue if your firmware is not upto 3.8.3 first before upgrading to 4.x

[Moogle Stiltzkin]

did your 509 come from firmware 3.8.2 or below to 4.x?

I know there is an issue if your firmware is not upto 3.8.3 first before upgrading to 4.x

all i remember was the firmware said it was dated 2015 .... i'll see if i took any screencaps prior but i'm not holding my breath (cauz i probly didn't )



checking release notes this seems to be the most latest for 509 back in 2015

QTS 4.2.0 Build 0910


and for oldest in 2015 was the

QTS 4.1.3 Build 0217
( 2015/02/24 )

https://www.qnap.com/en/releasenotes/in ... ose=2&p=10


making an educated guess it's either 1 of these i had installed prior to updating firmware


As for how i upgraded to 2015 before that can't remember, it was too long ago


*update

Found a screencap

update qnap 509 pro.JPG

So most likely it was using this before my most recent firmware update QTS 4.2.0 Build 0910 or at the very least it's a 4.2.0 ...build....



Okay found this too. this is a sequence of events which led to this situation

hard drive scan qnap 509 pro.JPG

update from 4.2.0 (20150919) to 4.2.6 (20170628)

[Toxic17]

So really you are backing up to a possibly broken QNAP 509 firmware? Thats hardly the best scenario to be testing a beta application

[Moogle Stiltzkin]

So really you are backing up to a possibly broken QNAP 509 firmware?

could be, thats what i'm trying to find out.

Thats hardly the best scenario to be testing a beta application

but i would not know this unless i tested first now would i


also to be fair i did perform the update steps for a clean setup from scratch before i started testing.
- firmware update
- factory reset
- reinitialize
- extended smart scan hdd
- bad block scan
- sync raid5 complete








Not sure how it can possibly get any cleaner/factory reset settings than this to perform any beta test as far as a regular user would know.

anyway waiting on support to get back to me on this


but anyway don't worry i'll run a 2nd test but from 653a to 659 pro II later on ... again.... sigh

[Moogle Stiltzkin]

hmm My 459 Pro uses HBS 1.2.161226. it works, just it is not the latest version. it is also available for Your 509. does it not work at all?

could you test if the latest HBS work on your 459 pro ? cause i heard that the new hbs is only for 4.3.x what firmware are u using for it?

also i asked if using 653a with latest hbs, to a 509 pro using the default backup station will work fine in that setting. So it's not necessary then for both to be hbs to work. But i do agree for further testing i'll try later with the other unit that can actually run hbs as well later.

cause i have to unpowered, unconnect the 509 to set that up, cause i'm missing cables X_X: also already got a backup task ongoing already.

[Moogle Stiltzkin]

Ran another quick test for 653a to 509 pro for storage3 share. was much faster to run, and already submitted the logs for feedback ^-^;