External backup to USB drive - hours spent on "Updates"?

Backup, Restore, Netbak Replicator, Cloud Storage Services
losdelrock
Getting the hang of things
Posts: 79
Joined: Mon Mar 26, 2012 5:36 am
Location: Gibraltar, Europe - currently not recognised by Google or Apple in their stores.

Re: External backup to USB drive - hours spent on "Updates"?

Post by losdelrock »

Similar Issues to the one I logged with QNAP.

viewtopic.php?f=15&t=130385&e=1&view=unread#unread

4.3.3 has broken external backups.

I thought the latest update had fixed it but now I am getting 100% CPU usage (kernel_process) and the job is sitting at 68% saying 176 hours and 40 minutes to go.

I am using EXT4 as the file system.

I will update QNAP support accordingly,

Adrian.
dnp1611
Starting out
Posts: 13
Joined: Tue May 23, 2017 11:14 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by dnp1611 »

same issue with a ts-451+ on latest available release 4.3.3, using backup station to backup to an external usb drive. in this case the usb HDD formatted to NTFS.

this was working as expected with their previous major version of their firmware - it was copying files that were new or changed from the nas box to a connected external usb hard drive formatted with NTFS - now it copies the all the files even when not modified.

if the backup starts to copy all files across ( call it a refresh) i can foresee several major issues:

it uses more resources and takes more time;
users come to expect long lists of copied files during backup;
it makes it more likely that ransomware affecting the NAS then affects the off-line backups;
it is much less likely that you will notice that all your files are now encrypted as you are used to the long backup times.

initially i thought it was the usual compatibility issues between linux and windows file systems like FAT32 and NTFS which are well documented:
https://serverfault.com/questions/54949 ... ile-system

AFAIK FAT32 and NTFS dont support owner and group and FAT32 has a lower precision for time. issues can be avoided by selecting suitable options such as the Rsync --modify-window=1 or --file-only etc. if u did not account for this the copy process would assume the files on the destination were older and refresh or overwrite them.

few years ago i ran across the FAT32 issue with backup station app and qnap support were unaware of the issue. they suggested updating to the latest firmware etc which made no difference. i solved it (at that time) by using NTFS. (they claim compatibility with windows systems? )

but i see there are reports that this bug is affecting backups to ext4 based usb hard drives.

why not test for this issue as part of their standardised pre-production tests - from my point of view the NAS is primarily for data preservation and security and therefore off line backup via usb is an important part of this primary requirement.
brossyg
Know my way around
Posts: 106
Joined: Fri Aug 28, 2009 10:38 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by brossyg »

I have exactly the same issue with a TS-453A ... it takes over 40 minutes for an incremental 2-3GB to be backed up to an external Seagate drive.
Ron1963
Been there, done that
Posts: 530
Joined: Wed Apr 28, 2010 9:22 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by Ron1963 »

oyvindo wrote:I can confirm after upgrading to 4.3.3.0189 Build 20170517, everything now works ok.
Fixed it for me as well on my 253.
1x TS251, 1x TS251D, 1x TS253
alfke
New here
Posts: 9
Joined: Sat Nov 19, 2016 2:29 am

Re: External backup to USB drive - hours spent on "Updates"?

Post by alfke »

It didn't fix it for me for my 453 Pro. I downgraded the firmware and everything is now working correctly. I opened a ticket and provided my log files. Qnap has acknowledged the bug and were very helpful.
DavebHC71
Starting out
Posts: 20
Joined: Wed Apr 13, 2016 4:41 am

Re: External backup to USB drive - hours spent on "Updates"?

Post by DavebHC71 »

If you can tell us...is it the firmware or Hybrid Backup that has the 'bug'? And, what version of the firmware did you downgrade to?
Ron1963
Been there, done that
Posts: 530
Joined: Wed Apr 28, 2010 9:22 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by Ron1963 »

Ron1963 wrote:
oyvindo wrote:I can confirm after upgrading to 4.3.3.0189 Build 20170517, everything now works ok.
Fixed it for me as well on my 253.
I have to correct myself. It was fixed when using a NTFS drive in an USB3 enclosure without encryption. I now found out my encrypted EXT4 drive, using an USB2 enclosure, still has the problem.
1x TS251, 1x TS251D, 1x TS253
alfke
New here
Posts: 9
Joined: Sat Nov 19, 2016 2:29 am

Re: External backup to USB drive - hours spent on "Updates"?

Post by alfke »

It was the firmware version. I downgraded to the February 2017 firmware release. No issues at all.
horgaa
Starting out
Posts: 10
Joined: Wed Apr 26, 2017 6:24 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by horgaa »

I haven't had time to try the most recent 4.3.3 builds but I can confirm that 4.2.5 is fine for my model TS-563
QNAP seem to have made a complete mess of 4.3.3 so I think I will just stick with 4.2.5 until 4.3.4 or later comes out
se2k
Starting out
Posts: 23
Joined: Fri Apr 06, 2012 10:59 am

Re: External backup to USB drive - hours spent on "Updates"?

Post by se2k »

Just wanted to let everyone know that I got an update from QNAP tech support a few days ago indicating that they fixed the issue internally and should be in the next firmware:

"It looks like it was fixed on an internal build some time ago, so it should be released on the next official firmware release. Please keep your eye out for that, and check the release notes to see if this fix was included.

Best regards,

Daniel Lei
QNAP, Inc.
US. Tech Support"

I asked them if they could provide a QFIX for it, but I haven't received a reply. At least we know it was fixed and should be in the next firmware!
Ron1963
Been there, done that
Posts: 530
Joined: Wed Apr 28, 2010 9:22 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by Ron1963 »

Ron1963 wrote:
Ron1963 wrote:
oyvindo wrote:I can confirm after upgrading to 4.3.3.0189 Build 20170517, everything now works ok.
Fixed it for me as well on my 253.
I have to correct myself. It was fixed when using a NTFS drive in an USB3 enclosure without encryption. I now found out my encrypted EXT4 drive, using an USB2 enclosure, still has the problem.
New build 4.3.3 build 0210 20170606 fixed it also for my EXT4 encrypted drive. No mention of the fix in the release notes though.
1x TS251, 1x TS251D, 1x TS253
michwenk
New here
Posts: 4
Joined: Mon May 01, 2017 5:50 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by michwenk »

Did someone try the new 4.3.3.0210 on a TS-251/TS-251+/TS-251C/TS-451/TS-451+/TS-451S/TS-651/TS-851 with a NTFS backup disk connected via USB ?
User avatar
oyvindo
Experience counts
Posts: 1399
Joined: Tue May 19, 2009 2:08 am
Location: Norway, Oslo

Re: External backup to USB drive - hours spent on "Updates"?

Post by oyvindo »

Just upgraded. Will try tonight and report back tomorrow.
ImageImageImage
JohnQ
New here
Posts: 2
Joined: Sun Mar 19, 2017 3:19 pm

Re: External backup to USB drive - hours spent on "Updates"?

Post by JohnQ »

4.3.3.0210 build 20170606 fixed the issue for me, backup time (with no updates or additions) went from 7h back to 6 min.

Cheers!
se2k
Starting out
Posts: 23
Joined: Fri Apr 06, 2012 10:59 am

Re: External backup to USB drive - hours spent on "Updates"?

Post by se2k »

I can also confirm that firmware 4.3.3.0210 build 20170606 fixed the issue on my TS-563. Strange that they didn't specifically mention this fix in the Change Log.
Locked

Return to “Backup & Restore”