Hybrid backup: Sync from Onedrive for Business takes for ages.

Backup, Restore, Netbak Replicator, Cloud Storage Services
Locked
User avatar
aarbee
Easy as a breeze
Posts: 387
Joined: Wed Feb 16, 2011 4:54 am

Hybrid backup: Sync from Onedrive for Business takes for ages.

Post by aarbee »

I have brought my customer to the cloud of Microsoft (Office365) on their request.
They also wanted a backup from the cloud to their old Qnap (TS-221).

I have made daily jobs. Mirroring from OneDrive4Business to the Cnap. Mo folder, tuesday folder etc.
And a spare Monthly backup (copyjob).
These 8 backups have been running good. Though calculating took 3-4 hours on their 20mbit ADSL line. For 150GB of data.
Since 6-7 weeks, does only the calculate. And calculating takes weeks. Until I stop the job.
CPU is constant at 80-90%. Until I stop the sync, then it drops to 10%.

The only thing that is still running is the monthly copy-backup job. That job runs for 45 minutes.

I wonder why the mirror is suddenly so slow. I do not want to use the copy job, as they might run out of Diskspace. Which is allready filled to 90%.
And my customer does not want to buy new ones.

Somebody a tip?
Thanks ahead.
Last edited by aarbee on Thu Aug 16, 2018 12:18 am, edited 1 time in total.
Friendly Greetings,

RobB

Main NAS:
Model: TS-253D - 20200725
Boot:- Raid 1: 2x 1 TB m.2 WD Red
Disks - 6TB WD Red, 350GB WD blue 2.5"

BACKUP NAS (On 2 hours a day due to Electricity costs)
Model: TvS-673 40GB (2*32+2*4) - 20170215
Boot:-Raid 1: 2x Crucial M.2 275GB 2x
Disks Raid 1:-3.5" 2x Toshiba 10 TB
UPS: Back-UPS Pro BR900G-GR
---

-----------------------------------------------------------------------------------------------------------------------------------------
Media Boxe: Nvidia ShieldTV Pro
-----------------------------------------------------------------------------------------------------------------------------------------
User avatar
aarbee
Easy as a breeze
Posts: 387
Joined: Wed Feb 16, 2011 4:54 am

Re: Hybrid backup: Sync from Onedrive for Business takes for ages.

Post by aarbee »

Nobody?
Sync is counting files for nearly a week now. And zero progression.
It seems that a copy works, but not a sync (Oneway).
Friendly Greetings,

RobB

Main NAS:
Model: TS-253D - 20200725
Boot:- Raid 1: 2x 1 TB m.2 WD Red
Disks - 6TB WD Red, 350GB WD blue 2.5"

BACKUP NAS (On 2 hours a day due to Electricity costs)
Model: TvS-673 40GB (2*32+2*4) - 20170215
Boot:-Raid 1: 2x Crucial M.2 275GB 2x
Disks Raid 1:-3.5" 2x Toshiba 10 TB
UPS: Back-UPS Pro BR900G-GR
---

-----------------------------------------------------------------------------------------------------------------------------------------
Media Boxe: Nvidia ShieldTV Pro
-----------------------------------------------------------------------------------------------------------------------------------------
2root4u
First post
Posts: 1
Joined: Thu Aug 23, 2018 6:44 am

Re: Hybrid backup: Sync from Onedrive for Business takes for ages.

Post by 2root4u »

I have a similar situation. I have a directory with about 300k files. I'm trying to use Hybrid Backup Sync to copy them to the cloud (although my destination is Amazon Drive), and the calculation takes days. During that time, it does transfer files, but only a few thousand a day. I have an older NAS, but it is not pegging the memory or CPU. It seems like Hybrid Backup simply can't to handle that many files.

I'm looking to buy a newer NAS (maybe QNap) which could help, but I'm concerned that this is an issue with the python script used for Hybrid Sync and not a horsepower issue. Is anyone else out there using Hybrid for massive amounts of cloud backup jobs successfully?
User avatar
aarbee
Easy as a breeze
Posts: 387
Joined: Wed Feb 16, 2011 4:54 am

Re: Hybrid backup: Sync from Onedrive for Business takes for ages.

Post by aarbee »

I did change the sync to a copy.
And I saw progression. 97 files in 3 days.

CPU is at 100%. Memory 50-70% I thought. CPU is very weak in this device.
I can hardly let my customer buy a new device, where the device was perfect for serving the files.

Thanks for telling me, you had the same issue.
Friendly Greetings,

RobB

Main NAS:
Model: TS-253D - 20200725
Boot:- Raid 1: 2x 1 TB m.2 WD Red
Disks - 6TB WD Red, 350GB WD blue 2.5"

BACKUP NAS (On 2 hours a day due to Electricity costs)
Model: TvS-673 40GB (2*32+2*4) - 20170215
Boot:-Raid 1: 2x Crucial M.2 275GB 2x
Disks Raid 1:-3.5" 2x Toshiba 10 TB
UPS: Back-UPS Pro BR900G-GR
---

-----------------------------------------------------------------------------------------------------------------------------------------
Media Boxe: Nvidia ShieldTV Pro
-----------------------------------------------------------------------------------------------------------------------------------------
ittayd
Starting out
Posts: 12
Joined: Sun Mar 18, 2018 10:24 pm

Re: Hybrid backup: Sync from Onedrive for Business takes for ages.

Post by ittayd »

Same issue here. Really looks bad.... One of the main reasons I bought the NAS was for OneDrive sync.
k8chu1
New here
Posts: 4
Joined: Tue Jun 20, 2017 2:27 am

Re: Hybrid backup: Sync from Onedrive for Business takes for ages.

Post by k8chu1 »

The same issue with Backblaze cloud.
It looks like it started on March 9 (based on the log).

It's very frustrating.
Locked

Return to “Backup & Restore”