Hybrid Backup Sync to QVR Pro Folder error

QVR Pro, QVR Pro Client, QVR Center and Surveillance Station
Post Reply
DickyDck
Getting the hang of things
Posts: 56
Joined: Thu Dec 29, 2016 1:58 am

Hybrid Backup Sync to QVR Pro Folder error

Post by DickyDck » Wed Aug 29, 2018 2:09 am

Hi all, I have a ticket in with support about this but I figured I'd bounce it off you guys to see if you may have any suggestions.

I switched from the standard "Surveillance Station" to the new "QVR Pro" for the extra features and it is great. However when I was using Surviellance Station, I was able to use Hybrid Backup to have a continuous Sync of all the camera recorded files to my Google Drive.

When you setup the QVR package it creates some default folders

QVRProAppData
QVRProAutoSnap
QVRProDB
QVRProRecording
QVRProSpace_DataVol1

Now it seems that all the videos are stored in QVRProRecording so I setup a continuous sync with Hybrid Cloud Sync from this folder to my Google Drive, but I keep getting this error...

Failed to complete Sync Job: "Cloud Sync 1". Disk error. Check NAS disks

but if I use any other folder from the QVR created ones, the sync works fine, or any other folder on my NAS. It just seems to be this one folder that won't work. I've tried making the permission everyone R/W, no luck, tried with and without "oplocks" which also made no difference.

any ideas guys?

DickyDck
Getting the hang of things
Posts: 56
Joined: Thu Dec 29, 2016 1:58 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by DickyDck » Wed Aug 29, 2018 9:56 am

Is there anywhere to get a detailed verbose log for the error in the "Event Notifications"? I figure this is basically a linux box and should have a means to increase the level of logging and I can pinpoint what is causing this error.

QNAPAlanK
QNAP Staff
Posts: 109
Joined: Wed Sep 16, 2015 2:15 pm

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by QNAPAlanK » Wed Aug 29, 2018 6:51 pm

Hi DickyDck

This issue about back to Cloud (include Google Drive) is a known but fixed issue.
When QVR Pro 1.2 release, you could get it.
The estimated release date will be the end of Oct.

Thank you.

DickyDck
Getting the hang of things
Posts: 56
Joined: Thu Dec 29, 2016 1:58 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by DickyDck » Sun Sep 02, 2018 3:07 am

Thanks @QNAPAlanK, if it is a known issue has a memo been sent to all the support staff? I was on remote session a couple of days ago, and we ran a series of tests..

1. QVRProRecording to Google Drive = Fail
2. QVRProRecording to another folder on NAS = Success
3. QVRProRecording to another folder, then from other folder to Google Drive = Success
4. QVRProSpace_Data_vol1 to Google Drive = Success

if it is going to be fixed thats fine I can wait, right now I am stepping stone copying from the recordings folder to a staging area folder on the NAS and from that folder to the cloud. It works but it puts a lot of cycles on my drives and uses some more upload bandwidth.

User avatar
lithiumus
Starting out
Posts: 45
Joined: Tue Sep 27, 2016 11:22 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by lithiumus » Wed Mar 04, 2020 10:23 pm

A year and half later and this still does not work...

I am working with QNAP to try and fix this. I'm using HBS 3 and trying to sync the QVRProRecordings directory. I can't complete a sync as it starts to report that the cloud drive is out of space, then it reaches a maximum number of skipped files... then it is no longer able to reach the source directory and it never finishes a sync.

The workaround is the perform a QVR Pro backup to a directory outside of the QVRPro directories as these are container station directories then HBS sync that directory. The only issue with this workaround is that the shortest backup interval is 1 hour and that's hardly a real-time sync.

The real solution would be to allow QVR Pro to save or mirror / sync recordings outside of the Container Station QVRPro directories or enhance the QVRPro backup feature to be real-time or near real-time.

User avatar
lithiumus
Starting out
Posts: 45
Joined: Tue Sep 27, 2016 11:22 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by lithiumus » Thu Mar 05, 2020 12:43 am

After reading some ideas on the forum, here is a better workaround... note that HBS 3's Real-time Sync does not seem to be working properly, at least not with my testing so I am using Scheduled One-way Mirror Sync every 5 mins which is the minimum time interval.

Create an HBS 3 One-way Sync job from the the QVRProRecording directory to a directory outside of the QVRPro directories lets call it "testlocal". Set the schedule to Periodic 5 mins.
Create another HBS 3 One-way Mirror Sync job from the above "testlocal" directory to your cloud folder. Set the schedule to Periodic 5 mins but start it about 3-4 mins after the first job.

I've been testing this and it seems to be working. I'll still work with QNAP to see if they can fix the issue with HBS 3 so that this can be done in 1 job rather than 2 but at least this workaround seems to work properly.

User avatar
lithiumus
Starting out
Posts: 45
Joined: Tue Sep 27, 2016 11:22 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by lithiumus » Fri Apr 03, 2020 5:58 am

lithiumus wrote:
Thu Mar 05, 2020 12:43 am
After reading some ideas on the forum, here is a better workaround... note that HBS 3's Real-time Sync does not seem to be working properly, at least not with my testing so I am using Scheduled One-way Mirror Sync every 5 mins which is the minimum time interval.

Create an HBS 3 One-way Sync job from the the QVRProRecording directory to a directory outside of the QVRPro directories lets call it "testlocal". Set the schedule to Periodic 5 mins.
Create another HBS 3 One-way Mirror Sync job from the above "testlocal" directory to your cloud folder. Set the schedule to Periodic 5 mins but start it about 3-4 mins after the first job.

I've been testing this and it seems to be working. I'll still work with QNAP to see if they can fix the issue with HBS 3 so that this can be done in 1 job rather than 2 but at least this workaround seems to work properly.
Nope... using HBS 3 with the QVRProRecording directory does NOT work. Looks like the only option is to use the QVRPro's backup feature which only backs up once an hour. Then use HBS 3 to sync the backup directory to the Cloud which obviously introduces a 1 hour delay.

I've opened a support ticket and they have requested access to my NAS to troubleshoot...

spile
Know my way around
Posts: 134
Joined: Tue May 24, 2016 12:13 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by spile » Thu Jun 11, 2020 6:52 pm

I am about to install a new dual camera system on a TS-251 using QVR Pro. My plan was to limit storage space by making nightly backups to a Google Drive account. From reading this thread it would appear that this is not straight forward.

kuanghh
Starting out
Posts: 10
Joined: Sat Dec 29, 2012 12:40 pm

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by kuanghh » Tue Jun 16, 2020 4:01 pm

lithiumus wrote:
Fri Apr 03, 2020 5:58 am
lithiumus wrote:
Thu Mar 05, 2020 12:43 am
After reading some ideas on the forum, here is a better workaround... note that HBS 3's Real-time Sync does not seem to be working properly, at least not with my testing so I am using Scheduled One-way Mirror Sync every 5 mins which is the minimum time interval.

Create an HBS 3 One-way Sync job from the the QVRProRecording directory to a directory outside of the QVRPro directories lets call it "testlocal". Set the schedule to Periodic 5 mins.
Create another HBS 3 One-way Mirror Sync job from the above "testlocal" directory to your cloud folder. Set the schedule to Periodic 5 mins but start it about 3-4 mins after the first job.

I've been testing this and it seems to be working. I'll still work with QNAP to see if they can fix the issue with HBS 3 so that this can be done in 1 job rather than 2 but at least this workaround seems to work properly.
Nope... using HBS 3 with the QVRProRecording directory does NOT work. Looks like the only option is to use the QVRPro's backup feature which only backs up once an hour. Then use HBS 3 to sync the backup directory to the Cloud which obviously introduces a 1 hour delay.

I've opened a support ticket and they have requested access to my NAS to troubleshoot...
Have qnap guys found out how to achieve 1 job to sync the QVRProRecording directory?

spile
Know my way around
Posts: 134
Joined: Tue May 24, 2016 12:13 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by spile » Sat Jul 25, 2020 6:24 pm

I have been experimenting with this and found that syncing the whole of the QVRProRecording directory results in unpredictable results. I have a suspicion that this is because of the way that QVRPro creates these as virtual files.
I have had success in creating a sync job of the Standard Format / Event files.
In other words I ignored the QVI Format folder and also the Normal01 folder so only the Event01 folders were synced.
The job was set up as
QVRProRecording/File/Standard_Format > USB drive
With Rules > Apply Filters > Settings > Exclude file types > Other [/Normal01]
I appreciate that this is not maintaining a backup of ALL my recordings but at least i have a backup of events which is a reasonable compromise for me.

spile
Know my way around
Posts: 134
Joined: Tue May 24, 2016 12:13 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by spile » Mon Jul 27, 2020 4:17 pm

From QNAP:
"All "recording files" under shared folder QVRProRecording are actually the shortcuts / recording file indexs from the original recording files storaged in the Recording Space as you configured in QVR Pro.

QVR Pro uses "Fuse", which HBS3 doesn't support. It could be impossible or difficult for HBS3 to scan the changes in these QVR Pro shared folders and to backup or sync these changes to the target in real time.
You may create a schedule in this sync job or backup job , for example 1 or 2 hours. And check if this sync or backup job in HBS3 could work as expected."

spile
Know my way around
Posts: 134
Joined: Tue May 24, 2016 12:13 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by spile » Mon Jul 27, 2020 6:32 pm

I have created a Feature Request in our internal system > Mantis 62797: Q-202007-08351 Feature Request > QVR Pro > Recording Backup should support external hard disk.

dmstork
First post
Posts: 1
Joined: Wed May 31, 2017 6:38 am

Re: Hybrid Backup Sync to QVR Pro Folder error

Post by dmstork » Fri Jul 31, 2020 6:36 pm

spile wrote:
Sat Jul 25, 2020 6:24 pm
The job was set up as
QVRProRecording/File/Standard_Format > USB drive
With Rules > Apply Filters > Settings > Exclude file types > Other [/Normal01]
I appreciate that this is not maintaining a backup of ALL my recordings but at least i have a backup of events which is a reasonable compromise for me.
That doesn't work for me and get similar errors when synchronizing all recordings. Possible that the events are occurring too often for this to work.
I do try to mirror it to a webdav server instead of an USB, but the problem is with the source.

I'm contemplating creating a cronjob that will copy/mirror files every 5-10 minutes from the QVR folder to a normal share, hoping that will have a better error handling, and let HBS mirror the cronjob copy.
When I find the time and it works, I will try remembering posting my findings here. :-)

An offsite sync every 5 to 10 (15 max) minutes instead of continuous, is acceptable. But it would enhance the value of QVR if you could do an (near) instantaneous sync offsite to cloud storage without all the hassle or delays. 1 hour is just too large of an interval, ample time to find and destroy NAS recordings

Post Reply

Return to “Surveillance Solution”