Page 1 of 1

azure backup keeps failing

Posted: Fri Oct 28, 2016 6:25 pm
by bkbartje
Hi,

I have an issue with the azure backup, ik keeps failing and I'm struggling with this for a couple of weeks now. I tried a lot, I even tried to remove all the settings and initiate them again,
still my azure backup doensn't work.
at the moment the error in the logfile is the following:
[AzureStorage] Backup job [Archief->Backup2016/backup] is abnormally shutdown. Please try again
but I keep getting this error.
what can I do about this?

Regards

Bart

Re: azure backup keeps failing

Posted: Wed Nov 09, 2016 3:58 pm
by bkbartje
Hi,
no Response yet?
I've checked some logfiles and what I found whas this error was the last thing in the logfiles
2016-11-08 14:34:19,222 PID:16063 backupscannerworkerthread.py:318 cc INFO identical, skip /<path to file>/._header_domoticazorg.png
2016-11-08 14:34:21,890 PID:16063 backupscannerworkerthread.py:732 cc INFO Archief->backup2016/backup change sub_state to Uploading
2016-11-08 14:34:22,359 PID:16063 backupscannerworkerthread.py:746 cc INFO Archief->backup2016/backup Uploading files
2016-11-08 14:40:16,540 PID:16063 backupscannerworkerthread.py:753 cc INFO Archief->backup2016/backup Scan State Files
2016-11-08 16:41:44,689 PID:16063 azureconnector.py:463 cc ERROR delete
Traceback (most recent call last):
File "./package/src/shared/bin/connector/azureconnector.py", line 442, in delete
File "./package/src/shared/python-lib/azure/storage/blobservice.py", line 713, in delete_blob
File "./package/src/shared/python-lib/azure/storage/storageclient.py", line 138, in _perform_request
File "./package/src/shared/python-lib/azure/storage/storageclient.py", line 127, in _perform_request_worker
File "./package/src/shared/python-lib/azure/http/httpclient.py", line 124, in perform_request
File "./package/src/shared/python-lib/azure/http/httpclient.py", line 110, in send_request_headers
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 991, in endheaders
self._send_output(message_body)
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 844, in _send_output
self.send(msg)
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 806, in send
self.connect()
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 1209, in connect
raise e
timeout: timed out
2016-11-09 02:40:03,777 PID:2935 engine.py:1003 cc INFO clear watchdog and var/garbage folder
does anyone have any suggestions for me?

thank you.

Re: azure backup keeps failing

Posted: Wed Nov 09, 2016 4:00 pm
by bkbartje
Hi,
no Response yet?
I've checked some logfiles and what I found whas this error was the last thing in the logfiles
2016-11-08 14:34:19,222 PID:16063 backupscannerworkerthread.py:318 cc INFO identical, skip /<path to file>/._header_domoticazorg.png
2016-11-08 14:34:21,890 PID:16063 backupscannerworkerthread.py:732 cc INFO Archief->backup2016/backup change sub_state to Uploading
2016-11-08 14:34:22,359 PID:16063 backupscannerworkerthread.py:746 cc INFO Archief->backup2016/backup Uploading files
2016-11-08 14:40:16,540 PID:16063 backupscannerworkerthread.py:753 cc INFO Archief->backup2016/backup Scan State Files
2016-11-08 16:41:44,689 PID:16063 azureconnector.py:463 cc ERROR delete
Traceback (most recent call last):
File "./package/src/shared/bin/connector/azureconnector.py", line 442, in delete
File "./package/src/shared/python-lib/azure/storage/blobservice.py", line 713, in delete_blob
File "./package/src/shared/python-lib/azure/storage/storageclient.py", line 138, in _perform_request
File "./package/src/shared/python-lib/azure/storage/storageclient.py", line 127, in _perform_request_worker
File "./package/src/shared/python-lib/azure/http/httpclient.py", line 124, in perform_request
File "./package/src/shared/python-lib/azure/http/httpclient.py", line 110, in send_request_headers
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 991, in endheaders
self._send_output(message_body)
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 844, in _send_output
self.send(msg)
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 806, in send
self.connect()
File "/share/MD0_DATA/.qpkg/AzureStorage/python/lib/python2.7/httplib.py", line 1209, in connect
raise e
timeout: timed out
2016-11-09 02:40:03,777 PID:2935 engine.py:1003 cc INFO clear watchdog and var/garbage folder
does anyone have any suggestions for me?

thank you.

Re: azure backup keeps failing

Posted: Tue May 30, 2017 7:52 pm
by bkbartje
Hi Guys,
once again the same question,
I was able to fix the issue above by excluding all folders from the backup, and then add them one by one and it worked.
up untill the moment we added a huge amount off files.
If a system retires we copy all the data to our QNAP NAS so just in case users can access data if needed. an action like this adds 200 to 500GB to the QNAP storrage.
and while doing that, the issues are happening abain.

It looks like when there is a timeout or a small connection interruption the Azure backup stops and doesn't try again.

would it be possible that in case of an error azure backup tries adding the file again for infinite of a configurable amount of times?
In this case the backup task will probably finish some day and then it only has to update the changed data again.