HBS 3 Backup fails on ext. drive but Sync succeeds

[ThomasvB]

I've recently bough a WD Elements 12TB external hard disk to backup my TS-653D (latest QTS 5.0 edition). The external drive is NTFS formatted and connected to the USB One Touch Copy port. With HBS 3 all backup jobs fail after less than 1 minute, with no clear error messages (meta data not found?, drive cannot be located?); the HBS 3 Sync jobs however run without any problems (albeit very slow). What could be the cause of the backup problems? Could it be the NTFS format or is it something else? QNAP support information is not really helpful.

[dolbyman]

download the full debug report (3 dots in hbs3) and check for a more detailed error description

[ThomasvB]

Apparently there is a problem with diskspace? That doesn't make any sense.


[2022-08-12 20:05:54,409][ BakWorker][E][qnap.cloudconnector3.common.executor][executor.py:__call__:284] : Subtask error: TransferTask<{'_state': 'ERROR', '_exc_info': (<class 'ucc.exception.NasFullError'>, NasFullError(InsufficientSpaceError(OSError(28, 'No space left on device'))), <traceback object at 0x7fd96b854c48>), '_cancel': <threading.Event object at 0x7fd96b83e390>, '_on_finish': None, '_on_error': None, 'src_cc': <ucc.local.LocalClient object at 0x7fd96b85dfd0>, 'src_key': '/dedup/vault/u_0000000/0_00/1_00/2_00/3_00/4_00/5_00/6_00/0000000_0000000000000001.qdv', 'dst_cc': <qswiss.observer.MethodCallObservable object at 0x7fd96b86d160>, 'dst_key': 'dedup/vault/0000000_0000000000000/0000000_0000000000000001.qdv', 'src_record': LocalMetadata({'path': '/dedup/vault/u_0000000/0_00/1_00/2_00/3_00/4_00/5_00/6_00/0000000_0000000000000001.qdv', 'name': '0000000_0000000000000001.qdv', 'size': 49065398, 'is_dir': False, 'client_mtime': 1660327552, 'server_mtime': 1660327552, 'hash': {'mtime': 1660327552}, 'is_deleted': False, 'permission': None, 'version_id': None, 'lock_retention_until_utc_timestamp': None, 'ino': '24772997', 'old_ino': None, 'p_ino': '24772996', 'src_path': None, 'is_sparse': False, 'is_symbolic': False, 'dev': '64778'}, raw=Stat(st_mode=33152, st_ino=24772997, st_p_ino=24772996, st_blocks=95840, st_dev=64778, st_nlink=1, st_uid=0, st_gid=0, st_size=49065398, st_atime=1660327552, st_mtime=1660327552, st_ctime=1660327552)), 'dst_record': None, 'data': None, 'preprocessors': [], 'operation': 'UPLOAD', 'total_size': 49065398, 'transferred_size': 16777232, 'src_transferred_size': 16777232, 'dst_transferred_size': 16777232, 'name': '/dedup/vault/u_0000000/0_00/1_00/2_00/3_00/4_00/5_00/6_00/0000000_0000000000000001.qdv', 'start_time': 1660327553.9387648, 'start_monotonic_time': 5459125.0138740027, 'check_time': 0, 'storage_class': None, 'tagging': None, 'object_lock_retention_until': None, 'on_progress': None, 'client_mtime': None, 'compute_src_md5': True, 'download_version_id': None, 'src_md5': None, 'remote_version_id': None, 'lock_retention_until_utc_timestamp': None}>
Traceback (most recent call last):
File "/var/lib/jenkins/jobs/CC3_PY3_QPKG_Release/workspace/ARCH/x86_64/master/master/qpkg/output/shared/python/lib/python3.7/site-packages/ucc/common.py", line 94, in outter_func
File "/var/lib/jenkins/jobs/CC3_PY3_QPKG_Release/workspace/ARCH/x86_64/master/master/qpkg/output/shared/python/lib/python3.7/site-packages/ucc/local.py", line 600, in upload
File "/var/lib/jenkins/jobs/CC3_PY3_QPKG_Release/workspace/ARCH/x86_64/master/master/qpkg/output/shared/python/lib/python3.7/site-packages/ucc/local.py", line 292, in _upload
File "/share/CACHEDEV1_DATA/.qpkg/HybridBackup/CloudConnector3/python/lib/python3.7/tempfile.py", line 547, in NamedTemporaryFile
(fd, name) = _mkstemp_inner(dir, prefix, suffix, flags, output_type)
File "/share/CACHEDEV1_DATA/.qpkg/HybridBackup/CloudConnector3/python/lib/python3.7/tempfile.py", line 258, in _mkstemp_inner
fd = _os.open(file, flags, 0o600)
FileNotFoundError: [Errno 2] No such file or directory: '/share/Elements/Backup/NAS_TvB/Backup 1.qdff/dedup/vault/0000000_0000000000000/.nmayyp57'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/var/lib/jenkins/jobs/CC3_PY3_QPKG_Release/workspace/ARCH/x86_64/master/master/qpkg/output/shared/python/lib/python3.7/site-packages/qnap/cloudconnector3/backup/factory.py", line 1684, in upload
File "/var/lib/jenkins/jobs/CC3_PY3_QPKG_Release/workspace/ARCH/x86_64/master/master/qpkg/output/shared/python/lib/python3.7/site-packages/ucc/local.py", line 1040, in upload
File "/var/lib/jenkins/jobs/CC3_PY3_QPKG_Release/workspace/ARCH/x86_64/master/master/qpkg/output/shared/python/lib/python3.7/site-packages/ucc/common.py", line 96, in outter_func
File "/var/lib/jenkins/jobs/CC3_PY3_QPKG_Release/workspace/ARCH/x86_64/master/master/qpkg/output/shared/python/lib/python3.7/site-packages/ucc/local.py", line 60, in _exc_handle
ucc.exception.NotFoundError: [Errno 2] No such file or directory: '/share/Elements/Backup/NAS_TvB/Backup 1.qdff/dedup/vault/0000000_0000000000000/.nmayyp57'

[FSC830]

It does make sense!
Afaik the sync job just sync modified files. As long as there is enough disk capacity the sync succeeds.
A backup job checks in advance if there is enough capacity at target device.
So if you delete all data from the USB drive, at least the first backup job will most likely succeed.
For following backup jobs this is not guaranteed.

Regards

[ThomasvB]

The folder that I tried to backup contains 28.5 GB of data; my backup drive has 10TB free.
So no, there is more than enough space on the target drive. My feeling is that it has to do with the NTFS format on the target drive.
The NTFS format does not support changing file mode/owner. Maybe I should format the drive to exFAT.