[ RClone ] [ CLI ] [ 1.61.1 ] RSync for Cloud Storage

[QNAP_Stephane]

Source : http://rclone.org

Download : x86,x64 x19,x31,x41, arm64



https://www.myqnap.org/product/rclone/


Note :

unzip
install within Appcenter
log in SSH to test, rclone command line is added to NAS $PATH


WebUI implemented since 1.50 ... port 5572 , credential : qnap / qnap


About :

Rclone is a command line program to sync files and directories to and from

Google Drive
Amazon S3
Openstack Swift / Rackspace cloud files / Memset Memstore
Dropbox
Google Cloud Storage
Amazon Cloud Drive
Microsoft One Drive
Hubic
Backblaze B2
Yandex Disk
The local filesystem

Features

MD5/SHA1 hashes checked at all times for file integrity
Timestamps preserved on files
Partial syncs supported on a whole file basis
Copy mode to just copy new/changed files
Sync (one way) mode to make a directory identical
Check mode to check for file hash equality
Can sync to and from network, eg two different cloud accounts

[QNAP_Stephane]

updated

[itherseed]

Many thanks. I'll try this.

[Cadish]

This is working a lot better than the stock Hybrid Backup application from QNAP for syncing everything to Amazon Cloud Drive.

Thanks a lot!
Cadish

[rudycloud]

I have been looking for this for a long time!

[proxemics]

Are there any tutorials on setting this up?

[Cadish]

QNAP_Stephane, after a reboot I need to stop and start the app again, as the "command cannot be found"... Any idea how to fix this?

Thanks a lot in advance!
Cadish

[QNAP_Stephane]

basically on start command are added in NAS PATH via a symlink pointing to qpkg path

it is possible the application has some failure to start if many applications are starting on same RC level

may be try to edit /etc/qpkg.conf and find the RC_Number = in RClone section and put an higher number

[somy1982]

Appreciate if somebody can write a tutorial on how to use the tool to do continuous backup

[Cadish]

Very quick and rough tutorial, based on the headless configuration, as described here: http://rclone.org/remote_setup/

Desktop

• Install rclone on your computer
• Configure rclone and copy/paste the token

QNAP

• Install rclone on the QNAP
• Log in onto your QNAP via SSH on a terminal
• Configure rclone via headless setup, where you paste the token as generated on the desktop
• Move your config file somewhere else, where it won't be deleted after reboot
• Generate an exclusion list if necessary: http://rclone.org/filtering/
• Try the command as you wish: http://rclone.org/docs/
• Put this into a separate file which is runned by the crontab. Best tutorial I found to make a crontab change sticky is this: https://www.techandme.se/qnap-and-cron/

Note: I got an error x509 on Amazon Cloud Drive. To resolve this issue, you need to update the ssl roots, as described here (maybe with --insecure): http://rclone.org/faq/#rclone-gives-x50 ... ided-error. As soon as the QNAP reboots, you'll need to execute this command again, so added this command to my executable file.

Here's my executable file:

Code: Select all

#!/bin/sh
####################################
#
# Backup to Amazon Cloud Drive
#
####################################

#Load CA Certificates: http://rclone.org/faq/#rclone-gives-x509-failed-to-load-system-roots-and-no-roots-provided-error
curl --insecure -o /etc/ssl/certs/ca-certificates.crt https://raw.githubusercontent.com/bagder/ca-bundle/master/ca-bundle.crt

#Start the rclone command
rclone sync /share/Path/To/Files ACD:/Path/To/Files --transfers=1 --checkers=1 -q --delete-during --exclude-from=/share/Other/Path/rclone-exclude.txt --config=/share/Other/Path/.rclone.conf

Hope it helps someone...

Regards
Cadish

[somy1982]

Very quick and rough tutorial, based on the headless configuration, as described here: http://rclone.org/remote_setup/

Desktop

• Install rclone on your computer
• Configure rclone and copy/paste the token

QNAP

• Install rclone on the QNAP
• Log in onto your QNAP via SSH on a terminal
• Configure rclone via headless setup, where you paste the token as generated on the desktop
• Move your config file somewhere else, where it won't be deleted after reboot
• Generate an exclusion list if necessary: http://rclone.org/filtering/
• Try the command as you wish: http://rclone.org/docs/
• Put this into a separate file which is runned by the crontab. Best tutorial I found to make a crontab change sticky is this: https://www.techandme.se/qnap-and-cron/

Note: I got an error x509 on Amazon Cloud Drive. To resolve this issue, you need to update the ssl roots, as described here (maybe with --insecure): http://rclone.org/faq/#rclone-gives-x50 ... ided-error. As soon as the QNAP reboots, you'll need to execute this command again, so added this command to my executable file.

Here's my executable file:

Code: Select all

#!/bin/sh
####################################
#
# Backup to Amazon Cloud Drive
#
####################################

#Load CA Certificates: http://rclone.org/faq/#rclone-gives-x509-failed-to-load-system-roots-and-no-roots-provided-error
curl --insecure -o /etc/ssl/certs/ca-certificates.crt https://raw.githubusercontent.com/bagder/ca-bundle/master/ca-bundle.crt

#Start the rclone command
rclone sync /share/Path/To/Files ACD:/Path/To/Files --transfers=1 --checkers=1 -q --delete-during --exclude-from=/share/Other/Path/rclone-exclude.txt --config=/share/Other/Path/.rclone.conf

Hope it helps someone...

Regards
Cadish

Thanks! Very nice tutorial, will try it tonight!
One question: without a UI how do you know the progress and status of the cron job?

[Cadish]

One question: without a UI how do you know the progress and status of the cron job?

You don't know the progress/status. I log into ACD and see there that files are still being uploaded...
This lack of transparency is the only disadvantage of this method.

[QNAP_Stephane]

updated to 1.34

[benfishbus]

One question: without a UI how do you know the progress and status of the cron job?

You don't know the progress/status. I log into ACD and see there that files are still being uploaded...
This lack of transparency is the only disadvantage of this method.

I use the switch --log-file=/path/to/logfile.txt and then 'tail' the log file anytime I want to check status. Not ideal, as it doesn't provide a cumulative completion percentage. But you can at least check what it's doing.

[QNAP_Stephane]

updated to 1.35