[Syncthing] QPKG 1-0.14.4 ... Sync and Cloud private

This is the best place for community developers to publish their genius work. Your Apps enrich the QNAP Turbo NAS.
User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

[Syncthing] QPKG 1-0.14.4 ... Sync and Cloud private

Postby father_mande » Thu Aug 28, 2014 4:49 pm

Hi,

Please it's delivery of new QPKG : Syncthing 0.14.4

IF you have already installed Syncthing ... please use the internal update mechanism proposed ...

IT'S A MAJOR UPDATE
ALL nodes MUST BE updated at same time (no coexistence )
ANDROID client MUST see here : http://forum.qnap.com/viewtopic.php?f=3 ... 35#p515858

Please read carefully ... some specific to QNAP integration

[name]
Syncthing
syncthing_64.gif

Syncthing replaces proprietary sync and cloud services with something open, trustworthy and decentralized. Your data is your data alone and you deserve to choose where it is stored, if it is shared with some third party and how it's transmitted over the Internet


Version :
QPKG 1-014.4
... update syncthing (for new user or restore afrter a crash auto-update will work for others)
... inotify update to 0.8.3
... relaysrv NOW strelaysrv update
... discovery server is no more needed (integrated in Synncthing)

QPKG 1-0.12.22
... update syncthing (for new user or if internal update d'ont work as well (64 bits system on kernel 3.4) )
... update relaysrv to Build 185
... update inotify to Version 0.7
QPKG 1-0.12.19
Syncthing update (for new user or if internal update d'ont work as well)
QPKG 1-0.12.15
... also update of inotify to 0.6.8
QPKG 1-0.12.11
QPKG 1-0.12.7
==== Add discosrv
==== update syncthing, syncthing-inotify, relaysrv
QPKG 1-0.12.2
==== ADD support for TAS-x68 series =======
MAJOR UPDATE to 0.12 new version ...
ALL NODES MUST be changed at the same period ...
ADDING :
syncthing-inotify for 0.12
NEW strelaysrv (it's a private relay server to manage access from syncthing when you are behind a firewall without possibility to open port ...) public relay server exist with Public or private you can synchronize data even from a node inside office with only port 443 open in output ...
====== CHANGE =====
QPKG 1.0.11.25 (last for version 11 family)
Update of syncthing
====== CHANGE =======
... cli and notify for armel are NOW usable (the problem was that now it's no more possible (or easy) to build exec for other plate-form only native ...
... IDEM syncthing.amd64.static ... IS NO MORE AVAILABLE
... ... so to have auto-update use the 386 version or wait for my own update

IMPORTANT
For system with a x86_64 kernel ... I will now provide the 2 binary (x86_64 ... with lib ; and x86 without lib (static))
... add an option to set the x86 or the 64 bits version (it's for users where auto-update don't work with the 64 bits version)
... this work ONLY on x86_64 system with 64 bits kernels
command :
syncsh set_x86 or set_x86_64 ... this change executable and restart syncthing ... so you can switch between
status is reported in
syncsh status
QPKG 1-0.10.20
update syncthing to 0.10.20
*** Same version NOW for all Arm models
*** In QPKG directory a PDF file (Getting Started)

[QNAP's model supported]
ALL except old Arm x09 family
Install choice version based on kernel ...
x86-64 (NATIVE 64 bits) for 809, x69, x70, x51/53, x59 (starting with 459), etc.
x86 (32 bits) for 509, x39, 259 ...
Armv5 for Arm series x10, x12, x19, x20 etc. except x31 ...
Armv7 for Arm series x31 and TAS-x68

[Other platform supported by syncthing (not supply in QPKG)]
Windows
Others Linux x86 / x86_64
BSD
Mac OS
others armv5 , armv6, armv7
Android

[External Links ]
License, documentation, source code, credits : http://syncthing.net/
GETTING STARTED : https://discourse.syncthing.net/t/getting-started/46 (bypass installation)
ALSO provide as a PDF in QPKG folder (obtain using command : getcfg syncthing Install_Path -f /etc/config/qpkg.conf )

[QNAP specific]
GUI use the language of your browser ... so languages are supported (English, French, etc.) tested ONLY with Chrome
Web GUI Port used : 8090 accessible from ALL I.P. ATTENTION this is change using syncthing.conf file in QPKG folder NOT inside the product ... so value in GUI are still the default one 127.0.0.1 (localhost) 8080 ( changed ... because ... generally used by QNAP web admin)
User : only admin for the moment (in future release you can choice the user)
Upnpc : upnpc IGD network forwarding / mapping work as well (with compatible router) BUT use GUI to use it or not, verify if it's work on your own network ... YOU DON'T need it if you use only your internal network
config.xml file is in : /share/XXX_DATA/.qpkg/syncthing (XXX can be HDA, MD0, CACHEDEV1 etc.) or get the folder path using : getcfg syncthing Install_Path -f /etc/config/qpkg.conf

UPDATE QPKG 1.0
Change HOME folder to QPKG syncthing folder (NO MORE using /root )
Suppress any thing to do with default folder NOW in QPKG_FOLDER/Sync
ADD daemon-mgr task management (so on restart a delai from 0 to 30 sec can be done ...
ADD Rotate Log ... default YES ... in QPKG folder (when all run set Log OFF to avoid disk spin-down
ADD HTTPS access through Web Admin SSL Port (so can share certificate (unsigned or signed) with QNAP system
Support of AUTO update (internal) and specific command to update the syncthing version in qpkg.conf file

Command available :
syncsh

Code: Select all

 # syncsh
Usage is :
 /usr/bin/syncsh start|stop|restart
 /usr/bin/syncsh status [full]
 /usr/bin/syncsh qpkg_anable|qpkg_disable
 /usr/bin/syncsh set_log|unset_log (need a restart to be use
 AFTER internal Update you can change Syncthing version in QPKG
 /usr/bin/syncsh set_new_version VERSION ( example VERSION = 0.9.10 check in GUI after internal update )

UPDATE Syncthing to 0.9.10 ...

[Advices]
READ THE DOCUMENTATION ... read the documentation, read the documentation ... :lol: :lol:
INSTALL : please wait some delay before using the Syncthing Web Interface (Arm is more concerned) ... because at FIRST RUN ... Syncthing create certificate ... so take up to 30sec on Arm, BUT it's during the first run only
If you want a private syncthing network ... deactivate "Global Announcement" (Gui)
If you are in an internal network only ... suppress upnp (Gui)
If you add a user / password to close Web Gui access and lost it ... clear 2 corresponding lines in config.xml file in the "gui" section.
ATTENTION ... folder is scanned and data and index are encrypted using AES ... transfert use TLS ... SO this can consume LOT of CPU and memory in case of large folders and files ... with Arm system please get attention to this CPU / memory point ...
YOU CAN change the scanning delay (to search new or modified files) ... for the moment it is MANUALLY in config.xml BUT it's a REAL GOOD IDEA for Arm and low processor models
ATTENTION the first scan and encryption can take a long time for large (quantity and/or size) files
ALSO TAKE attention to your network capacity (ex. some ADSL have a small output throughput ... )
IMPORTANT optionaly you can define Folder as MASTER ... so change affect clone NOT the original
ATTENTION ... rescan of Upnp IGD is 30 mns ... change it in config.xml file if you want to increase it
ATTENTION ... seems that ONLY real folder can be used for synchronisation ... so don't use Link (T.B.C.)
Internal HTTPS can be used BUT ... this generate others UNSIGNED certificate ... so you can have to accept the exception ... the URL is same as previous BUT HTTPS
... this internal change is not reflected in QTS desktop (next release) better is to use the Apache SSL system Proxy ... so same certificate as QNAP's are used ... so also signed certificate if you own one and integrate in QNAP system.

[tested on]
TS-x53, TS-x69, TS-x59, TS-x19 (Armv5), TS-x31 (Armv7) , TAS-168 (armv7)

[Download]
1-0.14.4 : https://www.father-mande.ovh/Q/qpkg/syn ... 0.14.4.zip

1-0.12.22 : https://mega.nz/#!NptUSCCQ!21iYx7FkJUeJ ... 6xHCshsfDY
1-0.12.19 : https://mega.nz/#!JgMVgByK!LeJITyv2P4HO ... d3iScyhPgs

download others versions ... Windows, Mac, Linux, Bsd, etc.
https://github.com/syncthing/syncthing/ ... ag/v0.14.4
Android : http://forum.qnap.com/viewtopic.php?f=3 ... 35#p515858

PLEASE return experience ... for the product ... I don't support it ... it's supported by Syncthing team

Have fun.
Philippe.
You do not have the required permissions to view the files attached to this post.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

scounter
New here
Posts: 5
Joined: Sat Feb 19, 2011 8:28 am
Model: TS-419P

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby scounter » Sun Aug 31, 2014 12:35 am

Hey there, great work :)

unfortunately it dose not work for me.
Installation process is quick and without errors. After installation the app seems to be enabled but when I try to follow the link to the GUI
http://nas_ip:8090/

i have an NO connection website error.

I have reinstalled but still the same problem.
I searched for the config.xml file in
/syncthing/confi/

folder but there is no config file.

My system is an old
TS-419 P on latest TS-Firmware 4.1

Hope it will work for someone other.

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby father_mande » Sun Aug 31, 2014 4:20 am

Hi,

I have tested on my "old" TS-219 ... so

I will write here some info to start it manually and see the error ... (please wait ... I am busy and have no time now)

the config.xml is in /root/.config/syncthing ...

NB perhaps I have do a package error ... I provide all and select them based on uname -m ... perhaps I make a mix between some version ...
Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby father_mande » Sun Aug 31, 2014 3:41 pm

Hi,

I just redo a "fresh" install on my TS-219II and all run fine ???

The only diff. with Intel ... it's that you must wait some time before syncthing web is accessible ... because time to create all the private certificates use by syncthing for this specific node ...
This done ONE ... during the first start of syncthing

To have a "trace" of install ... I have also run it (after clean) in console mode ... so hereafter the trace (25 sec to wait before end of key generation ... )

Code: Select all

[/share/Public] # ./syncthing_0.9.9.qpkg
Install QNAP package on TS-NAS ...
syncthing.tgz
24089+1 records in
24089+1 records out
qinstall.sh
qpkg.cfg
Set QPKG information to /etc/config/qpkg.conf
Link service start/stop script: syncthing.sh
Start services: syncthing
09:31:02 INFO: Generating RSA key and certificate...
[T2T3R] 09:32:26 INFO: syncthing v0.9.9 (go1.3.1 linux-arm default) unknown-user@build.syncthing.net 2014-08-27 08:20:44 UTC
[T2T3R] 09:32:26 INFO: My ID: XXXXXXX-RGLKCCH-O2XXXJP-GRNJCIQ-XKIXXXX-VE6YPQT-FXXXX4C-MDBXXXX
[T2T3R] 09:32:26 INFO: No config file; starting with empty defaults
[T2T3R] 09:32:26 INFO: Edit /root/.config/syncthing/config.xml to taste or use the GUI
[T2T3R] 09:32:26 INFO: Starting web GUI on http://0.0.0.0:8090/
[T2T3R] 09:32:26 INFO: Performing initial repository scan
[T2T3R] 09:32:27 INFO: Created UPnP port mapping - external port 9785
[T2T3R] 09:32:27 INFO: Starting local discovery announcements
[T2T3R] 09:32:27 INFO: No IPv6 discovery possible (listen udp [ff32::5222]:21026: address family not supported by protocol)
[T2T3R] 09:32:27 INFO: Starting global discovery announcements
[T2T3R] 09:32:27 OK: Ready to synchronize default (read-write)
[T2T3R] 09:32:27 INFO: Node XXXXXXX-RGLKCCH-O2XXXJP-GRNJCIQ-XKIXXXX-VE6YPQT-FXXXX4C-MDBXXXX is "NAS219II-aphil" at [dynamic]

[/share/HDA_DATA] #


I have also tested the Web Access from QTS Desktop ... without problem ...

JUST : verify that syncthing run or not ... and that 8090 is not used by another QPKG or program ...

Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

scounter
New here
Posts: 5
Joined: Sat Feb 19, 2011 8:28 am
Model: TS-419P

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby scounter » Sun Aug 31, 2014 9:25 pm

Hey again.

Ok I've reinstalled by app manager and it still doesn't work for me.
Try to search for /root/..... but no config file was there.

But Installing manually seems to be working. I can access to the webgui.

Going to AppManager, deactivate and reactivate the app there, will take me back on No website found...
After I reboot my NAS i notice that a new RSA KEY will be generated and all my presets are gone but syncthing is available again on nas_ip:8090
Seems that this is happening on every reboot of the NAS.


NB: The scan interval for the default /Sync is zero, so the folder is permanently scanned. I don't know if you wanna it so :)

Greetings
Max

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby father_mande » Mon Sep 01, 2014 12:33 am

Hi,

I will check the installation procedure ... perhaps (certainly) I do some error in the script (it's the reason to said Beta QPKG)

YES the default /root/Sync folder have a scan interval to zero ... but as I said (in first post) , this Sync folder will be cleared at boot ... so immediately after the first run, suppress it and create a folder in a safe place (shared resource for ex.) ... normally the scan interval will be put at 60 sec. by default ...

For the moment you have to change the scanning interval manually ... the change done by QPKG is under test for next release (QPKG not Syncthing)

I don't notice any problem on my TS-219 ... so perhaps it's linked to another QPKG ... please can you print here the result of :
in a console
ll /root/.config/

Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

scounter
New here
Posts: 5
Joined: Sat Feb 19, 2011 8:28 am
Model: TS-419P

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby scounter » Mon Sep 01, 2014 6:52 pm

Hello,

maybe I expressed myself bad, because my english is not the best one.
I mean when I installed with qpkg there was no /root/.config/syncthing.... after manual installation there is. Sorry.

Anyway here is the output

Code: Select all

[~] # ll /root/.config/
drwxr-xr-x    2 admin    administ      1.0k Sep  1 08:43 ./
drwxr-xr-x    3 admin    administ      1.0k Sep  1 08:43 ../
lrwxrwxrwx    1 admin    administ        38 Sep  1 08:43 syncthing -> /share/HDA_DATA/.qpkg/syncthing/config/


Yes, I changed the scan interval manually, so no problem there.

Stupd question from a noob but, why do you have to create the default /root/Sync folder?

NB: Only to let you know. When I set to use https, i get an ssl_error_rx_record_too_long error code and the GUI is not available again. Maybe it's an error of my NAS or certificate I don't know.
Yes I know Beta is Beta XD and this is why I try to help you with the bugs I found. I can't programming so my only way to help is bugreporting


Greetings
Max

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby father_mande » Mon Sep 01, 2014 8:01 pm

Hi scounter,

Following your remarks I have done some extras tests (to don't have result based on my own install and not a full clean one)

I will test new things and discover some problem (not same result when started from App. Center or manually) ... different for each plate-form ...

I will output soon a new version ...

Sync folder is created in HOME of admin ... so /root ... and I don't change the code from syncthing ... BUT I have found (I think) a workaround ... but the zero for rscan is forced ... so only things to do is to change using the GUI ...

NOT sure that you can use the HTTPS include in syncthing (I have to search if it's not a library problem) ...

Next relase (QPKG not syncthing) add :
... use of daemon-mgr to manage / restart automatically syncthing (perhaps with a small delay on some restart after configuration change ... )
... add Logging (to have a trace of event) (based on request)
... add use of QNAP apache proxy for HTTPS external connection ...
... solve default sync folder creation ...
... suppress the need to have config file attach to /root ... so keep and clear ...

LOT of THANKS for your report ... I can test myself all ... but be sure that I try to understand any problem when you send me information ... and sometimes solve it ...
... generally we receive complaints as user is consumer and not proactive ...
... but active user with problem and explain ... help really to understand ... implementation problem ...

Thanks again.

Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] QPKG_BETA ... Sync and Cloud private

Postby father_mande » Tue Sep 02, 2014 7:33 pm

Hi,

Please find here before (post announcement)

the new version of the QPKG (also including last syncthing version 0.9.10)

QPKG version is now composed of :
QPKG version itself : 1.0 AND Syncthing version delivery

Fresh install after suppression is BETTER than update (to don't have residual files ... ) BUT work and clean will be done at next boot

QPKG Syncthing : 1.0-0.9.10
... if you auto update syncthing ... you can change the syncthing version to reflect it by a command (syncsh)

What new :
better management using daemon_mgr
ADD rotate Log default is YES ... must be change to NO when all run fine to avoid disk spin-off problem (small)
ADD HTTPS access using Web Admin Port : https://your_qnap:SSL_WEB_ADMIN_PORT/syncthing/
Suppress any link with /root ...
default folder is now in QPKG_FOLDER/Sync

Download Link is in the first post ... (same)
etc.

Have fun
Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

scounter
New here
Posts: 5
Joined: Sat Feb 19, 2011 8:28 am
Model: TS-419P

Re: [Syncthing] New QPKG 1.0 ... Sync and Cloud private

Postby scounter » Wed Sep 03, 2014 4:28 am

Hu, you're verry quick with updates, respect.

I will give it a try and let you know.

Good evening.


Greetings,
Max

scounter
New here
Posts: 5
Joined: Sat Feb 19, 2011 8:28 am
Model: TS-419P

Re: [Syncthing] New QPKG 1.0 ... Sync and Cloud private

Postby scounter » Sun Sep 07, 2014 2:00 am

OK, seems to work fine at the moment, very great yob :D

Thank you :)

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] New QPKG 1.0-0.9.13 ... Sync and Cloud priva

Postby father_mande » Mon Sep 08, 2014 11:51 pm

Hi,

Update of QPKG to Syncthing 0.9.13 version

Update can be done :
... using the QPKG OR
... using the internal update mechanism ...

Download in first post ... as before

Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] New QPKG 1.0-0.9.13 ... Sync and Cloud priva

Postby father_mande » Mon Sep 15, 2014 5:12 pm

Hi,

Update og QPKG to Syncthing 0.9.15 version

Update can be done :
... using the QPKG OR
... using the Internal update

Download link is same as before ... in first post : viewtopic.php?f=320&t=97035#p429896

Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68

User avatar
muldy
Starting out
Posts: 11
Joined: Wed Apr 30, 2014 3:45 am
Model: None

Re: [Syncthing] New QPKG 1.0-0.9.15 ... Sync and Cloud priva

Postby muldy » Fri Sep 19, 2014 12:44 am

I get a "Update failure: Invalid format error" on my qnap 420 on Qpkg install by ui :(

User avatar
father_mande
Experience counts
Posts: 4661
Joined: Mon Oct 06, 2008 6:52 pm
Model: TS-x53/x53S/453mini
Location: Saint Mande, France

Re: [Syncthing] New QPKG 1.0-0.9.15 ... Sync and Cloud priva

Postby father_mande » Fri Sep 19, 2014 12:59 am

Hi,

Did you unzip the file to obtain the .qpkg ... before installing ?

Philippe.
https://www.father-mande.ovh/
QNAP TS-109 Debian Jessie
QNAP TS-459, TS-219P II ... 4.2.2
QNAP TS-269, TS-431+
QNAP TS-x53, TVS-x73 ... 4.3.1/2 + UX-500P
Qgenie, TAS-x68


Return to “Community Apps”

Who is online

Users browsing this forum: kioskpirat and 1 guest