[REQUEST] MergerFS
-
- Starting out
- Posts: 25
- Joined: Thu May 15, 2014 12:01 am
[REQUEST] MergerFS
@QNAP_Stephane can we have this qpkg with rclone/fuse?
https://github.com/trapexit/mergerfs
DESCRIPTION
mergerfs is a union filesystem geared towards simplifying storage and management of files across numerous commodity storage devices. It is similar to mhddfs, unionfs, and aufs.
FEATURES
Runs in userspace (FUSE)
Configurable behaviors
Support for extended attributes (xattrs)
Support for file attributes (chattr)
Runtime configurable (via xattrs)
Safe to run as root
Opportunistic credential caching
Works with heterogeneous filesystem types
Handling of writes to full drives (transparently move file to drive with capacity)
Handles pool of read-only and read/write drives
Turn read-only files into symlinks to increase read performance
Thank you very much!
https://github.com/trapexit/mergerfs
DESCRIPTION
mergerfs is a union filesystem geared towards simplifying storage and management of files across numerous commodity storage devices. It is similar to mhddfs, unionfs, and aufs.
FEATURES
Runs in userspace (FUSE)
Configurable behaviors
Support for extended attributes (xattrs)
Support for file attributes (chattr)
Runtime configurable (via xattrs)
Safe to run as root
Opportunistic credential caching
Works with heterogeneous filesystem types
Handling of writes to full drives (transparently move file to drive with capacity)
Handles pool of read-only and read/write drives
Turn read-only files into symlinks to increase read performance
Thank you very much!
-
- First post
- Posts: 1
- Joined: Fri Dec 21, 2018 4:02 pm
Re: [REQUEST] MergerFS
I would also like this qpkg!
or some other pointer of how to install mergerfs on QNAP
Thank you
or some other pointer of how to install mergerfs on QNAP
Thank you
- dolbyman
- Guru
- Posts: 35243
- Joined: Sat Feb 12, 2011 2:11 am
- Location: Vancouver BC , Canada
-
- Starting out
- Posts: 25
- Joined: Thu May 15, 2014 12:01 am
Re: [REQUEST] MergerFS
I end up use union function from RClone(https://rclone.org/union/ ), which gives similar functionality
- QNAP_Stephane
- Experience counts
- Posts: 4802
- Joined: Wed Mar 27, 2013 1:00 am
Re: [REQUEST] MergerFS
compiled and available for modern QTS NAS : https://www.qnapclub.eu/fr/qpkg/798
---------------------------------------------------------------------------------------------------------------------------
Find all QPKG in the MyQnap.org repository https://www.myqnap.org
join our discord server for any inquiry related to qpkg - https://discord.gg/4fPxHSWKQW
----------------------------------------------------------------------------------------------------------------------------
Find all QPKG in the MyQnap.org repository https://www.myqnap.org
join our discord server for any inquiry related to qpkg - https://discord.gg/4fPxHSWKQW
----------------------------------------------------------------------------------------------------------------------------
-
- Starting out
- Posts: 25
- Joined: Thu May 15, 2014 12:01 am
Re: [REQUEST] MergerFS
Thanks QNAP_Stephane!
Looks like the compiled mergerfs binary hardcoded to use /bin/mount in QNAP which doesn't support flag '--no-canonicalize'
is there a way we can point it to use /opt/bin/mount installed by entware?
or we need to manually link it to /bin/mount ?
Looks like the compiled mergerfs binary hardcoded to use /bin/mount in QNAP which doesn't support flag '--no-canonicalize'
Code: Select all
[/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # ls -lsa
total 20
4 drwxr-xr-x 5 admin administrators 4096 2019-09-12 10:10 ./
4 drwxr-xr-x 7 admin administrators 4096 2019-09-12 10:09 ../
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:09 dir1/
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir2/
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir3/
[/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # mergerfs ./dir1:./dir2 ./dir3
/bin/mount: unrecognized option '--no-canonicalize'
Usage: mount -V : print version
mount -h : print this help
mount : list mounted filesystems
mount -l : idem, including volume labels
So far the informational part. Next the mounting.
The command is `mount [-t fstype] something somewhere'.
Details found in /etc/fstab may be omitted.
mount -a [-t|-O] ... : mount all stuff from /etc/fstab
mount device : mount device at the known place
mount directory : mount known device here
mount -t type dev dir : ordinary mount command
Note that one does not really mount a device, one mounts
a filesystem (of the given type) found on the device.
One can also mount an already visible directory tree elsewhere:
mount --bind olddir newdir
or move a subtree:
mount --move olddir newdir
A device can be given by name, say /dev/hda1 or /dev/cdrom,
or by label, using -L label or by uuid, using -U uuid .
Other options: [-nfFrsvw] [-o options] [-p passwdfd].
For many more details, say man 8 mount .
or we need to manually link it to /bin/mount ?
- QNAP_Stephane
- Experience counts
- Posts: 4802
- Joined: Wed Mar 27, 2013 1:00 am
Re: [REQUEST] MergerFS
oh damned.. forgot this point... busybox way
need replace the mount/umount command by another one... grrrrrrr
need replace the mount/umount command by another one... grrrrrrr
---------------------------------------------------------------------------------------------------------------------------
Find all QPKG in the MyQnap.org repository https://www.myqnap.org
join our discord server for any inquiry related to qpkg - https://discord.gg/4fPxHSWKQW
----------------------------------------------------------------------------------------------------------------------------
Find all QPKG in the MyQnap.org repository https://www.myqnap.org
join our discord server for any inquiry related to qpkg - https://discord.gg/4fPxHSWKQW
----------------------------------------------------------------------------------------------------------------------------
-
- New here
- Posts: 4
- Joined: Fri Aug 26, 2016 11:23 pm
Re: [REQUEST] MergerFS
Hi,
@QNAP_Stephane Appear that mergerfs link is not available anymore https://www.qnapclub.eu/fr/qpkg/798
Can you fix?
Thank You
@QNAP_Stephane Appear that mergerfs link is not available anymore https://www.qnapclub.eu/fr/qpkg/798
Can you fix?
Thank You
- philippe.mande
- Getting the hang of things
- Posts: 94
- Joined: Sun Dec 23, 2018 6:15 pm
- Location: Saint-Mandé France
- Contact:
Re: [REQUEST] MergerFS
Hi,
Entware QPKG (+2500 packages) have a version of mergefs ... perhaps to test ...
Advantage, no adding one more QPKG but use existing one with internal update ...
Philippe.
Entware QPKG (+2500 packages) have a version of mergefs ... perhaps to test ...
Code: Select all
# opkg list | grep merge
mergerfs - 2.30.0-1 - mergerfs is a union filesystem geared towards simplifying storage and management of files across numerous commodity storage devices. It is similar to mhddfs, unionfs, and aufs.
Philippe.
New pseudo for Father_Mande (now closed) ...
QNAP TS-x53 Pro, TVS-x73, TS-x31+, TS-x28A DEAD ... and some oldest under Debian ... etc.
Asustor AS5002T ; AS1002T ... etc.
QNAP TS-x53 Pro, TVS-x73, TS-x31+, TS-x28A DEAD ... and some oldest under Debian ... etc.
Asustor AS5002T ; AS1002T ... etc.
-
- New here
- Posts: 4
- Joined: Fri Aug 26, 2016 11:23 pm
Re: [REQUEST] MergerFS
This works,philippe.mande wrote: ↑Sun Feb 07, 2021 4:59 pm Hi,
Entware QPKG (+2500 packages) have a version of mergefs ... perhaps to test ...
Advantage, no adding one more QPKG but use existing one with internal update ...Code: Select all
# opkg list | grep merge mergerfs - 2.30.0-1 - mergerfs is a union filesystem geared towards simplifying storage and management of files across numerous commodity storage devices. It is similar to mhddfs, unionfs, and aufs.
Philippe.
Thank you
-
- New here
- Posts: 4
- Joined: Fri Aug 26, 2016 11:23 pm
Re: [REQUEST] MergerFS
Hello again,
How to configure and use mergerfs in QNAP? i could create it correctly in ubuntu following some tutorial in internet but this couldn't be reproduced in QNAP because i can't create a service with systemctl i don't have the /etc/systemd folder. This folder is in other place or i can't get this to work in QNAP the same way in ubuntu? Can i use RunLast with mergerfs? Can someone point me the right way?
Thank you
How to configure and use mergerfs in QNAP? i could create it correctly in ubuntu following some tutorial in internet but this couldn't be reproduced in QNAP because i can't create a service with systemctl i don't have the /etc/systemd folder. This folder is in other place or i can't get this to work in QNAP the same way in ubuntu? Can i use RunLast with mergerfs? Can someone point me the right way?
Thank you
- OneCD
- Guru
- Posts: 12144
- Joined: Sun Aug 21, 2016 10:48 am
- Location: "... there, behind that sofa!"
Re: [REQUEST] MergerFS
Correct, QTS doesn't use SystemD (like Ubuntu), it uses the older SystemV-style service scripts.webcast wrote: ↑Sun Apr 18, 2021 10:36 am How to configure and use mergerfs in QNAP? i could create it correctly in ubuntu following some tutorial in internet but this couldn't be reproduced in QNAP because i can't create a service with systemctl i don't have the /etc/systemd folder. This folder is in other place or i can't get this to work in QNAP the same way in ubuntu?
If you've installed the 'mergerfs' package via 'opkg' (Entware), you can create your own SystemV-style init script containing your mount commands. Then put this script into [/opt/etc/init.d/], ensure the filename starts with an uppercase 'S', mark it as executable, and it will be automatically launched when Entware starts.
Check the 'mergerfs' integrated help for the command syntax:
Code: Select all
mergerfs --help
-
- New here
- Posts: 4
- Joined: Fri Aug 26, 2016 11:23 pm
Re: [REQUEST] MergerFS
Oh i see. Yes, i am working with Entware mergerfs package.
The problem is that i am not experienced with init.d, the things i am trying are not working at all.
Without worry about the mergerfs command can you put here the structure and steps to do please?
Also, how can i force this script to start only at the end when QNAP completly start and to be the last thing to init after a restart?
Thank you.
The problem is that i am not experienced with init.d, the things i am trying are not working at all.
Without worry about the mergerfs command can you put here the structure and steps to do please?
Also, how can i force this script to start only at the end when QNAP completly start and to be the last thing to init after a restart?
Thank you.
- philippe.mande
- Getting the hang of things
- Posts: 94
- Joined: Sun Dec 23, 2018 6:15 pm
- Location: Saint-Mandé France
- Contact:
Re: [REQUEST] MergerFS
Hi,
An init script ... is just a bash / sh script
... if you start a service (server) ... you must used the function provide (read the rc.func provide)
... if you start a "normal" script ... just put it in init.d folder
if script name start with S or have a suffix .sh ... it is launched in the current shell (so at root/admin when Entware start).
if not ... it is forked.
if name is like Snn ... nn is a number to define the order to start in Entware ...
As I know ... you don't be able to know easily when all QPKG are started ... but for QTS a file name /tmp/.boot_done is created ... if your problem is to be sure that all is mounted ... by default it's O.K. when QPKG start (Entware) ... except if a specific QPKG add and remove something but it's extremely rare.
in all case ... testing that folder in mergefs are on ... is always a good idea ...
LAST ... script is started in init phase of the QTS under root with limited environment ... so USE ONLY FULL PATHNAME for any command to avoid problem with PATH or command not found and SET any variable needed by your script.
Philippe.
An init script ... is just a bash / sh script
... if you start a service (server) ... you must used the function provide (read the rc.func provide)
... if you start a "normal" script ... just put it in init.d folder
if script name start with S or have a suffix .sh ... it is launched in the current shell (so at root/admin when Entware start).
if not ... it is forked.
if name is like Snn ... nn is a number to define the order to start in Entware ...
As I know ... you don't be able to know easily when all QPKG are started ... but for QTS a file name /tmp/.boot_done is created ... if your problem is to be sure that all is mounted ... by default it's O.K. when QPKG start (Entware) ... except if a specific QPKG add and remove something but it's extremely rare.
in all case ... testing that folder in mergefs are on ... is always a good idea ...
LAST ... script is started in init phase of the QTS under root with limited environment ... so USE ONLY FULL PATHNAME for any command to avoid problem with PATH or command not found and SET any variable needed by your script.
Philippe.
New pseudo for Father_Mande (now closed) ...
QNAP TS-x53 Pro, TVS-x73, TS-x31+, TS-x28A DEAD ... and some oldest under Debian ... etc.
Asustor AS5002T ; AS1002T ... etc.
QNAP TS-x53 Pro, TVS-x73, TS-x31+, TS-x28A DEAD ... and some oldest under Debian ... etc.
Asustor AS5002T ; AS1002T ... etc.
-
- First post
- Posts: 1
- Joined: Thu Mar 02, 2023 5:40 am
Re: [REQUEST] MergerFS
I met the same problem. Anybody managed to get it works?kitchenerer wrote: ↑Thu Sep 12, 2019 10:31 pm Thanks QNAP_Stephane!
Looks like the compiled mergerfs binary hardcoded to use /bin/mount in QNAP which doesn't support flag '--no-canonicalize'is there a way we can point it to use /opt/bin/mount installed by entware?Code: Select all
[/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # ls -lsa total 20 4 drwxr-xr-x 5 admin administrators 4096 2019-09-12 10:10 ./ 4 drwxr-xr-x 7 admin administrators 4096 2019-09-12 10:09 ../ 4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:09 dir1/ 4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir2/ 4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir3/ [/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # mergerfs ./dir1:./dir2 ./dir3 /bin/mount: unrecognized option '--no-canonicalize' Usage: mount -V : print version mount -h : print this help mount : list mounted filesystems mount -l : idem, including volume labels So far the informational part. Next the mounting. The command is `mount [-t fstype] something somewhere'. Details found in /etc/fstab may be omitted. mount -a [-t|-O] ... : mount all stuff from /etc/fstab mount device : mount device at the known place mount directory : mount known device here mount -t type dev dir : ordinary mount command Note that one does not really mount a device, one mounts a filesystem (of the given type) found on the device. One can also mount an already visible directory tree elsewhere: mount --bind olddir newdir or move a subtree: mount --move olddir newdir A device can be given by name, say /dev/hda1 or /dev/cdrom, or by label, using -L label or by uuid, using -U uuid . Other options: [-nfFrsvw] [-o options] [-p passwdfd]. For many more details, say man 8 mount .
or we need to manually link it to /bin/mount ?