[REQUEST] MergerFS

Ask community developers’ help for your most wanted Apps and also discover what the hottest and ultimate Apps are.
kitchenerer
Starting out
Posts: 25
Joined: Thu May 15, 2014 12:01 am

[REQUEST] MergerFS

Post by kitchenerer »

@QNAP_Stephane can we have this qpkg with rclone/fuse?

https://github.com/trapexit/mergerfs

DESCRIPTION

mergerfs is a union filesystem geared towards simplifying storage and management of files across numerous commodity storage devices. It is similar to mhddfs, unionfs, and aufs.

FEATURES

Runs in userspace (FUSE)
Configurable behaviors
Support for extended attributes (xattrs)
Support for file attributes (chattr)
Runtime configurable (via xattrs)
Safe to run as root
Opportunistic credential caching
Works with heterogeneous filesystem types
Handling of writes to full drives (transparently move file to drive with capacity)
Handles pool of read-only and read/write drives
Turn read-only files into symlinks to increase read performance


Thank you very much!
lasseman
First post
Posts: 1
Joined: Fri Dec 21, 2018 4:02 pm

Re: [REQUEST] MergerFS

Post by lasseman »

I would also like this qpkg!
or some other pointer of how to install mergerfs on QNAP
Thank you
User avatar
dolbyman
Guru
Posts: 34903
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: [REQUEST] MergerFS

Post by dolbyman »

kitchenerer
Starting out
Posts: 25
Joined: Thu May 15, 2014 12:01 am

Re: [REQUEST] MergerFS

Post by kitchenerer »

I end up use union function from RClone(https://rclone.org/union/ ), which gives similar functionality
User avatar
QNAP_Stephane
Experience counts
Posts: 4802
Joined: Wed Mar 27, 2013 1:00 am

Re: [REQUEST] MergerFS

Post by QNAP_Stephane »

compiled and available for modern QTS NAS : https://www.qnapclub.eu/fr/qpkg/798
---------------------------------------------------------------------------------------------------------------------------

Find all QPKG in the MyQnap.org repository https://www.myqnap.org
join our discord server for any inquiry related to qpkg - https://discord.gg/4fPxHSWKQW

----------------------------------------------------------------------------------------------------------------------------
kitchenerer
Starting out
Posts: 25
Joined: Thu May 15, 2014 12:01 am

Re: [REQUEST] MergerFS

Post by kitchenerer »

Thanks QNAP_Stephane!

Looks like the compiled mergerfs binary hardcoded to use /bin/mount in QNAP which doesn't support flag '--no-canonicalize'

Code: Select all

[/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # ls -lsa
total 20
4 drwxr-xr-x 5 admin administrators 4096 2019-09-12 10:10 ./
4 drwxr-xr-x 7 admin administrators 4096 2019-09-12 10:09 ../
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:09 dir1/
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir2/
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir3/
[/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # mergerfs ./dir1:./dir2 ./dir3
/bin/mount: unrecognized option '--no-canonicalize'
Usage: mount -V                 : print version
       mount -h                 : print this help
       mount                    : list mounted filesystems
       mount -l                 : idem, including volume labels
So far the informational part. Next the mounting.
The command is `mount [-t fstype] something somewhere'.
Details found in /etc/fstab may be omitted.
       mount -a [-t|-O] ...     : mount all stuff from /etc/fstab
       mount device             : mount device at the known place
       mount directory          : mount known device here
       mount -t type dev dir    : ordinary mount command
Note that one does not really mount a device, one mounts
a filesystem (of the given type) found on the device.
One can also mount an already visible directory tree elsewhere:
       mount --bind olddir newdir
or move a subtree:
       mount --move olddir newdir
A device can be given by name, say /dev/hda1 or /dev/cdrom,
or by label, using  -L label  or by uuid, using  -U uuid .
Other options: [-nfFrsvw] [-o options] [-p passwdfd].
For many more details, say  man 8 mount .
is there a way we can point it to use /opt/bin/mount installed by entware?
or we need to manually link it to /bin/mount ?
User avatar
QNAP_Stephane
Experience counts
Posts: 4802
Joined: Wed Mar 27, 2013 1:00 am

Re: [REQUEST] MergerFS

Post by QNAP_Stephane »

oh damned.. forgot this point... busybox way

need replace the mount/umount command by another one... grrrrrrr
---------------------------------------------------------------------------------------------------------------------------

Find all QPKG in the MyQnap.org repository https://www.myqnap.org
join our discord server for any inquiry related to qpkg - https://discord.gg/4fPxHSWKQW

----------------------------------------------------------------------------------------------------------------------------
webcast
New here
Posts: 4
Joined: Fri Aug 26, 2016 11:23 pm

Re: [REQUEST] MergerFS

Post by webcast »

Hi,

@QNAP_Stephane Appear that mergerfs link is not available anymore https://www.qnapclub.eu/fr/qpkg/798
Can you fix?

Thank You
User avatar
philippe.mande
Getting the hang of things
Posts: 94
Joined: Sun Dec 23, 2018 6:15 pm
Location: Saint-Mandé France
Contact:

Re: [REQUEST] MergerFS

Post by philippe.mande »

Hi,

Entware QPKG (+2500 packages) have a version of mergefs ... perhaps to test ...

Code: Select all

# opkg list | grep merge
mergerfs - 2.30.0-1 - mergerfs is a union filesystem geared towards simplifying storage and management of files across numerous commodity storage devices. It is similar to mhddfs, unionfs, and aufs.
Advantage, no adding one more QPKG but use existing one with internal update ...

Philippe.
New pseudo for Father_Mande (now closed) ...
QNAP TS-x53 Pro, TVS-x73, TS-x31+, TS-x28A DEAD ... and some oldest under Debian ... etc.
Asustor AS5002T ; AS1002T ... etc.
webcast
New here
Posts: 4
Joined: Fri Aug 26, 2016 11:23 pm

Re: [REQUEST] MergerFS

Post by webcast »

philippe.mande wrote: Sun Feb 07, 2021 4:59 pm Hi,

Entware QPKG (+2500 packages) have a version of mergefs ... perhaps to test ...

Code: Select all

# opkg list | grep merge
mergerfs - 2.30.0-1 - mergerfs is a union filesystem geared towards simplifying storage and management of files across numerous commodity storage devices. It is similar to mhddfs, unionfs, and aufs.
Advantage, no adding one more QPKG but use existing one with internal update ...

Philippe.
This works,
Thank you
webcast
New here
Posts: 4
Joined: Fri Aug 26, 2016 11:23 pm

Re: [REQUEST] MergerFS

Post by webcast »

Hello again,

How to configure and use mergerfs in QNAP? i could create it correctly in ubuntu following some tutorial in internet but this couldn't be reproduced in QNAP because i can't create a service with systemctl i don't have the /etc/systemd folder. This folder is in other place or i can't get this to work in QNAP the same way in ubuntu? Can i use RunLast with mergerfs? Can someone point me the right way?

Thank you
User avatar
OneCD
Guru
Posts: 12010
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [REQUEST] MergerFS

Post by OneCD »

webcast wrote: Sun Apr 18, 2021 10:36 am How to configure and use mergerfs in QNAP? i could create it correctly in ubuntu following some tutorial in internet but this couldn't be reproduced in QNAP because i can't create a service with systemctl i don't have the /etc/systemd folder. This folder is in other place or i can't get this to work in QNAP the same way in ubuntu?
Correct, QTS doesn't use SystemD (like Ubuntu), it uses the older SystemV-style service scripts.
webcast wrote: Sun Apr 18, 2021 10:36 am Can i use RunLast with mergerfs? Can someone point me the right way?
If you've installed the 'mergerfs' package via 'opkg' (Entware), you can create your own SystemV-style init script containing your mount commands. Then put this script into [/opt/etc/init.d/], ensure the filename starts with an uppercase 'S', mark it as executable, and it will be automatically launched when Entware starts. ;)

Check the 'mergerfs' integrated help for the command syntax:

Code: Select all

mergerfs --help

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
webcast
New here
Posts: 4
Joined: Fri Aug 26, 2016 11:23 pm

Re: [REQUEST] MergerFS

Post by webcast »

Oh i see. Yes, i am working with Entware mergerfs package.
The problem is that i am not experienced with init.d, the things i am trying are not working at all.
Without worry about the mergerfs command can you put here the structure and steps to do please?
Also, how can i force this script to start only at the end when QNAP completly start and to be the last thing to init after a restart?

Thank you.
User avatar
philippe.mande
Getting the hang of things
Posts: 94
Joined: Sun Dec 23, 2018 6:15 pm
Location: Saint-Mandé France
Contact:

Re: [REQUEST] MergerFS

Post by philippe.mande »

Hi,

An init script ... is just a bash / sh script
... if you start a service (server) ... you must used the function provide (read the rc.func provide)
... if you start a "normal" script ... just put it in init.d folder

if script name start with S or have a suffix .sh ... it is launched in the current shell (so at root/admin when Entware start).
if not ... it is forked.

if name is like Snn ... nn is a number to define the order to start in Entware ...

As I know ... you don't be able to know easily when all QPKG are started ... but for QTS a file name /tmp/.boot_done is created ... if your problem is to be sure that all is mounted ... by default it's O.K. when QPKG start (Entware) ... except if a specific QPKG add and remove something but it's extremely rare.
in all case ... testing that folder in mergefs are on ... is always a good idea ...

LAST ... script is started in init phase of the QTS under root with limited environment ... so USE ONLY FULL PATHNAME for any command to avoid problem with PATH or command not found and SET any variable needed by your script.

Philippe.
New pseudo for Father_Mande (now closed) ...
QNAP TS-x53 Pro, TVS-x73, TS-x31+, TS-x28A DEAD ... and some oldest under Debian ... etc.
Asustor AS5002T ; AS1002T ... etc.
maxpro91
First post
Posts: 1
Joined: Thu Mar 02, 2023 5:40 am

Re: [REQUEST] MergerFS

Post by maxpro91 »

kitchenerer wrote: Thu Sep 12, 2019 10:31 pm Thanks QNAP_Stephane!

Looks like the compiled mergerfs binary hardcoded to use /bin/mount in QNAP which doesn't support flag '--no-canonicalize'

Code: Select all

[/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # ls -lsa
total 20
4 drwxr-xr-x 5 admin administrators 4096 2019-09-12 10:10 ./
4 drwxr-xr-x 7 admin administrators 4096 2019-09-12 10:09 ../
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:09 dir1/
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir2/
4 drwxrwxrwx 2 admin administrators 4096 2019-09-12 10:10 dir3/
[/share/CACHEDEV1_DATA/my_temp_file/mergerfs] # mergerfs ./dir1:./dir2 ./dir3
/bin/mount: unrecognized option '--no-canonicalize'
Usage: mount -V                 : print version
       mount -h                 : print this help
       mount                    : list mounted filesystems
       mount -l                 : idem, including volume labels
So far the informational part. Next the mounting.
The command is `mount [-t fstype] something somewhere'.
Details found in /etc/fstab may be omitted.
       mount -a [-t|-O] ...     : mount all stuff from /etc/fstab
       mount device             : mount device at the known place
       mount directory          : mount known device here
       mount -t type dev dir    : ordinary mount command
Note that one does not really mount a device, one mounts
a filesystem (of the given type) found on the device.
One can also mount an already visible directory tree elsewhere:
       mount --bind olddir newdir
or move a subtree:
       mount --move olddir newdir
A device can be given by name, say /dev/hda1 or /dev/cdrom,
or by label, using  -L label  or by uuid, using  -U uuid .
Other options: [-nfFrsvw] [-o options] [-p passwdfd].
For many more details, say  man 8 mount .
is there a way we can point it to use /opt/bin/mount installed by entware?
or we need to manually link it to /bin/mount ?
I met the same problem. Anybody managed to get it works?
Post Reply

Return to “Apps Wanted”