[Ubooquity ] [ 2.1.2 ] Home server for comics and ebooks

This is the best place for community developers to publish their genius work. Your Apps enrich the QNAP Turbo NAS.
letkeman
Starting out
Posts: 25
Joined: Thu Mar 15, 2012 8:03 pm

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by letkeman »

Yes, sometimes all that you need to do is restart.
I'm glad that you got it working. I do not think that the solution is to use Internet Explorer, and I can tell you that I would much rather use Google Chrome or Firefox over Internet Explorer. But sometimes you have to do, what you have to do.

Please remember that I did run into a RAM/Cache as I stated before. There is probably a fix for this somewhere, but I have not put the time in to fix this, maybe some day I will. However I only have 512 MB on my 419+ which uses the ARM as well.
User avatar
jeeves5454
New here
Posts: 5
Joined: Fri May 08, 2015 11:56 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by jeeves5454 »

Thanks. I did run into a RAMDisk issue/Cache issue as well. I wonder if its possible to spill over some of the scan results on to actual hard disk space instead of expanding on the RAMDisk. The NAS crapped out reading through my comics overnights. Not sure how to fix that yet...
letkeman
Starting out
Posts: 25
Joined: Thu Mar 15, 2012 8:03 pm

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by letkeman »

Okay, here is the info for the solution as there is a way to overwrite where the files are located

https://vaemendis.net/ubooquity/article ... uity-1-8-0

"workdir" option
This new command line parameter allows you to specify where Ubooquity should create its own files (database, logs, preferences, cache, etc). The "user.dir" method, sometime mentionned on the forum to achieve the same result, is not reliable. You should use the new setting instead.

Looks like an update to the start up script is needed.

I may update the QPKG, but until this weekend at the earlist
stitchems
New here
Posts: 6
Joined: Sun Feb 21, 2016 1:40 pm

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by stitchems »

Hey all a bit off topic not sure a better place to ask but kinda related to Ubooquity does anyone know where I can get a working qpkg version of LazyLibrarian with the newest update from DobyTang/LazyLibrarian or anyone know how to install it from git because i'm not very tech and haven't been able to find a qpkg for it that works or instructions to install from git but want it to load content into Ubooquity

Thank you in advance to anyone that might be able to help.
jr9770
New here
Posts: 5
Joined: Mon Apr 27, 2015 5:43 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by jr9770 »

Hi everyone,

Has anyone had trouble getting Ubooquity to work with QTS version 4.3? I had it working fine on 4.2, but I upgraded today and now I can't connect to the Ubooquity server at all. The admin page and front end just give me a "This site can’t be reached" error. I've uninstalled and reinstalled the QPKG but it didn't help.

Any help would be greatly appreciated. Thanks!
mrs4t4n
Know my way around
Posts: 100
Joined: Tue Nov 11, 2014 5:53 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by mrs4t4n »

i remeber having troubles after the update... but i can't remember how i solve it :/
try to update java first and then restart ubooquity...
Also check logs to see whats going on...
jr9770
New here
Posts: 5
Joined: Mon Apr 27, 2015 5:43 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by jr9770 »

Thanks for the help. I just got it working again. For anyone having trouble after the 4.3 QTS update. All I did was uninstalled Ubooquity 1.10.1, QJDK8 1.8.33 (I apparently had an older version installed), and JRE 8.101.0. Once those were removed, I reinstalled each of them again, starting with JRE 8.101.0, then QJDK8 1.8.111 64 bit (http://www.positiv-it.fr/QNAP/APP/QJDK8 ... 4.qpkg.zip), and finally Ubooquity 1.10.1 64 bit (http://positiv-it.fr/QNAP/APP/UbooQuity ... 4.qpkg.zip). Now it loads again. Time to re-scan my collection! :)
User avatar
Trexx
Ask me anything
Posts: 5393
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

[Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by Trexx »

ratgurrl wrote:Thanks @jr9770. I was having this same issue. After the update to 4.3.3 I've had to completely recombobulate my NAS, as a lot of thing broke. I was having a hard time getting this to load. Not sure why the install from the club store didn't work, but using the links you posted and doing a manual install of QJDK8.111 and Ubooquity 1.10.1, did the trick.
Because Qnap's 3rd party repository option doesn't support differentiation between x86 & x64. Hence need for manual install.


Sent from my iPad using Tapatalk
Paul

Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350

Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
Slickums
Know my way around
Posts: 142
Joined: Fri Nov 25, 2016 6:51 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by Slickums »

Hola!

This is a great program...does exactly everything I need it to do (well, almost!) for sharing my Calibre libraries. My setup:

QNAP TS-251
8GB RAM
QTS 4.2.4 (from 4.2.3 as of this morning!)

I have several 'book' libraries that simply will not show up. They are configured exactly like the ones that do, same shared root folders, same permissions, etc.

I am getting multiple "Warnings" in the log. But the they are for libraries that do show up and appear to be ok, and in the ones that do not show up.

Here is a snippet of the log file after updating the QTS firmware and rebooting this morning:

Code: Select all

20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Running with the following parameters - headless: true, port: -1, webadmin: true, host: null, debug: false, execdir: /share/CACHEDEV1_DATA/.qpkg/UbooQuity
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - #############################
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - # Starting Ubooquity #
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - #############################
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Java version: 1.8.0_111
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Java vendor: Oracle Corporation
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Max heap size available: 910 MB
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - OS name: Linux
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - OS version: 3.12.6
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - OS architecture: i386
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Loading local version info
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Ubooquity 1.10.1 built on 2016-05-10 at 20:36
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Creating application folders
20170314 14:00:04 [main] INFO com.ubooquity.Ubooquity - Loading preferences
20170314 14:00:24 [main] INFO com.ubooquity.c - Starting internal server...
20170314 14:00:24 [Scanner thread] INFO com.ubooquity.data.feeder.a - Scanning books directories
20170314 14:00:24 [main] INFO com.ubooquity.c - Reverse proxy prefix is not activated
20170314 14:00:24 [main] INFO com.ubooquity.c - Internal server started. Listening on port 2202
20170314 14:00:24 [Scanner thread] WARN com.ubooquity.data.database.a - Could not find id of root path /share/CACHEDEV1_DATA/Backups/Calibre_eBooks/4-Sci-Fi (ignore this warning if you just added a new root directory)
20170314 14:00:24 [Scanner thread] WARN com.ubooquity.data.database.a - Could not find id of root path /share/CACHEDEV1_DATA/Backups/Calibre_eBooks/5-SciFi Series-Mags (ignore this warning if you just added a new root directory)
20170314 14:00:24 [Scanner thread] WARN com.ubooquity.data.database.a - Could not find id of root path /share/CACHEDEV1_DATA/Backups/Calibre_eBooks/6-NYT (ignore this warning if you just added a new root directory)
20170314 14:00:25 [Timer-1] INFO com.ubooquity.Ubooquity - Checking latest available Ubooquity version from website
20170314 14:00:26 [Timer-1] INFO com.ubooquity.Ubooquity - Latest version available: 1.10.1 - Current version: 1.10.1
20170314 14:01:40 [Scanner thread] WARN com.ubooquity.data.database.a - Could not find id of root path /share/CACHEDEV1_DATA/Backups/Calibre_eBooks/4-Sci-Fi (ignore this warning if you just added a new root directory)
20170314 14:01:40 [Scanner thread] WARN com.ubooquity.data.database.a - Could not find id of root path /share/CACHEDEV1_DATA/Backups/Calibre_eBooks/5-SciFi Series-Mags (ignore this warning if you just added a new root directory)
20170314 14:01:40 [Scanner thread] WARN com.ubooquity.data.database.a - Could not find id of root path /share/CACHEDEV1_DATA/Backups/Calibre_eBooks/6-NYT (ignore this warning if you just added a new root directory)
20170314 14:02:03 [Scanner thread] INFO com.ubooquity.fileformat.pdf.b - Reading metadata of pdf file: /share/CACHEDEV1_DATA/Backups/Calibre_eBooks/3-NonFiction/Hobson, Jake/Niwaki- Pruning, Training and Shaping Trees the Japenese Way (23148)/Niwaki- Pruning, Training and Shaping Tree - Hobson, Jake.pdf
20170314 14:02:32 [Scanner thread] ERROR com.ubooquity.Ubooquity - Uncaught exception on thread: Scanner thread
java.lang.OutOfMemoryError: Java heap space
  	at java.awt.image.DataBufferInt.(DataBufferInt.java:75) ~[na:1.8.0_111]
  	at java.awt.image.Raster.createPackedRaster(Raster.java:467) ~[na:1.8.0_111]
  	at java.awt.image.DirectColorModel.createCompatibleWritableRaster(DirectColorModel.java:1032) ~[na:1.8.0_111]
  	at java.awt.image.BufferedImage.(BufferedImage.java:333) ~[na:1.8.0_111]
  	at org.apache.pdfbox.pdmodel.graphics.image.SampledImageReader.getStencilImage(SampledImageReader.java:65) ~[pdfbox-
I used the QNAP Club Store repository to install 1.10.1. Here is what shows up doing a find:

Code: Select all

[/share/Backups/Calibre_eBooks] # find / -name UbooQuity
/share/CACHEDEV1_DATA/.qpkg/Entware-3x/UbooQuity
/share/CACHEDEV1_DATA/.qpkg/UbooQuity
[/share/Backups/Calibre_eBooks] # 
My libraries are quite large; the UbooQuity db looks like this and seems to keep growing:

Code: Select all

-rw-r--r--    1 admin    administ 586174464 Mar 14 08:00 ubooquity-4.h2.db
Here is my library/folder structure:

Code: Select all

[/share/Backups/Calibre_eBooks] # ls -l
drwxr-xr-x    2 1000     1000          4096 Mar  7 10:53 1-Work in Progress/
drwxrwxrwx 6811 1000     1000        245760 Mar  7 11:26 2-Fiction/
drwxrwxrwx 4714 1000     1000        172032 Mar  7 11:07 3-NonFiction/
drwxrwxrwx 2690 1000     1000        106496 Mar  5 19:46 4-Sci-Fi/
drwxrwxrwx   91 1000     1000          4096 Feb 16 13:26 5-SciFi Series-Mags/
drwxrwxrwx   46 1000     1000          4096 Feb 16 13:25 6-NYT/
drwxr-xr-x   10 1000     1000          4096 Mar  3 21:18 8-Touchpad/
[/share/Backups/Calibre_eBooks] # 
I am only using libraries/folders 2-6 in UbooQuity. 2, 3, 6 show up, while 4, 5 do not. They are all configured as "Books" in UbooQuity. And no, no "/"s at the end in the setup!!

Other folders set up as "Raw Files" in the /share/Multimedia folder are working normally.

Just to make sure, I did change the symlink folder location in the setup to direct links, even tho that issue had been fixed. It made no change.

So I am stuck. With the "root path" warnings and the "Java Heap Space" error, I don't know where to go with this. My hard drives have over 2TB free space and show no errors or problems.

Help! :DD

Monty
Slickums
Know my way around
Posts: 142
Joined: Fri Nov 25, 2016 6:51 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by Slickums »

Well, don't everyone speak at once, LoL. I realize not a lot of eyeballs here, so let me ask a much simpler question for you folks that know a little Java.

It looks like there might be a way to increase the java memory (heap space?) when the program starts up. The UbooQuity.sh file appears to be the place to do this, but I am guessing.

If so, how would I structure an argument to increase the memory to say 1.5GB (a guess at this point)? Obviously I am clueless with java, but willing to do some trial & error :DD

Thanks for any pointers!
nselimis
New here
Posts: 8
Joined: Tue Jun 28, 2016 10:30 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by nselimis »

So for generic Unix its simple, Do the following:
$ export _JAVA_OPTIONS="-Xmx1.5g"
$ java -jar jconsole.jar &
Picked up _JAVA_OPTIONS: -Xmx1.5g

See if in that script there is a way to do something the similar
Slickums
Know my way around
Posts: 142
Joined: Fri Nov 25, 2016 6:51 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by Slickums »

nselimis wrote:So for generic Unix its simple, Do the following:
$ export _JAVA_OPTIONS="-Xmx1.5g"
$ java -jar jconsole.jar &
Picked up _JAVA_OPTIONS: -Xmx1.5g

See if in that script there is a way to do something the similar
Thank You!

I started playing around before I saw your idea and tried this -Xms2G modification in the UbooQuity.sh startup file:

Code: Select all

/share/CACHEDEV1_DATA/.qpkg/QJDK8/bin/java -Xms2G -Dfile.encoding=UTF8 -jar Ubooquity.jar -webadmin -headless
This seemed to eliminate the "java heap space" error during scanning. I was finally able to get in a complete scan of my 3 main libraries. But it needed some help. It stopping on a particular pdf file with something about 'com.twelvemonkeys', which appeared to be a metadata or cover resource. I had to actually delete that file to get it to keep scanning past that point.

But, after getting all 114k books scanned, with a 701mb database file, I cannot get the 3 root folders to show up. Nothing, nada. The log file says the db was populated ok, so now have a new problem.

I even took out the heap space mod, and rebooted. That error seemed to happen only on the initial scan to populate the db, as it has not come back with the default 1G heap space. But, I still have a ton of 'WARN' errors about finding ID of root path. I have toggled almost every option, still won't show up...
nselimis
New here
Posts: 8
Joined: Tue Jun 28, 2016 10:30 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by nselimis »

So unrelated but related, when populating large DB's for other systems I have had to feed it data in chunks.
You could take a similar approach to this, start over completely and just give it one folder at a time to index and see how that works. If you find that a particular folder causes a fatal error you can now track it down more easily.

Just a thought.
Slickums
Know my way around
Posts: 142
Joined: Fri Nov 25, 2016 6:51 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by Slickums »

nselimis wrote:So unrelated but related, when populating large DB's for other systems I have had to feed it data in chunks.
You could take a similar approach to this, start over completely and just give it one folder at a time to index and see how that works. If you find that a particular folder causes a fatal error you can now track it down more easily.

Just a thought.
And that is a good thought!

I did that, but still had the issues with heap space until I increased it to 2G. And the "WARN" errors still remain.

However, on a lark, to get my folders back, I put the direct links back in and the folders now show up:

/share/Backups/Calibre/xxxx had scanned ok, but did not show up in the app.

/share/CACHEDEV1_DATA/Backups/Calibre/xxxx brought all the files/folders back.

Go figure...
Slickums
Know my way around
Posts: 142
Joined: Fri Nov 25, 2016 6:51 am

Re: [Ubooquity ] [ 1.10.1 ] Home server for comics and ebooks

Post by Slickums »

How can I get the Ubooquity log files to show the correct time per the qts system time?

I have changed the entry in php.ini: date.timezone = "America/xxxxxx" and rebooted, but still no change in the Uboo log timestamp. It appears to be showing UTC time, but I use the logs quite a bit, would really like to not have to do the mental math every time, LoL.

Thanks!
Post Reply

Return to “Community Apps”