[QPKG] sherpa: a mini-package-manager (CLI) beta

[MHuijbregts]

[/quote]
Can you please post the SickChill init log?

Code: Select all

cat /var/log/SickChill.log

[/quote]

This is what was in it:

Code: Select all

-------------------- start requested --------------------
= Sun Jan 26 22:21:00 CET 2020
= (SickChill) is not active
* updating (SickChill): failed!
= result: 128
= PullGitRepo(): 'fatal: not a git repository (or any parent up to mount point /share)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).'
* starting (SickChill): OK
-------------------- stop requested --------------------
= Sun Jan 26 22:43:00 CET 2020
= (SickChill) is not active
-------------------- start requested --------------------
= Sun Jan 26 22:43:05 CET 2020
= (SickChill) is not active
* updating (SickChill): failed!
= result: 128
= PullGitRepo(): 'fatal: not a git repository (or any parent up to mount point /share)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).'
* starting (SickChill): OK
-------------------- stop requested --------------------
= Sun Jan 26 23:12:55 CET 2020
= (SickChill) is not active
-------------------- start requested --------------------
= Sun Jan 26 23:13:00 CET 2020
= (SickChill) is not active
* updating (SickChill): failed!
= result: 128
= PullGitRepo(): 'fatal: not a git repository (or any parent up to mount point /share)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).'
* starting (SickChill): OK
-------------------- stop requested --------------------
= Mon Jan 27 08:36:38 CET 2020
= (SickChill) is not active
-------------------- start requested --------------------
= Mon Jan 27 08:37:40 CET 2020
= (SickChill) is not active
* updating (SickChill): failed!
= result: 128
= PullGitRepo(): 'fatal: not a git repository (or any parent up to mount point /share)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).'
* starting (SickChill): OK

Yes, I gave it a couple of tries. But I guess the GIT_DISCOVERY_ACCROSS_FILESYSTEM message is causing the stir up. I found that message on page 87 in this thread and am currently looking in to this.
- nzbToMedia folder is no longer there anymore.
- moved the nzbget to nzbget.old, just to get it out of the way.
- ran "./etc/init.d/sickchill.sh restart" but it seems like the above mentioned message kept it from installing in the first place (or complete it)

- ran "ps ax | grep python" but there were no references to SickChill in there (only to other apps)

Suggestions in the meantime are more than welcome

[OneCD]

- ran "./etc/init.d/sickchill.sh restart" but it seems like the above mentioned message kept it from installing in the first place (or complete it)

Agree, it may have never been pulled from GitHub. Can you please check the location the application should have been pulled into?

Code: Select all

ll $(/sbin/getcfg SickChill Install_Path -f /etc/config/qpkg.conf)/SickChill

[MHuijbregts]

Agree, it may have never been pulled from GitHub. Can you please check the location the application should have been pulled into?

Code: Select all

ll $(/sbin/getcfg SickChill Install_Path -f /etc/config/qpkg.conf)/SickChill

Code: Select all

ll $(/sbin/getcfg SickChill Install_Path -f /etc/config/qpkg.conf)/SickChill
total 52K
drwxrwxrwx 11 admin administrators 4.0K 2020-01-26 21:51 ./
drwxr-xr-x 11 admin administrators 4.0K 2020-01-27 08:37 ../
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 contrib/
-rw-rw-rw-  1 admin administrators   13 2019-12-01 22:07 .dockerignore
drwxrwxrwx  5 admin administrators 4.0K 2020-01-26 21:51 .git/
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 .github/
drwxrwxrwx  3 admin administrators 4.0K 2018-10-13 13:46 gui/
-rw-rw-rw-  1 admin administrators  203 2020-01-11 21:17 .lgtm.yml
drwxrwxrwx 90 admin administrators 4.0K 2020-01-26 21:51 lib/
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 locale/
drwxrwxrwx  9 admin administrators 4.0K 2020-01-26 21:51 sickbeard/
drwxrwxrwx 10 admin administrators 4.0K 2020-01-26 21:51 sickchill/
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 tests/
[/share/Public] #

[OneCD]

Code: Select all

ll $(/sbin/getcfg SickChill Install_Path -f /etc/config/qpkg.conf)/SickChill
total 52K
drwxrwxrwx 11 admin administrators 4.0K 2020-01-26 21:51 ./
drwxr-xr-x 11 admin administrators 4.0K 2020-01-27 08:37 ../
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 contrib/
-rw-rw-rw-  1 admin administrators   13 2019-12-01 22:07 .dockerignore
drwxrwxrwx  5 admin administrators 4.0K 2020-01-26 21:51 .git/
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 .github/
drwxrwxrwx  3 admin administrators 4.0K 2018-10-13 13:46 gui/
-rw-rw-rw-  1 admin administrators  203 2020-01-11 21:17 .lgtm.yml
drwxrwxrwx 90 admin administrators 4.0K 2020-01-26 21:51 lib/
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 locale/
drwxrwxrwx  9 admin administrators 4.0K 2020-01-26 21:51 sickbeard/
drwxrwxrwx 10 admin administrators 4.0K 2020-01-26 21:51 sickchill/
drwxrwxrwx  3 admin administrators 4.0K 2020-01-26 21:51 tests/
[/share/Public] #

That looks like an incomplete clone.

Please run this to remove the existing clone (your SickChill dB will be unaffected):

Code: Select all

rm -r $(/sbin/getcfg SickChill Install_Path -f /etc/config/qpkg.conf)/SickChill

... then start SickChill again to force a new git-pull:

Code: Select all

/etc/init.d/sickchill.sh start

[MHuijbregts]

That looks like an incomplete clone.

Please run this to remove the existing clone (your SickChill dB will be unaffected):

Code: Select all

rm -r $(/sbin/getcfg SickChill Install_Path -f /etc/config/qpkg.conf)/SickChill

... then start SickChill again to force a new git-pull:

Code: Select all

/etc/init.d/sickchill.sh start

This is excellent stuff. I've got it up and running. Now I just need to get everything back up and running as it was before.

Thank you very much for your support!
5 star rating from me

[OneCD]

I've got it up and running. Now I just need to get everything back up and running as it was before.

Nicely done.

[jkcchan]

Okay, I tried multiple things.

1. Noticed that `watcher.py` is in that dir, but not `watcher3.py`. Ran `/opt/bin/python3 watcher.py --userdata config --conf config/config.ini`, and it appeared to work on port 9090, with none of my data loaded. Below is the output

Code: Select all

Specified userdata directory created.
Creating database file /share/CACHEDEV1_DATA/.qpkg/OWatcher3/OWatcher3/config/watcher.sqlite
Creating tables.
Connected to database sqlite:////share/CACHEDEV1_DATA/.qpkg/OWatcher3/OWatcher3/config/watcher.sqlite
## Config file not found. Creating new basic config config/config.ini. Please review settings.
Clearing Mako cache.
[29/Jan/2020:14:08:28] ENGINE Listening for SIGTERM.
[29/Jan/2020:14:08:28] ENGINE Listening for SIGHUP.
[29/Jan/2020:14:08:28] ENGINE Listening for SIGUSR1.
[29/Jan/2020:14:08:28] ENGINE Bus STARTING
[29/Jan/2020:14:08:29] ENGINE Serving on http://0.0.0.0:9090
[29/Jan/2020:14:08:29] ENGINE Bus STARTED
[29/Jan/2020:14:08:44] ENGINE Started monitor thread 'Session cleanup'.
- http requests ommitted -
^C[29/Jan/2020:14:09:21] ENGINE Keyboard Interrupt: shutting down bus
[29/Jan/2020:14:09:21] ENGINE Bus STOPPING
[29/Jan/2020:14:09:21] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('0.0.0.0', 9090)) shut down
[29/Jan/2020:14:09:21] ENGINE Stopped thread 'Session cleanup'.
Stopping scheduled task: Movie Search
Stopping scheduled task: Update Checker
Stopping scheduled task: Metadata Update
Stopping scheduled task: Postprocessed Paths Scan
[29/Jan/2020:14:09:21] ENGINE Bus STOPPED
[29/Jan/2020:14:09:21] ENGINE Bus EXITING
[29/Jan/2020:14:09:21] ENGINE Bus EXITED
[29/Jan/2020:14:09:21] ENGINE Waiting for child threads to terminate...

2. I then renamed watcher.py to watcher3.py and tried to restart it via the QNAP console, did not run on either 5070 or 9090.

3. Ran LazyLibrarian with this command:

Code: Select all

[/share/CACHEDEV1_DATA/.qpkg/LazyLibrarian/LazyLibrarian] # /opt/bin/python3 LazyLibrarian.py --conf config/config.ini

Similar to watcher, no data, but running

Code: Select all

Lazylibrarian (pid 27030) is starting up...
29-Jan-2020 14:11:29 - INFO :: MAIN : __init__.py:initialize:765 : Log (Rotating) Level set to [1]- Log Directory is [/share/CACHEDEV1_DATA/.qpkg/LazyLibrarian/LazyLibrarian/Logs] - Config level is [1]
29-Jan-2020 14:11:29 - INFO :: MAIN : __init__.py:initialize:771 : Screen Log set to INFO
29-Jan-2020 14:11:29 - INFO :: MAIN : __init__.py:config_read:1159 : Config file loaded
29-Jan-2020 14:11:30 - INFO :: MAIN : __init__.py:initialize:838 : Database is version 0, integrity check: ok
29-Jan-2020 14:11:30 - INFO :: MAIN : common.py:logHeader:1229 : Checking TLS version, you can ignore any "InsecureRequestWarning" message
/opt/lib/python3.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
29-Jan-2020 14:11:31 - WARNING :: MAIN : __init__.py:initialize:864 : magic: missing
29-Jan-2020 14:11:31 - INFO :: MAIN : __init__.py:build_genres:1777 : Loaded genres from /share/CACHEDEV1_DATA/.qpkg/LazyLibrarian/LazyLibrarian/example.genres.json
29-Jan-2020 14:11:31 - INFO :: MAIN : __init__.py:build_bookstrap_themes:1762 : Bookstrap found 16 themes
29-Jan-2020 14:11:32 - INFO :: MAIN : versioncheck.py:logmsg:41 : New version is available. You are 57 commits behind
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:92 : Database OperationalError: no such table: jobs
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:93 : Failed query: [UPDATE jobs SET LastRun = ? WHERE Name = ?]
29-Jan-2020 14:11:32 - WARNING :: MAIN : LazyLibrarian.py:main:252 : Looking for Apprise library: No module named 'apprise'
29-Jan-2020 14:11:32 - INFO :: MAIN : LazyLibrarian.py:main:267 : Starting LazyLibrarian on port: 5299, webroot ""
29-Jan-2020 14:11:32 - INFO :: MAIN : webStart.py:initialize:66 : Starting LazyLibrarian web server on http://0.0.0.0:5299/
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:92 : Database OperationalError: no such table: jobs
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:93 : Failed query: [SELECT LastRun from jobs WHERE Name=?]
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:92 : Database OperationalError: no such table: Series
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:93 : Failed query: [SELECT SeriesName,SeriesID,Updated from Series where Status="Active" or Status="Wanted" order by Updated ASC]
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:92 : Database OperationalError: no such table: jobs
29-Jan-2020 14:11:32 - ERROR :: MAIN : database.py:_action:93 : Failed query: [SELECT LastRun from jobs WHERE Name=?]
29-Jan-2020 14:11:33 - INFO :: DB_UPGRADE : dbupgrade.py:dbupgrade:162 : Creating new database, version 58
29-Jan-2020 14:11:33 - ERROR :: MAIN : database.py:_action:92 : Database OperationalError: no such table: jobs
29-Jan-2020 14:11:33 - ERROR :: MAIN : database.py:_action:93 : Failed query: [SELECT LastRun from jobs WHERE Name=?]
29-Jan-2020 14:11:33 - ERROR :: MAIN : database.py:_action:92 : Database OperationalError: no such table: jobs
29-Jan-2020 14:11:33 - ERROR :: MAIN : database.py:_action:93 : Failed query: [SELECT LastRun from jobs WHERE Name=?]
29-Jan-2020 14:11:33 - INFO :: DB_UPGRADE : dbupgrade.py:check_db:519 : Database check found 0 errors
29-Jan-2020 14:11:33 - INFO :: DB_UPGRADE : dbupgrade.py:dbupgrade:285 : Database updated to version 58
29-Jan-2020 14:12:32 - ERROR :: POSTPROCESS : postprocess.py:processDir:487 : No download directories are configured
29-Jan-2020 14:12:33 - INFO :: POSTPROCESS : postprocess.py:processDir:1051 : 0 downloads processed.
29-Jan-2020 14:12:33 - INFO :: POSTPROCESS : postprocess.py:processDir:1056 : Found 0 unprocessed
29-Jan-2020 14:12:33 - INFO :: POSTPROCESS : postprocess.py:processDir:1159 : Nothing marked as snatched or seeding. Stopping postprocessor.
29-Jan-2020 14:12:33 - INFO :: CRON-VERSIONCHECK : versioncheck.py:logmsg:41 : New version is available. You are 57 commits behind

[OneCD]

1. Noticed that `watcher.py` is in that dir, but not `watcher3.py`. Ran `/opt/bin/python3 watcher.py --userdata config --conf config/config.ini`, and it appeared to work on port 9090, with none of my data loaded. Below is the output

A good start. The reason it didn't work correctly was because I failed to adjust the relative paths to the configuration location after later editing the base-path to the app (I'm sometimes coding from-the-hip (without testing), so once in a while, the command strings I publish are wrong.)

So, your new commands will be:

Code: Select all

export PYTHONPATH=/opt/bin/python3
cd $(/sbin/getcfg OWatcher3 Install_Path -f /etc/config/qpkg.conf)/OWatcher3
/opt/bin/python3 watcher.py --userdata ../config --conf ../config/config.ini

2. I then renamed watcher.py to watcher3.py ...

No, please don't do this. The main script should be called 'watcher.py'. If you rename it, the app won't update from GitHub correctly.

3. Ran LazyLibrarian with this command:

Code: Select all

[/share/CACHEDEV1_DATA/.qpkg/LazyLibrarian/LazyLibrarian] # /opt/bin/python3 LazyLibrarian.py --conf config/config.ini

No, also don't do this. LazyLibrarian uses different arguments.

Let's fix Watcher3 first.

[jkcchan]

Code: Select all

-rw-r--r--    1 admin    administ      7.6k Dec 29 15:45 watcher.py

Oops, my bad. I gave you the wrong command to launch Watcher3.

Try these:

Code: Select all

export PYTHONPATH=/opt/bin/python3
cd $(/sbin/getcfg OWatcher3 Install_Path -f /etc/config/qpkg.conf)/OWatcher3
/opt/bin/python3 watcher.py --userdata config --conf config/config.ini

Ahh sorry I didn't see this ...

Just ran it, same thing as before, runs on 9090 but none of the old settings or movies were loaded, no errors from output. I believe in troubleshooting, I had re-ran the sherpa script so does that mess with the data?

Thanks so much

[OneCD]

Just ran it, same thing as before, runs on 9090 but none of the old settings or movies were loaded, no errors from output.

Now I'm unsure what you've run. You've quoted an earlier command set.

Try this:

Code: Select all

export PYTHONPATH=/opt/bin/python3
cd $(/sbin/getcfg OWatcher3 Install_Path -f /etc/config/qpkg.conf)/OWatcher3
/opt/bin/python3 watcher.py --userdata ../config --conf ../config/config.ini

I believe in troubleshooting, I had re-ran the sherpa script so does that mess with the data?

No, but let's keep it simple. If you're new to BASH, please run only the commands I provide.

[jkcchan]

Okay my bad sorry I really appreciate your patience.

Code: Select all

[~] # export PYTHONPATH=/opt/bin/python3
[~] # cd $(/sbin/getcfg OWatcher3 Install_Path -f /etc/config/qpkg.conf)/OWatcher3
[/share/CACHEDEV1_DATA/.qpkg/OWatcher3/OWatcher3] # /opt/bin/python3 watcher.py --userdata ../config --conf ../config/config.ini
Userdata directory exists, continuing.
Connected to database sqlite:////share/CACHEDEV1_DATA/.qpkg/OWatcher3/OWatcher3/../config/watcher.sqlite
Config file found, merging any new options.
Clearing Mako cache.
[30/Jan/2020:18:25:48] ENGINE Listening for SIGTERM.
[30/Jan/2020:18:25:48] ENGINE Listening for SIGHUP.
[30/Jan/2020:18:25:48] ENGINE Listening for SIGUSR1.
[30/Jan/2020:18:25:48] ENGINE Bus STARTING
[30/Jan/2020:18:25:49] ENGINE Error in HTTP server: shutting down
Traceback (most recent call last):
  File "/share/CACHEDEV1_DATA/.qpkg/OWatcher3/OWatcher3/lib/cherrypy/process/servers.py", line 217, in _start_http_thread
    self.httpserver.start()
  File "/share/CACHEDEV1_DATA/.qpkg/OWatcher3/OWatcher3/lib/cheroot/server.py", line 1453, in start
    raise socket.error(msg)
OSError: No socket could be created -- (('192.168.0.12', 5070): [Errno 99] Cannot assign requested address)

[30/Jan/2020:18:25:49] ENGINE Bus STOPPING
[30/Jan/2020:18:25:49] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('192.168.0.12', 5070)) already shut down
Stopping scheduled task: Movie Search
Stopping scheduled task: Update Checker
Stopping scheduled task: Metadata Update
Stopping scheduled task: Postprocessed Paths Scan
[30/Jan/2020:18:25:49] ENGINE Bus STOPPED
[30/Jan/2020:18:25:49] ENGINE Bus EXITING
[30/Jan/2020:18:25:49] ENGINE Bus EXITED

[OneCD]

Code: Select all

OSError: No socket could be created -- (('192.168.0.12', 5070): [Errno 99] Cannot assign requested address)

Ah, this suggests the port number requested by Watcher3 has already been taken by another process.

Please run this to identify that process:

Code: Select all

lsof -i :5070

[potestus]

Screenshot_20200131-001710_Chrome.jpg

Post processing seems not to be updating I edited eol to add 100 but it seems it's not auto updating?

[jkcchan]

Code: Select all

OSError: No socket could be created -- (('192.168.0.12', 5070): [Errno 99] Cannot assign requested address)

Ah, this suggests the port number requested by Watcher3 has already been taken by another process.

Please run this to identify that process:

Code: Select all

lsof -i :5070

Ran it, no output. Even checked with netstat -tuln | grep 5070 and nothing

[OneCD]

Post processing seems not to be updating I edited eol to add 100 but it seems it's not auto updating?

Can you please SSH in again as 'admin' and run a manual git pull?

Code: Select all

cd /share/HDA_DATA/Qdownload/nzbToMedia && git pull