[QPKG] sherpa: a mini-package-manager (CLI) beta

[kilobyte]

Sorry.

The problem with reverting Entware (to a default install + sherpa required IPKGs) is that any extra IPKGs added by the user are not reinstalled. It's not possible to automatically reinstall these and ensure a stable and functional Entware environment.

No problem. I don't have a lot of apps on my NAS, so I only hope everything will work fine

Thanks for your job

[potestus]

Il have a rout around but except for the qnap bloatware. I've only got sab and sick.. But lots of Python versions. It seems to work Ok with the error msg.
Thanks.

Do you know if any way of delaying sab from starting processing.... It seems to start before sickchill.. I close down the Qnaps for a couple of hours overnight.. The apps recieved code 15. On start up Sab can't resolve the script on an Outstandong task because sickchill isn't ready yetm

[OneCD]

Il have a rout around but except for the qnap bloatware. I've only got sab and sick.. But lots of Python versions. It seems to work Ok with the error msg.
Thanks.

I'll do some testing this week and see if I can replicate those error messages.

Do you know if any way of delaying sab from starting processing.... It seems to start before sickchill.. I close down the Qnaps for a couple of hours overnight.. The apps recieved code 15. On start up Sab can't resolve the script on an Outstandong task because sickchill isn't ready yetm

Suggest installing SortMyQPKGs. It will ensure these packages (and a few others) start in the correct order.

[OneCD]

On start up Sab can't resolve the script on an Outstandong task because sickchill isn't ready yetm

Hmm, I just re-read the problem. You may need to re-order the startup list. viewtopic.php?p=709781#p709781

[potestus]

I've set up a schedule in nazb to start 15 mins after power up. Let's see..

[potestus]

warnings.warn(msg, LifetimeWarning)
[13:35:24] [INFO]::MAIN: Python v2.7 will reach end of life in 273 days.
[13:35:24] [WARNING]::MAIN: Please upgrade to a more recent Python version.
[13:35:24] [INFO]::MAIN: Checking database structure...
[13:35:24] [INFO]::MAIN: Database upgrade required: Initial Schema
[13:35:25] [INFO]::MAIN: Checking if git needs an update
[13:35:31] [INFO]::MAIN: No update needed
[13:35:31] [INFO]::MAIN: nzbToMedia Version:0db7c3e10c01cee85814a31fd3c5232b1d7d144e Branch:master (Linux 3.4.6)
[13:35:34] [INFO]::MAIN: #########################################################
[13:35:34] [INFO]::MAIN: ## ..::[nzbToMedia.py]::.. ##
[13:35:34] [INFO]::MAIN: #########################################################
[13:35:34] [INFO]::MAIN: Script triggered from SABnzbd 0.7.17+
[13:35:37] [WARNING]::MAIN: Data from SABnzbd queue could not be parsed
[13:35:39] [WARNING]::MAIN: Data from SABnzbd history could not be parsed
[13:35:40] [ERROR]::MAIN: Category:[movies] is not defined or is not enabled. Please rename it or ensure it is enabled for the appropriate section in your autoProcessMedia.cfg and try again.
[13:35:40] [ERROR]::MAIN: A problem was reported in the /share/Qdownload/nzbToMedia/nzbToMedia.py script.
Changing to directory: /share/MD0_DATA/Qdownload/nzbToMedia

Got this today from nztobmedia lots of issues..
New python needed?

[OneCD]

[13:35:40] [ERROR]::MAIN: Category:[movies] is not defined or is not enabled. Please rename it or ensure it is enabled for the appropriate section in your autoProcessMedia.cfg and try again.

Suggest asking Clinton Hall about this one: https://github.com/clinton-hall/nzbToMedia

New python needed?

From July 2019, I'll begin work on switching each sherpa application to use Python 3. For now, you can ignore these kinds of warnings.

[potestus]

Thanks again

I had movie Not movies set... Should work now.. Still unstable though..
What about the
[13:35:24] [INFO]::MAIN: Checking database structure...
[13:35:24] [INFO]::MAIN: Database upgrade required: Initial Schema
?

[OneCD]

You can either ignore it, or ask Clinton Hall. He wrote nzbToMedia.

[bjtukker]

It doesn't seem to work for me: I can't find a process sab or SAB and when I run ./sabnzbd.sh start, it's stating that it's not running:

Code: Select all

[/share/MD0_DATA/.qpkg/SABnzbdplus] # ./sabnzbd.sh start
= (SABnzbdplus) is not active
* updating (SABnzbdplus): OK
* updating (nzbToMedia): OK
* starting (SABnzbdplus): OK
= startup messages:
* service configured for HTTPS port: 9090
[/share/MD0_DATA/.qpkg/SABnzbdplus] #

Also, I can't open the webpage. I have installed it and even forced the install. Any ideas how to solve this?

install report:

Code: Select all

[/share/Public] # ./sherpa.sh SABnzbdplus
sherpa.sh (190317)

[ done ] downloaded sherpa package list
[ done ] downloaded QPKG (Par2_0.8.0.0_x86.qpkg)
[ done ] downloaded QPKG (SABnzbdplus_190205.qpkg)
[ done ] installed QPKG (Par2_0.8.0.0_x86.qpkg)
[ done ] updated Entware package list
[ done ] no IPKGs are required
[ done ] downloaded & installed (PIP modules)
[ done ] daemon stopped (sabnzbd.sh)
[ done ] created 'SABnzbdplus' settings backup
[ done ] uninstalled QPKG 'SABnzbdplus'
[ done ] installed QPKG (SABnzbdplus_190205.qpkg)
[ done ] wait complete
[ done ] daemon stopped (sabnzbd.sh)
[ done ] restored 'SABnzbdplus' settings backup
[ done ] daemon started (sabnzbd.sh)

[ done ] 'SABnzbdplus' has been successfully reinstalled!

- To display the runtime debug log:
        cat /share/Public/sherpa.debug.log

The contents of the log:

Code: Select all

[ dbug ] (II) ======================================================================
[ dbug ] (**) SCRIPT:           started: Thu Apr 4 21:39:14 CEST 2019
[ dbug ] (**) SCRIPT:           version: 190317
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (II) Markers: (**) detected, (II) information, (WW) warning, (LL) log file,
[ dbug ] (II)  (EE) error, (==) processing, (--) done, (>>) f entry, (<<) f exit,
[ dbug ] (II)  (vv) variable name & value, ($1) positional argument value.
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (**) NAS   :             model: TS-459 Pro II
[ dbug ] (**) NAS   :  firmware version: 4.2.6
[ dbug ] (**) NAS   :    firmware build: 20190322
[ dbug ] (**) NAS   :            kernel: 3.4.6 x86_64
[ dbug ] (**) NAS   :         OS uptime: 6 days
[ dbug ] (**) NAS   :       system load: 1 min=0.66, 5 min=0.68, 15 min=0.73
[ dbug ] (**) NAS   :              EUID: 0
[ dbug ] (**) NAS   :    default volume: /share/MD0_DATA
[ dbug ] (**) NAS   :             $PATH: /opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr
[ dbug ] (**) NAS   :              /opt: /share/MD0_DATA/.qpkg/Entware
[ dbug ] (**) NAS   :   /share/Download: MD0_DATA/Download
[ dbug ] (**) SCRIPT:    user arguments: SABnzbdplus
[ dbug ] (**) SCRIPT:        target app: SABnzbdplus
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (vv) $STEPHANE_QPKG_ARCH [x86]
[ dbug ] (vv) $PREF_ENTWARE [Entware]
[ dbug ] (**) QPKG  : Entware installer: std
[ proc ] downloading sherpa package list ...
[ done ] downloaded sherpa package list
[ dbug ] (<<) <Init> [0]
[ dbug ] (>>) <PauseDownloaders>
[ dbug ] (--) paused existing SABnzbd queue
[ dbug ] (<<) <PauseDownloaders> [0]
[ dbug ] (>>) <RemoveOther>
[ dbug ] (**) QPKG  :         'Optware': not installed [250]
[ dbug ] (<<) <RemoveOther> [0]
[ dbug ] (>>) <DownloadQPKGs>
[ dbug ] (>>) <DownloadQPKG>
[ proc ] downloading QPKG (Par2_0.8.0.0_x86.qpkg) ...
[ done ] downloaded QPKG (Par2_0.8.0.0_x86.qpkg)
[ dbug ] (<<) <DownloadQPKG> [0]
[ dbug ] (>>) <DownloadQPKG>
[ proc ] downloading QPKG (SABnzbdplus_190205.qpkg) ...
[ done ] downloaded QPKG (SABnzbdplus_190205.qpkg)
[ dbug ] (<<) <DownloadQPKG> [0]
[ dbug ] (<<) <DownloadQPKGs> [0]
[ dbug ] (>>) <InstallEntware>
[ dbug ] (--) adjusted $PATH
[ dbug ] (vv) $PATH [/opt/bin:/opt/sbin:/opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/bin/X11:/usr/local/sbin:/usr/local/bin:/usr/local/jre/bin:/Apps/bin:/Apps/sbin]
[ dbug ] (>>) <PatchEntwareInit>
[ dbug ] (II) patch: do the "opt shuffle" - already done
[ dbug ] (<<) <PatchEntwareInit> [0]
[ dbug ] (<<) <InstallEntware> [0]
[ dbug ] (>>) <InstallExtras>
[ proc ] installing QPKG (Par2_0.8.0.0_x86.qpkg) - this can take a while ...
[ done ] installed QPKG (Par2_0.8.0.0_x86.qpkg)
[ dbug ] (>>) <InstallIPKGs>
[ dbug ] (>>) <UpdateEntware>
[ proc ] updating Entware package list ...
[ done ] updated Entware package list
[ dbug ] (<<) <UpdateEntware> [0]
[ dbug ] (>>) <InstallIPKGBatch>
[ proc ] calculating number and size of IPKGs required ...
[ dbug ] (II) requested IPKGs: git git-http nano less ca-certificates python python-pip python-pyopenssl python-dev gcc unrar p7zip coreutils-nice ionice ffprobe
[ dbug ] (==) finding all IPKG dependencies ...
[ dbug ] (--) complete
[ dbug ] (II) found all IPKG dependencies in 11 iterations
[ dbug ] (==) excluding packages already installed ...
[ dbug ] (--) complete
[ dbug ] (II) IPKGs to download:
[ dbug ] (vv) $IPKG_download_size [0]
[ done ] no IPKGs are required
[ dbug ] (<<) <InstallIPKGBatch> [0]
[ dbug ] (<<) <InstallIPKGs> [0]
[ dbug ] (>>) <InstallPIPs>
[ proc ] downloading & installing (PIP modules) ...
[ done ] downloaded & installed (PIP modules)
[ dbug ] (<<) <InstallPIPs> [0]
[ dbug ] (<<) <InstallExtras> [0]
[ dbug ] (>>) <BackupAndRemoveOldApp>
[ dbug ] (>>) <BackupConfig>
[ proc ] stopping daemon (sabnzbd.sh) ...
[ done ] daemon stopped (sabnzbd.sh)
[ dbug ] (vv) $package_config_path [/share/MD0_DATA/.qpkg/SABnzbdplus/config]
[ dbug ] (vv) $QPKG_BACKUP_PATH [/share/Public/sherpa.tmp/backup]
[ dbug ] (II) moved old config to backup location
[ done ] created 'SABnzbdplus' settings backup
[ dbug ] (>>) <ConvertSettings>
[ dbug ] (<<) <ConvertSettings> [0]
[ dbug ] (<<) <BackupConfig> [0]
[ proc ] uninstalling QPKG 'SABnzbdplus' ...
[ done ] uninstalled QPKG 'SABnzbdplus'
[ dbug ] (<<) <BackupAndRemoveOldApp> [0]
[ dbug ] (>>) <InstallTargetApp>
[ proc ] installing QPKG (SABnzbdplus_190205.qpkg) - this can take a while ...
[ done ] installed QPKG (SABnzbdplus_190205.qpkg)
[ proc ] waiting for 10 seconds ...
[ done ] wait complete
[ dbug ] (>>) <RestoreConfig>
[ proc ] stopping daemon (sabnzbd.sh) ...
[ done ] daemon stopped (sabnzbd.sh)
[ done ] restored 'SABnzbdplus' settings backup
[ dbug ] (<<) <RestoreConfig> [0]
[ proc ] starting daemon (sabnzbd.sh) - this can take a while ...
[ done ] daemon started (sabnzbd.sh)
[ dbug ] (<<) <InstallTargetApp> [0]
[ dbug ] (>>) <Cleanup>
[ dbug ] (--) resumed existing SABnzbd queue
[ dbug ] (<<) <Cleanup> [0]
[ dbug ] (>>) <DisplayResult>
[ done ] 'SABnzbdplus' has been successfully reinstalled!
[ dbug ] (**) SCRIPT:          finished: Thu Apr  4 21:40:16 CEST 2019
[ dbug ] (**) SCRIPT:      elapsed time: 00h:01m:02s
[ dbug ] (II) ======================================================================
[ dbug ] (<<) <DisplayResult> [0]

[OneCD]

Code: Select all

[ dbug ] (**) NAS   :             model: TS-459 Pro II

How much RAM is installed? I think the default for this model was 1GB.

If so, please checkout this post by @Willem_K for a possible solution:

I think I have found the solution. My NAS TS-459 Pro is of an older type. I noticed already for some time a high usage of RAM and Processor (showing orange in nas resource monitor), perhaps due to all the updates the NAS has got during the years. In another forum I read a description how to double the internal memory of this nas (from 1GB to 2 GB). I was able to acquire a 2GB memory module for little money and after installing the 2GB module it appears that the nas is running much smoother! RAM usage stays much lower and SABnzbd keeps running until now!

[ptrkp]

I had some errors with Par2cmdline-MT so I tried you script to repair it but the script fales

[/share/Public] # ./sherpa.sh SABnzbd
sherpa.sh (190331)

[ done ] downloaded sherpa package list
[ done ] Entware package list is up-to-date
[ done ] no IPKGs are required
[ fail ] Download & install failed (PIP modules) [1]

[ fail ] 'SABnzbdplus' install failed! [20]

So I hope that you can help.

Code: Select all

[ dbug ] (>>) <Init>
[ dbug ] (II) ======================================================================
[ dbug ] (**) SCRIPT:           started: Sun Apr 7 21:38:33 CEST 2019
[ dbug ] (**) SCRIPT:           version: 190331
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (II) Markers: (**) detected, (II) information, (WW) warning, (LL) log file,
[ dbug ] (II)  (EE) error, (==) processing, (--) done, (>>) f entry, (<<) f exit,
[ dbug ] (II)  (vv) variable name & value, ($1) positional argument value.
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (**) NAS   :             model: TS-659 Pro II
[ dbug ] (**) NAS   :  firmware version: 4.2.6
[ dbug ] (**) NAS   :    firmware build: 20190322
[ dbug ] (**) NAS   :            kernel: 3.4.6 x86_64
[ dbug ] (**) NAS   :         OS uptime: 2:21
[ dbug ] (**) NAS   :       system load: 1 min=0.69, 5 min=0.98, 15 min=0.89
[ dbug ] (**) NAS   :              EUID: 0
[ dbug ] (**) NAS   :    default volume: /share/MD0_DATA
[ dbug ] (**) NAS   :             $PATH: /opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr
[ dbug ] (**) NAS   :              /opt: /share/MD0_DATA/.qpkg/Entware-3x
[ dbug ] (**) NAS   :   /share/Download: MD0_DATA/Download
[ dbug ] (**) SCRIPT:    user arguments: SABnzbd
[ dbug ] (**) SCRIPT:        target app: SABnzbdplus
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (vv) $STEPHANE_QPKG_ARCH [x86]
[ dbug ] (vv) $PREF_ENTWARE [Entware-3x]
[ dbug ] (**) QPKG  : Entware installer: std
[ proc ] downloading sherpa package list ...
[ done ] downloaded sherpa package list
[ dbug ] (<<) <Init> [0]
[ dbug ] (>>) <PauseDownloaders>
[ dbug ] (--) paused existing SABnzbd queue
[ dbug ] (<<) <PauseDownloaders> [0]
[ dbug ] (>>) <RemoveOther>
[ dbug ] (**) QPKG  :         'Optware': not installed [250]
[ dbug ] (<<) <RemoveOther> [0]
[ dbug ] (>>) <DownloadQPKGs>
[ dbug ] (>>) <DownloadQPKG>
[ dbug ] (II) existing QPKG checksum correct (SABnzbdplus_190205.qpkg)
[ dbug ] (<<) <DownloadQPKG> [0]
[ dbug ] (<<) <DownloadQPKGs> [0]
[ dbug ] (>>) <InstallEntware>
[ dbug ] (--) adjusted $PATH
[ dbug ] (vv) $PATH [/opt/bin:/opt/sbin:/opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/bin/X11:/usr/local/sbin:/usr/local/bin:/Apps/bin:/Apps/sbin:/usr/local/jre/bin]
[ dbug ] (>>) <PatchEntwareInit>
[ dbug ] (II) patch: do the "opt shuffle" - already done
[ dbug ] (<<) <PatchEntwareInit> [0]
[ dbug ] (<<) <InstallEntware> [0]
[ dbug ] (>>) <InstallExtras>
[ dbug ] (II) QPKG 'Par2' is already installed
[ dbug ] (II) QPKG 'Par2' is already enabled
[ dbug ] (>>) <InstallIPKGs>
[ dbug ] (>>) <UpdateEntware>
[ dbug ] (II) Entware package list was updated less than 60 minutes ago
[ done ] Entware package list is up-to-date
[ dbug ] (<<) <UpdateEntware> [0]
[ dbug ] (>>) <InstallIPKGBatch>
[ proc ] calculating number and size of IPKGs required ...
[ dbug ] (II) requested IPKGs: git git-http nano less ca-certificates python python-pip python-pyopenssl python-dev gcc unrar p7zip coreutils-nice ionice ffprobe
[ dbug ] (==) finding all IPKG dependencies ...
[ dbug ] (--) complete
[ dbug ] (II) found all IPKG dependencies in 11 iterations
[ dbug ] (==) excluding packages already installed ...
[ dbug ] (--) complete
[ dbug ] (II) IPKGs to download: 
[ dbug ] (vv) $IPKG_download_size [0]
[ done ] no IPKGs are required
[ dbug ] (<<) <InstallIPKGBatch> [0]
[ dbug ] (<<) <InstallIPKGs> [0]
[ dbug ] (>>) <InstallPIPs>
[ proc ] downloading & installing (PIP modules) ...
[ fail ] Download & install failed (PIP modules) [1]
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (LL) /share/Public/sherpa.tmp/PIP_modules.install.log
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (LL) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.
[ dbug ] (LL) Requirement already satisfied: setuptools in /share/MD0_DATA/.qpkg/Entware-3x/lib/python2.7/site-packages (39.0.1)
[ dbug ] (LL) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.
[ dbug ] (LL) Collecting sabyenc==3.3.5
[ dbug ] (LL) Using cached https://files.pythonhosted.org/packages/4f/30/a1a313ee4d9881cc5e119fcefb9f746df71f1b4fa6d3b53cc334799dbfd8/sabyenc-3.3.5.tar.gz
[ dbug ] (LL) Complete output from command python setup.py egg_info:
[ dbug ] (LL) Traceback (most recent call last):
[ dbug ] (LL) File "<string>", line 1, in <module>
[ dbug ] (LL) File "/opt/lib/python2.7/site-packages/setuptools/__init__.py", line 14, in <module>
[ dbug ] (LL) File "/opt/lib/python2.7/site-packages/setuptools/dist.py", line 27, in <module>
[ dbug ] (LL) File "/opt/lib/python2.7/site-packages/setuptools/config.py", line 9, in <module>
[ dbug ] (LL) from setuptools.py26compat import import_module
[ dbug ] (LL) ImportError: No module named py26compat
[ dbug ] (LL) 
[ dbug ] (LL) ----------------------------------------
[ dbug ] (LL) Command "python setup.py egg_info" failed with error code 1 in /share/MD0_DATA/.qpkg/Entware-3x/tmp/pip-install-VeEm3n/sabyenc/
[ dbug ] (LL) result=[1]
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (<<) <InstallPIPs> [20]
[ dbug ] (<<) <InstallExtras> [20]
[ dbug ] (>>) <Cleanup>
[ dbug ] (--) resumed existing SABnzbd queue
[ dbug ] (<<) <Cleanup> [20]
[ dbug ] (>>) <DisplayResult>
[ fail ] 'SABnzbdplus' install failed! [20]
[ dbug ] (**) SCRIPT:          finished: Sun Apr  7 21:38:46 CEST 2019
[ dbug ] (**) SCRIPT:      elapsed time: 00h:00m:13s
[ dbug ] (II) ======================================================================
[ dbug ] (<<) <DisplayResult> [20]

[OneCD]

Code: Select all

[ dbug ] (vv) $PREF_ENTWARE [Entware-3x]

It looks like you have the old Entware-3x package. Let's remove it and use the latest one instead:

Code: Select all

./sherpa.sh sab --reinstall-entware

[ptrkp]

Thanks that did the trick

[bjtukker]

Hi OneCD,

I have upgraded the machine to 3GB years ago, so it has 'plenty' of RAM
It has worked with the package from Qnap, and now wanted to update Sabnzb to the latest version.

The App is shown as installed and started in the AppCenter and the version is 190205. I can stop it there and the icon turns grey, start it and it's showing it's normal colors.

Maybe the issue is with ssl, as I'm struggling with configuring Tomcat with ssl as well, but that's another story. In the past I configured the default Qnap app to use http port 8800 instead of https and port 9090. How can switch back to that port? Editing it directly in the config file didn't seem to work...

Code: Select all

[ dbug ] (**) NAS   :             model: TS-459 Pro II

How much RAM is installed? I think the default for this model was 1GB.

If so, please checkout this post by @Willem_K for a possible solution:

I think I have found the solution. My NAS TS-459 Pro is of an older type. I noticed already for some time a high usage of RAM and Processor (showing orange in nas resource monitor), perhaps due to all the updates the NAS has got during the years. In another forum I read a description how to double the internal memory of this nas (from 1GB to 2 GB). I was able to acquire a 2GB memory module for little money and after installing the 2GB module it appears that the nas is running much smoother! RAM usage stays much lower and SABnzbd keeps running until now!