[QPKG] sherpa: a mini-package-manager (CLI) beta

[rop]

Hey @OneCD , thank you for your response.
It seems the problem was different then what I supposed it was in the first place. As it did not let me uninstall anything at all, so I SSH'd to the box and took down services and unmounted to be able to

Code: Select all

 e2fsck_64 -f -v -C 0 /dev/mapper/cachedev1

, once that finished remounted and started services and they worked, that is until you reboot and everything seems there but you can't run anything as for some reason the FS can't actually see the files. BTW when you try to run Check FS it via Qnap GUI it tell you it cannot because Entware is starting... But as I said its a totally different problem completely. Im still trying to figure out what is wrong with that box but at least the work around works until reboot.

Hey @rop.

Code: Select all

[ fail ] Entware appears to be installed but is not visible.

Can you please manually uninstall the existing Entware package via the App Center? Once this is complete, please login via SSH and run the sherpa script again.

[OneCD]

BTW when you try to run Check FS it via Qnap GUI it tell you it cannot because Entware is starting... But as I said its a totally different problem completely.

Ah, that's why sherpa is throwing an error. It's looking for the presence of [/opt/etc/passwd], but can't find it. Something is holding-up the Entware package re-integration.

Are you running any Entware init scripts?

Are you using SortMyQPKGs?

Maybe you could try disabling all apps?

[erkme73]

Quick question about SABNZBD problem...

I recently changed indexers from nzbs.org to nzbplanet. In theory, nothing should have changed with my sonarr/sabnzbd configuration - other than adding the new indexer and removing the old.

However, now when I queue up an NZB to sabznbd, almost all (maybe 95%) of the episodes/movies I try to grab fail with this error I've never had before.

2019-04-23_16-03-39.jpg

I know this is a reach/stretch, but I'm hoping this is something you guys have seen before and might have a simple solution/suggestion.

[dirkonline]

Quick question about SABNZBD problem...

I recently changed indexers from nzbs.org to nzbplanet. In theory, nothing should have changed with my sonarr/sabnzbd configuration - other than adding the new indexer and removing the old.

However, now when I queue up an NZB to sabznbd, almost all (maybe 95%) of the episodes/movies I try to grab fail with this error I've never had before.

2019-04-23_16-03-39.jpg

I know this is a reach/stretch, but I'm hoping this is something you guys have seen before and might have a simple solution/suggestion.

Sorry, I have not seen this but a quick search in the sab forums etc shows a few hits with similar errors.

I strongly suggest no mentioning of any indexers anywhere. A bit like Fight Club Rules really Maybe edit your post because this forum is searchable.


That said, you will most likely get better help over in the https://forums.sabnzbd.org/ and you should open a ticket on GIT https://github.com/sabnzbd/sabnzbd/issues

a)Turn on Debug logging beforehand, reproduce the effect, provide the logs, sanitise screenshots and provide an example nzb files to the guys over there.
b) Try adding a nzdb that fails whem coming from Sonarr manually to SABNZDB and see if it happens as well.

That said, this looks like the files are being deleted something before they can be processed. Your indexer should not have an impact on that at all.
Your temp files may be going missing but the screenshot doesn't really reveal all that much. This also looks a lot like what you had and they pretty much end up with, "not a sabnzdb issue" https://github.com/sabnzbd/sabnzbd/issues/952

[jayhova]

Hi All,

I was trying to update Couch Potato and get the following error. It looks like the main error log is "Download & install PIPs failed (PIP packages)". I already tried to reinstall entware as suggested in earlier posts. Any help would be appreciated.

Code: Select all

[/share/Public] # ./sherpa.sh couchpotato --debug
[ dbug ] (vv) $debug [true]
[ dbug ] (>>) <Init>
[ dbug ] (II) ======================================================================
[ dbug ] (**) SCRIPT:           started: Sat Apr 27 22:51:32 EDT 2019
[ dbug ] (**) SCRIPT:           version: 190425
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (II) Markers: (**) detected, (II) information, (WW) warning, (LL) log file,
[ dbug ] (II)  (EE) error, (==) processing, (--) done, (>>) f entry, (<<) f exit,
[ dbug ] (II)  (vv) variable name & value, ($1) positional argument value.
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (**) NAS   :             model: TS-469L
[ dbug ] (**) NAS   :  firmware version: 4.3.4
[ dbug ] (**) NAS   :    firmware build: 20190322
[ dbug ] (**) NAS   :            kernel: 3.4.6 x86_64
[ dbug ] (**) NAS   :         OS uptime: 27 days
[ dbug ] (**) NAS   :       system load: 1 min=0.45, 5 min=0.35, 15 min=0.25
[ dbug ] (**) NAS   :              EUID: 0
[ dbug ] (**) NAS   :    default volume: /share/MD0_DATA
[ dbug ] (**) NAS   :             $PATH: /opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr
[ dbug ] (**) NAS   :              /opt: /share/MD0_DATA/.qpkg/Entware
[ dbug ] (**) NAS   :   /share/Download: MD0_DATA/Download
[ dbug ] (**) SCRIPT:    user arguments: couchpotato --debug
[ dbug ] (**) SCRIPT:        target app: CouchPotato2
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (vv) $STEPHANE_QPKG_ARCH [x64]
[ dbug ] (vv) $PREF_ENTWARE [Entware]
[ dbug ] (**) QPKG  : Entware installer: std
[ proc ] downloading sherpa package list ...
[ done ] downloaded sherpa package list
[ dbug ] (<<) <Init> [0]
[ dbug ] (>>) <RemoveOther>
[ dbug ] (**) QPKG  :         'Optware': not installed [250]
[ dbug ] (<<) <RemoveOther> [0]
[ dbug ] (>>) <DownloadQPKGs>
[ dbug ] (>>) <DownloadQPKG>
[ dbug ] (II) existing QPKG checksum correct (CouchPotato2_180427.qpkg)
[ dbug ] (<<) <DownloadQPKG> [0]
[ dbug ] (<<) <DownloadQPKGs> [0]
[ dbug ] (>>) <InstallEntware>
[ dbug ] (--) adjusted $PATH
[ dbug ] (vv) $PATH [/opt/bin:/opt/sbin:/opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/bin/X11:/usr/local/sbin:/usr/local/bin:/Apps/bin:/Apps/sbin]
[ dbug ] (>>) <PatchEntwareInit>
[ dbug ] (II) patch: do the "opt shuffle" - already done
[ dbug ] (<<) <PatchEntwareInit> [0]
[ dbug ] (<<) <InstallEntware> [0]
[ dbug ] (>>) <InstallExtras>
[ dbug ] (>>) <InstallIPKGs>
[ dbug ] (>>) <UpdateEntware>
[ proc ] updating Entware package list ...
[ done ] updated Entware package list
[ dbug ] (<<) <UpdateEntware> [0]
[ dbug ] (>>) <InstallIPKGBatch>
[ proc ] calculating number and size of IPKGs required ...
[ dbug ] (II) requested IPKGs: git git-http nano less ca-certificates python python-pip python-pyopenssl python-lxml
[ dbug ] (==) finding all IPKG dependencies ...
[ dbug ] (--) complete
[ dbug ] (II) found all IPKG dependencies in 11 iterations
[ dbug ] (==) excluding packages already installed ...
[ dbug ] (--) complete
[ dbug ] (II) IPKGs to download:
[ dbug ] (vv) $IPKG_download_size [0]
[ done ] no IPKGs are required
[ dbug ] (<<) <InstallIPKGBatch> [0]
[ dbug ] (<<) <InstallIPKGs> [0]
[ dbug ] (>>) <InstallPIPs>
[ proc ] downloading & installing (PIP packages) ...
[ fail ] Download & install PIPs failed (PIP packages) [1]
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (LL) /share/Public/sherpa.tmp/PIP_packages.install.log
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (LL) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.
[ dbug ] (LL) Requirement already up-to-date: pip in /share/MD0_DATA/.qpkg/Entware/lib/python2.7/site-packages (19.1)
[ dbug ] (LL) Requirement already up-to-date: setuptools in /share/MD0_DATA/.qpkg/Entware/lib/python2.7/site-packages (41.0.1)
[ dbug ] (LL) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.
[ dbug ] (LL) ERROR: You must give at least one requirement to install (see "pip help install")
[ dbug ] (LL) result=[1]
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (<<) <InstallPIPs> [19]
[ dbug ] (<<) <InstallExtras> [19]
[ dbug ] (>>) <Cleanup>
[ dbug ] (<<) <Cleanup> [19]
[ dbug ] (>>) <DisplayResult>
[ fail ] 'CouchPotato2' install failed! :S [19]

* Please consider creating a new issue for this on GitHub:
	https://github.com/OneCDOnly/sherpa/issues

* Alternatively, post on the QNAP NAS Community Forum:
	https://forum.qnap.com/viewtopic.php?f=320&t=132373

* Remember to include a copy of your sherpa runtime debug log for analysis.
[ dbug ] (**) SCRIPT:          finished: Sat Apr 27 22:51:45 EDT 2019
[ dbug ] (**) SCRIPT:      elapsed time: 00h:00m:13s
[ dbug ] (II) ======================================================================
[ dbug ] (<<) <DisplayResult> [19]

[OneCD]

... and fixed again.

Apologies, the script is getting a major overhaul at the moment, so some functionality may break for short periods.

[jayhova]

... and fixed again.

Apologies, the script is getting a major overhaul at the moment, so some functionality may break for short periods.

Tried again just now. Looks like the same error.

[OneCD]

Tried again just now. Looks like the same error.

OK, should be good-to-go now. Please download the latest script and try again.

[jayhova]

OK, should be good-to-go now. Please download the latest script and try again.

That did it! Thanks for your help and work putting this together for everyone!

[OneCD]

Awesome, good work.

[Windza]

Been having lots of Python/pip related issues with SAB/Medusa recently and have only ever used manual installs over the years - have seen the Sherpa script mentioned from time to time so figured "let's try it".
I'm essentially trying to start from scratch but keep running into various errors (again related to Python/pip).
I have manually uninstalled my original Entware (v0.99) and attempted to use sherpa to reinstall and ended up with this;

"[ fail ] A required NAS system file is missing [/opt/bin/pip]"

Any advice/suggestions?

Code: Select all

[ dbug ] (II) ======================================================================
[ dbug ] (**) SCRIPT:           started: Sun Apr 28 18:01:01 EDT 2019
[ dbug ] (**) SCRIPT:           version: 190428
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (II) Markers: (**) detected, (II) information, (WW) warning, (LL) log file,
[ dbug ] (II)  (EE) error, (==) processing, (--) done, (>>) f entry, (<<) f exit,
[ dbug ] (II)  (vv) variable name & value, ($1) positional argument value.
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (**) NAS   :             model: TVS-871, QNAP Systems, Inc.
[ dbug ] (**) NAS   :  firmware version: 4.3.3
[ dbug ] (**) NAS   :    firmware build: 20170901
[ dbug ] (**) NAS   :            kernel: 4.2.8 x86_64
[ dbug ] (**) NAS   :         OS uptime: 1 day
[ dbug ] (**) NAS   :       system load: 1 min=0.30, 5 min=0.15, 15 min=0.11
[ dbug ] (**) NAS   :              EUID: 0
[ dbug ] (**) NAS   :    default volume: /share/CACHEDEV1_DATA
[ dbug ] (**) NAS   :             $PATH: /opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr
[ dbug ] (**) NAS   :              /opt: /share/CACHEDEV1_DATA/.qpkg/Entware
[ dbug ] (**) NAS   :   /share/Download: CACHEDEV1_DATA/Download
[ dbug ] (**) SCRIPT:    user arguments: Entware
[ dbug ] (**) SCRIPT:        target app: Entware
[ dbug ] (II) ----------------------------------------------------------------------
[ dbug ] (vv) $NAS_QPKG_ARCH [x64]
[ dbug ] (vv) $PREF_ENTWARE [Entware]
[ dbug ] (**) QPKG  : Entware installer: std
[ proc ] downloading sherpa package list ...
[ done ] downloaded sherpa package list
[ dbug ] (<<) <Init> [0]
[ dbug ] (>>) <RemoveQPKGs>
[ dbug ] (**) QPKG  :         'Optware': not installed [250]
[ proc ] uninstalling QPKG 'Entware' ...
[ done ] uninstalled QPKG 'Entware'
[ dbug ] (vv) $PREF_ENTWARE [Entware]
[ dbug ] (<<) <RemoveQPKGs> [0]
[ dbug ] (>>) <DownloadQPKGs>
[ dbug ] (>>) <DownloadQPKG>
[ dbug ] (II) existing QPKG checksum correct (Entware_1.00std.qpkg)
[ dbug ] (<<) <DownloadQPKG> [0]
[ dbug ] (>>) <DownloadQPKG>
[ dbug ] (II) existing QPKG checksum correct (Entware_1.00std.qpkg)
[ dbug ] (<<) <DownloadQPKG> [0]
[ dbug ] (<<) <DownloadQPKGs> [0]
[ dbug ] (>>) <InstallEntware>
[ proc ] installing file (Entware_1.00std.qpkg) - this can take a while ...
[ done ] installed file (Entware_1.00std.qpkg)
[ dbug ] (--) adjusted $PATH
[ dbug ] (vv) $PATH [/opt/bin:/opt/sbin:/opt/bin:/opt/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/bin/X11:/usr/local/sbin:/usr/local/bin]
[ dbug ] (>>) <PatchEntwareInit>
[ dbug ] (--) patch: do the "opt shuffle"
[ dbug ] (<<) <PatchEntwareInit> [0]
[ dbug ] (<<) <InstallEntware> [0]
[ dbug ] (>>) <InstallExtras>
[ dbug ] (>>) <InstallIPKGs>
[ dbug ] (>>) <UpdateEntware>
[ proc ] updating Entware package list ...
[ done ] updated Entware package list
[ dbug ] (<<) <UpdateEntware> [0]
[ dbug ] (>>) <InstallIPKGBatch>
[ proc ] calculating number and size of IPKGs required ...
[ dbug ] (II) requested IPKGs: git git-http nano less ca-certificates 
[ dbug ] (==) finding all IPKG dependencies ...
[ dbug ] (--) complete
[ dbug ] (II) found all IPKG dependencies in 7 iterations
[ dbug ] (==) excluding packages already installed ...
[ dbug ] (--) complete
[ dbug ] (II) IPKGs to download: ca-bundle ca-certificates file git git-http less libcurl libmagic libncurses libncursesw libopenssl nano zlib
[ dbug ] (==) calculating size of IPKGs to download ...
[ dbug ] (--) complete
[ dbug ] (vv) $IPKG_download_size [11274327]
[ done ] 13 IPKGs (11MB) to be downloaded
[ proc ] downloading & installing 13 IPKGs (Python, Git and others) ...
[ done ] downloaded & installed 13 IPKGs (Python, Git and others)
[ dbug ] (**) STAGE :      elapsed time: 00h:00m:04s
[ dbug ] (<<) <InstallIPKGBatch> [0]
[ dbug ] (<<) <InstallIPKGs> [0]
[ dbug ] (>>) <InstallPIPs>
[ fail ] A required NAS system file is missing [/opt/bin/pip]
[ dbug ] (<<) <InstallExtras> [43]
[ dbug ] (>>) <Cleanup>
[ dbug ] (<<) <Cleanup> [43]
[ dbug ] (>>) <DisplayResult>
[ fail ] 'Entware' reinstall failed! [43]
[ dbug ] (**) SCRIPT:          finished: Sun Apr 28 18:01:39 EDT 2019
[ dbug ] (**) SCRIPT:      elapsed time: 00h:00m:38s
[ dbug ] (II) ======================================================================
[ dbug ] (<<) <DisplayResult> [43]

[OneCD]

"[ fail ] A required NAS system file is missing [/opt/bin/pip]"

Any advice/suggestions?

Thanks for reporting this, I'm still working on Entware package installation as a single feature. Looks like it's not quite there yet.

For now, try installing one of the other apps (like SABnzbd), which will then automatically install Entware.

[mdhwoods]

OneCD, latest firmware broke my sab . always a risk
tried running the script and got some errors. disabled sortmyqpks's didnt help. did not uninstall entware as i didn't want to create other issues. Thanks as always.

Code: Select all

[ dbug ] (==) finding all IPKG dependencies ...
[ dbug ] (--) complete
[ dbug ] (II) found all IPKG dependencies in 11 iterations
[ dbug ] (==) excluding packages already installed ...
[ dbug ] (--) complete
[ dbug ] (II) IPKGs to download:
[ dbug ] (vv) $IPKG_download_size [0]
[ done ] no IPKGs are required
[ dbug ] (<<) <InstallIPKGBatch> [0]
[ dbug ] (<<) <InstallIPKGs> [0]
[ dbug ] (>>) <InstallPIPs>
[ proc ] downloading & installing (PIP packages) ...
[ fail ] Download & install PIPs failed (PIP packages) [1]
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (LL) /share/Public/sherpa.tmp/PIP_packages.install.log
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (LL) Traceback (most recent call last):
[ dbug ] (LL) File "/opt/bin/pip", line 7, in <module>
[ dbug ] (LL) from pip import main
[ dbug ] (LL) ImportError: cannot import name main
[ dbug ] (LL) result=[1]
[ dbug ] (LL) ----------------------------------------------------------------------
[ dbug ] (<<) <InstallPIPs> [19]
[ dbug ] (<<) <InstallExtras> [19]
[ dbug ] (>>) <Cleanup>
[ dbug ] (<<) <Cleanup> [19]
[ dbug ] (>>) <DisplayResult>
[ fail ] 'SABnzbdplus' install failed! [19]
[ dbug ] (**) SCRIPT:          finished: Mon Apr 29 11:31:26 EDT 2019
[ dbug ] (**) SCRIPT:      elapsed time: 00h:00m:02s
[ dbug ] (II) ======================================================================
[ dbug ] (<<) <DisplayResult> [19]

[OneCD]

did not uninstall entware as i didn't want to create other issues.

Best-guess though is that's what will be required.

I'm still working on the sherpa-managed single Entware reinstallation, so for now, please manually uninstall Entware via your App Center, then run sherpa with:

Code: Select all

./sherpa sab

... to reinstall Entware and SABnzbd.

[mdhwoods]

did not uninstall entware as i didn't want to create other issues.

Best-guess though is that's what will be required.

I'm still working on the sherpa-managed single Entware reinstallation, so for now, please manually uninstall Entware via your App Center, then run sherpa with:

Code: Select all

./sherpa sab

... to reinstall Entware and SABnzbd.

ok thanks, that did the trick, not sure if the reinstall of entware will cause other issues. Cant remember if i have anything else running that requires it. also re enabled sort my qpkg's after the reinstall. cant reboot now, but hopefully everything starts in the proper order once I do reboot. thoughts on why firmware update busted it? Its been some time since a firmware upgrade broke it.

anyone else that looks at this.

its ./sherpa.sh sab after uninstalling entware