[QPKG] SortMyQPKGs

This is the best place for community developers to publish their genius work. Your Apps enrich the QNAP Turbo NAS.
User avatar
OneCD
Guru
Posts: 12155
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [QPKG] SortMyQPKGs

Post by OneCD »

Hi and welcome to the forum (finally!) :)
tekwizard wrote: Tue Feb 01, 2022 5:32 am Would you please move

TVHeadend

to the very end. I'm using it with TVMosaic and it won't load the TV stick otherwise.
So, the loading order should be TVMosaic, then TVHeadend?

I've not used these packages: can you please describe the differences between them?

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
Don
Guru
Posts: 12289
Joined: Thu Jan 03, 2008 4:56 am
Location: Long Island, New York

Re: [QPKG] SortMyQPKGs

Post by Don »

Hi OneCD,

Is there a way to put a delay between the startup of QPKGS? I know that this is not a SortMyQPKGs issue but I thought you might know.

Thanks
Don
Use the forum search feature before posting.

Use RAID and external backups. RAID will protect you from disk failure, keep your system running, and data accessible while the disk is replaced, and the RAID rebuilt. Backups will allow you to recover data that is lost or corrupted, or from system failure. One does not replace the other.

NAS: TVS-882BR | F/W: 5.0.1.2346 | 40GB | 2 x 1TB M.2 SATA RAID 1 (System/VMs) | 3 x 1TB M.2 NMVe QM2-4P-384A RAID 5 (cache) | 5 x 14TB Exos HDD RAID 6 (Data) | 1 x Blu-ray
NAS: TVS-h674 | F/W: 5.0.1.2376 | 16GB | 3 x 18TB RAID 5
Apps: DNSMasq, PLEX, iDrive, QVPN, QLMS, MP3fs, HBS3, Entware, DLstation, VS, +
User avatar
OneCD
Guru
Posts: 12155
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [QPKG] SortMyQPKGs

Post by OneCD »

Hey @Don. :D

Hmm, good question. The actual startup of QPKGs is managed by QTS. If a QPKG required a delayed start, this would need to be built-into the service script for that QPKG.

Have you discovered an issue where consecutive and dependent QPKGs are starting too quickly?

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
Don
Guru
Posts: 12289
Joined: Thu Jan 03, 2008 4:56 am
Location: Long Island, New York

Re: [QPKG] SortMyQPKGs

Post by Don »

Maybe but probably not. I'm have an issue with Qulog (notification center) not being able to send alerts. If I click on resend it works. I use dnsmasq and Qvpn so I was just wondering if the one of these, or even netmgr, needed more time to start up before Qulog started. I'm don't think that is the issue but just reaching. QNAP will look at the system remotely.
Use the forum search feature before posting.

Use RAID and external backups. RAID will protect you from disk failure, keep your system running, and data accessible while the disk is replaced, and the RAID rebuilt. Backups will allow you to recover data that is lost or corrupted, or from system failure. One does not replace the other.

NAS: TVS-882BR | F/W: 5.0.1.2346 | 40GB | 2 x 1TB M.2 SATA RAID 1 (System/VMs) | 3 x 1TB M.2 NMVe QM2-4P-384A RAID 5 (cache) | 5 x 14TB Exos HDD RAID 6 (Data) | 1 x Blu-ray
NAS: TVS-h674 | F/W: 5.0.1.2376 | 16GB | 3 x 18TB RAID 5
Apps: DNSMasq, PLEX, iDrive, QVPN, QLMS, MP3fs, HBS3, Entware, DLstation, VS, +
User avatar
OneCD
Guru
Posts: 12155
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [QPKG] SortMyQPKGs

Post by OneCD »

Maybe we should move QuLog? Is it a separate QPKG?

edit: just checked this - yes, it's a separate QPKG.

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
Don
Guru
Posts: 12289
Joined: Thu Jan 03, 2008 4:56 am
Location: Long Island, New York

Re: [QPKG] SortMyQPKGs

Post by Don »

I think it definitely is a startup order issue. Notification center fails sending out messages. Today I upgraded notification center and it is now sending out messages. Performing the upgrade stopped and restarted Notification center. Since the network, dnsmasq, and Qvpn were already up and running Notification center had everything in place that it needs. I think notification center needs to move so it is one of the last things started. It is called Notification Center and not QuLog, sorry.

Code: Select all

[NotificationCenter]
Name = NotificationCenter
Status = complete
Display_Name = Notification Center
Version = 1.4.0.2076
Author = QNAP Systems, Inc.
QPKG_File = NotificationCenter.qpkg
Date = 2022-03-17
Alt_Shell = /mnt/ext/opt/NotificationCenter/etc/init.d/nc.sh
Install_Path = /mnt/ext/opt/NotificationCenter
WebUI = /nc/
Web_Port = -1
RC_Number = 101
Sys_App = 2
App_ID = A008
Desktop = 1
Win_Min_Width = 1170
Win_Min_Height = 580
Force_Visible = 1
Enable = TRUE
Class = null
FW_Ver_Min = 5.0.0
Use the forum search feature before posting.

Use RAID and external backups. RAID will protect you from disk failure, keep your system running, and data accessible while the disk is replaced, and the RAID rebuilt. Backups will allow you to recover data that is lost or corrupted, or from system failure. One does not replace the other.

NAS: TVS-882BR | F/W: 5.0.1.2346 | 40GB | 2 x 1TB M.2 SATA RAID 1 (System/VMs) | 3 x 1TB M.2 NMVe QM2-4P-384A RAID 5 (cache) | 5 x 14TB Exos HDD RAID 6 (Data) | 1 x Blu-ray
NAS: TVS-h674 | F/W: 5.0.1.2376 | 16GB | 3 x 18TB RAID 5
Apps: DNSMasq, PLEX, iDrive, QVPN, QLMS, MP3fs, HBS3, Entware, DLstation, VS, +
User avatar
OneCD
Guru
Posts: 12155
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [QPKG] SortMyQPKGs

Post by OneCD »

Don wrote: Fri Mar 18, 2022 11:32 am Since the network, dnsmasq, and Qvpn were already up and running Notification center had everything in place that it needs. I think notification center needs to move so it is one of the last things started.
@Don, are you able to confirm this by ensuring the NotificationCenter config block is placed last in [/etc/config/qpkg.conf], then restarting the NAS?

Let me know if it works. Cheers!

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
Don
Guru
Posts: 12289
Joined: Thu Jan 03, 2008 4:56 am
Location: Long Island, New York

Re: [QPKG] SortMyQPKGs

Post by Don »

I’ll try it over the weekend.
Use the forum search feature before posting.

Use RAID and external backups. RAID will protect you from disk failure, keep your system running, and data accessible while the disk is replaced, and the RAID rebuilt. Backups will allow you to recover data that is lost or corrupted, or from system failure. One does not replace the other.

NAS: TVS-882BR | F/W: 5.0.1.2346 | 40GB | 2 x 1TB M.2 SATA RAID 1 (System/VMs) | 3 x 1TB M.2 NMVe QM2-4P-384A RAID 5 (cache) | 5 x 14TB Exos HDD RAID 6 (Data) | 1 x Blu-ray
NAS: TVS-h674 | F/W: 5.0.1.2376 | 16GB | 3 x 18TB RAID 5
Apps: DNSMasq, PLEX, iDrive, QVPN, QLMS, MP3fs, HBS3, Entware, DLstation, VS, +
User avatar
Don
Guru
Posts: 12289
Joined: Thu Jan 03, 2008 4:56 am
Location: Long Island, New York

Re: [QPKG] SortMyQPKGs

Post by Don »

So I stopped SortMyQPKGs and edited qpkg.conf and moved Notification Center to the bottom of the file. I rebooted and Notification Center was once again unable to send messages. I checked qpkg.conf and Notification Center was back at it's old location. I moved it again with the same results. I then looked at SortMyQPKGS.log and even though SortMyQPKGs is stopped it is still autofixing the qpkg.conf file.

Code: Select all

──────────────────────────────────────────────────
SortMyQPKGs (20220210)
[Mon Mar 21 21:15:49 EDT 2022] 'autofix' requested
ALPHA=custom, OMEGA=custom

 * Original order *
(01) (A) netmgr
(02) (A) QVPN
(03) (A) DNSMasq
(04) (A) MalwareRemover
(05) (Φ) QuLog
(06) (Φ) SecurityCounselor
(07) (Ω) Entware-3x
(08) (Ω) PlexMediaServer
(09) (Ω) LogitechMediaServer
(10) (Ω) MP3fs
(11) (Ω) IDrive
(12) (Ω) QKVM
(13) (Ω) HybridBackup
(14) (Ω) ResourceMonitor
(15) (Ω) DownloadStation
(16) (Ω) Qboost
(17) (Ω) helpdesk
(18) (Ω) Boinc
(19) (Ω) SSDLaboratory
(20) (Ω) LicenseCenter
(21) (Ω) QcloudSSLCertificate
(22) (Ω) HideThatBanner
(23) (Ω) SortMyQPKGs
(24) (Φ) NotificationCenter

 * New order *
(01) (A) netmgr
(02) (A) QVPN
(03) (A) DNSMasq
(04) (A) MalwareRemover
(05) (Φ) QuLog
(06) (Φ) SecurityCounselor
(07) (Φ) NotificationCenter
(08) (Ω) Entware-3x
(09) (Ω) PlexMediaServer
(10) (Ω) LogitechMediaServer
(11) (Ω) MP3fs
(12) (Ω) IDrive
(13) (Ω) QKVM
(14) (Ω) HybridBackup
(15) (Ω) ResourceMonitor
(16) (Ω) DownloadStation
(17) (Ω) Qboost
(18) (Ω) helpdesk
(19) (Ω) Boinc
(20) (Ω) SSDLaboratory
(21) (Ω) LicenseCenter
(22) (Ω) QcloudSSLCertificate
(23) (Ω) HideThatBanner
(24) (Ω) SortMyQPKGs
[Mon Mar 21 21:15:49 EDT 2022] 'autofix' completed
──────────────────────────────────────────────────
SortMyQPKGs (20220210)
[Mon Mar 21 18:37:18 EDT 2022] 'autofix' requested
ALPHA=custom, OMEGA=custom

 * Original order *
(01) (A) netmgr
(02) (A) QVPN
(03) (A) DNSMasq
(04) (A) MalwareRemover
(05) (Φ) QuLog
(06) (Φ) SecurityCounselor
(07) (Ω) Entware-3x
(08) (Ω) PlexMediaServer
(09) (Ω) LogitechMediaServer
(10) (Ω) MP3fs
(11) (Ω) IDrive
(12) (Ω) QKVM
(13) (Ω) HybridBackup
(14) (Ω) ResourceMonitor
(15) (Ω) DownloadStation
(16) (Ω) Qboost
(17) (Ω) helpdesk
(18) (Ω) Boinc
(19) (Ω) SSDLaboratory
(20) (Ω) LicenseCenter
(21) (Ω) HideThatBanner
(22) (Ω) SortMyQPKGs
(23) (Ω) QcloudSSLCertificate
(24) (Φ) NotificationCenter

 * New order *
(01) (A) netmgr
(02) (A) QVPN
(03) (A) DNSMasq
(04) (A) MalwareRemover
(05) (Φ) QuLog
(06) (Φ) SecurityCounselor
(07) (Φ) NotificationCenter
(08) (Ω) Entware-3x
(09) (Ω) PlexMediaServer
(10) (Ω) LogitechMediaServer
(11) (Ω) MP3fs
(12) (Ω) IDrive
(13) (Ω) QKVM
(14) (Ω) HybridBackup
(15) (Ω) ResourceMonitor
(16) (Ω) DownloadStation
(17) (Ω) Qboost
(18) (Ω) helpdesk
(19) (Ω) Boinc
(20) (Ω) SSDLaboratory
(21) (Ω) LicenseCenter
(22) (Ω) QcloudSSLCertificate
(23) (Ω) HideThatBanner
(24) (Ω) SortMyQPKGs
[Mon Mar 21 18:37:18 EDT 2022] 'autofix' completed
──────────────────────────────────────────────────
NotificationCenter was in ALPHA.custom but I removed it on Sunday but SortMyQPKGS thinks it is still there and is autofixing even though it is stopped.

APLPA.custom

Code: Select all

netmgr
QVPN
DNSMasq
ProxyServer
Python3
JRE
MalwareRemover
Qcenter-Agent
Qcenter
ALPHA.default

Code: Select all

# assorted packages
HideThatBanner      # load early in-case App Center is opened immediately after bootup
MUSL_CROSS

# device drivers
USBSerialdrivers
V4LDrivers
RltkWifi1c
RltkWifi2b
ELFx31
MustangUserDriver   # load before container-station

# package managers
Optware
Optware-NG
Entware-ng
Entware-3x
Entware             # load before NVIDIA_GPU_DRV - affects Resource Monitor metrics if loaded after

# assorted packages
update_qpkg_conf
NvKernelDriver      # load before NVIDIA_GPU_DRV
NVIDIA_GPU_DRV      # load before HD_Station & linux-station
netmgr              # 'Network & Virtual Switch'
NMAP                # load before WMAP
AcronisK            # load before AcronisAgent
QX11                # 'Virtual Remote Desktop Window Manager'

# high-level language interpreters
Python
QPython2
Python3
QPython3
QPython39
Perl
QPerl
nodejs
nodejsv4
nodejsv6
nodejsv8
NodeJS
ruby
QRuby
Go
Erlang

# version control systems
git
QGit

# virtual environments
Mono
Qmono
DotNET
DotNETSDK
JRE
JRE_ARM
QJDK7
QJDK8
QJDK9
QJDK10
QJDK11
QJDK14
QJDK16
QJDK17
java-installer      # available in the FileBot repo
QVS                 # old 'Virtualization Station'
QKVM                # new 'Virtualization Station'
HD_Station          # note: 'HD Station' or 'Linux Station' - only one can be enabled at any time
container-station
linux-station       # load after container-station
Qemu

# certificate management
CACert              # load after QPerl and before Qapache

# web servers
Qapache
Tomcat
Tomcat8
TomCat9
TomCat10            # load after QJDK8
Nginx
QNginx
Caddy
Apache73
Apache74
Apache80
Apache81

# databases
QMongoDB
QMariaDB
MariaDB5
MariaDB10
CubeSQL
PimCore
postgresql
PostgreSQL
QPostgreSQL         # load before QOdOO, QOdoo11
PostgreSQLPremium   # load after Qapache
PostgreSQLPremium13 # load after Apache80
MySQL8
InfluxDB            # load before Chronograf
firebird
Neo4J
QuestDB
Dolt

# multimedia tools
ffmpeg              # load before FileBot, DigitalMediaServer, Soundscape
Qffmpeg             # load before FileBot, QBubbleUPnP
MediaInfoShared     # load before FileBot
MediaInfoCLI
MultimediaConsole
QuMagieCore         # 'QNAP AI Core' - load after container-station and MultimediaConsole
qumagie             # load after QuMagieCore
QMultimedia
HandBrake_CLI       # load before Tdarr
FileBot             # load before filebot-node
filebot-node        # load after NodeJS and FileBot

# media servers
XTeve
Plex
PlexMediaServer     # load before PlexRequests
PlexPlayer
Phlex
OpenPlexTheatre
pmp
Emby
EmbyServer
TeamSpeak3          # load before Sinusbot
Komga               # load after QJDK8

# VPN               # load all these before DownloadStation
QVPN
QOpenVPN
VyprVPN
TincVPN
WireGuard
Brook
Windscribe
Tailscale

# assorted QNAP packages
Qsirch              # load after JRE and before Qfiling
HybridBackup        # load before CloudBackup
OMEGA.custom

Code: Select all

Entware-3x
PlexMediaServer
LogitechMediaServer
MP3fs
IDrive
QKVM
HybridBackup
CloudBackupSync
ResourceMonitor
DownloadStation
Qboost
diagnosticApp
helpdesk
Boinc
SSDLaboratory
QDMS
LicenseCenter
QcloudSSLCertificate
HideThatBanner
OMEGA.default

Code: Select all

# NZB downloaders
NZBGet
QNZBGet
SABnzbdplus
QSabNZBdPlus
SABnzbd
QSabNZBd3

# torrent downloaders
Transmission
QTransmission
QTransmission3      # load before TransmissionWC
TransmissionWC      # load after QTransmission3
OTransmission
MTransmission3      # load after MUSL_CROSS
Deluge
Deluge-server
Deluge-web
QBittorrent
QBittorrent4
rtorrent

# searchers
SonarrTrackTV       # load before QSonarr
QSonarr
QSonarr3
Sonarr3
Radarr
RadarrDotNet
MRadarr             # load after MUSL_CROSS
QBazarr             # load after Sonarr & Radarr
SickBeard
QSickBeard
SickBeard-TVRage
SickRage
QSickRage
SickGear
OSickGear
SickChill
QSickChill
QSickChill3
SickChill80         # load after Apache80
Medusa
OMedusa
PyMedusa3
Headphones
QHeadPhones
Mylar
Mylar3
MovieGrabber
CouchPotato2
QCouchPotato
Watcher3
OWatcher3
Ombi
Ombi3
Ombi4
Lidarr
LidarrDotNET
MLidarr             # load after MUSL_CROSS
LazyLibrarian

# assorted packages
HappyGet2           # load after MusicStation & Python3
SurveillanceStation # load late due to long startup time
OpenHab3            # load late due to long startup time

# malware detection and removal (these are not "live" scanners)
MalwareRemover
MCAFEE_QNAP

# only run after everything else...
RunLast
SortMyQPKGs qpkg.conf entry

Code: Select all

[SortMyQPKGs]
Name = SortMyQPKGs
Class = null
Status = complete
Build = 20220210
Display_Name = SortMyQPKGs (CLI)
Version = 220210
Author = OneCD
QPKG_File = SortMyQPKGs.qpkg
Date = 2022-02-12
Shell = /share/CACHEDEV1_DATA/.qpkg/SortMyQPKGs/sortmyqpkgs.sh
Install_Path = /share/CACHEDEV1_DATA/.qpkg/SortMyQPKGs
WebUI = /SortMyQPKGs.log
RC_Number = 500
Web_Port = 8080
Enable = FALSE
store = e754538ad86a655a0687f76c5190a5f8
Desktop = 1
FW_Ver_Min = 4.0.0
Why is SortMyQPKGs running and moving it?
Use the forum search feature before posting.

Use RAID and external backups. RAID will protect you from disk failure, keep your system running, and data accessible while the disk is replaced, and the RAID rebuilt. Backups will allow you to recover data that is lost or corrupted, or from system failure. One does not replace the other.

NAS: TVS-882BR | F/W: 5.0.1.2346 | 40GB | 2 x 1TB M.2 SATA RAID 1 (System/VMs) | 3 x 1TB M.2 NMVe QM2-4P-384A RAID 5 (cache) | 5 x 14TB Exos HDD RAID 6 (Data) | 1 x Blu-ray
NAS: TVS-h674 | F/W: 5.0.1.2376 | 16GB | 3 x 18TB RAID 5
Apps: DNSMasq, PLEX, iDrive, QVPN, QLMS, MP3fs, HBS3, Entware, DLstation, VS, +
User avatar
OneCD
Guru
Posts: 12155
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [QPKG] SortMyQPKGs

Post by OneCD »

Don wrote: Tue Mar 22, 2022 10:05 am Why is SortMyQPKGs running and moving it?
Ah, that's because I hadn't included a bit of code to prevent 'autofix' from running when this QPKG is disabled ("stopped" in the App Center). Sorry @Don. :(

I've now fixed this: https://github.com/OneCDOnly/SortMyQPKG ... 464ca2ccc0 and also added NotificationCenter to OMEGA.default (if your testing indicates it doesn't fix the original issue, I'll remove it again).

BTW: I'm no-longer uploading QPKGs to the QnapClub, so you'll need to either:
  • download the new QPKG version (220322) directly from GitHub and install it manually in your App Center,
  • or else install sherpa, and let it handle the package upgrades for you. You'll need to periodically run an 'upgrade' process to do this - easily done with an entry in your crontab.

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
Don
Guru
Posts: 12289
Joined: Thu Jan 03, 2008 4:56 am
Location: Long Island, New York

Re: [QPKG] SortMyQPKGs

Post by Don »

Glad I could help you debug your package. :wink:

It worked a little, so this wasn't the solution. When the NAS started up I started to receive messages from Notification Center. Once QVPN started up as a client the messages started failing. Everything else on the NAS works fine with the VPN except NC. I'm back to working with QNAP support, sending them logs.

Thanks for the assist.

I have no issues getting the QPKG updates from github. Curious as to why you are no longer publishing them on the store.
Use the forum search feature before posting.

Use RAID and external backups. RAID will protect you from disk failure, keep your system running, and data accessible while the disk is replaced, and the RAID rebuilt. Backups will allow you to recover data that is lost or corrupted, or from system failure. One does not replace the other.

NAS: TVS-882BR | F/W: 5.0.1.2346 | 40GB | 2 x 1TB M.2 SATA RAID 1 (System/VMs) | 3 x 1TB M.2 NMVe QM2-4P-384A RAID 5 (cache) | 5 x 14TB Exos HDD RAID 6 (Data) | 1 x Blu-ray
NAS: TVS-h674 | F/W: 5.0.1.2376 | 16GB | 3 x 18TB RAID 5
Apps: DNSMasq, PLEX, iDrive, QVPN, QLMS, MP3fs, HBS3, Entware, DLstation, VS, +
User avatar
OneCD
Guru
Posts: 12155
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [QPKG] SortMyQPKGs

Post by OneCD »

No worries, thanks @Don. Image

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
Qmann
Easy as a breeze
Posts: 302
Joined: Mon Jun 08, 2020 8:09 am
Location: USA

Re: [QPKG] SortMyQPKGs

Post by Qmann »

OneCD wrote: Tue Mar 22, 2022 2:07 pm I'm no-longer uploading QPKGs to the QnapClub
@OneCD, what is going on here? Just done with all the issues with SSL certs and connections not always working? Or something else with QnapClub?

-Q
Model: TVS-872XT 64GB (Crucial 64GB Kit CT2K32G4SFD8266)
2 x 1TB XPG 1TB NVMe (ASX8200PNP-1TT-C) [RAID-1]
5 x 16TB EXOS [RAID-5]
Borg Backup running to an offisite pi, AND to the local TS-569L
Model: TS-569L Borg server for backups
6 x 8TB Ironwolf [RAID-5]
Qotom-Q355G4 Fanless Mini Micro PC running pSense in front of everything
haproxy for anything inside the LAN
User avatar
OneCD
Guru
Posts: 12155
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [QPKG] SortMyQPKGs

Post by OneCD »

Qmann wrote: Tue Apr 19, 2022 3:37 am @OneCD, what is going on here? Just done with all the issues with SSL certs and connections not always working? Or something else with QnapClub?
It's because I've been unable to get a response from the site-owner (@comicway) regarding issues with the site. I assume he's disappeared.

I've long had issues running searches on the QnapClub website (which always generate a 500 error). There are also a few problems related to management of the QPKGs I was uploading.

If the site-owner won't respond or isn't interested in fixing them, then I'd rather not send people to the QnapClub, only to face the same issues I've seen.

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
jacobp
New here
Posts: 2
Joined: Mon Dec 26, 2016 2:30 am

Re: [QPKG] SortMyQPKGs

Post by jacobp »

Hi @OneCD - can you add "Traefik" to load at the end. It seems that it needs to have all web services it is proxying up and running before it starts.
Post Reply

Return to “Community Apps”