Installing Newznab on QNAP

Post your questions about Web Server usage and Apache + PHP + MySQL/SQLite web applications.
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

Thanks forkless that looks like just what I need, I'll be sure to have a bash at it.
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

Just to say YES!! its backing up my db just grand. I also managed to get it to run a cronjob even though the net said the job would be deleted on reboot. I figured it would be like the auto run fiasco, but no it survives the reboot.

This got me thinking, could cron run a script to 'test' if the newznab_screen is running and if not run it ? let it check once per hour ? could this be done ?

ump..
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
User avatar
forkless
Experience counts
Posts: 1907
Joined: Mon Nov 23, 2009 6:52 am
Location: The Netherlands

Re: Installing Newznab on QNAP

Post by forkless »

I haven't looked at it. While checking the process with cron or some watchdog will work there is a reason you shouldn't do it. The loop usually crashes for a good reason, just restarting the script will not take away the cause of the crash in most instances.

As much as you (and me, trust me...) would like for this to be an automated process this app needs quite a fair bit of maintenance/administration.
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

Hi,
Like always I know your right. :D I guess I'm still looking at ways to get it to autostart. I saw on the wiki that cron would execute a job only once at boot up using the @reboot flag http://en.wikipedia.org/wiki/Cron I almost got exited until I tested it and found it did not work lol.
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

Hey guys,

Someone who is helping run my indexing site has asked me 'Are you processing all your releases upon download or just the first 100' and I don't know the answer, I am running forkless' modified newznab_screen script.

cheers

Ump..
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
User avatar
forkless
Experience counts
Posts: 1907
Joined: Mon Nov 23, 2009 6:52 am
Location: The Netherlands

Re: Installing Newznab on QNAP

Post by forkless »

The script by default only processes the last 100 releases. It's not really "my" script. It's just a slightly modified version of the already provided screen script (I only added the update_parsing, update_cleanup and deletespecial.php scripts to the screen loop. They will clean up/fix any obfuscated release names and/or delete them.


Ps. Deep RAR inspection is required for update_parsing to work properly.

Ps2. There is the $limited variable you can set to false in update_parsing.php and update_cleanup, however use with severe caution as it may backlog you quite a bit if you have a large database already.
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

After a reboot my server wont start giving this error

[~] # /etc/init.d/mysqld.sh restart
/mnt/ext/opt/mysql
/mnt/ext/opt/mysql
Try to shutting down MySQL
ERROR! MySQL manager or server PID file could not be found!
/mnt/ext/opt/mysql
Starting MySQL................................... ERROR!
[~] #

this is the second time it has done this any idea how to fix it ?

Also if I try to import a backup of the database it tells me its to large to import.

edit :- after looking at the php admin screen it seems the largest db I can import is 16mb which is why I cant import it ?
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
User avatar
forkless
Experience counts
Posts: 1907
Joined: Mon Nov 23, 2009 6:52 am
Location: The Netherlands

Re: Installing Newznab on QNAP

Post by forkless »

That's the limit of the web import. If you want to import databases larger than 16MB you need to use;

Code: Select all

/mnt/ext/opt/mysql/bin/mysql -u user -ppassword databasename < backup.sql
As far as the mysqld error goes, can you copy/paste the first 5 lines of your /etc/init.d/mysql.sh file please.
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

#!/bin/sh
export TMPDIR=/share/MD0_DATA/tmp
# Copyright Abandoned 1996 TCX DataKonsult AB & Monty Program KB & Detron HB
# This file is public domain and comes with NO WARRANTY of any kind
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

forkless wrote:That's the limit of the web import. If you want to import databases larger than 16MB you need to use;

Code: Select all

/mnt/ext/opt/mysql/bin/mysql -u user -ppassword databasename < backup.sql
As far as the mysqld error goes, can you copy/paste the first 5 lines of your /etc/init.d/mysql.sh file please.
so I replace user and password with my db info, and backup.sql with my db name and location

/mnt/ext/opt/mysql/bin/mysql -u xxx -pxxx newznab < /share/MD0_DATA/Backup/mysql/newznab.sql
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

Ok - all done, backup worked and its all good - phew !!!

I don't understand why I keep having this, The newznab script stops, I reboot and bang I have this problem. I have rebooted the server on numerous times before, but it fails when the server has been running for a few days and there are loads of releases.

Anyway - thanks again to forkless who once again saves the day :)
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
User avatar
forkless
Experience counts
Posts: 1907
Joined: Mon Nov 23, 2009 6:52 am
Location: The Netherlands

Re: Installing Newznab on QNAP

Post by forkless »

I think you may have the old sed modification for mysql.sh in your autostart.sh (I fixed that two weeks ago or so, maybe you didnt catch that update).


PS. Have you blacklisted nzbcave and hdnectar?
umpa
Easy as a breeze
Posts: 359
Joined: Sat Feb 18, 2012 8:04 pm

Re: Installing Newznab on QNAP

Post by umpa »

hdnectar was banned but nzbcave was not - it is now :)

this is the autorun from /share/MD0_DATA/.qpkg

Code: Select all

#!/bin/sh

# Script to set up screen and run newznab_screen.sh

touch /var/run/utmp
chmod 777 /var/run/utmp
export TERMINFO=/opt/share/terminfo
export TERM=xterm

# Fix tmp path for MySQL

sed '2iexport TMPDIR=\/share\/MD0_DATA\/tmp' < /etc/init.d/mysqld.sh > tempfile
chmod 755 tempfile
mv tempfile /etc/init.d/mysqld.sh
echo "Restarting MySQL..."
/etc/init.d/mysqld.sh restart > /dev/null

# start screen
/share/MD0_DATA/.qpkg/Optware/bin/screen /bin/sh /share/MD0_DATA/Web/misc/update_scripts/newznab_screen.sh
from what we found out I don't think this autorun is executed is it ?
1x TS-412 3x WD2003YYS (Enterprise) 1x WD20EFRX (Green) [Raid 0]
1x TS-412 3x WDC ED30EFRX (Red) 1X ST3000VN007 (IronWolf) [Raid 5]
1x TS-412 2x WD20EZRX (GREEN) & 2x WD20EARS (Green) [Raid 5]
1x TS-859pro 4x WD30EFRX (RED) & 4X ST3000VN007 (IronWolf) [Raid 5]
1x TS-869pro 8X HGST HDS724040ALE640 - (DeskTop) [Raid 5]
1x WDSharespace 4xWDC WD2003YYS (Enterprise) [Raid 0] - The worst NAS I have ever owned.
5x WD MybookWorld White light Edition (Which are fitted with WD Green drives as standard) also rubbish
User avatar
forkless
Experience counts
Posts: 1907
Joined: Mon Nov 23, 2009 6:52 am
Location: The Netherlands

Re: Installing Newznab on QNAP

Post by forkless »

Copy everything inside your autorun.sh on the bootblock except for the #!/bin/sh line and remove the autorun.sh line that points to /share/MD0_DATA/.qpkg/autorun
Post Reply

Return to “Web Server & Applications (Apache + PHP + MySQL / SQLite)”