[REQUEST] YouTube-DL

Ask community developers’ help for your most wanted Apps and also discover what the hottest and ultimate Apps are.
level42
Getting the hang of things
Posts: 61
Joined: Tue May 06, 2014 3:52 am
Location: 127.0.0.1
Contact:

[REQUEST] YouTube-DL

Post by level42 »

YouTube-DL

Description:
youtube-dl is a command-line program to download videos from YouTube.com and a few more sites. It requires the Python interpreter, version 2.6, 2.7, or 3.2+, and it is not platform specific. It should work on your Unix box, on Windows or on Mac OS X. It is released to the public domain, which means you can modify it, redistribute it or use it however you like.

Code: Select all

youtube-dl [OPTIONS] URL [URL...]
Link:
https://github.com/rg3/youtube-dl

Notes:
Albeit that we can install this ourselves, we are faced with a number of issues as this software has dependencies on specific locations to house its config files, such as /etc, /root, and /usr/local/bin. All of these directories are purged upon each reboot of the system.

This software is updated constantly! So, it would be nice to retain the ability to use the "youtube-dl -U" command to preform updates to the software.
NAS: TS-870-Pro | F/W: 4.3.4.0435
NAS: TS-859-Pro+ | F/W: 4.2.6
User avatar
OneCD
Guru
Posts: 12010
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [REQUEST] YouTube-DL

Post by OneCD »

Just following up on some of these older app requests. ;)

youtube-dl is available via Entware:

Code: Select all

opkg install youtube-dl

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
quassum
Know my way around
Posts: 230
Joined: Thu Jan 21, 2010 12:21 am

Re: [REQUEST] YouTube-DL

Post by quassum »

Almost to good to be true, installed perfectly fine via opkg but getting this error when trying to run:

Code: Select all

# youtube-dl 
Traceback (most recent call last):
  File "/opt/bin/youtube-dl", line 6, in <module>
    from pkg_resources import load_entry_point
  File "/opt/lib/python3.7/site-packages/pkg_resources/__init__.py", line 3256, in <module>
    @_call_aside
  File "/opt/lib/python3.7/site-packages/pkg_resources/__init__.py", line 3240, in _call_aside
    f(*args, **kwargs)
  File "/opt/lib/python3.7/site-packages/pkg_resources/__init__.py", line 3269, in _initialize_master_working_set
    working_set = WorkingSet._build_master()
  File "/opt/lib/python3.7/site-packages/pkg_resources/__init__.py", line 582, in _build_master
    ws.require(__requires__)
  File "/opt/lib/python3.7/site-packages/pkg_resources/__init__.py", line 899, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/opt/lib/python3.7/site-packages/pkg_resources/__init__.py", line 785, in resolve
    raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'youtube-dl==2020.7.28' distribution was not found and is required by the application
User avatar
Moogle Stiltzkin
Guru
Posts: 11448
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: [REQUEST] YouTube-DL

Post by Moogle Stiltzkin »

quassum wrote: Wed Nov 11, 2020 5:35 pm ...


Check the arstechnica article link. basically they did a cease and desist order, and got youtube-dl removed. That is why you are getting
distribution was not found and is required by the application

this reminds me of the streissand effect. people didn't realize this existed till they made it news headlines. now everyone downloads it to bypass those nasty youtube ads, kek
GitHub boots popular YouTube download tool after RIAA claim
RIAA claims tool, widely used by activists and archivists, is only for piracy.
https://arstechnica.com/tech-policy/202 ... iaa-claim/


i downloaded for my mpv video player from here, the last version
https://mpv.io/
https://www.videohelp.com/software/youtube-dl
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
zyxmon
Experience counts
Posts: 1001
Joined: Mon Oct 27, 2014 2:27 pm
Location: Moscow, Russia
Contact:

Re: [REQUEST] YouTube-DL

Post by zyxmon »

quassum wrote: Wed Nov 11, 2020 5:35 pm Almost to good to be true, installed perfectly fine via opkg but getting this error when trying to run:
....
Cannot confirm

Code: Select all

# opkg install youtube-dl
Installing youtube-dl (2020.7.28-1) to root...
Downloading http://bin.entware.net/aarch64-k3.10/youtube-dl_2020.7.28-1_aarch64-3.10.ipk
Installing python3-base (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-base_3.8.5-2_aarch64-3.10.ipk
Installing libtirpc (1.2.6-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/libtirpc_1.2.6-2_aarch64-3.10.ipk
Installing python3-light (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-light_3.8.5-2_aarch64-3.10.ipk
Installing python3-unittest (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-unittest_3.8.5-2_aarch64-3.10.ipk
Installing libncurses (6.2-1) to root...
Downloading http://bin.entware.net/aarch64-k3.10/libncurses_6.2-1_aarch64-3.10.ipk
Installing python3-ncurses (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-ncurses_3.8.5-2_aarch64-3.10.ipk
Installing python3-ctypes (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-ctypes_3.8.5-2_aarch64-3.10.ipk
Installing python3-pydoc (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-pydoc_3.8.5-2_aarch64-3.10.ipk
Installing python3-multiprocessing (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-multiprocessing_3.8.5-2_aarch64-3.10.ipk
Installing python3-codecs (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-codecs_3.8.5-2_aarch64-3.10.ipk
Installing libgdbm (1.18.1-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/libgdbm_1.18.1-2_aarch64-3.10.ipk
Installing python3-gdbm (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-gdbm_3.8.5-2_aarch64-3.10.ipk
Installing python3-email (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-email_3.8.5-2_aarch64-3.10.ipk
Installing python3-urllib (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-urllib_3.8.5-2_aarch64-3.10.ipk
Installing libexpat (2.2.9-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/libexpat_2.2.9-2_aarch64-3.10.ipk
Installing python3-xml (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-xml_3.8.5-2_aarch64-3.10.ipk
Installing libsqlite3 (3330000-1) to root...
Downloading http://bin.entware.net/aarch64-k3.10/libsqlite3_3330000-1_aarch64-3.10.ipk
Installing python3-sqlite3 (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-sqlite3_3.8.5-2_aarch64-3.10.ipk
Installing python3-logging (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-logging_3.8.5-2_aarch64-3.10.ipk
Installing python3-distutils (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-distutils_3.8.5-2_aarch64-3.10.ipk
Installing python3-openssl (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-openssl_3.8.5-2_aarch64-3.10.ipk
Installing python3-cgi (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-cgi_3.8.5-2_aarch64-3.10.ipk
Installing python3-cgitb (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-cgitb_3.8.5-2_aarch64-3.10.ipk
Installing libxml2 (2.9.10-1) to root...
Downloading http://bin.entware.net/aarch64-k3.10/libxml2_2.9.10-1_aarch64-3.10.ipk
Installing libdb47 (4.7.25.4.NC-5) to root...
Downloading http://bin.entware.net/aarch64-k3.10/libdb47_4.7.25.4.NC-5_aarch64-3.10.ipk
Installing python3-dbm (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-dbm_3.8.5-2_aarch64-3.10.ipk
Installing python3-asyncio (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-asyncio_3.8.5-2_aarch64-3.10.ipk
Installing python3-lzma (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-lzma_3.8.5-2_aarch64-3.10.ipk
Installing python3-decimal (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-decimal_3.8.5-2_aarch64-3.10.ipk
Installing python3 (3.8.5-2) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3_3.8.5-2_aarch64-3.10.ipk
Installing python3-pkg-resources (47.1.0-1) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-pkg-resources_47.1.0-1_aarch64-3.10.ipk
Installing python3-setuptools (47.1.0-1) to root...
Downloading http://bin.entware.net/aarch64-k3.10/python3-setuptools_47.1.0-1_aarch64-3.10.ipk
Configuring python3-base.
Configuring libtirpc.
Configuring python3-light.
Configuring python3-email.
Configuring python3-urllib.
Configuring python3-pydoc.
Configuring python3-cgi.
Configuring python3-cgitb.
Configuring python3-decimal.
Configuring libexpat.
Configuring python3-xml.
Configuring python3-unittest.
Configuring libncurses.
Configuring python3-ncurses.
Configuring python3-ctypes.
Configuring python3-multiprocessing.
Configuring python3-codecs.
Configuring libgdbm.
Configuring python3-gdbm.
Configuring libsqlite3.
Configuring python3-sqlite3.
Configuring python3-logging.
Configuring python3-distutils.
Configuring python3-openssl.
Configuring libxml2.
Configuring libdb47.
Configuring python3-dbm.
Configuring python3-asyncio.
Configuring python3-lzma.
Configuring python3.
Configuring python3-pkg-resources.
Configuring python3-setuptools.
Configuring youtube-dl.
/share/CACHEDEV1_DATA/.qpkg/Entware/root # youtube-dl https://www.youtube.com/watch?v=f4_x_8tj18o
[youtube] f4_x_8tj18o: Downloading webpage
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[download] Destination: QNAP Hybrid Backup Sync HBS3 _ Decryption Guide-f4_x_8tj18o.f137.mp4
[download] 100% of 26.79MiB in 00:04
[download] Destination: QNAP Hybrid Backup Sync HBS3 _ Decryption Guide-f4_x_8tj18o.f251.webm
[download] 100% of 3.17MiB in 00:00
[ffmpeg] Merging formats into "QNAP Hybrid Backup Sync HBS3 _ Decryption Guide-f4_x_8tj18o.mkv"
Deleting original file QNAP Hybrid Backup Sync HBS3 _ Decryption Guide-f4_x_8tj18o.f137.mp4 (pass -k to keep)
Deleting original file QNAP Hybrid Backup Sync HBS3 _ Decryption Guide-f4_x_8tj18o.f251.webm (pass -k to keep)
User avatar
quassum
Know my way around
Posts: 230
Joined: Thu Jan 21, 2010 12:21 am

Re: [REQUEST] YouTube-DL

Post by quassum »

Looks like I'm running Python 3.7 while you're on 3.8 I'm using the one installed by sherpa at the moment, not sure whether that's easy to update?
User avatar
Moogle Stiltzkin
Guru
Posts: 11448
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: [REQUEST] YouTube-DL

Post by Moogle Stiltzkin »

there's not gonna be another update for youtube-dl. they got shutdown.

i'm not aware of anyone that is taking over that project (most likely not). but you can still get the youtube-dl component that was last updated and use that at least for now.

not sure about qnap, but for mpv on desktop when the update script couldn't grab the youtube-dl component, i just manually copy pasted the last latest of that file, and it worked :}

so i assume you would have to do something similar if it can't grab the file from the repo for youtube-dl
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
User avatar
quassum
Know my way around
Posts: 230
Joined: Thu Jan 21, 2010 12:21 am

Re: [REQUEST] YouTube-DL

Post by quassum »

Moogle Stiltzkin wrote: Thu Nov 12, 2020 12:06 am there's not gonna be another update for youtube-dl. they got shutdown.
Do you have a source for that? Only their Github repository got shut down as far as I'm aware. Their site https://youtube-dl.org is still up and they also released a new version after the takedown. This is the changelog:

Code: Select all

version 2020.11.01

Core
* [utils] Don't attempt to coerce JS strings to numbers in js_to_json (#26851)
* [downloader/http] Properly handle missing message in SSLError (#26646)
* [downloader/http] Fix access to not yet opened stream in retry

Extractors
* [youtube] Fix JS player URL extraction
* [ytsearch] Fix extraction (#26920)
* [afreecatv] Fix typo (#26970)
* [23video] Relax URL regular expression (#26870)
+ [ustream] Add support for video.ibm.com (#26894)
* [iqiyi] Fix typo (#26884)
+ [expressen] Add support for di.se (#26670)
* [iprima] Improve video id extraction (#26507, #26494)
User avatar
Moogle Stiltzkin
Guru
Posts: 11448
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: [REQUEST] YouTube-DL

Post by Moogle Stiltzkin »

did u check the arstechnica link i asked u to look at? thats where i found out about this. i was using a different app on windows that has a script updating that uses youtube-dl when i noticed that error message you posted. the reason i found out for that, because their project got shutdown so it couldn't pull the youtube-dl from the original host.

so i worked around that by downloading from an archive site, the last latest file for it, then copy into the app folder, then it worked :)
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
User avatar
quassum
Know my way around
Posts: 230
Joined: Thu Jan 21, 2010 12:21 am

Re: [REQUEST] YouTube-DL

Post by quassum »

Moogle Stiltzkin wrote: Thu Nov 12, 2020 12:16 am did u check the arstechnica link i asked u to look at?
Yup, nowhere in the article it’s mentioned the project will shutdown.
User avatar
OneCD
Guru
Posts: 12010
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [REQUEST] YouTube-DL

Post by OneCD »

quassum wrote: Wed Nov 11, 2020 11:43 pm Looks like I'm running Python 3.7 while you're on 3.8 I'm using the one installed by sherpa at the moment, not sure whether that's easy to update?
Python 3.7 was previously required if you're running Watcher3, as it won't yet run on Python 3.8. Is OWatcher3 installed?

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
quassum
Know my way around
Posts: 230
Joined: Thu Jan 21, 2010 12:21 am

Re: [REQUEST] YouTube-DL

Post by quassum »

OneCD wrote: Thu Nov 12, 2020 1:43 am Python 3.7 was previously required if you're running Watcher3, as it won't yet run on Python 3.8. Is OWatcher3 installed?
Ah good catch, it is indeed installed here. Looks like it's still not supported https://github.com/barbequesauce/Watcher3/issues/79 maybe time to switch to something else.
User avatar
OneCD
Guru
Posts: 12010
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: [REQUEST] YouTube-DL

Post by OneCD »

Maybe try Stephane's Watcher3 QPKG? https://qnapclub.eu/en/qpkg/471

I think he packages it with a specific version of Python.

After you've transferred across your settings, uninstall OWatcher3, then reinstall Entware to ensure the latest Python 3 is installed:

Code: Select all

sherpa reinstall ew

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage
User avatar
jaysona
Been there, done that
Posts: 846
Joined: Tue Dec 02, 2008 11:26 am
Location: Somewhere in the Great White North

Re: [REQUEST] YouTube-DL

Post by jaysona »

Moogle Stiltzkin wrote: Thu Nov 12, 2020 12:16 am did u check the arstechnica link i asked u to look at? thats where i found out about this. i was using a different app on windows that has a script updating that uses youtube-dl when i noticed that error message you posted. the reason i found out for that, because their project got shutdown so it couldn't pull the youtube-dl from the original host.

so i worked around that by downloading from an archive site, the last latest file for it, then copy into the app folder, then it worked :)
You need to understand the difference between a git repository being pulled and a project shutting down. Youtube-dl was never "shut down" and probably never will be, just as Anonymous can never be shut down.
RAID is not a Back-up!

H/W: QNAP TVS-871 (i7-4790. 16GB) (Plex server) / TVS-EC1080 (32Gig ECC) - VM host & seedbox
H/W: Asustor AS6604T (8GB) / Asustor AS7010T (16GB) (media storage)
H/W: TS-219 Pro / TS-509 Pro
O/S: Slackware 14.2 / MS Windows 7-64 (x5)
Router1: Asus RT-AC86U - Asuswrt-Merlin - 386.7_2
Router2: Asus RT-AC68U - Asuswrt-Merlin - 386.7_2
Router3: Linksys WRT1900AC - DD-WRT v3.0-r46816 std
Router4: Asus RT-AC66U - FreshTomato v2021.10.15

Misc: Popcorn Hour A-110/WN-100, Pinnacle Show Center 250HD, Roku SoundBridge Radio (all retired)
Ditched QNAP units: TS-269 Pro / TS-253 Pro (8GB) / TS-509 Pro / TS-569 Pro / TS-853 Pro (8GB)
TS-670 Pro x2 (i7-3770s 16GB) / TS-870 Pro (i7-3770 16GB) / TVS-871 (i7-4790s 16GB)
User avatar
quassum
Know my way around
Posts: 230
Joined: Thu Jan 21, 2010 12:21 am

Re: [REQUEST] YouTube-DL

Post by quassum »

Post Reply

Return to “Apps Wanted”