Commit Graph

18970 Commits (82d496fef25bfd67351263e5061a9311efc32230)
 

Author SHA1 Message Date
dirkf 21924742f7 [InfoExtractor] Misc yt-dlp back-ports, etc
* add _yes_playlist() method
* avoid crash using _NETRC_MACHINE
* use _search_json() in _search_nextjs_data()
* _search_nextjs_data() default is JSON, not text
* test for above
1 year ago
dirkf 768ccccd9b [compat] Avoid type comparison in `compat_ord`
NB This isn't actually a compat fn; it should be utils.int_from_int_or_char
1 year ago
dirkf eee9a247eb [utils] Split out traversal.py dummy and traversal tests 1 year ago
dirkf 34484e49f5 [compat] Improve compat_etree_iterfind for Py2.6
Adapted from https://raw.githubusercontent.com/python/cpython/2.7/Lib/xml/etree/ElementPath.py
1 year ago
dirkf 06da64ee51 [utils] Update traverse_obj() from yt-dlp
* remove `is_user_input` option per https://github.com/yt-dlp/yt-dlp/pull/8673
* support traversal of compat_xml_etree_ElementTree_Element per https://github.com/yt-dlp/yt-dlp/pull/8911
* allow un/branching using all and any per https://github.com/yt-dlp/yt-dlp/pull/9571
* support traversal of compat_cookies.Morsel and multiple types in `set()` keys per https://github.com/yt-dlp/yt-dlp/pull/9577
thx Grub4k for these
* also, move traversal tests to a separate class
* allow for unordered dicts in tests for Py<3.7
1 year ago
dirkf a08f2b7e45
[workflows/ci.yml] Temporary workaround for Python 3.5 _pip_ failures
https://github.com/actions/setup-python/issues/866
1 year ago
dirkf 668332b973 [YouPorn] Add playlist extractors
* YouPornCategoryIE
* YouPornChannelIE
* YouPornCollectionIE
* YouPornStarIE
* YouPornTagIE
* YouPornVideosIE,
1 year ago
dirkf 0b2ce3685e [YouPorn] Improve extraction
* detect unwatchable videos
* improve duration extraction
* fix count extraction and support large values
* detect and remove SEO spam boilerplate description
1 year ago
dirkf c2766cb80e [test/test_download] Support 'playlist_maxcount:count' expected value
* parallel to `playlist_mincount'
* specify both for a range of playlist lengths
* if max < min the test will always fail!
1 year ago
dirkf eb38665438 [YouPorn] Incorporate yt-dlp PR 8827
* from https://github.com/yt-dlp/yt-dlp/pull/8827
* extract from webpage instead of broken API URL
* thx The-MAGI
1 year ago
dirkf e0727e4ab6 [postprocessor/ffmpeg] Fix finding ffprobe (bug in 21792b8)
Fixes 21792b88b7 (commitcomment-140705274), thx: vonProteus
1 year ago
Ori Avtalion 4ea59c6107
[utils] Fix crash in _report_ignoring_subs from c58b655 (#32762)
Align `utils.bug_reports_message()` with yt-dlp https://github.com/yt-dlp/yt-dlp/commit/5873d4ccdd, thanks fstirlitz

---------

Co-authored-by: dirkf <fieldhouse@gmx.net>
1 year ago
dirkf 21792b88b7 [external/FFmpeg] Fix and improve --ffmpeg-location handling
* pass YoutubeDL (FileDownloader) to FFmpegPostProcessor constructor
* consolidate path search in FFmpegPostProcessor
* make availability of FFmpegFD depend on existence of FFmpegPostProcessor
* detect ffmpeg executable on instantiation of FFmpegFD
* resolves #32735
1 year ago
dirkf d8f134a664 [downloader/external] Fix "Resource Warning" in downloader test
* add compat_subprocess_Popen context manager
* apply context manager in FFmpegFD._call_downloader()
1 year ago
dirkf 31a15a7c8d [compat] Simplify/fix compat_html_parser_HTMLParseError 1 year ago
dirkf 19dc10b986 [utils] Apply compat_contextlib_suppress 1 year ago
dirkf 182f63e82a [compat] Add compat_contextlib_suppress
with compat_contextlib_suppress(*Exceptions):
    # code that fails silently for any of Exceptions
1 year ago
gy-chen 71211e7db7
[Youtube] Fix unwanted private method __ie_msg in f8b0135850
Fixes `AttributeError no attribute '_YoutubeIE__ie_msg'` if unable to decode n-parameter
1 year ago
Bart Broere a60972e253 Fix indent from suggestion 1 year ago
Bart Broere 007bbeacd7
Remove afspelen and trailing slashes with one regex
Co-authored-by: dirkf <fieldhouse@gmx.net>
1 year ago
Bart Broere 4c90b2f587
Adhere to code style
Co-authored-by: dirkf <fieldhouse@gmx.net>
1 year ago
Bart Broere bc86c5f73b
Make regex more specific and remove redundant .* 1 year ago
Bart Broere ad64f3751e
Improve regex
Co-authored-by: Roy <git@rvsit.nl>
1 year ago
Bart Broere d4250c8703
Merge branch 'ytdl-org:master' into fix-npo-support 1 year ago
Zizheng Guo a96a45b2cd
[Vimeo] Improve `config` extraction (#32742)
* update for more robust json parsing
1 year ago
Bart Broere 58d7a00e3f Resolve some of the pull request feedback 1 year ago
Bart Broere 4398f6832f Fix zapp extractor 1 year ago
Bart Broere 1ca4e686a3 Add an MD5 1 year ago
Bart Broere 28624cfe09 Work work 1 year ago
Bart Broere c08f29f45b Update unit tests 1 year ago
hatsomatt 820fae3b3a [Videa] Fix extraction
* update API URL
* from https://github.com/yt-dlp/yt-dlp/pull/8003
* thanks to the authors!

Closes yt-dlp/7427
Authored by: hatsomatt, aky-01
1 year ago
dirkf aef24d97e9 [Videa] Align with yt-dlp 1 year ago
dirkf f7b30e3f73 [XFileShare] Update extractor for 2024
* simplify aa_decode()
* review and update supported sites and tests
* in above, include FileMoon.sx, and remove separate module
* incorporate changes from yt-dlp
* allow for decoding multiple scripts (eg, FileMoon)
* use new JWPlayer extraction
1 year ago
dirkf f66372403f [InfoExtractor] Rework and improve JWPlayer extraction
* use traverse_obj() and _search_json()
* support playlist `.load({**video1},{**video2}, ...)`
* support transform_source=... for _extract_jwplayer_data()
1 year ago
dirkf 7216fa2ac4 [InfoExtractor] Add `_search_json()`
* uses the error diagnostic to truncate the JSON string
* may be confused by non-C-Pythons
1 year ago
dirkf acc383b9e3 [utils] Let int_or_none() accept a base, like int() 1 year ago
Bart Broere 0ab79c37ae Reusable code for two NTR sites 1 year ago
Bart Broere 0cbcd1aec6 Make diff better 1 year ago
Bart Broere 159f825edd Add scaffolding for last few extractors and change order so the PR diff looks nice 1 year ago
Bart Broere 681b39032a Fix flake8 and better error reporting 1 year ago
Bart Broere 4b24e5f00d Re-add SchoolTV 1 year ago
Bart Broere 3b3d73cbe6 Use program-detail endpoint and remove a test 1 year ago
Bart Broere d426a92a60 Encoding suggestion from PR 1 year ago
Bart Broere d36d50fe5c Re-add Zapp 1 year ago
Bart Broere eb6e396bfb First version of a VPRO regex 1 year ago
Bart Broere 28ba01f1cc Add Ongehoord Nederland and test URL for BNNVARA 1 year ago
Bart Broere 4fc423845e Fix lint 1 year ago
Hubert Hirtz f0812d7848
[utils] Handle user:pass in URLs (#28801)
* Handle user:pass in URLs

Fixes "nonnumeric port" errors when youtube-dl is given URLs with
usernames and passwords such as:

    http://username:password@example.com/myvideo.mp4

Refs:
- https://en.wikipedia.org/wiki/Basic_access_authentication
- https://tools.ietf.org/html/rfc1738#section-3.1
- https://docs.python.org/3.8/library/urllib.parse.html#urllib.parse.urlsplit

Fixes #18276 (point 4)
Fixes #20258
Fixes #26211 (see comment)

* Align code with yt-dlp

---------

Co-authored-by: dirkf <fieldhouse@gmx.net>
1 year ago
Bart Broere 34b5b20107 Refactor into reusable method 1 year ago
Bart Broere 8b1a7d9a7c Use provided util 1 year ago