Commit Graph

285 Commits (196eb0fe77b78e2e5ca02c506c3837c2b1a7964c)

Author SHA1 Message Date
Benjamin Krausse e370f9ec36
[ie] Add `media_type` field
Authored by: trainman261
sepro 1732eccc0a
[core] Parse `release_year` from `release_date` ()
Closes 
Authored by: seproDev
sepro ddb2d7588b
[ie] Extract from `media` elements in SMIL manifests ()
Authored by: seproDev
bashonly d4f14a72dc
[ie] Do not test truth value of `xml.etree.ElementTree.Element` ()
Testing the truthiness of an `xml.etree.ElementTree.Element` instance is deprecated in py3.12

Authored by: bashonly
Simon Sawicki 377e85a179
[cleanup] Misc ()
* Simplify nuxt regex
* Fix tmz quotes and tests
* Update test python versions

Authored by: dirkf, gamer191, Grub4K
bashonly 904a19ee93
[ie] Make `_search_nuxt_data` more lenient
Authored by: std-move

Co-authored-by: std-move <26625259+std-move@users.noreply.github.com>
pukkandan 6148833f5c
[cleanup] Misc
bashonly 550e65410a
[ie] Extract subtitles from SMIL manifests ()
Authored by: bashonly, pukkandan
pukkandan 81b4712bca
[extractor] Fix `--load-pages`
coletdjnz 3d2623a898
[compat, networking] Deprecate old functions ()
Authored by: coletdjnz, pukkandan
coletdjnz 227bf1a33b
[networking] Rewrite architecture ()
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.

User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
   - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`

Authored by: coletdjnz
pukkandan bc344cd456
[core] Allow extractors to mark formats as potentially DRM ()
This is useful for HLS where detecting whether the format is
actually DRM requires the child manifest to be downloaded.

Makes the error message when using `--test` inconsistent,
but doesn't really matter.
pukkandan 5fd8367496
[extractor] Support multiple `_VALID_URL`s ()
Authored by: nixxo
pukkandan d7cd97e8d8
Fix bug in db3ad8a676
Closes 
pukkandan ad54c9130e
[cleanup] Misc
Closes , Closes , Closes , Closes , Closes 
Authored by: mikf, freezboltz, pukkandan
Nicolai Dagestad db3ad8a676
Add option `--netrc-cmd` ()
Authored by: NDagestad, pukkandan
Closes 
coletdjnz 8213ce28a4
[extractor/youtube] Extract `channel_is_verified` ()
Authored by: coletdjnz
coletdjnz c35448b7b1
[extractor/youtube] Extract more metadata for comments ()
Adds new comment fields:
* `author_url` - The url to the comment author's page
* `author_is_verified` - Whether the author is verified on the platform
* `is_pinned` - Whether the comment is pinned to the top of the comments

Closes https://github.com/yt-dlp/yt-dlp/issues/5411

Authored by: coletdjnz
coletdjnz b87e01c123
[cookies] Move `YoutubeDLCookieJar` to cookies module ()
Authored by: coletdjnz
Audrey 5caf30dbc3
[extractor/youtube] Extract `heatmap` data ()
Closes 
Authored by: tntmod54321
pukkandan 84ffeb7d5e
[extractor] Do not warn for invalid chapter data in description
Fixes https://github.com/yt-dlp/yt-dlp/issues/6811#issuecomment-1509876209
pukkandan f68434cc74
[extractor] Extract more metadata from ISM
Fixes 81b6102d20 (r105892531)
pukkandan baa922b5c7
[extractor] Do not exit early for unsuitable `url_result`
mushbite 22ccd5420b
[extractor/rutube] Extract chapters from description ()
Authored by: mushbite
pukkandan 5b28cef72d
[cleanup] Misc
pukkandan f34804b2f9
[extractor/youtube] Fix 5038f6d713
* [fragment] Fix `request_data`
* [youtube] Don't use POST for now. It may be easier to break in future

Authored by: bashonly, coletdjnz
pukkandan 43a3eaf963
[extractor] Fix DRM detection in m3u8
Fixes https://github.com/ytdl-org/youtube-dl/issues/31693#issuecomment-1445202857
pukkandan 45b2ee6f4f
Update to ytdl-commit-2dd6c6e
[YouTube] Avoid crash if uploader_id extraction fails
2dd6c6edd8

Except:
    * 295736c9cba714fb5de7d1c3dd31d86e50091cf8 [jsinterp] Improve parsing
    * 384f632e8a9b61e864a26678d85b2b39933b9bae [ITV] Overhaul ITV extractor
    * 33db85c571304bbd6863e3407ad8d08764c9e53b [feat]: Add support to external downloader aria2p
LowSuggestion912 b23167e754
[extractor/common] Fix `_search_nuxt_data` ()
Authored by: LowSuggestion912
bashonly 7e68567e50
[downloader/hls] Allow extractors to provide AES key ()
and related cleanup

Authored by: bashonly, Grub4K

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
bashonly 5ab3534d44
[extractor/slideslive] Fix slides and chapters/duration ()
* Fix slides/thumbnails extraction
* Extract duration to fix issues w/ `--embed-chapters`, `--split-chapters`
* Add `InfoExtractor._extract_mpd_vod_duration` method
* Expand applicability of `InfoExtractor._parse_m3u8_vod_duration` method
Authored by: bashonly
bashonly cb73b8460c
[extractor/nbc] Fix `NBC` and `NBCStations` extractors ()
Improve `InfoExtractor._parse_smil_formats` extension detection
Closes 
Authored by: bashonly
pukkandan edfc7725b1
[cleanup] Misc
pukkandan 08e29b9f1f
[cleanup] Misc
Closes , closes 
Simon Sawicki 32a84bcf4e
Update to ytdl-commit-195f22f6
[generic] Improve KVS (etc) extraction
195f22f679

Closes 
Authored by: Grub4k, pukkandan
Matthew e756f45ba0
Improve handling for overriding extractors with plugins ()
* Extractors replaced with plugin extractors now show in debug output
* Better testcase handling
* Added documentation
Authored by: coletdjnz, pukkandan
pukkandan 0b5546c723
[extractor] Let `_extract_format` functions obey `--ignore-no-formats`
pukkandan 71df9b7fd5
[cleanup] Misc
pukkandan 9bcfe33be7
[utils] Make `ExtractorError` mutable
pukkandan 9f14daf22b
[extractor] Deprecate `_sort_formats`
pukkandan 784320c98c
Implement universal format sorting
Closes 
pukkandan d0d74b7197
[utils] Move format sorting code into `utils`
pukkandan 105bfd90f5
Add new field `aspect_ratio`
Closes 
pukkandan 6368e2e639
[cleanup] Misc
Closes 
pukkandan 171a31dbe8
[extractor] Add a way to distinguish IEs that returns only videos
pukkandan f7fc8d39e9
[extractor] Fix `fatal=False` for `_search_nuxt_data`
Closes 
Matthew 0cf643b234
[extractor/youtube] Differentiate between no and disabled comments ()
`comments` and `comment_count` will be set to None, as opposed to 
an empty list and 0, respectively.

Fixes https://github.com/yt-dlp/yt-dlp/issues/5068

Authored by: coletdjnz, pukkandan
pukkandan 46d09f8707
[cleanup] Lint and misc cleanup
pukkandan 62b8dac490
[extractor] Improve `_generic_title`
m4tu4g c13a301a94
[extractor/zeenews] Add extractor ()
Closes  
Authored by: m4tu4g, pukkandan