Commit Graph

22081 Commits (8afd9468b0c822843bc480d366d1c86698daabfb)
 

Author SHA1 Message Date
pukkandan 81b4712bca
[extractor] Fix `--load-pages`
pukkandan 994f7ef8e6
[ie/generic] Fix generic title for embeds
Closes 
pukkandan a264433c9f
[outtmpl] Fix replacement for `playlist_index`
pukkandan 9f66247289
[ie/abematv] Temporary fix for protocol handler
Closes 
bashonly e57eb98222
[fd/external] Fix ffmpeg input from stdin ()
Bugfix for 1ceb657bdd

Authored by: bashonly
Simon Sawicki 9b16762f48
[ie/crunchyroll] Remove initial state extraction ()
Authored by: Grub4K
bashonly 65cfa2b057
[ie/MuseAI] Add extractor ()
Closes 
Authored by: bashonly
bashonly f4ea501551
[ie/MagellanTV] Add extractor ()
Closes 
Authored by: bashonly
bashonly af86873218
[utils] Improve `parse_duration`
Authored by: bashonly
bashonly 75dc8e673b
[networking] Fix `--legacy-server-connect` ()
Bugfix for 227bf1a33b

Authored by: bashonly
bashonly 71baa490eb
[networking] Fix POST requests with zero-length payloads ()
Bugfix for 227bf1a33b

Authored by: bashonly
bashonly 613dbce177
[ie/twitter:spaces] Fix format protocol ()
Closes 
Authored by: bashonly
Văn Anh bb5d84c9d2
[ie/facebook:reel] Fix extraction ()
Closes 
Authored by: demon071, bashonly
zhong-yiyu 1d3d579c21
[ie/pornhub] Update access cookies for UK ()
Closes 
Authored by: zhong-yiyu
bashonly 42ded0a429
[fd/external] Fixes to cookie handling
- Fix bug in `axel` Cookie header arg
- Pass cookies to `curl` as strings
- Write session cookies for `aria2c` and `wget`

Closes 
Authored by: bashonly
bashonly 6c5211cebe
[core] Fix HTTP headers and cookie handling
- Remove `Cookie` header from `http_headers` immediately after loading into cookiejar
- Restore compat for `--load-info-json` cookies
- Add more tests
- Fix improper passing of Cookie header by `MailRu` extractor

Closes 
Authored by: bashonly, pukkandan
Aaruni Kaushik 2b029ca0a9
[cleanup] Add color to `download-archive` message ()
Authored by: aaruni96, Grub4K, pukkandan
Closes 
pukkandan 131d132da5
[build] Make sure deprecated modules are added
coletdjnz 3d2623a898
[compat, networking] Deprecate old functions ()
Authored by: coletdjnz, pukkandan
coletdjnz 227bf1a33b
[networking] Rewrite architecture ()
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.

User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
   - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`

Authored by: coletdjnz
pukkandan c365dba843
[networking] Add module ()
No actual changes - code is only moved around
pukkandan 1b392f905d
[utils] Add temporary shim for logging
Related: , 
coletdjnz 1ba6fe9db5
[ie/youtube:tab] Detect looping feeds ()
Closes https://github.com/yt-dlp/yt-dlp/issues/5555

Note: the first page may still be repeated, however this is better than nothing.

Authored by: coletdjnz
Finn R. Gärtner 1bcb9fe871
[ie/piapro] Support `/content` URL ()
Authored by: FinnRG
Neurognostic 8a4cd12c8f
[pp/EmbedThumbnail] Support `m4v` ()
Authored by: Neurognostic
Aleri Kaisattera 2cfe221fbb
[ie/streamanity] Remove ()
Service is dead
Authored by: alerikaisattera
Mahmoud Abdel-Fattah 2af4eeb772
[utils] `clean_podcast_url`: Handle more trackers ()
Authored by: mabdelfattah, bashonly
Closes 
Zprokkel 325191d0c9
[ie/vrt] Update token signing key ()
Authored by: Zprokkel
GD-Slime bdd0b75e3f
[ie/BiliBiliBangumi] Fix extractors ()
- Overhaul BiliBiliBangumi extractor for the site's new API
- Add BiliBiliBangumiSeason extractor
- Refactor BiliBiliBangumiMedia extractor

Closes , Closes 
Authored by: GD-Slime
bashonly 92315c0377
[extractor/twitter] Fix GraphQL and legacy API ()
Authored by: bashonly
pukkandan b03fa78345
Revert 49296437a8
github-actions cc0619f62d Release 2023.07.06
Created by: pukkandan

:ci skip all :ci run dl
pukkandan b532a34810
[docs] Minor fixes
Closes 
Simon Sawicki 3121512228
[core] Change how `Cookie` headers are handled
Cookies are now saved and loaded under `cookies` key in the info dict
instead of `http_headers.Cookie`. Cookies passed in headers are
auto-scoped to the input URLs with a warning.

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: Grub4K
coletdjnz f8b4bcc0a7
[core] Prevent `Cookie` leaks on HTTP redirect
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: coletdjnz
bashonly 1ceb657bdd
[fd/external] Scope cookies
- ffmpeg: Calculate cookies from cookiejar and pass with `-cookies` arg instead of `-headers`
- aria2c, curl, wget: Write cookiejar to file and use external FD built-in cookiejar support
- httpie: Calculate cookies from cookiejar instead of `http_headers`
- axel: Calculate cookies from cookiejar and disable http redirection if cookies are passed
    - May break redirects, but axel simply don't have proper cookie support

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: bashonly, coletdjnz
pukkandan ad8902f616
[ie/vidlii] Handle relative URLs
Closes 
pukkandan 94ed638a43
[ie/youtube] Avoid false DRM detection ()
Some master manifests contain a mix of DRM and non-DRM formats
pukkandan bc344cd456
[core] Allow extractors to mark formats as potentially DRM ()
This is useful for HLS where detecting whether the format is
actually DRM requires the child manifest to be downloaded.

Makes the error message when using `--test` inconsistent,
but doesn't really matter.
pukkandan 906c0bdcd8
[formats] Fix best fallback for storyboards
Partial fix for 
pukkandan 337734d4a8
[cleanup] Misc
pukkandan fa44802809
[devscripts/make_changelog] Skip reverted commits
pukkandan 47bcd43724
[outtmpl] Pad `playlist_index` etc even when with internal formatting
Closes 
pukkandan 662ef1e910
[downloader/http] Avoid infinite loop when no data is received
Closes 
Jorge 6355b5f1e1
[misc] Add CodeQL workflow ()
coletdjnz 90db9a3c00
[extractor/youtube:stories] Remove ()
YouTube killed them

https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
bashonly 49296437a8
[extractor/twitter] Fix unauthenticated extraction ()
Closes 
Authored by: bashonly
bashonly 1cffd621cb
[extractor/twitter:spaces] Fix extraction ()
Closes 
Authored by: bashonly
RfadnjdExt 3b7f5300c5
[extractor/googledrive] Fix source format extraction ()
Closes 
Authored by: RfadnjdExt
coletdjnz 4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default ()
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.

Closes https://github.com/yt-dlp/yt-dlp/issues/7474

Authored by: coletdjnz