Commit Graph

3480 Commits (0bee29493ca8f91a0055a3706c7c94f5860188df)

Author SHA1 Message Date
bashonly 10025b715e
[core] Add `--compat-option manifest-filesize-approx` ()
Closes 
Authored by: bashonly
bashonly 595ea4a99b
[core] Fix format sorting with `--load-info-json` ()
Closes 
Authored by: bashonly
bashonly 2622c804d1
[fd/dash] Force native downloader for `--live-from-start` ()
Closes 
Authored by: bashonly
bashonly fd8fcf8f4f
Revert 39abae2354
The iOS client is not subject to integrity checks and is likely to be a more stable choice going forward

Authored by: bashonly
CrendKing 21b25281c5
[fd/aria2c] Remove duplicate `--file-allocation=none` ()
Authored by: CrendKing
sepro 4a601c9eff
[ie/weverse] Fix login error handling ()
Authored by: seproDev
Shubham 464327acdb
[ie/polskieradio:audition] Fix playlist extraction ()
Closes 
Authored by: shubhexists
bashonly ef79d20dc9
[ie/youtube] Check newly uploaded iOS HLS formats ()
Closes 
Authored by: bashonly
bashonly 39abae2354
[ie/youtube] Deprioritize iOS client formats ()
Authored by: bashonly
bashonly 4ce2f29a50
[ie/generic] Improve direct video link ext detection ()
Closes 
Authored by: bashonly
bashonly 177f0d963e
[ie/QDance] Update `_VALID_URL` ()
Authored by: bashonly
Bart Broere 8e02a4dcc8
[ie/npo] Send `POST` request to streams API endpoint ()
Closes 
Authored by: bartbroere
saintliao 7b8b1cf5eb
[ie/twitcasting] Fix livestream extraction ()
Closes 
Authored by: JC-Chung, saintliao

Co-authored-by: JC-Chung <52159296+JC-Chung@users.noreply.github.com>
bashonly a40e0b37df
[core] Only ensure playlist thumbnail dir if writing thumbs ()
Bugfix for 2acd1d555e

Closes 
Authored by: bashonly
Simon Sawicki 4e38e2ae9d
[rh:requests] Handle both `bytes` and `int` for `IncompleteRead.partial` (Fix 8a8b54523a) ()
Authored by: bashonly, coletdjnz, Grub4K
coletdjnz 8a8b54523a
[rh:requests] Add handler for `requests` HTTP library ()
Adds support for HTTPS proxies and persistent connections (keep-alive)

Closes https://github.com/yt-dlp/yt-dlp/issues/1890
Resolves https://github.com/yt-dlp/yt-dlp/issues/4070
Resolves https://github.com/ytdl-org/youtube-dl/issues/32549
Resolves https://github.com/ytdl-org/youtube-dl/issues/14523
Resolves https://github.com/ytdl-org/youtube-dl/issues/13734

Authored by: coletdjnz, Grub4K, bashonly
github-actions b73c409318 Release 2023.10.13
Created by: bashonly

:ci skip all :ci run dl
bashonly b634ba742d
[cleanup] Misc ()
Authored by: bashonly, gamer191
Riteo 2acd1d555e
[core] Ensure thumbnail output directory exists ()
Closes 
Authored by: Riteo
sepro b286ec68f1
[ie/jtbc] Add extractors ()
Authored by: seproDev
sepro e030b6b6fb
[ie/mbn] Add extractor ()
Authored by: seproDev
bashonly b931664231
[ie/radiko] Fix bug with `downloader_options`
Closes 
Authored by: bashonly
Simon Sawicki feebf6d02f
[ie/youtube] Fix bug with `--extractor-retries inf` ()
Authored by: Grub4K
bashonly 84e26038d4
[utils] `write_xattr`: Use `os.setxattr` if available ()
Closes 
Authored by: bashonly, Grub4K

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
garret 4de94b9e16
[ie/nhk] Fix Japanese-language VOD extraction ()
Closes 
Authored by: garret1317
Midnight Veil 88a99c87b6
[ie/tenplay] Add support for seasons ()
Closes 
Authored by: midnightveil
Stefan Lobbenmeier 09f815ad52
[ie/ArteTV] Support age-restricted content ()
Closes 
Authored by: StefanLobbenmeier
naginatana b7098d46b5
[ie/youku] Improve tudou.com support ()
Authored by: naginatana
Simon Sawicki 1c51c520f7
[fd/fragment] Improve progress calculation ()
This uses the download speed from all threads and also adds smoothing to speed and eta

Authored by: Grub4K
Awal Garg 9d7ded6419
[utils] `js_to_json`: Fix `Date` constructor parsing ()
Authored by: awalgarg, Grub4K
github-actions 4392c4680c Release 2023.10.07
Created by: Grub4K

:ci skip all :ci run dl
Simon Sawicki 377e85a179
[cleanup] Misc ()
* Simplify nuxt regex
* Fix tmz quotes and tests
* Update test python versions

Authored by: dirkf, gamer191, Grub4K
bashonly 03e85ea99d
[ie/youtube] Fix `heatmap` extraction ()
Closes 
Authored by: bashonly
Aleri Kaisattera 792f1e64f6
[ie/theta] Remove extractors ()
Authored by: alerikaisattera
trainman261 19c90e405b
[cleanup] Update extractor tests ()
Authored by: trainman261
garret e831c80e8b
[ie/nhk] Fix VOD extraction ()
Closes 
Authored by: garret1317
Raphaël Droz 0e722f2f3c
[ie/lbry] Extract `uploader_id` ()
Closes 
Authored by: drzraf
Esme 47c598783c
[ie/erocast] Add extractor ()
Closes 
Authored by: madewokherd
AS6939 35d9cbaf96
[ie/iq.com] Fix extraction and subtitles ()
Closes , Closes 
Authored by: AS6939
garret 2ad3873f0d
[ie/radiko] Improve extraction ()
Authored by: garret1317
Umar Getagazov 2f2dda3a7e
[ie/substack] Fix download cookies bug ()
Authored by: handlerug
Umar Getagazov fbcc299bd8
[ie/substack] Fix embed extraction ()
Authored by: handlerug
Raphaël Droz 48cceec1dd
[ie/lbry] Add playlist support ()
Closes , Closes 
Authored by: drzraf, bashonly, Grub4K
xofe a9efb4b8d7
[ie/abc.net.au:iview] Improve `episode` extraction ()
Authored by: xofe
c-basalt f980df734c
[ie/neteasemusic] Fix extractors ()
Closes 
Authored by: c-basalt
gillux 91a670a4f7
[ie/LiTV] Fix extractor ()
Closes 
Authored by: jiru
bashonly b095fd3fa9
[ie/WrestleUniverseVOD] Call API with device ID ()
Closes 
Authored by: bashonly
bashonly 0730d5a966
[ie/gofile] Fix token cookie bug
Authored by: bashonly
Simon Sawicki cc8d844152
[ie/xhamster:user] Support creator urls ()
Authored by: Grub4K
coletdjnz eb5bdbfa70
[ie/youtube] Raise a warning for `Incomplete Data` instead of an error ()
Closes https://github.com/yt-dlp/yt-dlp/issues/8206

Adds `raise_incomplete_data` extractor arg to revert this behaviour and raise an error.

Authored by: coletdjnz
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
github-actions c54ddfba0f Release 2023.09.24
Created by: Grub4K

:ci skip all :ci run dl
Simon Sawicki de015e9307
[core] Prevent RCE when using `--exec` with `%q` (CVE-2023-40581)
The shell escape function is now using `""` instead of `\"`. `utils.Popen` has been patched to properly quote commands.

Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-42h4-v29r-42qg for reference.

Authored by: Grub4K
Simon Sawicki 61bdf15fc7
[core] Raise minimum recommended Python version to 3.8 ()
Authored by: Grub4K
bashonly 1eaca74bc2
[ie/nfl.com:plus:replay] Fix extractor ()
Closes 
Authored by: bashonly
Mozi 92feb5654c
[ie/brilliantpala] Add extractors ()
Authored by: pzhlkj6612
Mozi 698beb9a49
[ie/niconicochannelplus] Add extractors ()
Closes 
Authored by: pzhlkj6612
garret 15591940ff
[ie/cineverse] Add extractors ()
Also removes AsianCrushIE and AsianCrushPlaylistIE (URLs do not work anymore & old IDs are unavailable).

Closes 
Authored by: garret1317
Mozi 6636021206
[ie/PIAULIZAPortal] Add extractor ()
Authored by: pzhlkj6612
garret eaee21bf71
[ie/Monstercat] Add extractor ()
Closes 
Authored by: garret1317
bashonly 5ca095cbcd
[cleanup] Misc ()
Closes , Closes 
Authored by: barsnick, sqrtNOT, gamer191, coletdjnz, Grub4K, bashonly
bashonly c2da0b5ea2
[ie/ArteTV] Fix HLS formats extraction
Closes 
Authored by: bashonly
Atsushi Watanabe c1d71d0d9f
[ie/twitcasting] Support `--wait-for-video` ()
Authored by: at-wat
std-move 568f080518
[ie/iprima] Fix extractor ()
Closes 
Authored by: std-move
bashonly 904a19ee93
[ie] Make `_search_nuxt_data` more lenient
Authored by: std-move

Co-authored-by: std-move <26625259+std-move@users.noreply.github.com>
bashonly 52414d64ca
[utils] `js_to_json`: Handle `Array` objects
Authored by: Grub4K, std-move

Co-authored-by: std-move <26625259+std-move@users.noreply.github.com>
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
std-move 2269065ad6
[ie/NovaEmbed] Fix extractor ()
Closes 
Authored by: std-move
kylegustavo a5e264d74b
[ie/Expressen] Improve `_VALID_URL` ()
Closes 
Authored by: kylegustavo
ClosedPort22 b84fda7388
[ie/bilibili] Extract Dolby audio formats ()
Closes 
Authored by: ClosedPort22
Simon 5fccabac27
[ie/rbgtum] Fix extraction and support new URL format ()
Authored by: simon300000
c-basalt 21f40e75df
[ie/douyutv] Fix extractors ()
Closes , Closes 
Authored by: c-basalt
Elyse b3febedbeb
[ie/Canal1,CaracolTvPlay] Add extractors ()
Closes 
Authored by: elyse0
Mozi 295fbb3ae3
[ie/eplus:inbound] Add extractor ()
Authored by: pzhlkj6612
bashonly 35f9a306e6
[dependencies] Handle deprecation of `sqlite3.version` ()
Closes 
Authored by: bashonly
Simon Sawicki b532556d0a
[ie/pr0gramm] Rewrite extractor ()
Authored by: Grub4K
Rohan Dey cf11b40ac4
[ie/media.ccc.de:lists] Fix extraction ()
Closes 
Authored by: Rohxn16
niemands 40999467f7
[ie/pornbox] Add extractor ()
Authored by: niemands
u-spec-png 8ac5b6d96a
[ie/N1Info:article] Fix extractor ()
Authored by: u-spec-png
c-basalt 69b03f84f8
[ie/weibo] Fix extractor and support user extraction ()
Closes , Closes , Closes 
Authored by: c-basalt
c-basalt 9e68747f96
[ie/bilibili] Add support for series, favorites and watch later ()
Closes 
Authored by: c-basalt
Elyse ba8e9eb2c8
[ie/radiofrance] Add support for livestreams, podcasts, playlists ()
Closes 
Authored by: elyse0
coletdjnz 20fbbd9249
[networking] Fix various socks proxy bugs ()
- Fixed support for IPv6 socks proxies
- Fixed support for IPv6 over socks5
- Fixed --source-address not being obeyed for socks4 and socks5
- Fixed socks4a when the destination address is an IPv4 address

Closes https://github.com/yt-dlp/yt-dlp/issues/7959
Fixes https://github.com/ytdl-org/youtube-dl/issues/15368

Authored by: coletdjnz
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
Co-authored-by: bashonly <bashonly@bashonly.com>
Sebastian Koch 81f46ac573
[ie/massengeschmack.tv] Fix title extraction ()
Authored by: sb0stn
aky-01 63e0c5748c
[ie/IndavideoEmbed] Fix extraction ()
Closes 
Authored by: aky-01
Simon efa2339502
[ie/lecturio] Improve `_VALID_URL` ()
Authored by: simon300000
soundchaser128 58493923e9
[ie/rule34video] Extract tags ()
Authored by: soundchaser128
Simon Sawicki 836e06d246
[core] Fix support for upcoming Python 3.12 ()
This also adds the following test runners:
- `3.12-dev` on `ubuntu-latest`
- `3.12-dev` on `windows-latest`
- `pypy-3.10` on `ubuntu-latest`

Authored by: Grub4K
bashonly 94389b225d
[ie/RTVSLO] Fix format extraction ()
Closes 
Authored by: bashonly
bashonly 9652bca1bd
[ie/web.archive:vlive] Remove extractor ()
Closes 
Authored by: bashonly
bashonly 538d37671a
[ie/AmazonMiniTV] Fix extractors
Closes 
Authored by: GautamMKGarg, bashonly

Co-authored by: GautamMKGarg <GautamMKgarg@gmail.com>
bashonly 2da7bcca16
Revert 9d376c4dae
Authored by: bashonly
garret eda0e415d2
[ie/bbc] Extract tracklist as chapters ()
Authored by: garret1317
bashonly 20c3c9b433
[ie/reddit] Extract subtitles
Closes 
Authored by: bashonly
bashonly 635ae31f68
[ie/mediastream] Make embed extraction non-fatal
Authored by: bashonly
bashonly 5367585219
[ie/generic] Fix KVS thumbnail extraction
Closes 
Authored by: bashonly
fireattack 308936619c
[ie/facebook] Improve format sorting ()
Authored by: fireattack
c-basalt 5be7e97886
[ie/sohu] Fix extractor ()
Closes , Closes 
Authored by: c-basalt, bashonly
barsnick b4c1c408c6
[ie/Bild.de] Extract HLS formats ()
Closes 
Authored by: barsnick
Tristan Lee 23d829a342
[ie/Rumble] Fix embed extraction ()
Authored by: trislee
04-pasha-04 0ce1f48bf1
[ie/funker530] Fix extraction ()
Authored by: 04-pasha-04
Mozi ecef42c3ad
[ie/zaiko] Improve thumbnail extraction ()
Authored by: pzhlkj6612
ApoorvShah111 a83da3717d
[ie/nitter] Fix title extraction fallback ()
Closes 
Authored by: ApoorvShah111
Aniruddh Joshi 9d376c4dae
[ie/AmazonMiniTV] Fix extractor ()
Closes 
Authored by: Aniruddh-J
c-basalt 5336bf57a7
[ie/bilibili] Extract `format_id` ()
Authored by: c-basalt
makeworld 9bf14be775
[ie/cbc] Ignore any 426 from API ()
Closes 
Authored by: makew0rld
c-basalt cebbd33b1c
[ie/twitcasting] Improve `_VALID_URL` ()
Closes 
Authored by: c-basalt
bashonly 069cbece9d
[ie/tiktok] Fix webpage extraction
Closes 
Authored by: bashonly
Simon Sawicki f659e64394
[ie/bpb] Overhaul extractor ()
Authored by: Grub4K
Jérôme Duval 7d3d658f4c
[ie/TV5MondePlus] Fix extractor ()
Closes 
Authored by: korli, dirkf
hatsomatt 98eac0e6ba
[ie/videa] Fix extraction ()
Closes 
Authored by: hatsomatt, aky-01

Co-authored-by: aky-01 <65510015+aky-01@users.noreply.github.com>
zhallgato 6e07e4bc7e
[ie/mediaklikk] Fix extractor ()
Fixes https://github.com/yt-dlp/yt-dlp/issues/8053

Authored by: bashonly, zhallgato
barsnick aee6b9b88c
[ie/Axs] Add extractor ()
Authored by: barsnick
Kshitiz Gupta 578a82e497
[ie/banbye] Support video ids containing a hyphen ()
Fixes https://github.com/yt-dlp/yt-dlp/issues/7895

Authored by: kshitiz305
SevenLives 497bbbbd73
[ie/abematv] Fix proxy handling ()
Fixes https://github.com/yt-dlp/yt-dlp/issues/8036

Authored by: SevenLives
garret 7b71643cc9
[ie/mixcloud] Update API URL ()
Closes 
Authored by: garret1317
bashonly 66cc64ff66
[ie/zoom] Extract duration
Closes 
Authored by: bashonly
bashonly a006ce2b27
[ie/twitter] Fix retweet extraction and syndication API ()
Authored by: bashonly
Szaby Grünwald 5d0395498d
[ie/wdr] Fix extraction ()
Closes 
Authored by: szabyg
ifan-t fe371dcf0b
[ie/S4C] Add series support and extract subs/thumbs ()
Authored by: ifan-t
ringus1 d3d81cc98f
[ie/facebook] Fix webpage extraction ()
Closes 
Authored by: ringus1
bashonly 99c99c7185
[ie/gofile] Update token
Closes 
Authored by: bashonly
bashonly c6ef553792
[ie/twitter:spaces] Pass referer header to downloader
Closes 
Authored by: bashonly
bashonly 69dbfe01c4
Bugfix for bae4834245
Authored by: bashonly
Mattias Wadman 2301b5c1b7
[ie/SVTPlay] Fix extraction ()
Closes 
Authored by: wader, dirkf
Simon Sawicki 77bff23ee9
Bugfix for 59e92b1f18
Closes 

Authored by: Grub4K
Rajeshwaran 7237c8dca0
[ie/hotstar] Extract `release_year` ()
Authored by: Rajeshwaran2001
bashonly 30ea88591b
[ie/hotstar] Make metadata extraction non-fatal
Authored by: bashonly
Grabien 630a55df8d
[ie/Mediaite] Fix extraction ()
Authored by: Grabien
RedDeffender bae4834245
[ie/NoodleMagazine] Fix extraction ()
Closes 
Authored by: RedDeffender
bashonly 099fb1b35c
Bugfix for b9f2bc2dbe
Authored by: bashonly
Omar Atef 4b3a6ef1b3
[ie/hungama] Overhaul extractors ()
Closes 
Authored by: Yalab7, bashonly
Stavros Ntentos 665876034c
[ie/antenna] Support antenna.gr ()
Authored by: stdedos
Nathan Touzé b9f2bc2dbe
[ie/Dropbox] Fix extractor ()
Closes , Closes 
Authored by: nathantouze, bashonly, denhotte
sepro c2d8ee0000
[ie/weverse] Support extraction without auth ()
Authored by: seproDev
bashonly 56b3dc0335
[ie/StagePlus] Fix m3u8 extraction ()
Closes 
Authored by: bashonly
bashonly d7aee8e310
[ie/Mzaalo] Improve `_VALID_URL`
Authored by: bashonly
Simon Sawicki 59e92b1f18
[rh/urllib] Simplify gzip decoding ()
Authored by: Grub4K
Davin Kevin 7cccab79e7
[ie/wat.tv] Fix extraction ()
Closes 
Authored by: davinkevin
trainman261 ed71189781
[ie/CBCPlayerPlaylist] Add extractor ()
Authored by: trainman261
bashonly a0de8bb860
[ie/zee5] Update access token endpoint ()
Closes 
Authored by: bashonly
garret 876b70c8ed
[ie/tbsjp] Add episode, program, playlist extractors ()
Authored by: garret1317
trainman261 339c339fec
[ie/CBCPlayer] Extract HLS formats and subtitles ()
Authored by: trainman261
bashonly dab87ca236
[cookies] Containers JSON should be opened as utf-8 ()
Closes 
Authored by: bashonly
coletdjnz 378ae9f9fb
[ie/youtube] Fix consent cookie ()
Fixes 

Authored by: coletdjnz
coletdjnz db7b054a61
[networking] Add request handler preference framework ()
Preference functions that take a request and a request handler instance can be registered to prioritize different request handlers per request.

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Franklin Lee db97438940
[ie/PicartoVod] Fix extractor ()
Closes 
Authored by: Frankgoji
ifan-t b9de629d78
[ie/S4C] Add extractor ()
Authored by: ifan-t
ringus1 a854fbec56
[ie/facebook] Add dash manifest URL ()
Fixes 
Authored by: ringus1
ischmidt20 30b29f3715
[ie/fox] Support foxsports.com ()
Authored by: ischmidt20
Steve 6d6081dda1
[extractor/pbs] Add extractor `PBSKidsIE` ()
Authored by: snixon
Fixes 
bashonly 6014355c61
[ie/twitter] Add fallback, improve error handling ()
Closes , Closes 
Authored by: bashonly
pukkandan f73c118035
`FFmpegFixupM3u8PP` may need to run with ffmpeg
Bug in 62b5c94cad
Closes 
coletdjnz 546b2c28a1
[ie/youtube] Fix `player_params` arg being converted to lowercase
Fix bug in ba06d77a31

Authored by: coletdjnz
pukkandan 6148833f5c
[cleanup] Misc
pukkandan 8cb7fc44db
Fix `--check-formats`
Bug in bc344cd456
pukkandan 3f7965105d
[utils] HTTPHeaderDict: Handle byte values
bashonly b09bd0c196
[ie/tiktok] Fix audio-only format extraction ()
Closes 
Authored by: bashonly
bashonly 127a224606
[ie/LBRY] Fix original format extraction ()
Authored by: bashonly
bashonly 86eeb044c2
[ie/hotstar] Support `/clips/` URLs ()
Closes 
Authored by: bashonly
bashonly 9a04113dfb
[ie/Reddit] Fix thumbnail extraction
Authored by: bashonly
coletdjnz ba06d77a31
[ie/youtube] Add `player_params` extractor arg ()
Authored by: coletdjnz
coletdjnz 4bf912282a
[networking] Remove dot segments during URL normalization ()
This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process.

Closes , 

Authored by: coletdjnz
nnoboa a15fcd299e
[ie/Wimbledon] Add extractor ()
Closes 
Authored by: nnoboa
Amirreza Aflakparast c03a58ec99
[ie/MotorTrendOnDemand] Update `_VALID_URL` ()
Closes 
Authored by: AmirAflak
coletdjnz bbeacff7fc
[networking] Ignore invalid proxies in env ()
Authored by: coletdjnz
bashonly dae349da97
[ie/WrestleUniversePPV] Fix HLS AES key extraction
Fix bug in ef8fb7f029

Closes 
Authored by: bashonly
bashonly 550e65410a
[ie] Extract subtitles from SMIL manifests ()
Authored by: bashonly, pukkandan
bashonly 39837ae319
[ie/triller] Fix unlisted video extraction ()
Authored by: bashonly
coletdjnz 86aea0d3a2
[networking] Add strict Request extension checking ()
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
bashonly 11de6fec9c
[ie/PatreonCampaign] Fix extraction ()
Authored by: bashonly
pukkandan a250b24733
[compat] Ensure submodules are imported correctly
Closes 
pukkandan 25b6e8f946
Fix e0c4db04dc for pypy
pukkandan e705738338
[ie/unsupported] List more sites with DRM
Closes , , , , 
pukkandan 62b5c94cad
[cleanup] Misc fixes
Closes 
pukkandan e0c4db04dc
[compat] Add `types.NoneType`
pukkandan 81b4712bca
[extractor] Fix `--load-pages`
pukkandan 994f7ef8e6
[ie/generic] Fix generic title for embeds
Closes 
pukkandan a264433c9f
[outtmpl] Fix replacement for `playlist_index`
pukkandan 9f66247289
[ie/abematv] Temporary fix for protocol handler
Closes 
bashonly e57eb98222
[fd/external] Fix ffmpeg input from stdin ()
Bugfix for 1ceb657bdd

Authored by: bashonly
Simon Sawicki 9b16762f48
[ie/crunchyroll] Remove initial state extraction ()
Authored by: Grub4K
bashonly 65cfa2b057
[ie/MuseAI] Add extractor ()
Closes 
Authored by: bashonly
bashonly f4ea501551
[ie/MagellanTV] Add extractor ()
Closes 
Authored by: bashonly
bashonly af86873218
[utils] Improve `parse_duration`
Authored by: bashonly
bashonly 75dc8e673b
[networking] Fix `--legacy-server-connect` ()
Bugfix for 227bf1a33b

Authored by: bashonly
bashonly 71baa490eb
[networking] Fix POST requests with zero-length payloads ()
Bugfix for 227bf1a33b

Authored by: bashonly
bashonly 613dbce177
[ie/twitter:spaces] Fix format protocol ()
Closes 
Authored by: bashonly
Văn Anh bb5d84c9d2
[ie/facebook:reel] Fix extraction ()
Closes 
Authored by: demon071, bashonly
zhong-yiyu 1d3d579c21
[ie/pornhub] Update access cookies for UK ()
Closes 
Authored by: zhong-yiyu
bashonly 42ded0a429
[fd/external] Fixes to cookie handling
- Fix bug in `axel` Cookie header arg
- Pass cookies to `curl` as strings
- Write session cookies for `aria2c` and `wget`

Closes 
Authored by: bashonly
bashonly 6c5211cebe
[core] Fix HTTP headers and cookie handling
- Remove `Cookie` header from `http_headers` immediately after loading into cookiejar
- Restore compat for `--load-info-json` cookies
- Add more tests
- Fix improper passing of Cookie header by `MailRu` extractor

Closes 
Authored by: bashonly, pukkandan
Aaruni Kaushik 2b029ca0a9
[cleanup] Add color to `download-archive` message ()
Authored by: aaruni96, Grub4K, pukkandan
Closes 
pukkandan 131d132da5
[build] Make sure deprecated modules are added
coletdjnz 3d2623a898
[compat, networking] Deprecate old functions ()
Authored by: coletdjnz, pukkandan
coletdjnz 227bf1a33b
[networking] Rewrite architecture ()
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.

User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
   - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`

Authored by: coletdjnz
pukkandan c365dba843
[networking] Add module ()
No actual changes - code is only moved around
pukkandan 1b392f905d
[utils] Add temporary shim for logging
Related: , 
coletdjnz 1ba6fe9db5
[ie/youtube:tab] Detect looping feeds ()
Closes https://github.com/yt-dlp/yt-dlp/issues/5555

Note: the first page may still be repeated, however this is better than nothing.

Authored by: coletdjnz
Finn R. Gärtner 1bcb9fe871
[ie/piapro] Support `/content` URL ()
Authored by: FinnRG
Neurognostic 8a4cd12c8f
[pp/EmbedThumbnail] Support `m4v` ()
Authored by: Neurognostic
Aleri Kaisattera 2cfe221fbb
[ie/streamanity] Remove ()
Service is dead
Authored by: alerikaisattera
Mahmoud Abdel-Fattah 2af4eeb772
[utils] `clean_podcast_url`: Handle more trackers ()
Authored by: mabdelfattah, bashonly
Closes 
Zprokkel 325191d0c9
[ie/vrt] Update token signing key ()
Authored by: Zprokkel
GD-Slime bdd0b75e3f
[ie/BiliBiliBangumi] Fix extractors ()
- Overhaul BiliBiliBangumi extractor for the site's new API
- Add BiliBiliBangumiSeason extractor
- Refactor BiliBiliBangumiMedia extractor

Closes , Closes 
Authored by: GD-Slime
bashonly 92315c0377
[extractor/twitter] Fix GraphQL and legacy API ()
Authored by: bashonly
pukkandan b03fa78345
Revert 49296437a8
github-actions cc0619f62d Release 2023.07.06
Created by: pukkandan

:ci skip all :ci run dl
Simon Sawicki 3121512228
[core] Change how `Cookie` headers are handled
Cookies are now saved and loaded under `cookies` key in the info dict
instead of `http_headers.Cookie`. Cookies passed in headers are
auto-scoped to the input URLs with a warning.

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: Grub4K
coletdjnz f8b4bcc0a7
[core] Prevent `Cookie` leaks on HTTP redirect
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: coletdjnz
bashonly 1ceb657bdd
[fd/external] Scope cookies
- ffmpeg: Calculate cookies from cookiejar and pass with `-cookies` arg instead of `-headers`
- aria2c, curl, wget: Write cookiejar to file and use external FD built-in cookiejar support
- httpie: Calculate cookies from cookiejar instead of `http_headers`
- axel: Calculate cookies from cookiejar and disable http redirection if cookies are passed
    - May break redirects, but axel simply don't have proper cookie support

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: bashonly, coletdjnz
pukkandan ad8902f616
[ie/vidlii] Handle relative URLs
Closes 
pukkandan 94ed638a43
[ie/youtube] Avoid false DRM detection ()
Some master manifests contain a mix of DRM and non-DRM formats
pukkandan bc344cd456
[core] Allow extractors to mark formats as potentially DRM ()
This is useful for HLS where detecting whether the format is
actually DRM requires the child manifest to be downloaded.

Makes the error message when using `--test` inconsistent,
but doesn't really matter.
pukkandan 906c0bdcd8
[formats] Fix best fallback for storyboards
Partial fix for 
pukkandan 337734d4a8
[cleanup] Misc
pukkandan 47bcd43724
[outtmpl] Pad `playlist_index` etc even when with internal formatting
Closes 
pukkandan 662ef1e910
[downloader/http] Avoid infinite loop when no data is received
Closes 
coletdjnz 90db9a3c00
[extractor/youtube:stories] Remove ()
YouTube killed them

https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
bashonly 49296437a8
[extractor/twitter] Fix unauthenticated extraction ()
Closes 
Authored by: bashonly
bashonly 1cffd621cb
[extractor/twitter:spaces] Fix extraction ()
Closes 
Authored by: bashonly
RfadnjdExt 3b7f5300c5
[extractor/googledrive] Fix source format extraction ()
Closes 
Authored by: RfadnjdExt
coletdjnz 4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default ()
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.

Closes https://github.com/yt-dlp/yt-dlp/issues/7474

Authored by: coletdjnz
c-basalt 8776349ef6
[extractor/vk] VKPlay, VKPlayLive: Add extractors ()
Closes 
Authored by: c-basalt
urectanc af1fd12f67
[extractor/stacommu] Add extractors ()
Authored by: urectanc
coletdjnz fcbc9ed760
[extractor/youtube:tab] Support shorts-only playlists ()
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
bashonly a2be9781fb
[extractor/Douyin] Fix extraction from webpage
Closes 
Authored by: bashonly
Xiao Han 8f05fbae2a
[extractor/abc] Fix extraction ()
Closes 
Authored by: meliber
Aman Salwan 5b4b92769a
[extractor/crunchyroll:music] Fix `_VALID_URL` ()
Closes 
Authored by: AmanSal1, rdamas

Co-authored-by: Robert Damas <robert.damas@byom.de>
pukkandan 91302ed349
[utils] clean_podcast_url: Handle protocol in redirect URL
Closes 
pukkandan f393bbe724
[extractor/sbs] Python 3.7 compat
Closes 
pukkandan 8a8af356e3
[downloader/aria2c] Add `--no-conf`
Closes 
pukkandan d949c10c45
[extractor/youtube] Process `post_live` over 2 hours
bashonly ef8509c300
[extractor/kick] Fix `_VALID_URL`
Closes 
Authored by: bashonly
nnoboa 5e16cf92eb
[extractor/AdultSwim] Extract subtitles from m3u8 ()
Authored by: nnoboa
Closes 
bashonly f0a1ff1181
[extractor/qdance] Add extractor ()
Closes 
Authored by: bashonly
pukkandan 58786a10f2
[extractor/youtube] Add extractor-arg `formats`
Closes 
pukkandan e59e20744e
Bugfix for b4e0d75848
Simon 89bed01374
[extractor/youtube] Fix comments' `is_favorited` ()
Authored by: bbilly1
Closes 
github-actions de4cf77ec1 Release 2023.06.22
Created by: pukkandan

:ci skip all :ci run dl
pukkandan 812cdfa06c
[cleanup] Misc
pukkandan cd810afe2a
[extractor/youtube] Improve nsig function name extraction
pukkandan b4e0d75848
Improve `--download-sections`
* Support negative time-ranges
* Add `*from-url` to obey time-ranges in URL

Closes 
Berkan Teber 71dc18fa29
[extractor/youtube] Improve description parsing performance ()
* The parsing is skipped when not needed
* The regex is improved by simulating atomic groups with lookaheads

Authored by: pukkandan, berkanteber
bashonly 98cb1eda7a
[extractor/rheinmaintv] Add extractor ()
Authored by: barthelmannk

Co-authored-by: barthelmannk <81305638+barthelmannk@users.noreply.github.com>
bashonly 774aa09dd6
[extractor/dplay] GlobalCyclingNetworkPlus: Add extractor ()
* Allows `country` API param to be configured with `--xff`/`geo_bypass_country`

Closes 
Authored by: bashonly
rexlambert22 f2ff0f6f19
[extractor/motherless] Add gallery support, fix groups ()
Authored by: rexlambert22
pukkandan 5fd8367496
[extractor] Support multiple `_VALID_URL`s ()
Authored by: nixxo
pukkandan 0dff8e4d1e
Indicate `filesize` approximated from `tbr` better
pukkandan 1e75d97db2
[extractor/youtube] Add `ios` to default clients used
* IOS is affected neither by 403 or by nsig so helps mitigate them preemptively
* IOS also has higher bit-rate "premium" formats though they are not labeled as such
pukkandan 81ca451480
[extractor/youtube] Workaround 403 for android formats
Ref: https://github.com/TeamNewPipe/NewPipe/issues/9038#issuecomment-1289756816
Roland Hieber 3f756c8c40
[extractor/nebula] Fix extractor ()
Closes 
Authored by: Lamieur, rohieb

Co-authored-by: Lam <github@Lam.pl>