Commit Graph

1740 Commits (86e5f3ed2e6e71eb81ea4c9e26288f16119ffd0c)

Author SHA1 Message Date
pukkandan 0bb322b9c0
Add field `webpage_url_domain`
Closes 
pukkandan ff9f925b63
[test/download] Add more fields
pukkandan 5bfc8bee5a
Fix PostProcessor hooks not registered for some PPs
Closes 
pukkandan 19188702ef
[FormatSort] Prevent incorrect deprecation warning
Closes 
The Hatsune Daishi d984a98def
[ok.ru] add mobile fallback ()
Authored by: nao20010128nao
u-spec-png 069c6ccf02
[olympics] Add uploader and cleanup ()
Authored by: u-spec-png
MinePlayersPE 53dad39e30
[TikTok] Pass cookies to mobile API ()
Authored by: MinePlayersPE
Ashish Gupta db77c49c84
[SonyLiv] Add OTP login support ()
Closes 
Authored by: Ashish0804
Ashish Gupta abc07b554c
[NateTV] Add NateIE and NateProgramIE ()
Authored by: Ashish0804, Hyeeji
Ashish Gupta 86f3d52f8c [DiscoveryPlusShowBaseIE] yield actual video id
u-spec-png 8b688881ba
[instagram] Expand valid URL ()
Closes 

Authored by: u-spec-png
Ashish Gupta 13debc86e7
[Rutube] Add RutubeChannelIE ()
Closes  
Authored by: Ashish0804
nyuszika7h b5f94e4fa1
[toggo] Add extractor ()
Authored by: nyuszika7h
YuenSzeHong 61882afdc5
[fujitv] Extract 1080p from `tv_android` m3u8 ()
Authored by: YuenSzeHong
coletdjnz aa4b054512
[web.archive:youtube] Improve metadata extraction ()
Authored-by: coletdjnz
YuenSzeHong 487c5b3389
[TVer] Extract better thumbnails ()
Authored by: YuenSzeHong
Nil Admirari 8157a09d22
[SponsorBlock] Add Filler and Highlight categories ()
Authored by: nihil-admirari, pukkandan
Jertzukka b1aaf1c07f
[gofile] Add extractor ()
Closes  
Authored by: Jertzukka, Ashish0804
chris 5f9aaac8c2
[zdf] Support videos with different ptmd location ()
Authored by: iw0nderhow
David Skrundz 54c2521ca6
[CBC Gem] Extract 1080p formats ()
Authored by: DavidSkrundz
The Hatsune Daishi 2814f12ba4
[skeb] Add extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30287
Authored by: nao20010128nao
raleeper 1619836cb7
[crackle] Look for non-DRM formats ()
Authored by: raleeper
pukkandan e3c7d49571
[compat] Suppress errors in enabling VT mode
Closes 
The Hatsune Daishi ddd24c9949
[ntvcojp] Extract NUXT data ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30309
Authored by: nao20010128nao
Michal Kubeček 443b21dc4e
[ceskatelevize] Fetch iframe from nextJS data ()
Closes 
Authored by: mkubecek
The Hatsune Daishi 66f4c04e50
[extractor] Add `_search_nuxt_data` ()
Authored by: nao20010128nao
nixxo 93864403ea
[redtube] Handle formats delivered inside a JSON ()
Closes 
Authored by: dirkf, nixxo
pukkandan b5475f1145
Pre-process when using `--flat-playlist`
pukkandan 38d79fd16c
Use `parse_duration` for `--wait-for-video`
and some minor fix
pukkandan acc0d6a411
Allow `--no-write-thumbnail` to override `--write-all-thumbnail`
Closes 
pukkandan 146cc4114a
bugfix for 63ccf4ff1a
pukkandan 818faa3a86
[vimeo] Extract chapters
Closes 
MinePlayersPE aa5ecf082c
[TrueID] Add extractor ()
Authored by: MinePlayersPE
pukkandan d2b2fca53f
[extractor] Ignore errors in comment extraction when `-i` is given
Closes 
pukkandan 63ccf4ff1a
[lazy_extractors] Fix bug in 2c4aaaddc9
SearchIEs must not inherit from extractors that have a _VALID_URL defined
pukkandan 43b2290658
Fix `--throttled-rate`
nixxo 99148c6a33
[RaiNews] Fix extractor ()
Closes 
Authored by: nixxo
pukkandan 9bdd99cf39
[EmbedSubtitle] Disable duration check temporarily
Closes , 
pukkandan 2c4aaaddc9
[lazy_extractors] Fix for search IEs
Closes 
pukkandan 5f7cb91ae9
[youtube] Fix `ytsearchdate`
Related: 
pukkandan 3efb96a6d1
Fix control characters being printed to `--console-title`
Closes 
pukkandan 3262f8abf2
[trovo] Fix inheritance of `TrovoChannelBaseIE`
Closes 
Christian Paul bdbafb3913
[Jamendo] Fix use of `_VALID_URL_RE` ()
Closes 
Authored by: jaller94
pukkandan a804f6d89c
[cleanup Fix some typos
* `MetadataFromFieldPP` is not deprecated!
* Wrong args to `MetadataFromFieldPP`
* Some mistakes in change log
* Type in build.yml causing release tag to be placed on wrong commit
github-actions 814dfb7e25 [version] update
Created by: pukkandan

:ci skip all
pukkandan 91f071af60
Release 2021.12.01
pukkandan 2aa5e2cc01
Ensure same config file is not loaded multiple times
j54vc1bk 1bad50eced
[CableAV] Add extractor ()
Authored by: j54vc1bk
u-spec-png ac0efabf12
[Bilibili] Fix title extraction ()
Closes 
Authored by: u-spec-png
Ashish Gupta 73f035e1fe
[Cleanup] Remove some unnecessary groups in regexes ()
Authored by: Ashish0804
nyuszika7h 0cbed930c8
[trovo] Fix extractor ()
Closes 

Authored by: nyuszika7h
Ashish Gupta 5118d2ec58
[DiscoveryPlus] Rewrite extractors (see desc) ()
* Add `DiscoveryPlusItalyShowIE`
* Use `uuid.uuid4().hex` for device id so no cookies are required
* Fix dash formats not being downloaded
* Extract subtitles from manifests
* Move all extractors to one file and restructure inheritances

Authored by: Ashish0804, pukkandan
pukkandan 717216b093
Validate --get-bypass-country
Closes 
pukkandan 5c22c63da3
Fix `--trim-filename` when filename has `.`
Closes 
pukkandan ee8dd27a73
[cleanup] Add deprecation warnings
pukkandan f304da8a29
[cleanup] Misc cleanup
Closes , closes 
pukkandan 06dfe0a0a2
[cleanup] Refactor `JSInterpreter._seperate`
pukkandan 75b725a7cc
[build] Use `workflow_dispatch` for release
pukkandan 36eaf3039a
[build] Save Git HEAD at release alongside version info
pukkandan f2ebc5c7be
Option `--wait-for-video` to wait for scheduled streams
pukkandan b222c27145
Option `--break-per-input` to apply --break-on... to each input URL
pukkandan 5e5be0c0b2
Fix --break-on-archive when pre-checking
pukkandan 7578d77d8c
[downloader] Add colors to download progress
pukkandan b29165267f
[youtube] Decrypt n-sig for URLs with `ratebypass`
Closes 
pukkandan bc104778d6
[vimeo] Sort http formats higher
Closes 
MinePlayersPE d298d33fe6
[Instagram] Display more login errors ()
Authored by: MinePlayersPE
Deer-Spangle bf57cfa8b7
[RedGifs] Add Search and User extractors ()
Authored by: Deer-Spangle
std-move 3c2208f82d
[NovaEmbed] Fix extractor ()
Authored by: std-move
shirt 93e597ba28
Fix logic error in report_unplayable_conflict
pukkandan b28cdcc0e4
[tiktok:user] Set `webpage_url` correctly
Closes 
DEvmIb a33c0d9c5d
[twitch:vod] Extract live status ()
Authored by: DEvmIb
pukkandan 75689fe59b
Ensure directory exists when checking formats
pukkandan 5ce1d13eba
[EmbedSubtitles] Slightly relax duration check
and related cleanup
Closes 
pukkandan e04b003e64
[FixupM3u8] Fixup MPEG-TS in MP4 container
Closes , https://github.com/ytdl-org/youtube-dl/issues/26410
Grabien 909b0d66f4
[Senate.gov] Add SenateGovIE and fix SenateISVPIE ()
Authored by: Grabien, pukkandan
u-spec-png dfd78699f5
[Aljazeera] Fix extractor ()
Closes 
Authored by: u-spec-png
mpeter50 639f80c1f9
[Twitch:vod] Add chapters ()
Authored by: mpeter50
gustaf 896a88c5c6
[Tvplayhome] Fix extractor ()
Authored by: pukkandan, 18928172992817182 (gustaf)
chio0hai 4e4ba1d75f
[redgifs] Add extractor ()
Closes 
Authored by: chio0hai
Yakabuff 2abf081554
[xvideos] Fix extractor ()
Closes  
Authored by: Yakabuff
Henrik Heimbuerger 359df0fc42
[nebula] Add NebulaCollectionIE and rewrite extractor ()
Closes 
Authored by: hheimbuerger
Ashish Gupta 3938a9212c
[CPTwentyFour] Add extractor ()
Closes 
Authored by: Ashish0804
shirt cf1f13b817
[generic] Support mpd manifests without extension ()
Authored by: shirt-dev
Grabien 18d6dd4e01
[extractor/breitbart] Breitbart.com website support ()
Authored by: Grabien
cntrl-s 883ecd5494
Streamff extractor ()
Closes  
Authored by: cntrl-s
pukkandan eb56d132d2
[cleanup,instagram] Refactor extractors
Closes 
Aurora 17b4540662
[radiozet] Add extractor ()
Authored by: 0xA7404A (Aurora)
Tim da27aeea5c
[ITV] Fix extractor ()
Closes 
Authored by: staubichsauger
Sipherdrakon fec41d17a5
[MTV] Improve mgid extraction ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30149
Fixes: , , https://github.com/ytdl-org/youtube-dl/issues/30139

Authored by: Sipherdrakon, kikuyan
pukkandan a61fd4cf6f
[youtube:search_url] Add playlist/channel support
Closes , 
pukkandan a6213a4925
[cleanup,youtube] Reorganize Tab and Search extractor inheritances
pukkandan 9941a1e127
[PatreonUser] Do not capture RSS URLs
Closes 
pukkandan ff51ed588f
Clarify video/audio-only formats in -F
Related: 
pukkandan 57dbe8077f
[jsinterp] Fix splice to handle float
Needed for new youtube js player f1ca6900
Closes 
pukkandan e5d731f35d
[tv2] Expand valid URL
Closes 
pukkandan d52cd2f5cd
[sbs] Fix for movies and livestreams
Closes 
pukkandan bc8ab44ea0
[itv] Fix for Python 3.6/3.7
Closes 
pukkandan 8f122fa070
[extractor] Extract `average_rating` from JSON-LD
Eg: Crunchyroll
pukkandan 14a086058a
[ARDBetaMediathek] Handle new URLs
Adapted from 8562218350
Closes 
Zirro 0e6b018a10
Ensure path for link files exists ()
Authored by: Zirro
pukkandan f7b558df4d
[mediaklikk] Expand valid URL
Partial fix for 
pukkandan 1ee34c76bb
[vimeo] Add fallback for config URL
Closes 
pukkandan 234416e4bf
[downloader/ffmpeg] Fix for direct videos inside mpd manifests
Closes 
pukkandan c98d4df23b
[WDR] Expand valid URL
Closes 
4a1e2y5 849d699a8b
[xvideos] Detect embed URLs ()
Authored by: 4a1e2y5
Ashish Gupta 77fcc65158
[CozyTV] Add extractor ()
Authored by: Ashish0804
aarubui 545ad64988
[willow] Add extractor ()
Authored by: aarubui
pukkandan d76991ab07
Fix `--check-formats` for `mhtml`
Closes 
pukkandan 282f570918
[utils] Fix error when copying `LazyList`
pukkandan c07a39ae8e
[utils] Fix `PagedList`
Bug in d8cf8d97a8
pukkandan c5e3f84972
[utils] Allow alignment in `render_table`
and add tests
nyuszika7h c45b87419f
[bbc] Get all available formats ()
Authored by: nyuszika7h
Paper 7333296ff5
[VidLii] Add 720p support ()
Authored by: mrpapersonic
The Hatsune Daishi a04e005521
[AES] Add ECB mode ()
Needed for 
Authored by: nao20010128nao
nyuszika7h 6b993ca765
[hls] Better FairPlay DRM detection ()
Authored by: nyuszika7h
pukkandan dd2a987d3f
[tests] Fix tests
pukkandan 9222c38182
[cleanup] Minor cleanup
Closes , Closes 
pukkandan 467b6b8387
[ExtractAudio] Support `alac`
Closes 
pukkandan 8863c8f09e
[soundcloud:search] Fix pagination
Joshua Lochner e16fefd869
[Reddit] Add support for 1080p videos ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29565

Authored by: xenova
zulaport c6118ca2cc
[Stripchat] Add extractor ()
Authored by: zulaport
Paul Wise 764f5de2f4
[blogger] Add extractor ()
Authored by: pabs3
Paul Wise cfcaf64a4b
[rtrfm] Add extractor ()
Authored by: pabs3
u-spec-png 402cd603a4
[LinkedIn] Add extractor ()
Closes  
Authored by: u-spec-png
The Hatsune Daishi 22a510ff44
[mixch] add support for mixch.tv ()
Authored by: nao20010128nao
u-spec-png 61be785a67
[peer.tv] Add extractor ()
Closes  
Authored by: u-spec-png
Ashish Gupta 11852843e7
[AmazonStoreIE] Fix regex to not match vdp urls ()
Closes:  
Authored by: Ashish0804
Ashish Gupta 525d9e0c7d
[HotStar] Set language field from tags ()
Authored by: Ashish0804
Ashish Gupta 9d63137eac
[CanalAlpha] Add extractor ()
Closes:  
Authored by: Ashish0804
Ashish Gupta 266a1b5d52
[ESPNCricInfo] Add extractor ()
Closes:  
Authored by: Ashish0804
Ashish Gupta 450bdf69bc
[OneFootball] Add extractor ()
Closes:  
Authored by: Ashish0804
pukkandan 720c309932
[youtube] Add storyboard formats
Closes: , https://github.com/ytdl-org/youtube-dl/issues/9868
Related: https://github.com/ytdl-org/youtube-dl/pull/14951
pukkandan d8cf8d97a8
[utils] Fix `PagedList`
coletdjnz d0d012d4e7
[youtube] Add `default` player client ()
Authored-by: coletdjnz
pukkandan 013b50b794
Fix 'postprocessor_hooks`
Closes 
pukkandan dac5df5a98
Add option `--embed-info-json` to embed info-json in mkv
Closes 
pukkandan f279aaee8e
Add compat-option embed-metadata
pukkandan d0e6121adf
[curiositystream] Fix login
Bug from 92775d8a40
pukkandan 9ac24e235e
[curiositystream] Add more metadata
Closes 
pukkandan 7c7f7161fc
Fix `--load-info-json` of playlists with failed entries
pukkandan e339d25a0d
[youtube] Minor improvement to format sorting
pukkandan 39c04074e7
[ExtractAudio] Fix conversion to `wav`
Closes 
pukkandan 92775d8a40
[CuriosityStream] Fix series
Bug indroduced in ed807c1837
MinePlayersPE df03de2c02
[RoosterTeethSeries] Fix for multiple pages ()
Authored by: MinePlayersPE
pukkandan 48e9310660
[nexx] Better error message for unsupported format
Related: 
pukkandan c1dc0ee56e
[NovaEmbed] Fix extractor
Closes 
pukkandan bf5f605e76
bugfix for e08a85d865
pukkandan e08a85d865
Fix writing playlist infojson with `--no-clean-infojson`
pukkandan 093a17107e
Allow using a custom format selector through API
Closes , 
pukkandan 44bcb8d122
Fix bug in parsing `--add-header`
Closes 
makeworld 013ae2e503
[CBC Gem] Fix for shows that don't have all seasons ()
Closes 
Authored by: makeworld-the-better-one
u-spec-png b47d236d72
[Tokentube] Fix description ()
Authored by: u-spec-png
pukkandan 9ebf3c6ab9 [version] update
:ci skip all
pukkandan 2e9a445bc3 [version] update
:ci skip all
Lauren Liberda ebfab36fca
[tvp] Add TVPStreamIE ()
Authored by: selfisekai
Lauren Liberda c15de6ffe6
[tvp] Fix extractor ()
Authored by: selfisekai
Lauren Liberda 56bb56f3cf
[tvp] Fix embeds ()
Authored by: selfisekai
Lauren Liberda c0599d4fe4
[wppilot] Add extractors ()
Authored by: selfisekai
Lauren Liberda 3f771f75d7
[radiokapital] Add extractors ()
Authored by: selfisekai
Lauren Liberda ed76230b3f
[polsatgo] Add extractor ()
Authored by: selfisekai, sdomi

Co-authored-by: Dominika Liberda <ja@sdomi.pl>
Lauren Liberda 89fcdff5d8
[polskieradio] Add extractors ()
Authored by: selfisekai
Lauren Liberda f98709af31
[extractor] Add `_search_nextjs_data` ()
Authored by: selfisekai
pukkandan c586f9e8de
[cleanup] minor fixes
pukkandan 59a7a13ef9
[docs] Minor documentation improvements
Closes , 
pukkandan 4476d2c764
[outtmpl] Add alternate forms for `q` and `j`
pukkandan aa9369a2d8
[cleanup] Minor improvements to error and debug messages
stanoarn d54c6003ab
fix for e1b7c54d78
Authored by: stanoarn
u-spec-png 1ee316a34a
[Gab] Add extractor ()
Closes  
Authored by: u-spec-png
ozburo 358247ed2a
[imdb] Fix thumbnail ()
Authored by: ozburo
nixxo 9b12e9a573
[la7] Fix extractor ()
Closes  
Authored by: nixxo
u-spec-png a109acbf82
[ZenYandex] Fix extractor ()
Closes 
Authored by: u-spec-png
pukkandan a49891c761
Fix bug in `--load-infojson` of playlists
Fixes: https://github.com/yt-dlp/yt-dlp/issues/1514#issuecomment-962659529
pukkandan 582fad70f5
[outtmpl] Do not traverse `None`
Closes 
pgaig aeec0e44e2
[VRT] Fix login ()
Closes  
Authored by: pgaig
Ryan Hendrickson d9190e4467
[youtube] Add Invidious list for playlists/channels ()
Authored by: rhendric
stanoarn e1b7c54d78
[iPrima] Fix extractor ()
Authored by: stanoarn
pukkandan 244644c02c
[roosterteeth] Add series extractor
pukkandan 34921b4345
[utils] Add `join_nonempty`
pukkandan a331949df3
[test/download] Fallback test to `bv`
u-spec-png 2c5e8a961e
[Newgrounds] Fix description ()
Authored by: u-spec-png
u-spec-png b515b37cc4
[Vupload] Fix extractor ()
Authored by: u-spec-png
pukkandan 3c4eebf772
[AmazonStore] Add extractor ()
Closes 

Authored by: Ashish0804
u-spec-png fb2d1ee6cc
[Instagram] Add IOS URL support ()
Authored by: u-spec-png
pukkandan 9cb070f9c0
[vimeo] Detect source extension
and misc cleanup

Cherry-picked from 
Closes 

Authored by: flashdagger
pukkandan 2a6f8475ac
[vimeo] Fix ondemand videos and direct URLs with hash
Closes , 
Francesco Frassinelli 73673ccff3
[RaiplayRadio] Add extractors ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/21837
Authored by: frafra
pukkandan aeb2a9ad27
[FormatSort] `eac3` is better than `ac3`
pukkandan df6c409d1f
[piksel] Fix sorting
pukkandan a9d4da606d
[crunchyroll] Add extractor-args `language` and `hardsub`
Closes 
pukkandan c18d4482b1
[youtube] Fix sorting for some videos
u-spec-png 0f6518938d
[N1] Add support for nova.rs ()
Authored by: u-spec-png
u-spec-png 22cd06c452
[Instagram] Improve thumbnail extraction ()
Authored by: u-spec-png
pukkandan a4211baff5
[cleanup] Minor cleanup
pukkandan 8913ef74d7
[ffmpeg] Detect libavformat version for `aac_adtstoasc`
and print available features in verbose head
Based on https://github.com/ytdl-org/youtube-dl/pull/29581
pukkandan 832e9000c7
[ffmpeg] Accurately detect presence of setts
Closes 
CrypticSignal 673c0057e8
[ExtractAudio] Use `libfdk_aac` if available
Closes 
Authored by: CrypticSignal
pukkandan 9af98e17bd
[ffmpeg] Framework for feature detection
Related: , , https://github.com/ytdl-org/youtube-dl/pull/29581
pukkandan 31c49255bf
[ExtractAudio] Rescale --audio-quality correctly
Authored by: CrypticSignal, pukkandan
pukkandan bd93fd5d45
[fragment] Fix progress display in fragmented downloads
Closes 
pukkandan d89257f398
[youtube] Remove unnecessary no-playlist warning
pukkandan 9bd979ca40
[utils] Parse `vp09` as vp9
pukkandan a1fc7ca074
[jsinterp] Handle default in switch better
u-spec-png c588b602d3
[Instagram] Fix incorrect resolution ()
Authored by: u-spec-png
kaz-us f0ffaa1621
[vk] Fix login ()
Closes 
Authored by: kaz-us
pukkandan 0930b11fda
[docs,cleanup] Improve docs and minor cleanup
Closes , , , , , , 
pukkandan a0bb6ce58d
[youtube] refactor itag processing
pukkandan da48320075
[linkedin] Don't login multiple times
kaz-us 5b6cb56207
[vk] Add subtitles ()
Authored by: kaz-us
u-spec-png b2f25dc242
[Olympics] Fix extractor ()
Authored by: u-spec-png
Ashish Gupta 2f9e021299
[PlanetMarathi] Add extractor ()
Authored by: Ashish0804
u-spec-png 8dcf65c92e
[Instagram] Add login to playlist ()
Authored by: u-spec-png
Marcel 92592bd305
[ceskatelevize] Fix extractor ()
Authored by: flashdagger
pukkandan 404f611f1c
[youtube] Fix throttling by decrypting n-sig ()
u-spec-png cd9ea4104b
[instagram] Add more formats when logged in ()
Authored by: u-spec-png
Ashish Gupta 652fb0d446
[VLive] Add upload_date and thumbnail ()
Closes 
Authored by: Ashish0804
Sipherdrakon 6b301aaa34
[mtv] Fix some videos ()
Partial fix for 
Authored by: Sipherdrakon
pukkandan fa0b816e37
[generic] Detect more json_ld
Closes 
pukkandan 5e7bbac305
[generic] parse jwplayer with only the json URL
Closes 
pukkandan 10beccc980
[FormatSort] Fix some fields' defaults
Closes 
nixxo e6ff66efc0
[mediaset] Add playlist support ()
Closes 
Authored by: nixxo
Luc Ritchie aeaf3b2b92
[Coub] Fix media format identification ()
Authored by: wlritchi
Ashish Gupta 7b5f3f7c3d
[MLSScoccer] Add extractor ()
Authored by: Ashish0804
Closes 
ajj8 3783b5f1d1
[itv] Add support for ITV News ()
Authored by: ajj8
pukkandan ab630a57b9
[viewlift] Fix typo in 5be76d1ab7
pukkandan 16b0d7e621
[utils] Add `jwt_decode_hs256`
Code from 
Authored by: Ashish0804
pukkandan 5be76d1ab7
[viewlift] Add cookie-based login and series support
Closes , 
Authored by: Ashish0804, pukkandan
ajj8 b7b186e7de
[sky] Add `SkyNewsStoryIE` ()
Authored by: ajj8
nyuszika7h bd1c792327
[wakanim] Detect geo-restriction ()
Authored by: nyuszika7h
nyuszika7h dc88e9be03
[wakanim] Add support for MPD manifests ()
Closes 
Authored by: nyuszika7h
pukkandan 673944b001
[compat] Don't create console in `windows_enable_vt_mode`
Closes 
Ashish Gupta 0c873df3a8
[3speak] Add extractors ()
Closes 
Authored by: Ashish0804
pukkandan c35ada3360
[twitter] Do not sort by codec
Closes 
pukkandan 0db3bae879
[extractor] Fix some errors being converted to `ExtractorError`
pukkandan 48f796874d
[utils] Create `DownloadCancelled` exception
as super-class of ExistingVideoReached, RejectedVideoReached, MaxDownloadsReached

Third parties can also sub-class this to cancel the download queue from a hook
pukkandan abad800058
[downloader/ffmpeg] Fix vtt download with ffmpeg
pukkandan 08438d2ca5
[outtmpl] Add type `link` for internet shortcut files
and refactor related code
Closes 
pukkandan 7de837a5e3
[utils] Sanitize URL when determining protocol
Closes 
pukkandan 7e59ca440a
[DiscoveryPlus] Allow language codes in URL
Closes 
u-spec-png 8e7ab2cf08
[Bilibili:comments] Fix infinite loop ()
Closes 
Authored by: u-spec-png
u-spec-png ad64a2323f
[instagram] Fix bug in ab2ffab22d ()
Authored by: u-spec-png
pukkandan f2fe69c7b0
Approximate filesize from bitrate
Closes 
pukkandan fccf502118
[youtube] Populate `thumbnail` with the best "known" thumbnail
Closes , Related: https://github.com/yt-dlp/yt-dlp/issues/340#issuecomment-950290624
pukkandan 9f1a1c36e6
Separate `--check-all-formats` from `--check-formats`
Previously, `--check-formats` tested only the selected video formats, but ALL thumbnails
pukkandan 96565c7e55
[cleanup] Add keyword automatically to SearchIE descriptions
and some minor cleanup of docs
pukkandan ec11a9f4a2
[minicurses] Add more colors
Alf Marius 93c7f3398d
[Nrk] See desc ()
* Endpoint has changed. Currently the old one redirects to the new one, but this may change
* Descriptions use \r instead of \n. So translate it

Authored by: fractalf
pukkandan 1117579b94 [version] update
:ci skip all
pukkandan 49a57e70a9
[cleanup] misc
pukkandan 457f6d6866
[vlive:channel] Fix extraction
Based on https://github.com/ytdl-org/youtube-dl/pull/29866
Closes , , https://github.com/ytdl-org/youtube-dl/issues/29837
Authored by kikuyan, pukkandan
pukkandan ad0090d0d2
[cookies] Local State should be opened as utf-8
Closes 
makeworld d183af3cc1
[CBC] Support CBC Gem member content ()
Authored by: makeworld-the-better-one
makeworld 3c239332b0
[CBC] Fix Gem livestream ()
Authored by: makeworld-the-better-one
u-spec-png ab2ffab22d
[Instagram] Add login ()
Authored by: u-spec-png
zenerdi0de f656a23cb1
[patreon] Fix vimeo player regex ()
Closes 
Authored by: zenerdi0de
pukkandan 58ab5cbc58
[vimeo] Fix embedded `player.vimeo` URL
Closes , partially fixes 
Cherry-picked from upstream commit 3ae9c0f410b1d4f63e8bada67dd62a8d2852be32
Damiano Amatruda 17ec8bcfa9
[microsoftstream] Add extractor ()
Based on: https://github.com/ytdl-org/youtube-dl/pull/24649
Fixes: https://github.com/ytdl-org/youtube-dl/issues/24440
Authored by: damianoamatruda, nixklai
u-spec-png 0f6e60bb57
[tagesschau] Fix extractor ()
Closes 
Authored by: u-spec-png
pukkandan ef58c47637
[SponsorBlock] Obey `extractor-retries` and `sleep-requests`
pukkandan 19b824f693
Re-implement deprecated option `--id`
Despite `--title`, `--literal` etc being deprecated,
`--id` is still documented in youtube-dl and so should be kept
jfogelman f0ded3dad3
[AdobePass] Fix RCN MSO ()
Authored by: jfogelman
pukkandan 733d8e8f99
[build] Refactor `pyinst.py` and misc cleanup
Closes 
pukkandan 386cdfdb5b
[build] Release windows exe built with py2exe
Closes: 
Related: , , , , 
pukkandan 6e21fdd279
[build] Enable lazy-extractors in releases
Set the environment variable `YTDLP_NO_LAZY_EXTRACTORS`
to forcefully disable lazy extractor loading
Ricardo 0e5927eebf
[build] Build standalone MacOS packages ()
Closes  
Authored by: smplayer-dev
pukkandan d3c93ec2b7
Don't create console for subprocesses on Windows ()
Closes 
pukkandan b4b855ebc7
[fragment] Print error message when skipping fragment
pukkandan 2cda6b401d
Revert "[fragments] Pad fragments before decrypting ()"
This reverts commit 373475f035.
pukkandan aa7785f860
[utils] Standardize timestamp formatting code
Closes 
pukkandan 9fab498fbf
[http] Retry on socket timeout
Closes 
Nil Admirari e619d8a752
[ModifyChapters] Do not mutate original chapters ()
Closes  
Authored by: nihil-admirari
Zirro 1e520b5535
Add option `--no-batch-file` ()
Authored by: Zirro
pukkandan 176f1866cb
Add HDR information to formats
pukkandan 17bddf3e95
Reduce default `--socket-timeout`
pukkandan 2d9ec70423
[ModifyChapters] Allow removing sections by timestamp
Eg: --remove-chapters "*10:15-15:00".
The `*` prefix is used so as to avoid any conflicts with other valid regex
pukkandan e820fbaa6f
Do not verify thumbnail URLs by default
Partially reverts cca80fe611 and 0ba692acc8

Unless `--check-formats` is specified, this causes yt-dlp to return incorrect thumbnail urls.
See https://github.com/yt-dlp/yt-dlp/issues/340#issuecomment-877909966, 

But the overhead in general use is not worth it

Closes , 
pukkandan b11d210156
[EmbedMetadata] Allow overwriting all default metadata
with `meta_default` key
pukkandan 24b0a72b30
[cleanup] Remove broken youtube login code
coletdjnz aae16f6ed9
[youtube:comments] Fix comment section not being extracted in new layouts ()
Co-authored-by: coletdjnz, pukkandan
shirt 373475f035
[fragments] Pad fragments before decrypting ()
Closes , , 
Authored by: shirt-dev
Ashish Gupta 920134b2e5
[Gronkh] Add extractor ()
Closes 
Authored by: Ashish0804
Ashish Gupta 72ab768719
[SkyNewsAU] Add extractor ()
Closes 
Authored by: Ashish0804
LE 01b052b2b1
[tbs] Add tbs live streams ()
Authored by: llacb47
Ákos Sülyi 019a94f7d6
[utils] Use `importlib` to load plugins ()
Authored by: sulyi
nyuszika7h e69585f8c6
[7plus] Add cookie based authentication ()
Closes 
Authored by: nyuszika7h
Damiano Amatruda 693ec74401
[on24] Add extractor ()
Authored by: damianoamatruda
pukkandan 239df02103
Make `duration_string` and `resolution` available in --match-filter
Related: 
pukkandan 18f96d129b
[utils] Allow duration strings in filter
Closes 
pukkandan ec3f6640c1
[crunchyroll] Add season to flat-playlist
Closes 
pukkandan dd078970ba
[crunchyroll] Add support for `beta.crunchyroll` URLs
and fix series URLs with language code
pukkandan 71ce444a3f
Fix --restrict-filename when used with default template
pukkandan 580d3274e5 [youtube] Expose different formats with same itag
pukkandan 03b4de722a
[downloader] Fix slow progress hooks
Closes 
pukkandan 48ee10ee8a
Fix conflict b/w id and ext in format selection
Closes 
Ashish Gupta 6ff34542d2
[Hotstar] Raise appropriate error for DRM
gustaf e3950399e4
[Viafree] add support for Finland ()
Authored by: 18928172992817182 (gustaf)
Ashish Gupta 974208e151
[trovo] Support channel clips and VODs ()
Closes 
Authored by: Ashish0804
pukkandan 883d4b1eec
[YoutubeDL] Write verbose header to logger
pukkandan a0c716bb61
[instagram] Show appropriate error when login is needed
Closes 
pukkandan d5a39f0bad
[http] Show the last encountered error
Closes 
Ashish Gupta a64907d0ac
[Hotstar] Mention Dynamic Range in format id ()
Authored by: Ashish0804
pukkandan 6993f78d1b
[extractor,utils] Detect more codecs/mimetypes
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29943
pukkandan 993191c0d5
Fix bug in c111cefa5d
pukkandan fc5c8b6492
[eria2c] Fix --skip-unavailable fragment
pukkandan b836dc94f2
[outtmpl] Fix bug in expanding environment variables
pukkandan c111cefa5d
[downloader/ffmpeg] Improve simultaneous download and merge
pukkandan 975a0d0df9
Calculate more fields for merged formats
Closes 
pukkandan ecdc9049c0
[YouTube] Add auto-translated subtitles
Closes 
pukkandan 7b38649845
Fix verbose head not showing custom configs
pukkandan e88d44c6ee
[cleanup] Cleanup bilibili code
Closes 
Authored by pukkandan, u-spec-png
pukkandan a2160aa45f
[extractor] Generalize `getcomments` implementation
pukkandan cc16383ff3
[extractor] Simplify search extractors
pukkandan a903d8285c
Fix bug in storyboards
Caused by 9359f3d4f0
pukkandan 9dda99f2fc [Merger] Do not add `aac_adtstoasc` to non-hls audio
pukkandan ba10757412 [extractor] Detect `EXT-X-KEY` Apple FairPlay
pukkandan e6faf2be36
[update] Clean up error reporting
Closes 
pukkandan ed39cac53d Load archive only after printing verbose head
If there is some issue in loading archive, the verbose head should be visible in the logs
pukkandan a169858f24 Fix `check_formats` output being written to stdout when `-qv`
Closes 
pukkandan 0481e266f5
[tiktok] Fix typo in 943d5ab133
and update tests
Closes 
Ashish Gupta 2c4bba96ac
[EUScreen] Add Extractor ()
Closes 
Authored by: Ashish0804
pukkandan e8f726a57f
[hidive] Fix typo in b5ae35ee6d
pukkandan 8063de5109 [version] update
:ci skip all
pukkandan dec0d56fa9
Release 2021.10.10
pukkandan 21186af70a
[downloader] Fix throttledratelimit
The timer should not reset at start of each block
pukkandan d1d5c08f29
[minicurses] Fix when printing to file
Closes 
Bojidar Qnkov 2e01ba6218
[NovaPlay] Add extractor ()
Authored by: Bojidarist
pukkandan 91b6c884c9
Revert "[ffmpeg] Set max probesize to workaround AAC HLS stream issues ()"
This reverts commit 250a938de8.

This is no longer necessary since 7687c8ac6e
Felix S 28fe35b4e3
[francetv] Update extractor ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29996
Closes: https://github.com/yt-dlp/yt-dlp/issues/970, https://github.com/ytdl-org/youtube-dl/issues/29956, https://github.com/ytdl-org/youtube-dl/issues/29957, https://github.com/ytdl-org/youtube-dl/issues/29969, https://github.com/ytdl-org/youtube-dl/issues/29990, https://github.com/ytdl-org/youtube-dl/issues/30010

Authored by: fstirlitz, sarnoud
pukkandan aa9a92fdbb
[downloader/ffmpeg] Fix bug in initializing `FFmpegPostProcessor`
When `FFmpegFD` initializes the PP, it passes `self` as the `downloader`
But it does not have a `_postprocessor_hooks` attribute

Closes 
pukkandan a170527e1f [version] update
:ci skip all
Ashish Gupta 81bcd43a03
[HotStarSeries] Fix cookies ()
Authored by: Ashish0804
pukkandan b5ae35ee6d
[cleanup] Misc cleanup
pukkandan 4e3b637d5b
Merge webm formats into mkv if thumbnails are to be embedded
This was originally implemented in 4d971a16b8 () by @damianoamatruda
but was reverted in 3b297919e0
since it was unintentionally being triggered for `write_thumbnail` (See )
Jules-A 8cd69fc407
[Funimation] Fix for /v/ urls ()
Closes  
Authored by: pukkandan, Jules-A
pukkandan 2614f64600
[utils] Let traverse_obj accept functions as keys
pukkandan b922db9fe5
[http] Respect user-provided chunk size over extractor's
pukkandan f2cad2e496
[Hidive] Fix subtitles broken by 705e7c2005
u-spec-png d6124e191e
[bilibili] Fix bug in efc947fb3e
Authored by: u-spec-png
coletdjnz ac56cf38a4
[youtube:tab] Fallback to API when webpage fails to download ()
and add some extractor_args to force this mode
Authored by: coletdjnz
Damiano Amatruda c08b8873ea
[ciscowebex] Add extractor ()
Authored by: damianoamatruda
pukkandan 819e05319b
Improved progress reporting (See desc) ()
* Separate `--console-title` and `--no-progress`
* Add option `--progress` to show progress-bar even in quiet mode
* Fix and refactor `minicurses`
* Use `minicurses` for all progress reporting
* Standardize use of terminal sequences and enable color support for windows 10
* Add option `--progress-template` to customize progress-bar and console-title
* Add postprocessor hooks and progress reporting

Closes: , , , 
u-spec-png fee3f44f5f
[Streamable] Add codecs ()
Authored by: u-spec-png
pukkandan 705e7c2005
[Hidive] Fix duplicate and incorrect formats
pukkandan 49e7e9c3ce
[docs,build] Change all pycryptodome references to pycryptodomex
pukkandan 8472674399
[FixupM3u8] Do not run if merge is needed
We pass the relevant arguments to the merger, so separate fixup in redundant
pukkandan 1276a43a77
[youtube] Fix non-fatal errors in fetching player
pukkandan 519804a92f
bugfix for 80c03fa98f
pukkandan 1b6bb4a85a
[reddit] bugfix for 8e3fd7e034
pukkandan 644149afec
[soundcloud:playlist] Detect last page correctly
Closes 
pukkandan 4e3d1898a8
Workaround ssl errors in mingw python
Closes 
coletdjnz 762e509d91
[Mediaite] Relax valid url ()
Closes 
Authored by: coletdjnz
i6t d92125aeba
[GoPro] Add extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30044
Authored by: i6t
makeworld 0f0ac87be3
[CBC] Cleanup tests ()
Related:  
Authored by: makeworld-the-better-one
u-spec-png 755203fc3f
[parliamentlive.tv] Fix extractor ()
Closes  
Authored by: u-spec-png
MinePlayersPE 943d5ab133
[Douyin] Rewrite extractor ()
Closes 
Authored by: MinePlayersPE
u-spec-png 3001a84dca
[Newgrounds] Add age_limit and fix duration ()
Authored by: u-spec-png
u-spec-png ebf2fb4d61
[Vupload] Add extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29877
Authored by: u-spec-png
u-spec-png efc947fb3e
[Bilibili] Add subtitle converter ()
Closes 
Based on https://github.com/y2361547758/bcc2ass
Authored by: u-spec-png
pukkandan b11c04a8ae
Fix `-f mp4` behaving differently from youtube-dl
pukkandan 5d535b4a55
[build] Allow building with py2exe (and misc fixes)
py2exe config is copied from youtube-dl
Closes 
pukkandan a1c3967307
[EmbedSubtitle, SubtitlesConvertor] Fix error when subtitle file is missing
Closes , 
Bug from 8e25d624df
pukkandan e919569e67
[funimation] Sort formats according to the relevant extractor-args
Ákos Sülyi ff1dec819a
[aes] Improve performance slightly ()
Authored by: sulyi
Felix S 9359f3d4f0
[extractor] Extract storyboards from SMIL manifests ()
Authored by: fstirlitz
Aleri Kaisattera 0eaec13ba6
[Theta] Add video extractor ()
Authored by: alerikaisattera
jfogelman ad095c4283
[adobepass] Add RCN as MSO ()
Authored by: jfogelman
pukkandan e6f21b3d92
[docs,cleanup] Some minor refactoring and improve docs
pukkandan 3ae5e79774
[postprocessor] Add plugin support
Adds option `--use-postprocessor` to enable them
pukkandan 8e3fd7e034
[reddit] Fix 429 by generating a random `reddit_session`
Related: a76e2e0f88, , https://github.com/ytdl-org/youtube-dl/issues/29986
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30017
Authored by: AjaxGb
pukkandan 80c03fa98f
Allow empty output template to skip a type of file
Closes , 
pukkandan 1f2a268bd3
[embedsubtitle] Fix error when duration is unknown
i6t 851876095b
[Gettr] Add extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29589
Authored by: i6t
ajj8 2d997542ca
[bbc] Extract better quality videos ()
mobile-tablet-main only provides 540p25, so it shouldn't be used for the first attempt. Instead pc provides up to 720p50

Authored by: ajj8
pukkandan 7756277882
Workaround for bug in `ssl.SSLContext.load_default_certs` ()
* Remove old compat code
* Load certificates only when not using nocheckcertificate
* Load each certificate individually

Closes 
Related bugs.python.org/issue35665, bugs.python.org/issue4531
shirt 7687c8ac6e
[HLS] Fix decryption issues ()
* Unpad HLS fragments with PKCS#7 according to datatracker.ietf.org/doc/html/rfc8216
* media_sequence should only be incremented in for media fragments
* The native decryption should only be used if ffmpeg is unavailable since it is significantly slower. Closes 

Authored by: shirt-dev, pukkandan
Ashish Gupta 80c360d7aa
[LinkedInLearning] Fix newline bug in subtitles ()
Authored by: Ashish0804
shirt 250a938de8
[ffmpeg] Set max probesize to workaround AAC HLS stream issues ()
Fixes: , , 

Authored by: shirt-dev
Ashish Gupta f1d42a83ab
[Rumble] Add RumbleChannelIE ()
Authored by: Ashish0804
ChillingPepper 3cf4b91dc5
[SovietsCloset] Add duration from m3u8 ()
Authored by: ChillingPepper
u-spec-png fecb20a503
[N1] Add extractor ()
Authored by: u-spec-png
pukkandan 360167b9fc Fix `--flat-playlist` when neither IE nor id is known
pukkandan 28234287f1 [update] Check for new version even if not updateable
pukkandan 91dd88b90f
[outtmpl] Alternate form of format type `l` for `\n` delimited list
Aleri Kaisattera d31dab7084
[vidme] Remove extractor ()
Authored by: alerikaisattera
u-spec-png c470901ccf
[reddit] Add embedded url ()
Authored by: u-spec-png
i6t 2333ea1029
[Veo] Add extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29445
Authored by: i6t
u-spec-png 9a13345439
[PolskieRadio] Fix extractors ()
Closes 
Authored by: jakubadamw, u-spec-png
pukkandan 524e2e4fda
[outtmpl] Format type `U` for unicode normalization
Matt Broadway f440b14f87
[cookies] Fix keyring fallback ()
The password returned by `security find-generic-password` has a newline at the end

Closes 
Authored by: mbway
Ashish Gupta 8dc831f715
[LinkedInLearning] Add subtitles ()
Authored by: Ashish0804
Closes 
u-spec-png e99b2d2771
[Newgrounds] Fix view count on songs ()
Authored by: u-spec-png
pukkandan 1fed277349 [version] update
:ci skip all
pukkandan ff1c7fc9d3
Allow `0` in `--playlist-items`
pukkandan 600e900300
[zdf] Improve format sorting
Closes 
f4pp3rk1ng 20b91b9b63
[SpankBang] Fix uploader ()
Closes  
Authored by: f4pp3rk1ng, coletdjnz
pukkandan 4c88ff87fc
[build] Improve release process ()
* Automate more of the release process by animelover1984, pukkandan - closes 
* Fix sha256 by nihil-admirari - closes 
* Bring back brew taps by nao20010128nao 
* Provide `--onedir` zip for windows by pukkandan - Closes , ,  and 

Authored by: pukkandan, animelover1984, nihil-admirari, nao20010128nao
renalid e27cc5d864
[Arte] Improve description extraction ()
Authored by: renalid
Aleri Kaisattera eb6d4ad1ca
[Theta] Add extractor ()
Authored by: alerikaisattera
coletdjnz 99e9e001de
[youtube] Cleanup authentication code ()
Authored by: coletdjnz
pukkandan 51ff9ca0b0
[xattr] bugfix for b19404591a
pukkandan b19404591a
Separate the options `--ignore-errors` and `--no-abort-on-error`
In youtube-dl, `-i` ignores both download and post-processing error, and
treats the download as successful even if the post-processor fails.

yt-dlp used to skip the entire video on either error and there was no
option to ignore the post-processing errors like youtube-dl does.

By splitting the option into two, now either just the download errors
(--no-abort-on-error, default on CLI) or all errors (--ignore-errors)
can be ignored as per the users' needs

Closes 
pukkandan 1f8471e22c
Ignore empty entries in `_list_from_options_callback`
pukkandan 77c4a9ef68
Download subtitles in order of `--sub-langs`
Closes 
pukkandan 8f70b0b82f
[cbs] Report appropriate error for DRM
Closes 
pukkandan be867b03f5
bugfix for bd50a52b0d
pukkandan 1813a6ccd4
[youtube] Fix `--mark-watched` with `--cookies-from-browser`
Closes 
pukkandan 8100c77223
[lbry] Show error message from API response
Ashish Gupta 9ada988bfc
[Koo] Add extractor ()
Authored by: Ashish0804
Ashish Gupta d1a7768432
[Chingari] Add extractors ()
Authored by: Ashish0804
NeroBurner 49fa4d9af7
[atv.at] Use jwt for API ()
The jwt token is implemented according to RFC7519

Closes 
Authored by: NeroBurner
The Hatsune Daishi ee2b3563f3
[downloader/niconico] Pass custom headers ()
Closes 
Authored by: nao20010128nao
Glenn Slayden bdc196a444
[cleanup] Fix line endings for `nebula.py` ()
:ci skip
Authored by: glenn-slayden
Ashish Gupta 388bc4a640
[Hotstar] Add referer for subs ()
Authored by: Ashish0804
pukkandan 50eff38c1c
bugfix for a21e0ab1a1
Closes 
nixxo 4be9dbdc24
[comedycentral] Support `collection-playlist` ()
Authored by: nixxo
pukkandan a21e0ab1a1
[ffmpeg] Add `aac_adtstoasc` when merging if needed
Related: 
pukkandan a76e2e0f88
[reddit] Workaround for 429 by redirecting to old.reddit.com
Closes 
The Hatsune Daishi bd50a52b0d
Basic framework for simultaneous download of multiple formats ()
Authored by: nao20010128nao
Sipherdrakon c12977bdc4
[AnimalPlanet] Fix extractor ()
Authored by: Sipherdrakon
ChillingPepper f6d8776d34
[SovietsCloset] Fix playlists for games with only named categories
Authored by: ConquerorDopy
pukkandan d806c9fd97
[docs,cleanup] Add deprecation warning in docs
for some counter intuitive behaviour that may be removed in future.

and fix linter
pukkandan 5e3f2f8fc4
[youtube] Return full URL instead of just ID
pukkandan 1009f67c2a
[fragment,aria2c] Generalize and refactor some code
pukkandan bd6f722de8
dump files should obey `--trim-filename` ()
Authored by: sulyi
pukkandan d9d8b85747
[fragment] Fix range header when using `-N` and media sequence ()
Authored by: shirt
pukkandan daf7ac2b92
[fragment] Avoid repeated request for AES key
pukkandan 96933fc1b6
[aria2c] Fix IV for some AES-128 streams
Authored by: shirt
makeworld 0d32e124c6
[CBC] Fix CBC Gem extractors ()
Closes 
Authored by: makeworld-the-better-one
u-spec-png cb2ec90e91
[Peertube] Add channel extractor ()
Authored by: u-spec-png
pukkandan 3cd786dbd7
[youtube] Warn when trying to download clips
u-spec-png 8f8e8eba24
[Nuvid] Fix extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29886
Authored by: u-spec-png
Ákos Sülyi 09906f554d
[aes] Add `aes_gcm_decrypt_and_verify` ()
Authored by: sulyi, pukkandan
Yuan Chao a63d9bd0b0
[CGTN] Add extractor ()
Authored by: chao813
pukkandan f137e4c27c
[utils] Improve `extract_timezone`
Code taken from: https://github.com/ytdl-org/youtube-dl/pull/29845
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29948
Authored by: dirkf
nyuszika7h 4762621925
[videa] Fix some extraction errors ()
Authored by: nyuszika7h
pukkandan 57aa7b8511
[hls] Byterange + AES128 is supported by native downloader
pukkandan 9c1c3ec016
[Oreilly] Bugfix for 7738bd3272
DigitalDJ f9cc0161e6
[extractor] Fix root-relative URLs in MPD ()
Authored by: DigitalDJ
Nil Admirari c6af2dd8e5
[SponsorBlock] Improve merge algorithm ()
Authored by: nihil-admirari
Mohammad Khaled AbouElSherbini 7738bd3272
[Oreilly] Handle new web url ()
The change in URL is most likely a server side issue. But we can work around it by a simple substitution

Authored by: MKSherbini
pukkandan 7c37ff97d3
Allow alternate fields in outtmpl
Closes , 
The Hatsune Daishi d47f46e17e
[damtomo] Add extractor ()
Authored by: nao20010128nao
coletdjnz 298bf1d275
[itv] Prefer last matching featureset ()
Bug fix for 
Authored by: coletdjnz
Aleri Kaisattera d1b39ad844
[CAM4] Add extractor ()
Authored by: alerikaisattera
pukkandan edf65256aa
[hls,aes] Fallback to native implementation for AES-CBC
and detect `Cryptodome` in addition to `Crypto`

Closes 
Related: 
pukkandan 7303f84abe
[options] Fix `--no-config` and refactor reading of config files
Closes , 
pukkandan f5aa5cfbff
Add format type `B` for outtmpl to treat the value as bytes
This is useful to limit the filename to a certain number of bytes rather than characters
Closes 
Aleri Kaisattera f1f6ca78b4
[Streamanity] Add Extractor ()
Authored by: alerikaisattera
Ashish Gupta 2fac2e9136
[Mediaite] Add Extractor ()
Closes  
Authored by: Ashish0804
Ashish Gupta 23dd2d9a32
[NDR] Rewrite NDRIE ()
Closes  
Authored by: Ashish0804
Ashish Gupta b89378a69a
[globo] Fix GloboIE ()
Closes  
Authored by: Ashish0804
pukkandan 0001fcb586
Add option `--netrc-location`
Closes , 
pukkandan c589c1d395
[compat] Don't ignore `HOME` (if set) on windows
Related: 
pukkandan f7590d4764
[vrv] Don't raise error when thumbnails are missing
Closes 
pukkandan dbf7eca917
[soundcloud] Update `_CLIENT_ID`
Related: 
pukkandan d21bba7853
[options] Strip spaces in list-like switches
Ashish Gupta a8cb7eca61
[HiDive] Fix extractor ()
Closes , 
Authored by: Ashish0804
nyuszika7h 92790da2bb
[radlive] Add new extractor ()
Closes 
Authored by: nyuszika7h
Sipherdrakon b5a39ed43b
[DIYNetwork] Support new format ()
Authored by: Sipherdrakon
LE cc33cc4395
[VrtNU] Handle login errors ()
Authored by: llacb47
Ashish Gupta 1722099ded
[Mxplayer] Use mobile API ()
Authored by: Ashish0804
u-spec-png e9a30b181e
[Peertube] Add playlist extractor ()
Authored by: u-spec-png
zenerdi0de 9c95ac677e
[Fancode] Fix live streams ()
Authored by: zenerdi0de
coletdjnz ea706726d6
[ITV] Fix extractor, add subtitles and thumbnails ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/28955 (see also https://github.com/ytdl-org/youtube-dl/issues/28906#issuecomment-831008270)

Closes , https://github.com/ytdl-org/youtube-dl/issues/28906, https://github.com/ytdl-org/youtube-dl/issues/29337, https://github.com/ytdl-org/youtube-dl/issues/29190, https://github.com/ytdl-org/youtube-dl/issues/28939, https://github.com/ytdl-org/youtube-dl/issues/29620

Authored-by: coletdjnz, sleaux-meaux, Vangelis66
pukkandan f60990ddfc
[peertube] Update instances ()
Authored by: u-spec-png
pukkandan ad226b1dc9
[funimation] Fix for locations outside US
Closes 
Authored by: Jules-A, pukkandan
pukkandan ca46b94134
[cookies] Make browser names case insensitive
pukkandan 67ad7759af
[brightcove] Extract subtitles from manifests
pukkandan d5fe04f5c7
Fix `--compat-option no-direct-merge`
dalan 03c862794f
[9Now] handle episodes of series ()
Authored by: dalanmiller
MinePlayersPE 0fd6661edb
[TikTokUser] Fix extractor using mobile API ()
and misc cleanup

Closes 
Authored by: MinePlayersPE, llacb47
u-spec-png 02c7ae8104
[Newgrounds] Add `NewgroundsUserIE` and improve extractor ()
Authored by: u-spec-png
Ashish Gupta 16f7e6be3a
[bilibili]Add BiliIntlIE and BiliIntlSeriesIE ()
Closes  
Authored by: Ashish0804
Ashish Gupta ffecd3034b
[MuseScore] Add Extractor ()
Closes  
Authored by: Ashish0804
Felix S 1c5ce74c04
[zype] Extract subtitles from the m3u8 manifest ()
Closes 
Authored by: fstirlitz
pukkandan 81a136b80f
[WebVTT] Adjust parser to accommodate PBS subtitles ()
Closes 
coletdjnz eab3f867e2
[nzherald] Add NZHeraldIE ()
Authored-by: coletdjnz

Related: https://github.com/ytdl-org/youtube-dl/issues/28267
coletdjnz a7e999beec
[pbs] Fix subtitle extraction ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/24430, https://github.com/ytdl-org/youtube-dl/pull/17434
Closes: , https://github.com/ytdl-org/youtube-dl/issues/18796, https://github.com/ytdl-org/youtube-dl/issues/17273
Authored-by: coletdjnz, gesa, raphaeldore
Ashish 71407b3eca
[Olympics] Add replay extractor ()
Closes  
Authored by: Ashish0804
Ashish dc9de9cbd2
[Yandex] Add ZenYandexIE and ZenYandexChannelIE ()
Authored by: Ashish0804
Poschi 92ddaa415e
[gotostage] Add extractor ()
Authored by: poschi3
coletdjnz b6de707d13
[youtube] Improvements to JS player extraction (See desc) ()
* fallback player url extraction when it fails to be extracted from the webpage
* don't download js player unnecessarily for clients that don't require it
* try to extract js player url from any additional client configs
* ability to skip the js player usage/download using `player_skip=js`
* ability to skip the initial webpage download using `player_skip=webpage`

known issue:
* authentication for multi-channel accounts and multi-account cookies may not work correctly if the webpage or client configs are skipped
*  formats from the web client requiring signature decryption will be skipped if player js extraction is skipped

Authored by: coletdjnz
coletdjnz bccdbd22d5
[Mediaklikk] Add Extractor ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/17453, https://github.com/ytdl-org/youtube-dl/pull/25098
Fixes: https://github.com/ytdl-org/youtube-dl/issues/21431
Authored-by: tmarki, mrx23dot, coletdjnz
MinePlayersPE bd9ff55bcd [tiktok] Use API to fetch higher quality video ()
Authored by: MinePlayersPE, llacb47
pukkandan 526d74ec5a
[cleanup] Misc
pukkandan e04a1ff92e
[soundcloud] Retry playlist pages on `502` error
Closes 
pukkandan aa6c25309a [soundcloud] Make playlist extraction lazy
pukkandan d98b006b85 [dw] Fix extractor
Closes 
pukkandan 265a7a8ee5
[redtube] Fix exts
Closes 
pukkandan 826446bd82
[plutotv] Fix extractor for URLs with `/en`
Closes 
The Hatsune Daishi bc79491368
[17live] Add 17.live extractor ()
Authored by: nao20010128nao
ChillingPepper 421ddcb8b4
[SovietsCloset] Add extractor ()
Authored by: ChillingPepper
coletdjnz c0ac49bcca
[youtube] Retry on 'Unknown Error' ()
and do not repeat unimportant alerts

Closes 
Authored by: coletdjnz
coletdjnz 02def2714c
[southpark] Fix SouthParkDE ()
This was broken by ee1e05581e
Authored by: coletdjnz
pukkandan f9be9cb9fd
[cookies] Print warning for cookie decoding error only once
Closes 
pukkandan 4614bc22c1 Allow `--force-write-archive` to work with `--flat-playlist`
Related: 
pukkandan 8e5fecc88c
Handle more playlist errors with `-i`
pukkandan 165efb823b
[ModifyChapters] fixes (See desc)
* [docs] Fix typo
* Do not enable `sponskrub` by default
* Fix `--force-keyframes-at-cuts`
* Don't embed subtitles if the video has been cut. Previously, running `--remove-chapters` with `--embed-subs` multiple times caused repeated cuts and out-of-sync subtitles
* Store `_real_duration` to prevent running ffprobe multiple times
pukkandan dd594deb2a
Fix `--no-get-comments`
Closes 
pukkandan 409e18286e
Fix `extra_info` being reused across runs
58adec4677 was supposed to solve this, but ended up being an incomplete fix
Closes 
pukkandan 8113999995
Fix `--compat-option playlist-index`
pukkandan 8026e50152
[version] update
:ci skip all
pukkandan 9ee4f0bb5b
Release 2021.09.02
pukkandan 347182a0cd
Show a more useful error in older python versions
pukkandan a7429aa9fa
[youtube] Fix subtitle names
Nil Admirari 7a340e0df3
Native SponsorBlock implementation and related improvements ()
SponsorBlock options:
* The fetched sponsor sections are written to infojson
* `--sponsorblock-remove` removes specified chapters from file
* `--sponsorblock-mark` marks the specified sponsor sections as chapters
* `--sponsorblock-chapter-title` to specify sponsor chapter template
* `--sponsorblock-api` to use a different API

Related improvements:
* Split `--embed-chapters` from `--embed-metadata`
* Add `--remove-chapters` to remove arbitrary chapters
* Add `--force-keyframes-at-cuts` for more accurate cuts when removing and splitting chapters

Deprecates all `--sponskrub` options

Authored by: nihil-admirari, pukkandan
ouwou f0e5366335
[reddit] Fix for quarantined subreddits ()
Authored by: ouwou
nyuszika7h 49ca8db06b
[mediaset] Fix extraction for more videos ()
Closes 
Authored by: nyuszika7h
nyuszika7h ee57a19d84
[mediaset] Fix extraction for some videos ()
This was broken by 
Closes  
Authored by: nyuszika7h
octotherp 908b56eaf7
[XHamster] Extract `uploader_id` ()
Authored by: octotherp
u-spec-png 1461d7bef2
[Tokentube] Add extractor ()
Closes  
Authored by: u-spec-png
pukkandan 8a2d992389
[facebook] Fix format sorting
Closes 
pukkandan 8e25d624df
[EmbedSubtitle] Continue even if some files are missing
coletdjnz e88dabb35e
[Viafree] Fix extractor and extract subtitles ()
Authored by: coletdjnz
Fixes 
BunnyHelp 8eb7ba82ca
[iwara.tv] Extract more metadata ()
Authored-by: BunnyHelp
Luc Ritchie b2eeee0ce0
[afreecatv] Tolerate failure to parse date string ()
Authored by: wlritchi
Luc Ritchie 875cfb8cbc
[afreecatv] Fix adult VODs ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/28405
Fixes https://github.com/ytdl-org/youtube-dl/issues/26622, https://github.com/ytdl-org/youtube-dl/issues/26926

Authored by: wlritchi
u-spec-png 05664a2f7b
[CDA] Add more formats ()
Fixes: , https://github.com/ytdl-org/youtube-dl/issues/29844
Authored by: u-spec-png
coletdjnz 62cdaaf0e2
[StarTV] Add extractor for startv.com.tr ()
Authored-by: mrfade, coletdjnz
Related: https://github.com/ytdl-org/youtube-dl/issues/22715
coletdjnz 419508eabb
[Motherless] Fix extractor ()
Authored-by: coletdjnz
Fixes , https://github.com/ytdl-org/youtube-dl/issues/29626
Sipherdrakon 54153fb71b
[VH1,TVLand] Fix extractors ()
Fixes  but not 
Authored by: Sipherdrakon
zenerdi0de 1dd6d9ca9d
[Patreon] Add PatreonUserIE ()
Authored by: zenerdi0de
IONECarter 356ac009d3
[peloton] Add extractor ()
Authored by: IONECarter, capntrips, pukkandan
coletdjnz 9a292a620c
[ATV.at] Fix extractor for ATV.at ()
Authored-by: NeroBurner, coletdjnz
Fixes https://github.com/ytdl-org/youtube-dl/issues/29079
coletdjnz 7e55872286
[camtube] remove extractor ()
Co-authored-by: alerikaisattera
std-move 2fc14b9925
[Nova] fix extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/27840
Authored by: std-move
Ashish 58f68fe703
[TV2Hu] Fix `TV2HuIE` and add `TV2HuSeriesIE` ()
Closes  
Authored by: Ashish0804
animelover1984 abafce59a1
[Niconico] Add Search extractors ()
Authored by: animelover1984, pukkandan
pukkandan 2e7781a93c
[docs] Fix some typos
Closes , 
Ashish bc36bc36a1
[ShemarooMe] Fix extractor ()
Closes  
Authored by: Ashish0804
Paul Wrubel d75201a873
Use `os.replace` where applicable ()
When using 
```py
os.remove(encodeFilename(filename))
os.rename(encodeFilename(temp_filename), encodeFilename(filename))
```
the `os.remove` need not be atomic and so can be executed arbitrarily compared to the immediately following rename call. It is better to use `os.replace` instead

Authored by: paulwrubel
pukkandan 691d5823d6
[aria2c] Obey `--rate-limit`
pukkandan c311988d19
[youtube] Improve 26e8e04454
The streams of the same itag may have slightly different size/bitrate
pukkandan 26e8e04454
[youtube] Prefer audio stream that YouTube considers default
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29864
Related: https://github.com/clsid2/mpc-hc/issues/1268
pukkandan 198e3a04c9
[FormatSort] Remove priority of `lang`
Robin 61bfacb233
[facebook] Update onion URL ()
Authored by: Derkades
Ashish 85a0021fb3
[ProjectVeritas] Add extractor ()
https://github.com/ytdl-org/youtube-dl/issues/26749
Authored by: Ashish0804
Ashish 7a45a1590b
[Epicon] Add extractors ()
Authored by: Ashish0804
CeruleanSky 1c36c1f320
Fix `--no-prefer-free-formats` ()
Authored by: CeruleanSky
pukkandan e0493e90fc
fix bug in 88acdbc269
The Hatsune Daishi 1931a55ee8
[radiko] Add extractors ()
https://github.com/ytdl-org/youtube-dl/issues/29840
Authored by: nao20010128nao
i6t 63b1ad0f05
[iwara] Add thumbnail ()
Authored by: i6t
coletdjnz 0bb1bc1b10
[youtube] Remove annotations and deprecate `--write-annotations` ()
Closes  
Authored by: coletdjnz
pukkandan 45842107b9
fix bug in 6251555f1c
:ci skip
pukkandan 6251555f1c
[downloader/ffmpeg] Support for DASH manifests (experimental)
Closes 
pukkandan 330690a214
[downloader/ffmpeg] Allow passing custom arguments before -i
Closes 
tandy1000 91d4b32bb6
[ManotoTV] Add new extractors ()
Authored by: tandy1000
pukkandan a181cd0c60
[facebook] Fix metadata extraction
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29796
Closes , https://github.com/ytdl-org/youtube-dl/issues/29421, https://github.com/ytdl-org/youtube-dl/issues/23627, https://github.com/ytdl-org/youtube-dl/issues/23180, https://github.com/ytdl-org/youtube-dl/issues/14156

Authored by: kikuyan
Ashish ea81966e64
[TV2] Fix extractor ()
Closes  
Authored by: Ashish0804
Ashish 2acf2ce5cb
[GabTV] Add extractor ()
Closes 
Authored by: Ashish0804
Ashish f7f18f905c
[tiktok] Add TikTokUserIE ()
Authored-by: Ashish0804, pukkandan
pukkandan 4f8b70b593
[TikTok] Fix metadata extraction
MinePlayersPE e43e9f3c2c
[aljazeera] Fix extractor ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/29517
Authored by: MinePlayersPE
pukkandan 71dd5d4a00
[peertube] handle new video URL format
Closes , https://github.com/ytdl-org/youtube-dl/issues/29782
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29475
Authored by: Chocobozzz
nyuszika7h 52a2f994c9
[adobepass] Fix Verizon SAML login ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/19136 from 64bddfe15c

Authored-by: nyuszika7h, ParadoxGBB <paradoxgbb@yahoo.com>
pukkandan 8b7491c8d1
Fix `add_info_extractor` when used via API
Bug from: 251ae04e6a
pukkandan 251ae04e6a
[lazy_extractor] Create instance only after pre-checking archive
pukkandan 1151c4079a
[extractor] Show video id in error messages if possible
pukkandan 88acdbc269
[extractor] Better error message for DRM ()
Closes 
Tom-Oliver Heidel 9b5fa9ee7c
[youtube] Add av01 itags to known formats list ()
Authored by: blackjack4494
mahanstreamer aca5774e68
[bitchute] Fix test ()
Authored by: mahanstreamer
pukkandan 3fb4e21b38
[lazy_extractors] Fix `suitable` and add flake8 test
pukkandan 4dfbf8696b
[utils] Add `parse_qs`
pukkandan 8fc54b1230
[youtube] Add `shorts` to `_VALID_URL`
Normally the generic extractor will redirect the URL,
but the cookies consent screen may sometimes appear instead

Closes 
pukkandan da33e35b05
Don't try to merge with final extension
The formats may not be directly mergable into the final extension
pukkandan 5ad28e7ffd
[extractor] Common function `_match_valid_url`
Jérôme Duval f79ec47d71
[tv5mondeplus] Fix extractor ()
Authored by: korli
Ashish 45b0596290
[HearThisAtIE] Fix extractor ()
Closes:  
Authored by: Ashish0804
Ashish 96c23f3be8
[Zee5] Fix extractor and add subtitles ()
Closes 
Authored by Ashish0804
CHJ85 6e7dfe4959
[BannedVideo] Add Extractor ()
Closes: 
Original PR: https://github.com/ytdl-org/youtube-dl/pull/24572
Authored by: smege1001, blackjack4494, pukkandan
animelover1984 c34f505b04
[bilibili] Add category extractor ()
Authored by: animelover1984
Ashish 14183d1f80
[Hungama] Fix `HungamaSongIE` and add `HungamaAlbumPlaylistIE` ()
Authored by: Ashish0804
pukkandan 58adec4677
Fix `extra_info` being reused across runs
Closes 
pukkandan 9e598870dd
Fix `playlist_index` not obeying `playlist_start`
and add tests
Closes 
pukkandan 8f18aca871
Let `--match-filter` reject entries early
Makes redundant: `--match-title`, `--reject-title`, `--min-views`, `--max-views`
pukkandan 3ad56b4236
Fix `-J` when there are failed videos
Glenn Slayden 5d62709bc7
[cleanup] Replace improper use of tab in trovo ()
:ci skip

Authored by: glenn-slayden
shirt 5fa206fb54
[ParamountPlus] Fix geo verification ()
Closes  
Authored by: shirt
mzbaulhaque df2a5633da
[pornhub] Separate and fix playlist extractor ()
Closes 
Authored by: mzbaulhaque
Felix S 7a6742b5f9
[webvtt] Fix timestamp overflow adjustment ()
In some streams, empty segments may appear with a bogus, non-monotone MPEG timestamp.
This should not be considered as an overflow

Authored by: fstirlitz
The Hatsune Daishi e040bb0a41
[voicy] Add extractor ()
Authored by: nao20010128nao
pukkandan f8fabc9930
[kakao] Fix extractor
Closes 
jhwgh1968 d967c68e4c
[eroprofile] Fix page skipping in albums ()
Bug from  
Authored by: jhwgh1968
SsSsS 3dd39c5f9a
[instagram] Add referrer to prevent throttling ()
Code from: https://github.com/ytdl-org/youtube-dl/pull/29751
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29736

Authored by: u-spec-png, kikuyan
mzbaulhaque be44eefd5e
[filmmodu] Add extractor ()
Closes 
Authored by: mzbaulhaque
pukkandan f775c83110
Fix `--force-overwrites` when using `-k`
For formats that need merge, the `.fxxx` files are not removed before
downloading the corresponding `.part` files. This causes the rename to fail
pukkandan b714b41f81
[soundcloud] Refetch `client_id` on 403
Closes 
pukkandan 31654882e9
[options] Add `_set_from_options_callback`
pukkandan 86c66b2d3e
Fix `-F` for extractors that directly return url
Related: 
pukkandan 37242e56f2
Fix bug during subtitle conversion
pukkandan 6c7274ecd2
Fix resuming of single formats when using --no-part
Closes 
coletdjnz 641ad5d813
[youtube] Extract error messages from HTTPError response ()
Authored by: coletdjnz
Felix S 0715f7e19b
Revert erroneous use of the `Content-Length` header ()
This reverts commit 6c907eb33f

The use of the Content-Length value here is erroneous and may lead
to truncated downloads if a compression scheme is specified in the
Content-Encoding header, as the Content-Length header refers to the
size of encoded data, not of the raw bytestream. This has been noticed
in the wild with WebVTT subtitle segments.

Authored by: fstirlitz
pukkandan a8731fcc1d minor bugfixes
bugs due to be2fc5b212, e9f4ccd19e
pukkandan ade6dc5e9e
[version] update
:ci skip all
jhwgh1968 c196640ff1
[eroprofile] Add album downloader ()
Authored by: jhwgh1968
SsSsS 60c8fc73c6
[instagram] Fix comments extraction ()
Authored-by: u-spec-png <miloradkalabasdt@gmail.com>
Ashish bc8745480e
[BandCamp] Add BandcampMusicIE ()
Authored by Ashish0804
The Hatsune Daishi ff5e16f2f6
[mirrativ] Add extractors ()
Authored by: nao20010128nao
pukkandan be2fc5b212
[extractor] Detect `sttp` as subtitles in MPD
Closes 
Solution by: fstirlitz
pukkandan 7be9ccff0b [utils] Fix `InAdvancePagedList.__getitem__`
Since it didn't have any cache, the page was re-fetched for each video.
* Also generalized the cache code