Commit Graph

1890 Commits (8246f8402b77dfb5c905e97b04b09f89632575d9)

Author SHA1 Message Date
pukkandan 334b1c4800
[rokfin] Add extractor ()
Authored by: P-reducible, pukkandan
coletdev 7c219ea601
[youtube:tab] Follow redirect to regional channel ()
Closes 
Authored by: coletdjnz
Lesmiscore (Naoya Ozaki) 93c8410d33
[downloader/fragment] Fix bugs around resuming with Range ()
Authored by: Lesmiscore
Lesmiscore 195c22840c
[downloader/fragment] Ignore `FileNotFoundError` when downloading livestreams
when `--live-from-start` is used for YouTube and the live ends, request for the last segment prematurely ends (or 404, 403).
this is causing lack of the file and `FileNotFoundError`
lacking segment doesn't have any data, so it's safe to ignore
Lesmiscore f0734e1190
[downloader/fragment] Fix problem where multiple threads can share one iterator
which causes "ValueError: generator already executing" error

Closes 
Lesmiscore (Naoya Ozaki) 15dfb3929c
[fc2:live] Add extractor ()
Authored by: Lesmiscore
Lesmiscore (Naoya Ozaki) 3e9b66d761
[AbemaTV] Add extractors ()
Authored by: Lesmiscore
Lesmiscore (Naoya Ozaki) a539f06570
[downloader/fragment] Improve `--live-from-start` for YouTube livestreams ()
Lesmiscore (Naoya Ozaki) 03f830040a
[YoutubeDL] Fill more fields for playlists ()
pukkandan 09b49e1f68
Add pre-processor stage `after_filter`
* Move `_match_entry` and `post_extract` to `process_video_result`. It is also left in `process_info` for API compat
* `--list-...` options and `--force-write-archive` now obey filtering options
* Move `SponsorBlockPP` to `after_filter`. Closes https://github.com/yt-dlp/yt-dlp/issues/2536
* Reverts 4ec82a72bb since this commit addresses the issue it was solving
pukkandan 1108613f02
[youtube:tab] Reject webpage data if redirected to home page
Closes 
pukkandan a30a6ed3e4
[youtube:tab] Add `approximate_date` extractor-arg
pukkandan 65d151d58f
[spiegel] Fix `_VALID_URL`
Closes 
pukkandan 72073451be
[ThumbnailsConvertor] Support `webp`
Closes 
Lesmiscore (Naoya Ozaki) 77cc7c6e60
[nhk] Add support for NHK for School ()
Authored by: Lesmiscore
i6t 971c4847d7
[Gettr] Fix formats order ()
Closes 

Authored by: i6t
Nil Admirari 7a34b5d628
[SponsorBlock] Fixes for highlight and "full video labels" ()
Authored by: nihil-admirari
Aniruddh Joshi 4d4f9a029f
[zee5] Support web-series ()
Authored by: Aniruddh-J
Lesmiscore (Naoya Ozaki) f099df1463
[TwitCasting] Check for password protection ()
Authored by: Lesmiscore
pukkandan 3f4faff748
[generic] Pass referer to extracted formats
Closes 
Daniel.Zeng be8d623455
[Bilibili] Pass referer for all formats ()
Authored by: blackgear
Lesmiscore a7d4acc018
[youtube] Escape possible `$` in `_extract_n_function_name` regex
Bepis febff4c119
[tubitv] Fix/improve TV series extraction ()
Authored by: bbepis
pukkandan ed66a17ef0
[FFmpegConcat] Abort on `--simulate`
Bricio 5625e6073f
[Biqle] Fix extractor ()
Closes 
Authored by: Bricio
pukkandan 0ad92dfb18
[youtube] De-prioritize potentially damaged formats
Closes 
pukkandan 60f3e99592
Tolerate failure to `--write-link` due to unknown URL
Closes 
pukkandan 8d93e69d67
Create necessary directories for `--print-to-file`
Closes 
pukkandan 3aa915400d
Fix `-all` for `--sub-langs`
Closes 
pukkandan dcd55f766d
[aria2c] Add `--http-accept-gzip=true`
Closes , 
pukkandan 2e4cacd038
[youtube] Fix intermittent failure of embed-based age-gate bypass
Ronnnny c15c316b21
[abc] Support 1080p ()
Authored by: Ronnnny
Bricio 549cb2a836
[rtvs] Fix extractor ()
Closes 

Authored by: Bricio
MinePlayersPE c571b3a6ab
[youtube] Fix n-sig extraction for phone player JS ()
Authored by: MinePlayersPE
Bricio 5b804e3906
[washingtonpost] Fix extractor ()
Closes 
Authored by: Bricio
Lesmiscore (Naoya Ozaki) 6bb608d055
[piapro] Add extractor ()
Based on https://github.com/ytdl-org/youtube-dl/pull/25922
Closes , https://github.com/ytdl-org/youtube-dl/issues/5856

Authored by: pycabbage, Lesmiscore
Nil Admirari ae419aa94f
[Sponsorblock] minor fixes ()
* preserve mtime - Closes 
* keep concat spec on failure

Authored by: nihil-admirari
ajj8 ac184ab742
[bbc] Fix extraction of news articles ()
Closes 

Authored by: ajj8
pukkandan 5c10453827
Fix for when stdout/stderr encoding is None
Closes 
pukkandan ffa89477ea
[extractor] Fix for manifests without period duration
Closes 
Authored by: dirkf, pukkandan
zenerdi0de db74de8c54
[dropbox] fix regex ()
Closes 
Authored by: zenerdi0de
Grabien edecb5f81f
[extractor/cspan] Support of C-Span congress videos ()
Authored by: Grabien
lyz-code 85a0ad0117
[bandcamp] Fix user URLs ()
Authored by: lyz-code
Lesmiscore (Naoya Ozaki) 07ea0014ae
[twitcasting] Add fallback for finding running live ()
Authored by: Lesmiscore
schn0sch e1f7f235bd
[peekvids] Use JSON-LD ()
Authored by: schn0sch
Lesmiscore (Naoya Ozaki) 9a5b012575
[niconico:tag] Add support for searching tags ()
Lesmiscore (Naoya Ozaki) df635a09a4
[twitcasting] Fix extraction ()
Authored by: Lesmiscore
cyberfox1691 812283199a
[murrtube] Add extractor ()
Authored by: cyberfox1691
marieell 5c6dfc1f79
[ATVAt] Detect geo-restriction ()
Authored by: marieell
schn0sch c2a8547fdc
[peekvids] Add extractor ()
Authored by: schn0sch
Bricio 0a19532ead
[Caltrans] Add extractor ()
Closes 

Authored by: Bricio
Ronald Ip 2d41e2eceb
[twitter] Fix for private videos ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/27643
Authored by: iphoting
Lesmiscore (Naoya Ozaki) 81c5f44c0f
[fc2] Fix extraction ()
Closes 

Authored by: Lesmiscore
Michael Pauley 1f7db8533a
[cookies] Update MacOS12 `Cookies.binarycookies` location ()
Authored by: mdpauley
pukkandan e8969bda94
Obey `--abort-on-error` for "ffmpeg not installed"
Closes 
chris c82f051dbb
[ruv.is] Add extractor ()
Closes: 

Authored by: iw0nderhow
pukkandan 49895f062e
[tiktok] Fix `vt.tiktok` URLs
and add test
coletdev 60f393e48b
[youtube] Ensure subtitle urls are absolute ()
Closes 

Authored by: coletdjnz
pukkandan 88afe05695
[tiktok] Fix `vm.tiktok` URLs
Closes 
pukkandan 57ebfca39b
Set `webpage_url_...` from `webpage_url` and not input URL
Closes 
YuenSzeHong b1cb0525ac
[fujitv] Extract resolution for free sources ()
Authored by: YuenSzeHong
Lesmiscore (Naoya Ozaki) da42679b87
[utils] WebSockets wrapper for non-async functions ()
Authored by: Lesmiscore
Lesmiscore 2944835080
[bigo] Fix extractor to not to use `form_params`
Tom a3eb987e0e
[zoom] Add support for screen cast ()
Authored by: Mipsters
Lesmiscore (Naoya Ozaki) 7bc33ad0e9
[bigo] Add extractor ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/18357

Authored by: Lesmiscore
Bricio 2068a60318
[generic] Set rss `guid` as video id ()
Closes 
Authored by: Bricio
Lukas Fink 1ce9a3cb49
Add regex operator and quoting to format filters ()
Closes  
Authored by: lukasfink1
pukkandan d49f8db39f
[utils] Validate `DateRange` input
Closes 
pukkandan ab6df717d1
[youtube] Differentiate descriptive audio by language code
Related: 
pukkandan 0c8d9e5fec
[youtube] Label original auto-subs
Closes 
Felix S 3f047fc406
[extractor] Extract subtitles from manifests for more sites ()
vimeo, globo, kaltura, svt

Authored by: fstirlitz
i6t 82b5176783
[Gettr] Add `GettrStreamingIE` ()
Closes 
Authored by: i6t
Bricio 17b183886f
[globo] Expand valid URL ()
Closes  
Authored by: Bricio
Bricio cd170e8184
[beeg] Fix extractor ()
Closes 

Authored by: Bricio
pukkandan 297e9952b6
[extractor] Allow `http_headers` to be specified for `thumbnails`
marieell dca4f46274
[cleanup] Remove extractors for some dead websites ()
90tv.ir, HornBunny.com, 220.ro, 5min.com, Kankan.com, Roxwel.com,
FreshLive.tv, TheScene.com, Vube.com

Authored by: marieell
Luc Ritchie 5dee3ad037
[afreecatv] Support password-protected livestreams ()
Authored by: wlritchi
pukkandan 079a7cfc71
[downloader] Do not use aria2c for non-native `m3u8`
Closes 
pukkandan 3856407a86
[options] Rename `--clean-infojson` to `--clean-info-json`
pukkandan db2e129ca0
[options] Better ambiguous option resolution
Eg: `--write-auto` no longer results in
> ambiguous option: --write-auto (--write-auto-subs, --write-automatic-subs?)
marieell 1209b6ca5b
[zaq1] Remove dead extractor ()
Was already partially removed in 29f7c58aaf
Authored-by: marieell
Justin Keogh a3125791c7
[utils] Use `locked_file` for `sanitize_open` ()
Authored by: jakeogh
ofkz f1657a98cb
[nfb] Add extractor ()
Authored by: ofkz
github-actions b761428226 [version] update
Created by: pukkandan

:ci skip all
pukkandan 84bbc54599
[youtube:search] Add tests
pukkandan 1e5d87beee
[websocket] Make syntax error in `websockets` module non-fatal
Closes 
nixxo 22219f2d1f
[mediaset] Fix extractor ()
Closes 
Authored by: nixxo
Lesmiscore (Naoya Ozaki) 5a13fdd225
[twitcasting] Enforce UTF-8 for POST payload ()
Authored by: Lesmiscore
coletdjnz af5c1c553e
[youtube] Fix search extractor
Regression introduced in 16aa9ea41d. Closes 
Authored-by: coletdjnz
github-actions 3cea9ec2eb [version] update
Created by: pukkandan

:ci skip all
pukkandan d5a398988b
Update to ytdl-commit-78ce962
[youtube] Support channel search
78ce962f4f
pukkandan 455a15e2dc
[cleanup,docs] Minor fixes
Closes , 
pukkandan 460a1c08b9
[FFmpegConcat] Abort on --skip-download and download errors
Closes 
pukkandan 4918522735
[utils] Strip double spaces in `clean_html`
Closes 
Authored by: dirkf
pukkandan 65662dffb1
Make nested --config-locations relative to parent file
* and allow environment variables in it so that you can use `$PWD`/`%cd%`
to specify paths relative to current directory
pukkandan 5e51f4a8ad
[glomex] Simplify embed detection ()
Closes 
pukkandan 54bb39065c
[bilibili] Fix extractor
Closes , Closes 
Fixes https://github.com/yt-dlp/yt-dlp/pull/1716#issuecomment-980512982
pukkandan c5332d7fbb
[instagram] Fix bug in 013322a95e
Closes 
pukkandan 35cd4c4d88
[cctv] De-prioritize sample format
Closes 
pukkandan 67fb99f193
[doodstream] Fix extractor
Closes 
pukkandan 85553414ae
[generic] Allow further processing of json_ld URL
Closes 
pukkandan d16df59db5
Fix `--compat-options list-formats`
Closes 
Bricio 63c3ee4f63
[globo] Fix extractor ()
Closes 
Authored by: Bricio
pukkandan 182bda88e8
[youtube, cleanup] Misc fixes and cleanup
pukkandan 16aa9ea41d [youtube] Add extractor `YoutubeMusicSearchURLIE`
Closes 
Lesmiscore (Naoya Ozaki) d6bc443bde
[fc2] Fix extraction ()
Closes 
Authored by: Lesmiscore
MinePlayersPE 046cab3915
[TikTok] Iterate through app versions ()
Closes 
Authored by: MinePlayersPE
Sipherdrakon 7df07a3b55
[dplay] Add extractors for site changes ()
Closes 
Authored by: Sipherdrakon
Zenon Mousmoulas 2d49720f89
[ertgr] Add new extractors ()
Authored-by: zmousm, dirkf
pukkandan 48416bc4a8
[youtube] Fix n-sig for player e06dea74
pukkandan 6a0546e313
[outtmpl] Handle hard-coded file extension better
When we know that the user-provided extension is the correct final one,
replace it with intermediate extension during download
pukkandan dbcea0585f
[outtmpl] Handle `-o ""` better
Since the specific type of file is not downloaded when giving `-o "<type>:"`,
now `-o ""` acts as an alias to `--skip-download`
KiberInfinity f7d4854131
[Pladform] Fix redirection to external player ()
Authored by: KiberInfinity
foghawk 403be2eefb
[tumblr] Fix 403 errors and handle vimeo embeds ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/29585
Authored by: foghawk
lazypete365 63bac931c2
[mildom] Fix extractor ()
Closes 
Authored by: lazypete365
Jeff Huffman 7c74a01584
[crunchyroll] Fix login ()
Closes 
Authored by: tejing1
pukkandan 1d3586d0d5
[aes] Add unpad_pkcs7
pukkandan c533c89ce1
[GoogleSearch] Fix extractor
KiberInfinity b8b3f4562a
[Odnoklassniki] Improve embedded players extraction ()
Authored by: KiberInfinity
nyuszika7h 1c6f480160
[viki] Fix "Bad request" for manifest ()
Closes 
Authored by: nyuszika7h
u-spec-png f8580bf02f
[Bilibili] Add 8k support ()
Closes , 
Authored by: u-spec-png
Zenon Mousmoulas 19afd9ea51
[GlomexEmbed] Avoid large match objects
Closes 
Authored by: zmousm
trasssh b72270d27e
[MySpass] Fix video url processing ()
Closes 
Authored by: trassshhub
Jeff Huffman 706dfe441b
[crunchyroll:beta] Add cookies support ()
* Extract directly from the beta API when cookies are passed. If login cookie is absent, the extraction is delegated to `CrunchyrollIE`. This causes different metadata to be extracted (including formats and video id) and therefore results in a different archive entry. For now, this issue is unavoidable since the browser also redirects to the old site when not logged in.

* Adds extractor-args `format` and `hardsub` to control the source and subtitles of the extracted formats

Closes 
Authored by: tejing1
YuenSzeHong c4da5ff971
[Fujitv] Extract metadata and support premium ()
Authored by: YuenSzeHong
KiberInfinity e26f9cc1e5
[YandexVideoPreview] Add extractor ()
Closes 
Authored by: KiberInfinity
pukkandan fa8fd95118
[cookies] Fix keyring selection for unsupported desktops
Closes 
MinePlayersPE 05b23b4156
[iq.com] Add VIP support ()
Authored by: MinePlayersPE
Aleri Kaisattera 8f028b5f40
[Vimm] add recording extractor ()
Authored by: alerikaisattera
MinePlayersPE 013322a95e
[Instagram] Fix extraction when logged in ()
Closes 
Authored by: MinePlayersPE
Ashish Gupta fb62afd6f0
[Musicdex] Add extractors ()
Closes 
Authored by: Ashish0804
Ashish Gupta 50600e833d
[ThisOldHouse] Improve Premium URL check ()
Closes 
Authored by: Ashish0804
pukkandan fc08bdd6ab
[extractor] Allow non-fatal `title` extraction
pukkandan 2568d41f70
[bilibili] Make anthology title non-fatal
pukkandan 88f23a18e0
[docs,cleanup] Fix linter and misc cleanup
Closes 
pukkandan bb66c24797
Add option `--print-to-file`
Closes 
pukkandan 2edb38e8ca
[extractor] Extract video inside `Article` json_ld
Closes 
pukkandan af6793f804
[downloader/ffmpeg] Handle unknown formats better
pukkandan b695e3f9bd
[orf:tvthek] Lazy playlist extraction and obey --no-playlist
Closes 
pukkandan 6a5a30f9e2
Ensure `_type` is present in `info.json`
Closes 
pukkandan d37707bda4
Fix/improve `InAdvancePagedList`
pukkandan f40ee5e9a0
[extractor] Add convinience function `_yes_playlist`
pukkandan 1f13021eca
[web.archive:youtube] Add `ytarchive:` prefix
and misc cleanup
pukkandan e612f66c7c
[archive.org] Ignore unnecessary files
Closes 
coletdjnz 87e8e8a7d0
[youtube:api] Do not use seek when reading HTTPError response
Authored-by: coletdjnz
Aleri Kaisattera e600a5c908
[CAM4] Add thumbnail extraction ()
Authored by: alerikaisattera
github-actions 50ce204cc2
[version] update
Created by: pukkandan

:ci skip all
pukkandan ed40877833
Fix 426764371f for Py3.6
sian1468 935f5a4209
[line] Remove `tv.line.me` ()
Service is discontinued
Authored by: sian1468
pukkandan 6970b6005e
[cleanup] Minor fixes
Closes 
pukkandan fc5fa964c7
[docs] Improvements
pukkandan e0ddbd02bd
[cleanup] Use format_field where applicable
pukkandan 0bfc53d05c
List playlist thumbnails in `--list-thumbnails`
Ashish Gupta 78ab4f447c
[Newsy] Add extractor ()
Closes 
Authored by: Ashish0804
coletdjnz 85fee22152
[PRX] Add Extractors ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/15948

Authored by: coletdjnz
Felix S ad9158d5f4
[ard] Extract subtitles ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/30543, related: https://github.com/ytdl-org/youtube-dl/pull/17766
Authored by: fstirlitz
xtkoba f81c62a6a4
Add option --legacy-server-connect ()
to allow HTTPS connection to servers that do not support RFC 5746 secure renegotiation

Authored by: xtkoba
coletdjnz 6c73052c0a
[youtube] Extract channel subscriber count ()
Closes 
* Adds `channel_follower_count` field
Authored-by: coletdjnz
Ashish Gupta 593e43c030
[LnkIE] Add extractor ()
Closes:  
Authored by: Ashish0804
Ashish Gupta 8fe514d382
[CrowdBunker] Add extractors ()
Closes:  
Authored by: Ashish0804
pukkandan b1156c1e59
Fix d14cbdd92d
pukkandan 311b6615d8
[extractor] Improve `url_result` and related
coletdjnz 396a76f7bf
[youtube] Enforce UTC ()
and [utils] use `utcnow` in `datetime_from_str`

Related:  
Authored by: coletdjnz
coletdjnz 301d07fc4b
[youtube:tab] Extract channel banner ()
Closes 
Authored by: coletdjnz
pukkandan d14cbdd92d
[utils] Add `Sec-Fetch-Mode` to `std_headers`
Closes 
pukkandan 19b4c74d40
Revert d6579d532b
Closes , Reopens 
pukkandan 135dfa2c7e
[extractor,cleanup] Use `_search_nextjs_data`
MinePlayersPE e0585e6562
[TikTok] Extract captions ()
Closes 
Authored by: MinePlayersPE
MinePlayersPE 426764371f
[iq.com] Add extractors ()
Closes 
Authored by: MinePlayersPE
krichbanana 64f36541c9
[youtube:tab] Raise error on tab redirect ()
Closes 
Authored by: krichbanana, coletdjnz
Aleri Kaisattera 0ff1e0fba3
[Theta] Fix valid URL ()
Authored by: alerikaisattera
Zenon Mousmoulas 1a20d29552
[tvopengr] Add extractors ()
Authored by: zmousm
nyuszika7h f7085283e1
[instagram] Fix username extraction for stories and highlights ()
Authored by: nyuszika7h
Ashish Gupta e25ca9b017
[RTNews] Add extractor ()
Closes 
Authored by: Ashish0804
trasssh 4259402c56
[Ted] Rewrite extractor ()
Closes 
Authored by: pukkandan, trassshhub
Ashish Gupta dfb7f2a25d
[CTVNewsIE] Add fallback for video search ()
Closes 
Authored by: Ashish0804
Lesmiscore (Naoya Ozaki) 42c5458a02
[TVer] Extract message for unaired live ()
Closes 
Authored by: Lesmiscore
Lesmiscore (Naoya Ozaki) ba1c671d2e
[mixch] Add `MixchArchiveIE` ()
Closes 
Authored by: Lesmiscore
Zenon Mousmoulas b143e83ec9
[megatvcom] Add embed test ()
Authored by: zmousm
k3ns1n 4a77fb1d6b
[daftsex] Add extractors ()
Authored by: k3ns1n
pukkandan 66f7c6a3e0
[youtube] Do not return `upload_date` for playlists
Closes 
Partially reverts 
Re-opens 
pukkandan baf599effa
[pbs] de-prioritize AD formats
Related: 
pukkandan 8bd1c00bf3
[utils] Handle `ss:xxx` in `parse_duration`
Closes 
pukkandan 596379e260
[youtube] Make invalid storyboard URL non-fatal
Closes 
pukkandan b6ce9bb038
[youtube] Detect live-stream embeds
Closes 
Ashish Gupta eea1b0358e
[ThisOldHouseIE] Add support for premium videos ()
Authored by: Ashish0804
Closes: 
Zenon Mousmoulas 32b95bb643
[megatvcom] Add extractors ()
Authored by: zmousm
Zenon Mousmoulas fdf80059d9
[glomex] Minor fixes ()
Authored by: zmousm
Ashish Gupta aa062713c1
[PokerGo] Add extractors ()
Authored by: Ashish0804
Closes: 
Zenon Mousmoulas 71738b1451
[glomex] Add new extractors ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30212
Authored by: zmousm
pukkandan 0bb5ac1ac4
[dplay] Re-structure DiscoveryPlus extractors
Timendum 77b28f000a
[dplay] Migrate DiscoveryPlusItaly to DiscoveryPlus ()
Partially fixes 
Authored by: timendum
pukkandan d57576b9d9
[httpie] Fix `available` method
Closes 
trasssh 11c861702d
[generic] Improve KVS player extraction ()
Closes 
Authored by: trassshhub
Lesmiscore (The Hatsune Daishi) a4a426023d
[twitcasting] Refactor extractor ()
Co-authored-by: Ashish Gupta <39122144+Ashish0804@users.noreply.github.com>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>

Authored by: Lesmiscore
pukkandan 3b603dbdf1
Add option `--concat-playlist`
Closes , related: 
pukkandan 5df1ac92bd
[ffmpeg] Ignore unknown streams
Closes 
pukkandan b2db8102dc
[facebook] Fix extraction from groups
Closes , related: 
Hirokuni Yano e9a6a65a55
[yahoo:gyao] Improved playlist handling ()
Authored by: hyano
pukkandan ed8d87f911
[cleanup, docs] Minor fixes
Closes 
pukkandan 397235c52b
[ffmpeg] Standardize use of `-map 0`
Closes 
pukkandan 4636548463
[CeskaTelevize] Use `http` for manifests
Workaround for 
pukkandan cb3c5682ae
[kakao] Detect geo-restriction
Code from: d8085580f6
Petr Vaněk 7d449fff53
[streamcz] Fix extractor ()
Closes , closes 
Authored by: arkamar, pukkandan
pukkandan 80fa6e5327
[facebook] Improve title and uploader extraction
Closes , closes 
Lesmiscore (The Hatsune Daishi) fabb27fcea
[twitcasting] Throw proper error for login-only streams ()
Closes 

Authored by: Lesmiscore
pukkandan e04938ab88
Check for existing thumbnail/subtitle in final directory
Closes 
teridon 8bcd404818
[digitalconcerthall] Add extractor ()
Authored by: teridon
nixxo 0df11dafdd
[rai] Add Raiplaysound extractors ()
Closes 
Authored by: nixxo, pukkandan
pukkandan dc5f409cdc
Fix typo in ed5835b451
pukkandan 99d6f9461d
[aparat] Fix extractor
Closes 
pukkandan 8130779db6
Allow listing formats, thumbnails, subtitles using `--print` ()
Closes 
Authored by: pukkandan, Zirro
pukkandan ed5835b451
Allow `--print` to be run at any post-processing stage
trasssh e88e1febd8
[noodlemagazine] Add extractor ()
Authored by: trassshhub
trasssh faca674510
[Rule34video] Add extractor ()
Authored by: trassshhub
MinePlayersPE 0931ba94ab
[Nexx] Extract more metadata ()
Authored by: MinePlayersPE
pukkandan b31874334d
[tiktok] Extract user thumbnail
Closes 
Authored by: pukkandan, MinePlayersPE
pukkandan f1150b9e1e
[twitter] Fix video in quoted tweets
Closes 
pukkandan d6579d532b
[utils] Partially revert d76d15a669
Closes 
pukkandan 2be56f2242
[funk] Support origin URLs
Closes 
foghawk 62c955efc9
[veoh] Improve extractor ()
* [veoh] Remove old _extract_video
* [veoh] Extend _VALID_URL to accept '/videos/'
* [veoh] Prefer high quality
* [veoh] Extract more metadata

Authored by: foghawk
Zenon Mousmoulas 0254f16274
[utils] Improve `get_elements_text_and_html_by_attribute` regex ()
Authored by: zmousm, pukkandan
Ashish Gupta a70b71e85a
[vk] Fix VKUserVideosIE ()
Authored by: Ashish0804
Closes 
Unit 193 4c968755fc
[PornHub,YouTube] Refresh onion addresses ()
Authored by: unit193
MinePlayersPE be1f331f21
[TikTok] Misc fixes ()
Closes 
Authored by: MinePlayersPE
Ashish Gupta 3cf5429a21
Add EuropeanTourIE ()
Closes  
Authored by: Ashish0804
ischmidt20 bfa0e270cf
[NBCSports] Fix extraction of platform URLs ()
Authored by: ischmidt20
Luc Ritchie f76ca2dd56
[afreecatv] Add support for livestreams ()
Authored by: wlritchi
MinePlayersPE 5f969a78b0
[Nexx] Support 3q CDN ()
Closes 
Authored by: MinePlayersPE
ischmidt20 443f8de820
[fox] Extract m3u8 from preview ()
Authored by: ischmidt20
Moises Lima 768145d48a
[Pornez] Add extractor ()
Authored by: mozlima
pukkandan 976ae3eabb
[youtube] Update tests
coletdjnz f0d785d3ed
[youtube:tab] Extract more playlist metadata ()
* Add fields modified_date, modified_timestamp
* Add field playlist_count
* [youtube:tab] Extract view_count, playlist_count, modified_date

Authored by: coletdjnz, pukkandan
foghawk 97a6b117d9
[callin] Add extractor ()
Authored by: foghawk
Zenon Mousmoulas 6f32a0b5b7
[utils] Improve parsing for nested HTML elements ()
and add functions to return the HTML of elements

Authored by: zmousm
Aleri Kaisattera e8736539f3
[Vimm] Add extractor ()
Authored by: alerikaisattera
coletdjnz 9c634ef857
[MainStreaming] Add extractor ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/29615

Authored by: coletdjnz
coletdjnz 9f517bb1f3
[gfycat] Support embeds ()
Closes 
Authored by: coletdjnz
Lesmiscore (The Hatsune Daishi) b8eeced286
[openrec] Add movie extractor ()
Closes 
Authored by: Lesmiscore
Alexander Simon db47787024
[hrfernsehen] Fix ardloader extraction ()
Authored by: CreaValix
pukkandan fdeab99eab
[zee5] Add geo-bypass
pukkandan 9e907ebddf
[cleanup] Misc cleanup
pukkandan 21df2117e4
[vk] Capture `clip` URLs
pukkandan 06e57990f7
Allow multiple and nested configuration files
pukkandan b62fa6d75f
Fix `-s --ignore-no-formats --force-write-archive`
Bug in a13e684813
pukkandan be72c62480
Fix recursion error in f46e2f9d92
Closes 
pukkandan 61e9d9268c
Fix bug in 8896899216
Closes 
pukkandan a13e684813
Write `download_archive` only after all formats are downloaded
Closes 
pukkandan f46e2f9d92
Add key `requested_downloads` in the root `info_dict`
pukkandan 9c906919ae
Add field `video_autonumber`
Closes 
pukkandan 6020e05d23
Raise error if subtitle download fails
Closes 
pukkandan ebed8b3732
Add more post-processing stages
playlist = After entire playlist
after_video = After downloading all formats of a video
pukkandan 1e43a6f733
Allow `--exec` to be run at any post-processing stage
Deprecates `--exec-before-download`
pukkandan ca30f449a1
Add `--print playlist:` to print fields per playlist
k3ns1n af3cbd8782
[vk] Improve _VALID_URL ()
Authored by: k3ns1n
zenerdi0de 7141ced57d
[Dropbox] Support password protected files and more formats ()
Authored by: zenerdi0de
coletdjnz 18c7683d27
[youtube:api] Update Innertube clients ()
* Updated iOS clients to support 60fps formats (see: https://github.com/TeamNewPipe/NewPipeExtractor/issues/680#issuecomment-1002724558)
* General update of versions and keys of other clients
 Authored-by: coletdjnz
chris f5c2c2c9b0
[zdf] Add chapter extraction ()
Authored by: iw0nderhow
pukkandan 8896899216
[FfmpegMetadata] Allow setting metadata of individual streams
Closes 
pukkandan 1797b073ed
[utils] Use key `None` in `traverse_obj` to return as-is
pukkandan 4c922dd3fc
Fix live title for multiple formats
pukkandan b8e976a445
[facebook] Parse dash manifests
Ashish Gupta a9f5f5d6eb
[RedBullTV] Parse subtitles from manifest ()
Closes 
Authored by: Ashish0804
chris f522573787
[extractor] Extract chapters from JSON-LD ()
Authored by: iw0nderhow, pukkandan
nixxo 7592749cbe
[extractor] Extract thumbnails from JSON-LD ()
Authored by: nixxo
MinePlayersPE 8efffafa53
[XVideos] Check HLS formats ()
Closes 
Authored by; MinePlayersPE
Ashish Gupta 26f2aa3db9
[hotstar] Add extractor args to ignore tags ()
Authored by: Ashish0804
pgaig 3464a2727b
[VrtNU] Handle empty title ()
Closes 
Authored by: pgaig
Ashish Gupta 497d77e1aa
[KelbyOne] Add extractor ()
Closes 
Authored by: Ashish0804
LE 9040e2d6e3
[mixcloud] Detect restrictions ()
Authored by; llacb47
MinePlayersPE 6134fbeb65
[TikTok] Pass cookies to formats ()
Closes 
Authored by: MinePlayersPE
MinePlayersPE cfcf60ea99
[BiliIntl] Add login ()
and misc improvements

Authored by: MinePlayersPE
Felix S 4afa3ec4b6
[extractor] Detect more subtitle codecs in MPD manifests ()
Authored by: fstirlitz
MinePlayersPE 11aa91a12f
[TikTok] Fix extraction for sigi-based webpages ()
Fixes: 
Authored by: MinePlayersPE
pukkandan abbeeebc4c
[outtmpl] Alternate form for `D` and fix suffix's case
Fixes: https://github.com/yt-dlp/yt-dlp/issues/2085#issuecomment-1002247689, https://github.com/yt-dlp/yt-dlp/pull/2132/files#r775729811
pukkandan 2c539d493a
[cookies] Fix bug when keyring is unspecified
Closes 
pukkandan 042931a507
Allow escaped `,` in `--extractor-args`
Closes 
MinePlayersPE 96f13f01a6
[TikTok] Change app version ()
Closes , 
Authored by: MinePlayersPE, llacb47
u-spec-png 4b9353239e
[Drooble] Add extractor ()
Closes 
Authored by: u-spec-png
u-spec-png dd5e60b15d
[Instagram] Add story/highlight extractor ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/25575
Authored by: u-spec-png
MinePlayersPE e540c56f39
[TikTok] Fallback to feed API endpoint ()
Authored by: MinePlayersPE
Workaround for 
pukkandan 45d86abeb4
Allow unicode characters in `info.json`
Closes 
Pierre Mdawar f02d24d8d2
[utils] Fix `format_bytes` output for Bytes ()
Authored by: pukkandan, mdawar
pukkandan ceb98323f2
Don't treat empty containers as `None` in `sanitize_info`
pukkandan 7537e35b64
[gfycat] Fix `uploader`
github-actions 1e5c83b26b [version] update
Created by: pukkandan

:ci skip all
pukkandan 6a34813a0d
[docs] Add examples for using `TYPES:` in `-P`/`-o`
Matt Broadway f59f5ef8b6
[cookies] Support other keyrings ()
Authored by: mbway
pukkandan f44afb54ef
[aria2c] Don't show progress when `--no-progress`
pukkandan 77cee0f188
[EmbedThumbnail] Prefer AtomicParsley over ffmpeg if available
pukkandan 6a17677577
[ThumbnailsConvertor] Fix for when there are no thumbnails
Closes 
Ashish Gupta ee7b9bdf5d [Zee5] Fix VALID_URL for tv-shows
pukkandan 185bf31070
[youtube] End `live-from-start` properly when stream ends with 403
Closes 
pukkandan 0b77924a38
[tiktok] Fix `extractor_key` used in archive
MinePlayersPE 8126298c1b
[TikTok] Add music, sticker and tag IEs ()
Closes 
Authored by: MinePlayersPE
pukkandan 6da22e7d4f
Avoid recursion error when re-extracting info
MinePlayersPE c62ecf0d90
[BiliIntl] Fix extractor ()
Closes 
Authored by: MinePlayersPE
The Hatsune Daishi 3774f4f427
[PixivSketch] Add extractors ()
Authored by: nao20010128nao
git-anony-mouse 9980d3d213
[generic] Fix HTTP KVS Player ()
Authored by: git-anony-mouse
pukkandan 8eb4b1bb8e
[ffmpeg] Fix position of `--ppa`
Bug in ca5db158ae
Closes 
pukkandan 332da56f52
[CBC] Fix URL regex
Closes 
github-actions 459aea84c3 [version] update
Created by: pukkandan

:ci skip all
pukkandan 0f86a1cd59
[dplay] Temporary fix for `discoveryplus.com/it`
Closes 
pukkandan 352d5da812
[utils] Improve `parse_count`
MinePlayersPE d43de6821c
[GameJolt] Add extractors ()
Authored by: MinePlayersPE
u-spec-png 070f6a85ea
[Steam] Fix extractor ()
Closes 
Authored by: u-spec-png
Benedikt Wildenhain 4b4b7f746c
[OpenCast] Add extractors ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/26934
Authored by: bwildenhain, C0D3D3V
Sonic e9efb99f66
[dropout] Add extractor ()
Authored-by: TwoThousandHedgehogs, pukkandan
coletdjnz a709d87335
[youtube:tab] Extract video thumbnails from playlist ()
closes 
Co-Authored-by: coletdjnz, pukkandan
siddharth 774a46c53d
[npr] Make SMIL extraction non-fatal ()
Closes 
Authored by: r5d
MinePlayersPE c8b80b9643
[RCTIPlusSeries] Lazy extraction and video type selection ()
Authored by: MinePlayersPE
MinePlayersPE 4e260d1a56
[Instagram] Try bypassing login wall with embed page ()
Authored by: MinePlayersPE
Luc Ritchie 4f3fa23e5a
[utils] Fix parsing `YYYYMMDD` dates in Nov/Dec ()
The date format `%Y%m%d%H%M` will successfully match against
one-digit month, day, hour, and minute strings, even though %m et al.
are documented as being zero-padded. So dates without time in
Nov/Dec may be wrongly parsed as dates in January with time.

This commit adds a format string of `%Y%m%d` to our supported date
format strings directly below (higher priority) its problematic relatives.

Closes 
Authored by: wlritchi
pukkandan b28bac93ab
Fix bug in 1cefca9e44
Fixes https://github.com/ytdl-patched/ytdl-patched/issues/11
pukkandan 37893bb0c9
[outtmpl] Change filename sanitization type to `S`
`F` is already used for float!
Bug in e0fd95737d
Ashish Gupta c25de59cf7
[LBRY] Support livestreams ()
Closes  
Authored by: Ashish0804, pukkandan
Emanuel Hoogeveen 205a0654c0
Add option `--file-access-retries` ()
Closes 
Authored by: ehoogeveen-medweb
aarubui 663949f825
[NJPWWorld] Extract formats from m3u8 ()
Authored by: aarubui
pukkandan b69fd25c25
[cleanup] Misc cleanup
Closes     
pukkandan e0fd95737d
[outtmpl] Add alternate forms `F`, `D`
and improve `id` detection

F = sanitize as filename (# = restricted)
D = add Decimal suffixes

Closes , 2081
pukkandan 4ac5b94807
[dash] Fix `--test`
Bug in adbc4ec4bb
pukkandan 4273cc776d
[dash] Fix aria2c dash downloads
Bug in adbc4ec4bb
pukkandan fa9f30b802
Add interactive format selection with `-f -`
Closes 
pukkandan 1cefca9e44
Add warning when using `-f best`
kebianizao 5edb8dfec2
[rtve] Add `RTVEAudioIE` ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29023
Authored by: kebianizao
The Hatsune Daishi adbc4ec4bb
[dash,youtube] Download live from start to end ()
* Add option `--live-from-start` to enable downloading live videos from start
* Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start
* [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments
* [fragment] Allow multiple live dash formats to download simultaneously
* [youtube] Implement fragment re-fetching for the live dash formats
* [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs)
* [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms

Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats

Closes 
Authored by: nao20010128nao, pukkandan
Julien Hadley Jack c031b0414c
[ondemandkorea] Update `jw_config` regex ()
Authored by: julien-hadleyjack
coletdjnz f3aa3c3f98
[youtube:tab] Extract more metadata from feeds/channels/playlists ()
Parse relative time text, extract live, upcoming status, availability and channel id from feeds/channels/playlists (where applicable). 
Closes 
Authored-by: coletdjnz
cypheron ae43a4b986
[hse] Add extractors ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/27060
Authored by: cypheron, pukkandan
pukkandan ca5db158ae
[postprocessor/ffmpeg] Always add `faststart`
Closes 
pukkandan 5f549d4959
[Facebook] Handle redirect URLs
Closes 
Paul Wise 6839d02cb6
[ABC:iview] Add show extractor ()
Authored by: pabs3
Abdullah Ibn Fulan 2aae2c91ff
[audiomack] Update album and song VALID_URL ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29810
Closes , https://github.com/ytdl-org/youtube-dl/issues/29800
Authored by: abdullah-if, dirkf
Lapinot c2dedf12e8
[soundcloud] Add related tracks extractor ()
Authored by: Lapin0t
Unit 193 e75bb0d6c3
[cleanup] Fix some typos ()
Authored by: unit193
pukkandan dd0228ce1f
Remove known invalid thumbnails from `info_dict`
Related: https://github.com/yt-dlp/yt-dlp/issues/980#issuecomment-997396821
pukkandan 37e57a9fd4
[youtube:tab] Ignore query when redirecting channel to playlist
and cleanup of related code
Closes 
pukkandan 940a67a3e2
[docs] Change all examples to use double quotes
to be platform-agnostic
pukkandan e6ae51c123
[generic] Extract m3u8 formats from JSON-LD
pukkandan aab41cdd33
[PlutoTV] Expand `_VALID_URL`
Closes 
pukkandan b3a5115ff1
[zee5] Support /episodes in URL
Closes 
Felix S d76d15a669
[utils] Update `std_headers` ()
* Update our chrome versions used for `User-Agent`s
* Drop the `Accept-Charset` header that no browser emits any more

Authored by: kikuyan, fstirlitz
PilzAdam e978789f0f
[outtmpl] Add operator `&` for replacement text ()
Authored by: PilzAdam
Sematre 375d9360bf
[gronkh] Support new URL pattern ()
Authored by: Sematre
Zenon Mousmoulas d5c3254889
[extractor] Support default implicit graph in JSON-LD ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30229

Per W3C JSON-LD v1.1 §4.9 (non-normative ref):

    When a JSON-LD document's top-level structure is a map that contains
    no other keys than @graph and optionally @context (properties that
    are not mapped to an IRI or a keyword are ignored), @graph is
    considered to express the otherwise implicit default graph.

Authored by: zmousm
std-move fe69f52e5c
[NovaEmbed] update player regex ()
Authored by: std-move
pukkandan 3116be32b4
[brightcove] Fix 487c5b3389
pukkandan a8549f19e7
[tiktok] Fix 53dad39e30
pukkandan 39ca3b5c7f
[extractor] Standardize `_live_title`
coletdjnz 46383212b3
[youtube:comments] Add more options for limiting number of comments extracted ()
Extends `max_comments` extractor arg to support `max-parents,max-replies,max-replies-per-thread`.
Authored-by: coletdjnz
pukkandan 0bb322b9c0
Add field `webpage_url_domain`
Closes 
pukkandan ff9f925b63
[test/download] Add more fields
pukkandan 5bfc8bee5a
Fix PostProcessor hooks not registered for some PPs
Closes 
pukkandan 19188702ef
[FormatSort] Prevent incorrect deprecation warning
Closes 
The Hatsune Daishi d984a98def
[ok.ru] add mobile fallback ()
Authored by: nao20010128nao
u-spec-png 069c6ccf02
[olympics] Add uploader and cleanup ()
Authored by: u-spec-png
MinePlayersPE 53dad39e30
[TikTok] Pass cookies to mobile API ()
Authored by: MinePlayersPE
Ashish Gupta db77c49c84
[SonyLiv] Add OTP login support ()
Closes 
Authored by: Ashish0804
Ashish Gupta abc07b554c
[NateTV] Add NateIE and NateProgramIE ()
Authored by: Ashish0804, Hyeeji
Ashish Gupta 86f3d52f8c [DiscoveryPlusShowBaseIE] yield actual video id
u-spec-png 8b688881ba
[instagram] Expand valid URL ()
Closes 

Authored by: u-spec-png
Ashish Gupta 13debc86e7
[Rutube] Add RutubeChannelIE ()
Closes  
Authored by: Ashish0804
nyuszika7h b5f94e4fa1
[toggo] Add extractor ()
Authored by: nyuszika7h
YuenSzeHong 61882afdc5
[fujitv] Extract 1080p from `tv_android` m3u8 ()
Authored by: YuenSzeHong
coletdjnz aa4b054512
[web.archive:youtube] Improve metadata extraction ()
Authored-by: coletdjnz
YuenSzeHong 487c5b3389
[TVer] Extract better thumbnails ()
Authored by: YuenSzeHong
Nil Admirari 8157a09d22
[SponsorBlock] Add Filler and Highlight categories ()
Authored by: nihil-admirari, pukkandan
Jertzukka b1aaf1c07f
[gofile] Add extractor ()
Closes  
Authored by: Jertzukka, Ashish0804
chris 5f9aaac8c2
[zdf] Support videos with different ptmd location ()
Authored by: iw0nderhow
David Skrundz 54c2521ca6
[CBC Gem] Extract 1080p formats ()
Authored by: DavidSkrundz
The Hatsune Daishi 2814f12ba4
[skeb] Add extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30287
Authored by: nao20010128nao
raleeper 1619836cb7
[crackle] Look for non-DRM formats ()
Authored by: raleeper
pukkandan e3c7d49571
[compat] Suppress errors in enabling VT mode
Closes 
The Hatsune Daishi ddd24c9949
[ntvcojp] Extract NUXT data ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30309
Authored by: nao20010128nao
Michal Kubeček 443b21dc4e
[ceskatelevize] Fetch iframe from nextJS data ()
Closes 
Authored by: mkubecek
The Hatsune Daishi 66f4c04e50
[extractor] Add `_search_nuxt_data` ()
Authored by: nao20010128nao
nixxo 93864403ea
[redtube] Handle formats delivered inside a JSON ()
Closes 
Authored by: dirkf, nixxo
pukkandan b5475f1145
Pre-process when using `--flat-playlist`
pukkandan 38d79fd16c
Use `parse_duration` for `--wait-for-video`
and some minor fix
pukkandan acc0d6a411
Allow `--no-write-thumbnail` to override `--write-all-thumbnail`
Closes 
pukkandan 146cc4114a
bugfix for 63ccf4ff1a
pukkandan 818faa3a86
[vimeo] Extract chapters
Closes 
MinePlayersPE aa5ecf082c
[TrueID] Add extractor ()
Authored by: MinePlayersPE
pukkandan d2b2fca53f
[extractor] Ignore errors in comment extraction when `-i` is given
Closes 
pukkandan 63ccf4ff1a
[lazy_extractors] Fix bug in 2c4aaaddc9
SearchIEs must not inherit from extractors that have a _VALID_URL defined
pukkandan 43b2290658
Fix `--throttled-rate`
nixxo 99148c6a33
[RaiNews] Fix extractor ()
Closes 
Authored by: nixxo
pukkandan 9bdd99cf39
[EmbedSubtitle] Disable duration check temporarily
Closes , 
pukkandan 2c4aaaddc9
[lazy_extractors] Fix for search IEs
Closes 
pukkandan 5f7cb91ae9
[youtube] Fix `ytsearchdate`
Related: 
pukkandan 3efb96a6d1
Fix control characters being printed to `--console-title`
Closes 
pukkandan 3262f8abf2
[trovo] Fix inheritance of `TrovoChannelBaseIE`
Closes 
Christian Paul bdbafb3913
[Jamendo] Fix use of `_VALID_URL_RE` ()
Closes 
Authored by: jaller94
pukkandan a804f6d89c
[cleanup Fix some typos
* `MetadataFromFieldPP` is not deprecated!
* Wrong args to `MetadataFromFieldPP`
* Some mistakes in change log
* Type in build.yml causing release tag to be placed on wrong commit
github-actions 814dfb7e25 [version] update
Created by: pukkandan

:ci skip all
pukkandan 91f071af60
Release 2021.12.01
pukkandan 2aa5e2cc01
Ensure same config file is not loaded multiple times
j54vc1bk 1bad50eced
[CableAV] Add extractor ()
Authored by: j54vc1bk
u-spec-png ac0efabf12
[Bilibili] Fix title extraction ()
Closes 
Authored by: u-spec-png
Ashish Gupta 73f035e1fe
[Cleanup] Remove some unnecessary groups in regexes ()
Authored by: Ashish0804