Commit Graph

1599 Commits (24e3d87431855fd30ecf738ed7ddc6d89c6b5ef9)

Author SHA1 Message Date
pukkandan 455a15e2dc
[cleanup,docs] Minor fixes
Closes , 
pukkandan 460a1c08b9
[FFmpegConcat] Abort on --skip-download and download errors
Closes 
pukkandan 4918522735
[utils] Strip double spaces in `clean_html`
Closes 
Authored by: dirkf
pukkandan 65662dffb1
Make nested --config-locations relative to parent file
* and allow environment variables in it so that you can use `$PWD`/`%cd%`
to specify paths relative to current directory
pukkandan 5e51f4a8ad
[glomex] Simplify embed detection ()
Closes 
pukkandan 54bb39065c
[bilibili] Fix extractor
Closes , Closes 
Fixes https://github.com/yt-dlp/yt-dlp/pull/1716#issuecomment-980512982
pukkandan c5332d7fbb
[instagram] Fix bug in 013322a95e
Closes 
pukkandan 35cd4c4d88
[cctv] De-prioritize sample format
Closes 
pukkandan 67fb99f193
[doodstream] Fix extractor
Closes 
pukkandan 85553414ae
[generic] Allow further processing of json_ld URL
Closes 
pukkandan d16df59db5
Fix `--compat-options list-formats`
Closes 
Bricio 63c3ee4f63
[globo] Fix extractor ()
Closes 
Authored by: Bricio
pukkandan 182bda88e8
[youtube, cleanup] Misc fixes and cleanup
pukkandan 16aa9ea41d [youtube] Add extractor `YoutubeMusicSearchURLIE`
Closes 
Lesmiscore (Naoya Ozaki) d6bc443bde
[fc2] Fix extraction ()
Closes 
Authored by: Lesmiscore
MinePlayersPE 046cab3915
[TikTok] Iterate through app versions ()
Closes 
Authored by: MinePlayersPE
Sipherdrakon 7df07a3b55
[dplay] Add extractors for site changes ()
Closes 
Authored by: Sipherdrakon
Zenon Mousmoulas 2d49720f89
[ertgr] Add new extractors ()
Authored-by: zmousm, dirkf
pukkandan 48416bc4a8
[youtube] Fix n-sig for player e06dea74
pukkandan 6a0546e313
[outtmpl] Handle hard-coded file extension better
When we know that the user-provided extension is the correct final one,
replace it with intermediate extension during download
pukkandan dbcea0585f
[outtmpl] Handle `-o ""` better
Since the specific type of file is not downloaded when giving `-o "<type>:"`,
now `-o ""` acts as an alias to `--skip-download`
KiberInfinity f7d4854131
[Pladform] Fix redirection to external player ()
Authored by: KiberInfinity
foghawk 403be2eefb
[tumblr] Fix 403 errors and handle vimeo embeds ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/29585
Authored by: foghawk
lazypete365 63bac931c2
[mildom] Fix extractor ()
Closes 
Authored by: lazypete365
Jeff Huffman 7c74a01584
[crunchyroll] Fix login ()
Closes 
Authored by: tejing1
pukkandan 1d3586d0d5
[aes] Add unpad_pkcs7
pukkandan c533c89ce1
[GoogleSearch] Fix extractor
KiberInfinity b8b3f4562a
[Odnoklassniki] Improve embedded players extraction ()
Authored by: KiberInfinity
nyuszika7h 1c6f480160
[viki] Fix "Bad request" for manifest ()
Closes 
Authored by: nyuszika7h
u-spec-png f8580bf02f
[Bilibili] Add 8k support ()
Closes , 
Authored by: u-spec-png
Zenon Mousmoulas 19afd9ea51
[GlomexEmbed] Avoid large match objects
Closes 
Authored by: zmousm
trasssh b72270d27e
[MySpass] Fix video url processing ()
Closes 
Authored by: trassshhub
Jeff Huffman 706dfe441b
[crunchyroll:beta] Add cookies support ()
* Extract directly from the beta API when cookies are passed. If login cookie is absent, the extraction is delegated to `CrunchyrollIE`. This causes different metadata to be extracted (including formats and video id) and therefore results in a different archive entry. For now, this issue is unavoidable since the browser also redirects to the old site when not logged in.

* Adds extractor-args `format` and `hardsub` to control the source and subtitles of the extracted formats

Closes 
Authored by: tejing1
YuenSzeHong c4da5ff971
[Fujitv] Extract metadata and support premium ()
Authored by: YuenSzeHong
KiberInfinity e26f9cc1e5
[YandexVideoPreview] Add extractor ()
Closes 
Authored by: KiberInfinity
pukkandan fa8fd95118
[cookies] Fix keyring selection for unsupported desktops
Closes 
MinePlayersPE 05b23b4156
[iq.com] Add VIP support ()
Authored by: MinePlayersPE
Aleri Kaisattera 8f028b5f40
[Vimm] add recording extractor ()
Authored by: alerikaisattera
MinePlayersPE 013322a95e
[Instagram] Fix extraction when logged in ()
Closes 
Authored by: MinePlayersPE
Ashish Gupta fb62afd6f0
[Musicdex] Add extractors ()
Closes 
Authored by: Ashish0804
Ashish Gupta 50600e833d
[ThisOldHouse] Improve Premium URL check ()
Closes 
Authored by: Ashish0804
pukkandan fc08bdd6ab
[extractor] Allow non-fatal `title` extraction
pukkandan 2568d41f70
[bilibili] Make anthology title non-fatal
pukkandan 88f23a18e0
[docs,cleanup] Fix linter and misc cleanup
Closes 
pukkandan bb66c24797
Add option `--print-to-file`
Closes 
pukkandan 2edb38e8ca
[extractor] Extract video inside `Article` json_ld
Closes 
pukkandan af6793f804
[downloader/ffmpeg] Handle unknown formats better
pukkandan b695e3f9bd
[orf:tvthek] Lazy playlist extraction and obey --no-playlist
Closes 
pukkandan 6a5a30f9e2
Ensure `_type` is present in `info.json`
Closes 
pukkandan d37707bda4
Fix/improve `InAdvancePagedList`
pukkandan f40ee5e9a0
[extractor] Add convinience function `_yes_playlist`
pukkandan 1f13021eca
[web.archive:youtube] Add `ytarchive:` prefix
and misc cleanup
pukkandan e612f66c7c
[archive.org] Ignore unnecessary files
Closes 
coletdjnz 87e8e8a7d0
[youtube:api] Do not use seek when reading HTTPError response
Authored-by: coletdjnz
Aleri Kaisattera e600a5c908
[CAM4] Add thumbnail extraction ()
Authored by: alerikaisattera
github-actions 50ce204cc2
[version] update
Created by: pukkandan

:ci skip all
pukkandan ed40877833
Fix 426764371f for Py3.6
sian1468 935f5a4209
[line] Remove `tv.line.me` ()
Service is discontinued
Authored by: sian1468
pukkandan 6970b6005e
[cleanup] Minor fixes
Closes 
pukkandan fc5fa964c7
[docs] Improvements
pukkandan e0ddbd02bd
[cleanup] Use format_field where applicable
pukkandan 0bfc53d05c
List playlist thumbnails in `--list-thumbnails`
Ashish Gupta 78ab4f447c
[Newsy] Add extractor ()
Closes 
Authored by: Ashish0804
coletdjnz 85fee22152
[PRX] Add Extractors ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/15948

Authored by: coletdjnz
Felix S ad9158d5f4
[ard] Extract subtitles ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/30543, related: https://github.com/ytdl-org/youtube-dl/pull/17766
Authored by: fstirlitz
xtkoba f81c62a6a4
Add option --legacy-server-connect ()
to allow HTTPS connection to servers that do not support RFC 5746 secure renegotiation

Authored by: xtkoba
coletdjnz 6c73052c0a
[youtube] Extract channel subscriber count ()
Closes 
* Adds `channel_follower_count` field
Authored-by: coletdjnz
Ashish Gupta 593e43c030
[LnkIE] Add extractor ()
Closes:  
Authored by: Ashish0804
Ashish Gupta 8fe514d382
[CrowdBunker] Add extractors ()
Closes:  
Authored by: Ashish0804
pukkandan b1156c1e59
Fix d14cbdd92d
pukkandan 311b6615d8
[extractor] Improve `url_result` and related
coletdjnz 396a76f7bf
[youtube] Enforce UTC ()
and [utils] use `utcnow` in `datetime_from_str`

Related:  
Authored by: coletdjnz
coletdjnz 301d07fc4b
[youtube:tab] Extract channel banner ()
Closes 
Authored by: coletdjnz
pukkandan d14cbdd92d
[utils] Add `Sec-Fetch-Mode` to `std_headers`
Closes 
pukkandan 19b4c74d40
Revert d6579d532b
Closes , Reopens 
pukkandan 135dfa2c7e
[extractor,cleanup] Use `_search_nextjs_data`
MinePlayersPE e0585e6562
[TikTok] Extract captions ()
Closes 
Authored by: MinePlayersPE
MinePlayersPE 426764371f
[iq.com] Add extractors ()
Closes 
Authored by: MinePlayersPE
krichbanana 64f36541c9
[youtube:tab] Raise error on tab redirect ()
Closes 
Authored by: krichbanana, coletdjnz
Aleri Kaisattera 0ff1e0fba3
[Theta] Fix valid URL ()
Authored by: alerikaisattera
Zenon Mousmoulas 1a20d29552
[tvopengr] Add extractors ()
Authored by: zmousm
nyuszika7h f7085283e1
[instagram] Fix username extraction for stories and highlights ()
Authored by: nyuszika7h
Ashish Gupta e25ca9b017
[RTNews] Add extractor ()
Closes 
Authored by: Ashish0804
trasssh 4259402c56
[Ted] Rewrite extractor ()
Closes 
Authored by: pukkandan, trassshhub
Ashish Gupta dfb7f2a25d
[CTVNewsIE] Add fallback for video search ()
Closes 
Authored by: Ashish0804
Lesmiscore (Naoya Ozaki) 42c5458a02
[TVer] Extract message for unaired live ()
Closes 
Authored by: Lesmiscore
Lesmiscore (Naoya Ozaki) ba1c671d2e
[mixch] Add `MixchArchiveIE` ()
Closes 
Authored by: Lesmiscore
Zenon Mousmoulas b143e83ec9
[megatvcom] Add embed test ()
Authored by: zmousm
k3ns1n 4a77fb1d6b
[daftsex] Add extractors ()
Authored by: k3ns1n
pukkandan 66f7c6a3e0
[youtube] Do not return `upload_date` for playlists
Closes 
Partially reverts 
Re-opens 
pukkandan baf599effa
[pbs] de-prioritize AD formats
Related: 
pukkandan 8bd1c00bf3
[utils] Handle `ss:xxx` in `parse_duration`
Closes 
pukkandan 596379e260
[youtube] Make invalid storyboard URL non-fatal
Closes 
pukkandan b6ce9bb038
[youtube] Detect live-stream embeds
Closes 
Ashish Gupta eea1b0358e
[ThisOldHouseIE] Add support for premium videos ()
Authored by: Ashish0804
Closes: 
Zenon Mousmoulas 32b95bb643
[megatvcom] Add extractors ()
Authored by: zmousm
Zenon Mousmoulas fdf80059d9
[glomex] Minor fixes ()
Authored by: zmousm
Ashish Gupta aa062713c1
[PokerGo] Add extractors ()
Authored by: Ashish0804
Closes: 
Zenon Mousmoulas 71738b1451
[glomex] Add new extractors ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30212
Authored by: zmousm
pukkandan 0bb5ac1ac4
[dplay] Re-structure DiscoveryPlus extractors
Timendum 77b28f000a
[dplay] Migrate DiscoveryPlusItaly to DiscoveryPlus ()
Partially fixes 
Authored by: timendum
pukkandan d57576b9d9
[httpie] Fix `available` method
Closes 
trasssh 11c861702d
[generic] Improve KVS player extraction ()
Closes 
Authored by: trassshhub
Lesmiscore (The Hatsune Daishi) a4a426023d
[twitcasting] Refactor extractor ()
Co-authored-by: Ashish Gupta <39122144+Ashish0804@users.noreply.github.com>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>

Authored by: Lesmiscore
pukkandan 3b603dbdf1
Add option `--concat-playlist`
Closes , related: 
pukkandan 5df1ac92bd
[ffmpeg] Ignore unknown streams
Closes 
pukkandan b2db8102dc
[facebook] Fix extraction from groups
Closes , related: 
Hirokuni Yano e9a6a65a55
[yahoo:gyao] Improved playlist handling ()
Authored by: hyano
pukkandan ed8d87f911
[cleanup, docs] Minor fixes
Closes 
pukkandan 397235c52b
[ffmpeg] Standardize use of `-map 0`
Closes 
pukkandan 4636548463
[CeskaTelevize] Use `http` for manifests
Workaround for 
pukkandan cb3c5682ae
[kakao] Detect geo-restriction
Code from: d8085580f6
Petr Vaněk 7d449fff53
[streamcz] Fix extractor ()
Closes , closes 
Authored by: arkamar, pukkandan
pukkandan 80fa6e5327
[facebook] Improve title and uploader extraction
Closes , closes 
Lesmiscore (The Hatsune Daishi) fabb27fcea
[twitcasting] Throw proper error for login-only streams ()
Closes 

Authored by: Lesmiscore
pukkandan e04938ab88
Check for existing thumbnail/subtitle in final directory
Closes 
teridon 8bcd404818
[digitalconcerthall] Add extractor ()
Authored by: teridon
nixxo 0df11dafdd
[rai] Add Raiplaysound extractors ()
Closes 
Authored by: nixxo, pukkandan
pukkandan dc5f409cdc
Fix typo in ed5835b451
pukkandan 99d6f9461d
[aparat] Fix extractor
Closes 
pukkandan 8130779db6
Allow listing formats, thumbnails, subtitles using `--print` ()
Closes 
Authored by: pukkandan, Zirro
pukkandan ed5835b451
Allow `--print` to be run at any post-processing stage
trasssh e88e1febd8
[noodlemagazine] Add extractor ()
Authored by: trassshhub
trasssh faca674510
[Rule34video] Add extractor ()
Authored by: trassshhub
MinePlayersPE 0931ba94ab
[Nexx] Extract more metadata ()
Authored by: MinePlayersPE
pukkandan b31874334d
[tiktok] Extract user thumbnail
Closes 
Authored by: pukkandan, MinePlayersPE
pukkandan f1150b9e1e
[twitter] Fix video in quoted tweets
Closes 
pukkandan d6579d532b
[utils] Partially revert d76d15a669
Closes 
pukkandan 2be56f2242
[funk] Support origin URLs
Closes 
foghawk 62c955efc9
[veoh] Improve extractor ()
* [veoh] Remove old _extract_video
* [veoh] Extend _VALID_URL to accept '/videos/'
* [veoh] Prefer high quality
* [veoh] Extract more metadata

Authored by: foghawk
Zenon Mousmoulas 0254f16274
[utils] Improve `get_elements_text_and_html_by_attribute` regex ()
Authored by: zmousm, pukkandan
Ashish Gupta a70b71e85a
[vk] Fix VKUserVideosIE ()
Authored by: Ashish0804
Closes 
Unit 193 4c968755fc
[PornHub,YouTube] Refresh onion addresses ()
Authored by: unit193
MinePlayersPE be1f331f21
[TikTok] Misc fixes ()
Closes 
Authored by: MinePlayersPE
Ashish Gupta 3cf5429a21
Add EuropeanTourIE ()
Closes  
Authored by: Ashish0804
ischmidt20 bfa0e270cf
[NBCSports] Fix extraction of platform URLs ()
Authored by: ischmidt20
Luc Ritchie f76ca2dd56
[afreecatv] Add support for livestreams ()
Authored by: wlritchi
MinePlayersPE 5f969a78b0
[Nexx] Support 3q CDN ()
Closes 
Authored by: MinePlayersPE
ischmidt20 443f8de820
[fox] Extract m3u8 from preview ()
Authored by: ischmidt20
Moises Lima 768145d48a
[Pornez] Add extractor ()
Authored by: mozlima
pukkandan 976ae3eabb
[youtube] Update tests
coletdjnz f0d785d3ed
[youtube:tab] Extract more playlist metadata ()
* Add fields modified_date, modified_timestamp
* Add field playlist_count
* [youtube:tab] Extract view_count, playlist_count, modified_date

Authored by: coletdjnz, pukkandan
foghawk 97a6b117d9
[callin] Add extractor ()
Authored by: foghawk
Zenon Mousmoulas 6f32a0b5b7
[utils] Improve parsing for nested HTML elements ()
and add functions to return the HTML of elements

Authored by: zmousm
Aleri Kaisattera e8736539f3
[Vimm] Add extractor ()
Authored by: alerikaisattera
coletdjnz 9c634ef857
[MainStreaming] Add extractor ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/29615

Authored by: coletdjnz
coletdjnz 9f517bb1f3
[gfycat] Support embeds ()
Closes 
Authored by: coletdjnz
Lesmiscore (The Hatsune Daishi) b8eeced286
[openrec] Add movie extractor ()
Closes 
Authored by: Lesmiscore
Alexander Simon db47787024
[hrfernsehen] Fix ardloader extraction ()
Authored by: CreaValix
pukkandan fdeab99eab
[zee5] Add geo-bypass
pukkandan 9e907ebddf
[cleanup] Misc cleanup
pukkandan 21df2117e4
[vk] Capture `clip` URLs
pukkandan 06e57990f7
Allow multiple and nested configuration files
pukkandan b62fa6d75f
Fix `-s --ignore-no-formats --force-write-archive`
Bug in a13e684813
pukkandan be72c62480
Fix recursion error in f46e2f9d92
Closes 
pukkandan 61e9d9268c
Fix bug in 8896899216
Closes 
pukkandan a13e684813
Write `download_archive` only after all formats are downloaded
Closes 
pukkandan f46e2f9d92
Add key `requested_downloads` in the root `info_dict`
pukkandan 9c906919ae
Add field `video_autonumber`
Closes 
pukkandan 6020e05d23
Raise error if subtitle download fails
Closes 
pukkandan ebed8b3732
Add more post-processing stages
playlist = After entire playlist
after_video = After downloading all formats of a video
pukkandan 1e43a6f733
Allow `--exec` to be run at any post-processing stage
Deprecates `--exec-before-download`
pukkandan ca30f449a1
Add `--print playlist:` to print fields per playlist
k3ns1n af3cbd8782
[vk] Improve _VALID_URL ()
Authored by: k3ns1n
zenerdi0de 7141ced57d
[Dropbox] Support password protected files and more formats ()
Authored by: zenerdi0de
coletdjnz 18c7683d27
[youtube:api] Update Innertube clients ()
* Updated iOS clients to support 60fps formats (see: https://github.com/TeamNewPipe/NewPipeExtractor/issues/680#issuecomment-1002724558)
* General update of versions and keys of other clients
 Authored-by: coletdjnz
chris f5c2c2c9b0
[zdf] Add chapter extraction ()
Authored by: iw0nderhow
pukkandan 8896899216
[FfmpegMetadata] Allow setting metadata of individual streams
Closes 
pukkandan 1797b073ed
[utils] Use key `None` in `traverse_obj` to return as-is
pukkandan 4c922dd3fc
Fix live title for multiple formats
pukkandan b8e976a445
[facebook] Parse dash manifests
Ashish Gupta a9f5f5d6eb
[RedBullTV] Parse subtitles from manifest ()
Closes 
Authored by: Ashish0804
chris f522573787
[extractor] Extract chapters from JSON-LD ()
Authored by: iw0nderhow, pukkandan
nixxo 7592749cbe
[extractor] Extract thumbnails from JSON-LD ()
Authored by: nixxo
MinePlayersPE 8efffafa53
[XVideos] Check HLS formats ()
Closes 
Authored by; MinePlayersPE
Ashish Gupta 26f2aa3db9
[hotstar] Add extractor args to ignore tags ()
Authored by: Ashish0804
pgaig 3464a2727b
[VrtNU] Handle empty title ()
Closes 
Authored by: pgaig
Ashish Gupta 497d77e1aa
[KelbyOne] Add extractor ()
Closes 
Authored by: Ashish0804
LE 9040e2d6e3
[mixcloud] Detect restrictions ()
Authored by; llacb47
MinePlayersPE 6134fbeb65
[TikTok] Pass cookies to formats ()
Closes 
Authored by: MinePlayersPE
MinePlayersPE cfcf60ea99
[BiliIntl] Add login ()
and misc improvements

Authored by: MinePlayersPE
Felix S 4afa3ec4b6
[extractor] Detect more subtitle codecs in MPD manifests ()
Authored by: fstirlitz
MinePlayersPE 11aa91a12f
[TikTok] Fix extraction for sigi-based webpages ()
Fixes: 
Authored by: MinePlayersPE
pukkandan abbeeebc4c
[outtmpl] Alternate form for `D` and fix suffix's case
Fixes: https://github.com/yt-dlp/yt-dlp/issues/2085#issuecomment-1002247689, https://github.com/yt-dlp/yt-dlp/pull/2132/files#r775729811
pukkandan 2c539d493a
[cookies] Fix bug when keyring is unspecified
Closes 
pukkandan 042931a507
Allow escaped `,` in `--extractor-args`
Closes 
MinePlayersPE 96f13f01a6
[TikTok] Change app version ()
Closes , 
Authored by: MinePlayersPE, llacb47
u-spec-png 4b9353239e
[Drooble] Add extractor ()
Closes 
Authored by: u-spec-png
u-spec-png dd5e60b15d
[Instagram] Add story/highlight extractor ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/25575
Authored by: u-spec-png
MinePlayersPE e540c56f39
[TikTok] Fallback to feed API endpoint ()
Authored by: MinePlayersPE
Workaround for 
pukkandan 45d86abeb4
Allow unicode characters in `info.json`
Closes 
Pierre Mdawar f02d24d8d2
[utils] Fix `format_bytes` output for Bytes ()
Authored by: pukkandan, mdawar
pukkandan ceb98323f2
Don't treat empty containers as `None` in `sanitize_info`
pukkandan 7537e35b64
[gfycat] Fix `uploader`
github-actions 1e5c83b26b [version] update
Created by: pukkandan

:ci skip all
pukkandan 6a34813a0d
[docs] Add examples for using `TYPES:` in `-P`/`-o`
Matt Broadway f59f5ef8b6
[cookies] Support other keyrings ()
Authored by: mbway
pukkandan f44afb54ef
[aria2c] Don't show progress when `--no-progress`
pukkandan 77cee0f188
[EmbedThumbnail] Prefer AtomicParsley over ffmpeg if available
pukkandan 6a17677577
[ThumbnailsConvertor] Fix for when there are no thumbnails
Closes