Commit Graph

1435 Commits (d6bc443bdeb8d0246cef1c4b8b9206a18413dbca)

Author SHA1 Message Date
zenerdi0de 7141ced57d
[Dropbox] Support password protected files and more formats ()
Authored by: zenerdi0de
coletdjnz 18c7683d27
[youtube:api] Update Innertube clients ()
* Updated iOS clients to support 60fps formats (see: https://github.com/TeamNewPipe/NewPipeExtractor/issues/680#issuecomment-1002724558)
* General update of versions and keys of other clients
 Authored-by: coletdjnz
chris f5c2c2c9b0
[zdf] Add chapter extraction ()
Authored by: iw0nderhow
pukkandan 8896899216
[FfmpegMetadata] Allow setting metadata of individual streams
Closes 
pukkandan 1797b073ed
[utils] Use key `None` in `traverse_obj` to return as-is
pukkandan 4c922dd3fc
Fix live title for multiple formats
pukkandan b8e976a445
[facebook] Parse dash manifests
Ashish Gupta a9f5f5d6eb
[RedBullTV] Parse subtitles from manifest ()
Closes 
Authored by: Ashish0804
chris f522573787
[extractor] Extract chapters from JSON-LD ()
Authored by: iw0nderhow, pukkandan
nixxo 7592749cbe
[extractor] Extract thumbnails from JSON-LD ()
Authored by: nixxo
MinePlayersPE 8efffafa53
[XVideos] Check HLS formats ()
Closes 
Authored by; MinePlayersPE
Ashish Gupta 26f2aa3db9
[hotstar] Add extractor args to ignore tags ()
Authored by: Ashish0804
pgaig 3464a2727b
[VrtNU] Handle empty title ()
Closes 
Authored by: pgaig
Ashish Gupta 497d77e1aa
[KelbyOne] Add extractor ()
Closes 
Authored by: Ashish0804
LE 9040e2d6e3
[mixcloud] Detect restrictions ()
Authored by; llacb47
MinePlayersPE 6134fbeb65
[TikTok] Pass cookies to formats ()
Closes 
Authored by: MinePlayersPE
MinePlayersPE cfcf60ea99
[BiliIntl] Add login ()
and misc improvements

Authored by: MinePlayersPE
Felix S 4afa3ec4b6
[extractor] Detect more subtitle codecs in MPD manifests ()
Authored by: fstirlitz
MinePlayersPE 11aa91a12f
[TikTok] Fix extraction for sigi-based webpages ()
Fixes: 
Authored by: MinePlayersPE
pukkandan abbeeebc4c
[outtmpl] Alternate form for `D` and fix suffix's case
Fixes: https://github.com/yt-dlp/yt-dlp/issues/2085#issuecomment-1002247689, https://github.com/yt-dlp/yt-dlp/pull/2132/files#r775729811
pukkandan 2c539d493a
[cookies] Fix bug when keyring is unspecified
Closes 
pukkandan 042931a507
Allow escaped `,` in `--extractor-args`
Closes 
MinePlayersPE 96f13f01a6
[TikTok] Change app version ()
Closes , 
Authored by: MinePlayersPE, llacb47
u-spec-png 4b9353239e
[Drooble] Add extractor ()
Closes 
Authored by: u-spec-png
u-spec-png dd5e60b15d
[Instagram] Add story/highlight extractor ()
Fixes https://github.com/ytdl-org/youtube-dl/issues/25575
Authored by: u-spec-png
MinePlayersPE e540c56f39
[TikTok] Fallback to feed API endpoint ()
Authored by: MinePlayersPE
Workaround for 
pukkandan 45d86abeb4
Allow unicode characters in `info.json`
Closes 
Pierre Mdawar f02d24d8d2
[utils] Fix `format_bytes` output for Bytes ()
Authored by: pukkandan, mdawar
pukkandan ceb98323f2
Don't treat empty containers as `None` in `sanitize_info`
pukkandan 7537e35b64
[gfycat] Fix `uploader`
github-actions 1e5c83b26b [version] update
Created by: pukkandan

:ci skip all
pukkandan 6a34813a0d
[docs] Add examples for using `TYPES:` in `-P`/`-o`
Matt Broadway f59f5ef8b6
[cookies] Support other keyrings ()
Authored by: mbway
pukkandan f44afb54ef
[aria2c] Don't show progress when `--no-progress`
pukkandan 77cee0f188
[EmbedThumbnail] Prefer AtomicParsley over ffmpeg if available
pukkandan 6a17677577
[ThumbnailsConvertor] Fix for when there are no thumbnails
Closes 
Ashish Gupta ee7b9bdf5d [Zee5] Fix VALID_URL for tv-shows
pukkandan 185bf31070
[youtube] End `live-from-start` properly when stream ends with 403
Closes 
pukkandan 0b77924a38
[tiktok] Fix `extractor_key` used in archive
MinePlayersPE 8126298c1b
[TikTok] Add music, sticker and tag IEs ()
Closes 
Authored by: MinePlayersPE
pukkandan 6da22e7d4f
Avoid recursion error when re-extracting info
MinePlayersPE c62ecf0d90
[BiliIntl] Fix extractor ()
Closes 
Authored by: MinePlayersPE
The Hatsune Daishi 3774f4f427
[PixivSketch] Add extractors ()
Authored by: nao20010128nao
git-anony-mouse 9980d3d213
[generic] Fix HTTP KVS Player ()
Authored by: git-anony-mouse
pukkandan 8eb4b1bb8e
[ffmpeg] Fix position of `--ppa`
Bug in ca5db158ae
Closes 
pukkandan 332da56f52
[CBC] Fix URL regex
Closes 
github-actions 459aea84c3 [version] update
Created by: pukkandan

:ci skip all
pukkandan 0f86a1cd59
[dplay] Temporary fix for `discoveryplus.com/it`
Closes 
pukkandan 352d5da812
[utils] Improve `parse_count`
MinePlayersPE d43de6821c
[GameJolt] Add extractors ()
Authored by: MinePlayersPE
u-spec-png 070f6a85ea
[Steam] Fix extractor ()
Closes 
Authored by: u-spec-png
Benedikt Wildenhain 4b4b7f746c
[OpenCast] Add extractors ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/26934
Authored by: bwildenhain, C0D3D3V
Sonic e9efb99f66
[dropout] Add extractor ()
Authored-by: TwoThousandHedgehogs, pukkandan
coletdjnz a709d87335
[youtube:tab] Extract video thumbnails from playlist ()
closes 
Co-Authored-by: coletdjnz, pukkandan
siddharth 774a46c53d
[npr] Make SMIL extraction non-fatal ()
Closes 
Authored by: r5d
MinePlayersPE c8b80b9643
[RCTIPlusSeries] Lazy extraction and video type selection ()
Authored by: MinePlayersPE
MinePlayersPE 4e260d1a56
[Instagram] Try bypassing login wall with embed page ()
Authored by: MinePlayersPE
Luc Ritchie 4f3fa23e5a
[utils] Fix parsing `YYYYMMDD` dates in Nov/Dec ()
The date format `%Y%m%d%H%M` will successfully match against
one-digit month, day, hour, and minute strings, even though %m et al.
are documented as being zero-padded. So dates without time in
Nov/Dec may be wrongly parsed as dates in January with time.

This commit adds a format string of `%Y%m%d` to our supported date
format strings directly below (higher priority) its problematic relatives.

Closes 
Authored by: wlritchi
pukkandan b28bac93ab
Fix bug in 1cefca9e44
Fixes https://github.com/ytdl-patched/ytdl-patched/issues/11
pukkandan 37893bb0c9
[outtmpl] Change filename sanitization type to `S`
`F` is already used for float!
Bug in e0fd95737d
Ashish Gupta c25de59cf7
[LBRY] Support livestreams ()
Closes  
Authored by: Ashish0804, pukkandan
Emanuel Hoogeveen 205a0654c0
Add option `--file-access-retries` ()
Closes 
Authored by: ehoogeveen-medweb
aarubui 663949f825
[NJPWWorld] Extract formats from m3u8 ()
Authored by: aarubui
pukkandan b69fd25c25
[cleanup] Misc cleanup
Closes     
pukkandan e0fd95737d
[outtmpl] Add alternate forms `F`, `D`
and improve `id` detection

F = sanitize as filename (# = restricted)
D = add Decimal suffixes

Closes , 2081
pukkandan 4ac5b94807
[dash] Fix `--test`
Bug in adbc4ec4bb
pukkandan 4273cc776d
[dash] Fix aria2c dash downloads
Bug in adbc4ec4bb
pukkandan fa9f30b802
Add interactive format selection with `-f -`
Closes 
pukkandan 1cefca9e44
Add warning when using `-f best`
kebianizao 5edb8dfec2
[rtve] Add `RTVEAudioIE` ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29023
Authored by: kebianizao
The Hatsune Daishi adbc4ec4bb
[dash,youtube] Download live from start to end ()
* Add option `--live-from-start` to enable downloading live videos from start
* Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start
* [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments
* [fragment] Allow multiple live dash formats to download simultaneously
* [youtube] Implement fragment re-fetching for the live dash formats
* [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs)
* [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms

Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats

Closes 
Authored by: nao20010128nao, pukkandan
Julien Hadley Jack c031b0414c
[ondemandkorea] Update `jw_config` regex ()
Authored by: julien-hadleyjack
coletdjnz f3aa3c3f98
[youtube:tab] Extract more metadata from feeds/channels/playlists ()
Parse relative time text, extract live, upcoming status, availability and channel id from feeds/channels/playlists (where applicable). 
Closes 
Authored-by: coletdjnz
cypheron ae43a4b986
[hse] Add extractors ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/27060
Authored by: cypheron, pukkandan
pukkandan ca5db158ae
[postprocessor/ffmpeg] Always add `faststart`
Closes 
pukkandan 5f549d4959
[Facebook] Handle redirect URLs
Closes 
Paul Wise 6839d02cb6
[ABC:iview] Add show extractor ()
Authored by: pabs3
Abdullah Ibn Fulan 2aae2c91ff
[audiomack] Update album and song VALID_URL ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29810
Closes , https://github.com/ytdl-org/youtube-dl/issues/29800
Authored by: abdullah-if, dirkf
Lapinot c2dedf12e8
[soundcloud] Add related tracks extractor ()
Authored by: Lapin0t
Unit 193 e75bb0d6c3
[cleanup] Fix some typos ()
Authored by: unit193
pukkandan dd0228ce1f
Remove known invalid thumbnails from `info_dict`
Related: https://github.com/yt-dlp/yt-dlp/issues/980#issuecomment-997396821
pukkandan 37e57a9fd4
[youtube:tab] Ignore query when redirecting channel to playlist
and cleanup of related code
Closes 
pukkandan 940a67a3e2
[docs] Change all examples to use double quotes
to be platform-agnostic
pukkandan e6ae51c123
[generic] Extract m3u8 formats from JSON-LD
pukkandan aab41cdd33
[PlutoTV] Expand `_VALID_URL`
Closes 
pukkandan b3a5115ff1
[zee5] Support /episodes in URL
Closes 
Felix S d76d15a669
[utils] Update `std_headers` ()
* Update our chrome versions used for `User-Agent`s
* Drop the `Accept-Charset` header that no browser emits any more

Authored by: kikuyan, fstirlitz
PilzAdam e978789f0f
[outtmpl] Add operator `&` for replacement text ()
Authored by: PilzAdam
Sematre 375d9360bf
[gronkh] Support new URL pattern ()
Authored by: Sematre
Zenon Mousmoulas d5c3254889
[extractor] Support default implicit graph in JSON-LD ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30229

Per W3C JSON-LD v1.1 §4.9 (non-normative ref):

    When a JSON-LD document's top-level structure is a map that contains
    no other keys than @graph and optionally @context (properties that
    are not mapped to an IRI or a keyword are ignored), @graph is
    considered to express the otherwise implicit default graph.

Authored by: zmousm
std-move fe69f52e5c
[NovaEmbed] update player regex ()
Authored by: std-move
pukkandan 3116be32b4
[brightcove] Fix 487c5b3389
pukkandan a8549f19e7
[tiktok] Fix 53dad39e30
pukkandan 39ca3b5c7f
[extractor] Standardize `_live_title`
coletdjnz 46383212b3
[youtube:comments] Add more options for limiting number of comments extracted ()
Extends `max_comments` extractor arg to support `max-parents,max-replies,max-replies-per-thread`.
Authored-by: coletdjnz
pukkandan 0bb322b9c0
Add field `webpage_url_domain`
Closes 
pukkandan ff9f925b63
[test/download] Add more fields
pukkandan 5bfc8bee5a
Fix PostProcessor hooks not registered for some PPs
Closes 
pukkandan 19188702ef
[FormatSort] Prevent incorrect deprecation warning
Closes 
The Hatsune Daishi d984a98def
[ok.ru] add mobile fallback ()
Authored by: nao20010128nao
u-spec-png 069c6ccf02
[olympics] Add uploader and cleanup ()
Authored by: u-spec-png
MinePlayersPE 53dad39e30
[TikTok] Pass cookies to mobile API ()
Authored by: MinePlayersPE
Ashish Gupta db77c49c84
[SonyLiv] Add OTP login support ()
Closes 
Authored by: Ashish0804
Ashish Gupta abc07b554c
[NateTV] Add NateIE and NateProgramIE ()
Authored by: Ashish0804, Hyeeji
Ashish Gupta 86f3d52f8c [DiscoveryPlusShowBaseIE] yield actual video id
u-spec-png 8b688881ba
[instagram] Expand valid URL ()
Closes 

Authored by: u-spec-png
Ashish Gupta 13debc86e7
[Rutube] Add RutubeChannelIE ()
Closes  
Authored by: Ashish0804
nyuszika7h b5f94e4fa1
[toggo] Add extractor ()
Authored by: nyuszika7h
YuenSzeHong 61882afdc5
[fujitv] Extract 1080p from `tv_android` m3u8 ()
Authored by: YuenSzeHong
coletdjnz aa4b054512
[web.archive:youtube] Improve metadata extraction ()
Authored-by: coletdjnz
YuenSzeHong 487c5b3389
[TVer] Extract better thumbnails ()
Authored by: YuenSzeHong
Nil Admirari 8157a09d22
[SponsorBlock] Add Filler and Highlight categories ()
Authored by: nihil-admirari, pukkandan
Jertzukka b1aaf1c07f
[gofile] Add extractor ()
Closes  
Authored by: Jertzukka, Ashish0804
chris 5f9aaac8c2
[zdf] Support videos with different ptmd location ()
Authored by: iw0nderhow
David Skrundz 54c2521ca6
[CBC Gem] Extract 1080p formats ()
Authored by: DavidSkrundz
The Hatsune Daishi 2814f12ba4
[skeb] Add extractor ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30287
Authored by: nao20010128nao
raleeper 1619836cb7
[crackle] Look for non-DRM formats ()
Authored by: raleeper
pukkandan e3c7d49571
[compat] Suppress errors in enabling VT mode
Closes 
The Hatsune Daishi ddd24c9949
[ntvcojp] Extract NUXT data ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30309
Authored by: nao20010128nao
Michal Kubeček 443b21dc4e
[ceskatelevize] Fetch iframe from nextJS data ()
Closes 
Authored by: mkubecek
The Hatsune Daishi 66f4c04e50
[extractor] Add `_search_nuxt_data` ()
Authored by: nao20010128nao
nixxo 93864403ea
[redtube] Handle formats delivered inside a JSON ()
Closes 
Authored by: dirkf, nixxo
pukkandan b5475f1145
Pre-process when using `--flat-playlist`
pukkandan 38d79fd16c
Use `parse_duration` for `--wait-for-video`
and some minor fix
pukkandan acc0d6a411
Allow `--no-write-thumbnail` to override `--write-all-thumbnail`
Closes 
pukkandan 146cc4114a
bugfix for 63ccf4ff1a
pukkandan 818faa3a86
[vimeo] Extract chapters
Closes 
MinePlayersPE aa5ecf082c
[TrueID] Add extractor ()
Authored by: MinePlayersPE
pukkandan d2b2fca53f
[extractor] Ignore errors in comment extraction when `-i` is given
Closes 
pukkandan 63ccf4ff1a
[lazy_extractors] Fix bug in 2c4aaaddc9
SearchIEs must not inherit from extractors that have a _VALID_URL defined
pukkandan 43b2290658
Fix `--throttled-rate`
nixxo 99148c6a33
[RaiNews] Fix extractor ()
Closes 
Authored by: nixxo
pukkandan 9bdd99cf39
[EmbedSubtitle] Disable duration check temporarily
Closes , 
pukkandan 2c4aaaddc9
[lazy_extractors] Fix for search IEs
Closes 
pukkandan 5f7cb91ae9
[youtube] Fix `ytsearchdate`
Related: 
pukkandan 3efb96a6d1
Fix control characters being printed to `--console-title`
Closes 
pukkandan 3262f8abf2
[trovo] Fix inheritance of `TrovoChannelBaseIE`
Closes 
Christian Paul bdbafb3913
[Jamendo] Fix use of `_VALID_URL_RE` ()
Closes 
Authored by: jaller94
pukkandan a804f6d89c
[cleanup Fix some typos
* `MetadataFromFieldPP` is not deprecated!
* Wrong args to `MetadataFromFieldPP`
* Some mistakes in change log
* Type in build.yml causing release tag to be placed on wrong commit
github-actions 814dfb7e25 [version] update
Created by: pukkandan

:ci skip all
pukkandan 91f071af60
Release 2021.12.01
pukkandan 2aa5e2cc01
Ensure same config file is not loaded multiple times
j54vc1bk 1bad50eced
[CableAV] Add extractor ()
Authored by: j54vc1bk
u-spec-png ac0efabf12
[Bilibili] Fix title extraction ()
Closes 
Authored by: u-spec-png
Ashish Gupta 73f035e1fe
[Cleanup] Remove some unnecessary groups in regexes ()
Authored by: Ashish0804
nyuszika7h 0cbed930c8
[trovo] Fix extractor ()
Closes 

Authored by: nyuszika7h
Ashish Gupta 5118d2ec58
[DiscoveryPlus] Rewrite extractors (see desc) ()
* Add `DiscoveryPlusItalyShowIE`
* Use `uuid.uuid4().hex` for device id so no cookies are required
* Fix dash formats not being downloaded
* Extract subtitles from manifests
* Move all extractors to one file and restructure inheritances

Authored by: Ashish0804, pukkandan
pukkandan 717216b093
Validate --get-bypass-country
Closes 
pukkandan 5c22c63da3
Fix `--trim-filename` when filename has `.`
Closes 
pukkandan ee8dd27a73
[cleanup] Add deprecation warnings
pukkandan f304da8a29
[cleanup] Misc cleanup
Closes , closes 
pukkandan 06dfe0a0a2
[cleanup] Refactor `JSInterpreter._seperate`
pukkandan 75b725a7cc
[build] Use `workflow_dispatch` for release
pukkandan 36eaf3039a
[build] Save Git HEAD at release alongside version info
pukkandan f2ebc5c7be
Option `--wait-for-video` to wait for scheduled streams
pukkandan b222c27145
Option `--break-per-input` to apply --break-on... to each input URL
pukkandan 5e5be0c0b2
Fix --break-on-archive when pre-checking
pukkandan 7578d77d8c
[downloader] Add colors to download progress
pukkandan b29165267f
[youtube] Decrypt n-sig for URLs with `ratebypass`
Closes 
pukkandan bc104778d6
[vimeo] Sort http formats higher
Closes 
MinePlayersPE d298d33fe6
[Instagram] Display more login errors ()
Authored by: MinePlayersPE
Deer-Spangle bf57cfa8b7
[RedGifs] Add Search and User extractors ()
Authored by: Deer-Spangle
std-move 3c2208f82d
[NovaEmbed] Fix extractor ()
Authored by: std-move
shirt 93e597ba28
Fix logic error in report_unplayable_conflict
pukkandan b28cdcc0e4
[tiktok:user] Set `webpage_url` correctly
Closes 
DEvmIb a33c0d9c5d
[twitch:vod] Extract live status ()
Authored by: DEvmIb
pukkandan 75689fe59b
Ensure directory exists when checking formats
pukkandan 5ce1d13eba
[EmbedSubtitles] Slightly relax duration check
and related cleanup
Closes 
pukkandan e04b003e64
[FixupM3u8] Fixup MPEG-TS in MP4 container
Closes , https://github.com/ytdl-org/youtube-dl/issues/26410
Grabien 909b0d66f4
[Senate.gov] Add SenateGovIE and fix SenateISVPIE ()
Authored by: Grabien, pukkandan
u-spec-png dfd78699f5
[Aljazeera] Fix extractor ()
Closes 
Authored by: u-spec-png
mpeter50 639f80c1f9
[Twitch:vod] Add chapters ()
Authored by: mpeter50
gustaf 896a88c5c6
[Tvplayhome] Fix extractor ()
Authored by: pukkandan, 18928172992817182 (gustaf)
chio0hai 4e4ba1d75f
[redgifs] Add extractor ()
Closes 
Authored by: chio0hai
Yakabuff 2abf081554
[xvideos] Fix extractor ()
Closes  
Authored by: Yakabuff
Henrik Heimbuerger 359df0fc42
[nebula] Add NebulaCollectionIE and rewrite extractor ()
Closes 
Authored by: hheimbuerger
Ashish Gupta 3938a9212c
[CPTwentyFour] Add extractor ()
Closes 
Authored by: Ashish0804
shirt cf1f13b817
[generic] Support mpd manifests without extension ()
Authored by: shirt-dev
Grabien 18d6dd4e01
[extractor/breitbart] Breitbart.com website support ()
Authored by: Grabien
cntrl-s 883ecd5494
Streamff extractor ()
Closes  
Authored by: cntrl-s
pukkandan eb56d132d2
[cleanup,instagram] Refactor extractors
Closes 
Aurora 17b4540662
[radiozet] Add extractor ()
Authored by: 0xA7404A (Aurora)
Tim da27aeea5c
[ITV] Fix extractor ()
Closes 
Authored by: staubichsauger
Sipherdrakon fec41d17a5
[MTV] Improve mgid extraction ()
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30149
Fixes: , , https://github.com/ytdl-org/youtube-dl/issues/30139

Authored by: Sipherdrakon, kikuyan
pukkandan a61fd4cf6f
[youtube:search_url] Add playlist/channel support
Closes , 
pukkandan a6213a4925
[cleanup,youtube] Reorganize Tab and Search extractor inheritances
pukkandan 9941a1e127
[PatreonUser] Do not capture RSS URLs
Closes 
pukkandan ff51ed588f
Clarify video/audio-only formats in -F
Related: 
pukkandan 57dbe8077f
[jsinterp] Fix splice to handle float
Needed for new youtube js player f1ca6900
Closes 
pukkandan e5d731f35d
[tv2] Expand valid URL
Closes 
pukkandan d52cd2f5cd
[sbs] Fix for movies and livestreams
Closes 
pukkandan bc8ab44ea0
[itv] Fix for Python 3.6/3.7
Closes 
pukkandan 8f122fa070
[extractor] Extract `average_rating` from JSON-LD
Eg: Crunchyroll
pukkandan 14a086058a
[ARDBetaMediathek] Handle new URLs
Adapted from 8562218350
Closes 
Zirro 0e6b018a10
Ensure path for link files exists ()
Authored by: Zirro
pukkandan f7b558df4d
[mediaklikk] Expand valid URL
Partial fix for 
pukkandan 1ee34c76bb
[vimeo] Add fallback for config URL
Closes 
pukkandan 234416e4bf
[downloader/ffmpeg] Fix for direct videos inside mpd manifests
Closes 
pukkandan c98d4df23b
[WDR] Expand valid URL
Closes 
4a1e2y5 849d699a8b
[xvideos] Detect embed URLs ()
Authored by: 4a1e2y5