Commit Graph

2086 Commits (2aab569f1c4c0c5b991a4ad50913d82fd04b3d26)

Author SHA1 Message Date
ping 14c3a98049
[extractor/naver] Add `navernow` extractor ()
Authored by: ping
Elyse e0a4a3d5bf
[extractor/freetv] Add extractor ()
Closes 
Authored by: elyse0
Elyse 62b2b736e7
[extractor/zdf] Improve format sorting ()
Closes 

Authored by: elyse0
Lesmiscore 6837633a4a
[extractor/tver] Fix extractor ()
Authored by: Lesmiscore
coletdev 2ae778b8fc
[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args ()
Allows user to override Innertube API host or key for all requests
Authored by: coletdjnz
Ashish Gupta c82a4a8fce
[extractor/atscaleconfevent] Add extractor ()
Closes 
Authored by: Ashish0804
vkorablin 6e7c9201cd
[extractor/ccc] Extract view_count ()
Authored by: vkorablin
Angel Toloza bde0132e15
[extractor/southpark] Add `southpark.lat` extractor ()
Authored by: darkxex
pukkandan 233ad894d3
[update] Use `.git` folder to distinguish `source`/`unknown`
This is not perfect, but is good enough for how we use this information

Closes 
Daniel Lindholm 0d6bafbfa7
[expressen] Fix extractor ()
Authored by: aejdl
MMM 36195c4461
[dash] Show fragment count with `--live-from-start` ()
Authored by: flashdagger
coletdjnz 65141660ab
[extractor/youtube] Fix bug in b7c47b7438
Closes 

Authored by: coletdjnz
Christoph Moench-Tegeder dec30912a7
[cookies] Detect profiles for cygwin/BSD ()
Closes 
Authored by: moench-tegeder
pukkandan 5ec1b6b716
Add option `--download-sections` to download video partially
Closes , Closes 
pukkandan e0ab98541c
[ExtractAudio] Allow conditional conversion
Closes 
pukkandan 35faefee5d
[ExtractAudio, cleanup] Refactor
pukkandan b7c47b7438
[extractor] Add `_search_json`
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
pukkandan 00bbc5f177
[ThumbnailsConvertor] Allow conditional conversion
Closes 
Lesmiscore 0bea4fd807
[extractor/0000studio] Add extractors ()
Authored by: Lesmiscore
ischmidt20 b5770743fe
[extractor/espn] Add `WatchESPN` extractor ()
Authored by: ischmidt20, pukkandan
pukkandan 1890fc6389
[cleanup] Misc fixes
Cherry-picks from: , 
Related: , https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
pukkandan c4910024f3
[extractor] Fix bug in 617f658b7e
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only

Closes 
coletdev c7a7baaa13
[extractor/youtube] Fix `:ytnotifications` extractor ()
Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775

Authored by: coletdjnz
siddharth ravikumar e50c3500b4
[extractor/npr] Use stream url from json-ld ()
Closes 
Authored by: r5d
pukkandan 09d02ea429
[extractor] Fix bug in f95b9dee45
Closes 
sqrtNOT ac05fb9338
[extractor/niconico:series] Fix extractor ()
Authored by: sqrtNOT
pukkandan 28786529dc
[extractor/dropout] Login is not mandatory
Workaround for 
pukkandan 6b0b0a289a
[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries`
pukkandan f95b9dee45
[extractor] Add dev option `--load-pages`
pukkandan 617f658b7e
[extractor, cleanup] Refactor `_download_...` methods
pukkandan 8a7f6d7a15
Do not print progress to `stderr` with `-q`
It is arguable how this "should" behave, but since progress is always
written to stdout in older yt-dl/p, we should keep it as-is

Bug in cf4f42cb97
Closes 
Lesmiscore 9c0412cf6b
[extractor/vevo] Fix extractor ()
Authored by: Lesmiscore
gamer191 84131d0351
[extractor/animelab] Remove extractor ()
https://www.animelab.com/sunset

Authored by: gamer191
Lesmiscore 1cd6cba306
[extractor/PokemonSoundLibrary] Remove extractor ()
Authored by: Lesmiscore
Lesmiscore 661e7253a2
[extractor/iwara:user] Make paging better ()
Authored by: Lesmiscore
Lesmiscore 222a230871
[extractor/common] Recognize `src` attribute from HTML5 media elements ()
Authored by: Lesmiscore
coletdjnz ee27297f82
[extractor/youtube] Fix initial player response extraction
Authored by: pukkandan, coletdjnz
Stefan Borer ee164987c7
[extractor/playsuisse] Add extractor ()
Authored by: sbor23, pukkandan
pukkandan 0fe51254cb
[extractor/youtube] Bring back `_extract_chapters_from_description`
Closes 
pukkandan 52023f1291
[extractor/youtube] Make signature extraction non-fatal
and reduce verbosity of it's warning

Closes 
mozbugbox 5bbe631e04
[extractor/duboku] Fix for hostname change ()
Authored by: mozbugbox
coletdev 2c6dcb65fb
[utils] Send HTTP/1.1 ALPN extension ()
Some servers may reject requests if not sent (e.g. fingerprinting)

Fixes 

Authored by: coletdjnz
miseran 520876fa09
[extractor/zattoo] Fix live streams ()
Authored by: miseran
pukkandan 0bf9dc1e35
Fix bug in 8a82af3511
pukkandan 829bbd1d05
[youtube] Add warning for PostLiveDvr
Closes , Related 
pukkandan 8a82af3511
[cleanup] Misc fixes and cleanup
Closes , Closes , Closes 
pukkandan 8246f8402b
[spotify:show] Fix extractor
Closes 
pukkandan 6b9e832db7
`--config-location -` to provide options interactively
monnef d2ff2c91bb
[curiositystream] Get `auth_token` from cookie ()
Closes 
Authored by: mnn
m4tu4g 7879e79d11
[bloomberg] Change playback endpoint ()
Closes 
Authored by: m4tu4g
Lesmiscore 8a3e7b1c95
[yahoo:gyao] Fix extractor
This fixes 400 error for /title/ URLs.
pukkandan d9473db78a
[ModifyChapters] Fix repeated removal of small segments
Closes 
pukkandan 11233f2afd
[downloader, cleanup] Refactor `report_progress`
Closes 
pukkandan 3a85e9cee9
[ffmpeg] Check version lazily
Closes 
pukkandan c4a62b99f6
Fix bug in 23326151c4
pukkandan b5899f4f19
[build, cleanup] Refactor
Closes , 
Felix S 92922fe7f9
[rumble] Extract subtitles ()
Closes 
Authored by: fstirlitz
pukkandan c487cf0010
[cleanup] Misc
pukkandan 415f8d51a8
Ensure pre-processor errors do not block video download
Closes 
pukkandan ca6d59d2c1
Fix `--simulate --max-downloads`
Bug in c3e6ffba53
Closes 
pukkandan 1a8cc83735
Bugfix for 3a408f9d19
pukkandan 2762dbb17e
[compat] Add `functools.cached_property`
pukkandan 666c36d58d
Bugfix for 23326151c4
adamanldo 854b0d325e
[StreamCZ] Fix extractor ()
Closes 
Authored by: dirkf, adamanldo
Elyse 79c318937b
[ina] Fix extractor ()
Closes 
Authored by: elyse0
Jeff Huffman 88d62206b4
[crunchyroll:beta] Fix extractor after API change ()
Closes 
Authored by: Burve, tejing1
pukkandan e79969b242
Return an error code if update fails
Closes 
pukkandan 53973b4d2c
[utils] Fix bug in 0b9c08b47b
* Cache of `supports_terminal_sequences` must be reset after enabling VT mode
* and move `windows_enable_vt_mode` to utils to avoid cyclic imports
pukkandan b801cd7179
[tiktok] Detect embeds
Closes 
pukkandan 0b9c08b47b
[utils] Improve performance using `functools.cache`
Closes 
pukkandan 2f97cc615b
[utils] `ISO3166Utils`: Add `EU` and `AP`
Fixes https://github.com/yt-dlp/yt-dlp/pull/3302#discussion_r875528517
pukkandan 2dd5a2e3a1
[doc, cleanup] Re-indent "Usage and Options" section
pukkandan 23326151c4
Add option --retry-sleep ()
Closes 
pukkandan 9e49146352
Add option `--alias`
github-actions 926ccc84ef [version] update
Created by: pukkandan

:ci skip all
pukkandan 21633673c3
[cleanup] Minor fixes
pukkandan 80e8493ee7
[utils] `is_html`: Handle double BOM
Closes 
pukkandan aedaa455d9
[vimeo] Fix extractors
Closes , Closes , Closes , Closes 
May also fix , 
pukkandan d6bf1161db
[generic] Refactor `_extract_rss`
Closes 
pukkandan 7896214c42
Bugfix for 591bb9d355
Closes 
pukkandan 5792c950bf
[compat] Implement `compat.imghdr`
Python 3.11 deprecates `imghdr` module
pukkandan 591bb9d355
Fix color in `-q -F`
and convert `ydl._out_files`/`ydl._allow_colors` to `Namespace`

Closes 
coletdjnz 5faf6528fb
[http] Fix bug in retrying on read timeout in py < 3.10
socket.timeout is not an alias of TimeoutError in py < 3.10
Fixes bug in a2e77303e3
Authored-by: coletdjnz
pukkandan 0fa7d2c8e4
Bugfix for 2414649192
pukkandan b2a2d91310
[adobepass] Allow cookies for authenticating MSO
Possible workaround for 
pukkandan 490110c543
`--max-downloads` should obey `--break-per-input`
pukkandan 2414649192
[cleanup] Misc cleanup
pukkandan 5d5c0f7e99
[Hotstar] Bugfix for a1ddaa899c
Closes 
Dzmitry Neviadomski 3ac7b66047
[goodgame] Add extractor ()
Authored by: nevack
P-reducible c9b2b368b3
[rokfin:search] Add extractor ()
Authored by: P-reducible, pukkandan
pukkandan e037c405ad
[rokfin] Implement login ()
Authored by: P-reducible, pukkandan
Conner 4bf72cc1c9
[Podchaser] Add extractors ()
Authored by; connercsbn
Elyse 25f0e68f97
[wat] Fix extraction of multi-language videos and subtitles ()
Closes , closes 
Authored by: elyse0
Elyse 3358f89361
[adn] Update AES key ()
Closes 
Authored by: elyse0
Henrik Heimbuerger f3b3fe16af
[nebula] Add support for subscriptions ()
Closes  
Authored by: hheimbuerger
Jordan Weatherby d1c4f6d4da
[youtube] Added piped instance urls ()
Closes 
Authored by: JordanWeatherby
pukkandan 82d020804d
[extractor] Use classmethod/property where possible
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
Filip Hedman 7ddbf09c25
[DRTV] Improve `_VALID_URL` ()
Authored by: vertan
pukkandan 2e4585da92
[cookies] Throttle progress-bar
Closes 
pukkandan 8dcce6a89c
[extractor] Document netrc machines
Closes 
pukkandan 494f52308b
[FixupM3u8] Obey `--hls-prefer-mpegts`
Closes 
pukkandan 3d38b2d6d0
Fix `--date today`
Closes 
pukkandan 3a408f9d19
Show name of downloader in verbose log
Closes 
pukkandan d76fa1f3d4
[cookies] Allow `cookiefile` to be a text stream
Closes 
pukkandan fe1daad3cb
Bugfix for 59f943cd50
Fixes: 59f943cd50 (commitcomment-73251597)
pukkandan 0f06bcd759
[cleanup] Minor fixes (See desc)
* [youtube] Fix `--youtube-skip-dash-manifest`
* [build] Use `$()` in `Makefile`. Closes 
* Fix bug in 385ffb467b
* Fix bug in 43d7f5a5d0
* [cleanup] Remove unnecessary `utf-8` from `str.encode`/`bytes.decode`
* [utils] LazyList: Expose unnecessarily "protected" attributes
and other minor cleanup
ca-za d239db0306
[toggo] Improve `_VALID_URL` ()
Authored by: ca-za
pukkandan 385ffb467b
[wistia] Fix `_VALID_URL`
Closes 
Authored by: dirkf
Evan Spensley 5f8ea7e0d8
[Jamendo] Extract more metadata ()
Authored by: evansp
pukkandan d7a1aa00c6
Run `FFmpegFixupM3u8PP` for live-streams if needed
Closes 
MMM 5747d4f4e8
[kaltura] Update API calls ()
Authored by: flashdagger
Lesmiscore 1f8b4ab733
[radiko] Fix extractor ()
Authored by: Lesmiscore
pukkandan d4736fdb43
Remove warning for videos with an empty title
pukkandan 895aeb71d7
[toggo] Fix `_VALID_URL`
Closes 
pukkandan 4f28b537d9
Allow use of weaker ciphers with `--legacy-server-connect`
Closes 
pukkandan 6b70527f9d
[cleanup, zingmp3] Refactor extractors
Teemu Ikonen a0fe51d562
[ruutu] Support hs.fi embeds ()
Authored by: tpikonen, pukkandan
diegorodriguezv bd18c5d170
[cleanup, tmz] Update tests ()
Authored by: diegorodriguezv
Ha Tien Loi 54044decd0
[ZingMp3] Add chart and user extractors ()
Authored by: hatienl0i261299
Ha Tien Loi 89f383c4ee
[gronkh] Add playlist extractors ()
Closes 
Authored by: hatienl0i261299
pukkandan 91e5e839d3
[youtube] Deprioritize format 22
Reduces chance of encountering 
FestplattenSchnitzel 10fa2471fc
[VideocampusSachsen] Improve extractor ()
Authored by: FestplattenSchnitzel
i6t ff4d7860d5
[iwara] Add playlist extractors ()
Authored by: i6t
rand-net 4f7a98c565
[KhanAcademy] Fix extractor ()
Authored by: rand-net
Lesmiscore b58f8d8f2c
[TVer] Improve extraction ()
Authored by: Lesmiscore
Ha Tien Loi f963b7ab18
[Likee] Add extractor ()
Closes 
Authored by: hatienl0i261299
pukkandan 86925f6334
[Fifa] Sort formats
Closes 
m4tu4g 468f104ce7
[masters] Add extractor ()
Closes 
Authored by: m4tu4g
Bricio cbc6ee10da
[Fifa] Add Extractor ()
Closes 
Authored by: Bricio
nyuszika7h 6ef5ad9e29
[trovo] Update to new API ()
Closes 
Authored by: nyuszika7h
coletdev bb58c9ed5c
Add support for SSL client certificate authentication ()
Adds `--client-certificate`, `--client-certificate-key`, `--client-certificate-password`

Authored-by: coletdjnz
Co-authored-by: df <fieldhouse@gmx.net>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
coletdev afac4caa7d
Fix redirect HTTP method handling ()
Authored by: coletdjnz
HE7086 b4f536626a
[BilibiliLive] Add extractor ()
Authored by: HE7086, pukkandan
felix e4fa34a13e
[hls] Fix unapplied byte_range for EXT-X-MAP fragment
Cherry-picked from 
Authored by: fstirlitz
Marwen Dallel 1a7cd9c487
[LCI] Fix extractor ()
Authored by: MarwenDallel
Justin Keogh 131e14dc66
[utils] `locked_file`: Ignore illegal seek on `truncate` ()
Closes 

Authored by: jakeogh
coletdev 6e634cbe42
[youtube] Add YoutubeStoriesIE ()
Get channel stories with `ytstories:<channel UCID>`

Authored-by: coletdjnz
pukkandan 3fe75fdc80
[cleanup] Misc fixes (see desc)
* Do not warn when fixup is skipped for existing file
* [fragment] Fix `--skip-unavailable-fragments` for HTTP Errors
* [utils] write_string: Fix bug in 59f943cd50
* [utils] parse_codecs: Subtitle codec is generally referred to as `scodec`. https://github.com/yt-dlp/yt-dlp/pull/2174#discussion_r790156048
* [docs] Remove note about permissions. Closes 
pukkandan 6f7563beb7
[XAttrMetadata] Refactor and document dependencies
pukkandan 43d7f5a5d0
[EmbedThumbnail] Do not obey `-k`
Lesmiscore 94aa064497
[utils] YoutubeDLCookieJar: Detect and reject JSON file ()
Authored by: Lesmiscore
pukkandan 07689fc149
[reddit] Prevent infinite loop
Closes 
pukkandan bfec31bec8
[youtube] De-prioritize auto-generated thumbnails
Closes 
pukkandan 1d485a1a79
[cleanup] Misc fixes
Closes , https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364
pukkandan 0a41f331cc
[doc] Minor improvements
Closes , Closes 
pukkandan 492272fed6
`--match-filter -` to interactively ask for each video
pukkandan 59f943cd50
[utils] `write_string`: Workaround newline issue in `conhost`
On windows `conhost`, when `WINDOWS_VT_MODE` is enabled, `\n` is not
actually sent if the window is exactly the length of printed line,
and the line does not end with a white-space character. So the
line-break disappears when resizing the window.

Fixes 
pukkandan 0a5a191a2a
Improve `--clean-infojson`
It should not removes fields that may be needed for `--load-infojson`.
Eg: `_ffmpeg_args`, `_has_drm`
Giedrius Statkevičius 4877f9055c
[lrt] Support livestreams ()
Authored by: GiedriusS
Elyse a076c1f97a
[extractor] Update `manifest_url`s after redirect ()
Authored by: elyse0
Evan Spensley b3602f6824
[InfoQ] Don't fail on missing audio format ()
Closes  
Authored by: evansp
Elyse 779da8e31b
[extractor] Update dash `manifest_url` after redirects ()
Closes  
Authored by: elyse0
Lesmiscore 997378f9df
[twitcasting] Pass headers for each formats ()
Authored by: Lesmiscore
ekangmonyet 83bfb5e290
[Niconico] Support 2FA ()
Authored by: ekangmonyet
pukkandan 4f80952353
[cleanup] Delete unused extractors
pukkandan e13945a2fe
[ffmpeg] Fix features detection
pukkandan ca04e1bf49
[Metadata] Remove filename from attached info-json
Elyse 00828e2c93
[downloader/ffmpeg] Specify headers for each URL ()
Closes 
Authored by: elyse0
pukkandan 059bc4db19
[compat/asyncio] Use `asyncio.all_tasks`
pukkandan 9196cbfe8b
[compat] Ensure submodules are correctly wrapped
pukkandan 9cd080508d
Revert acbc642250
Reverts "[utils] WebSocketsWrapper: Ignore warnings at websockets instantiation"

The warning should not be suppressed. We need to address it
Lesmiscore 69b59b4b4b
[downloader/fc2] Stop heatbeating once FFmpeg finishes
Authored by: Lesmiscore
Lesmiscore acbc642250
[utils] WebSocketsWrapper: Ignore warnings at websockets instantiation
This also fixes crash caused by moving asyncio to .compat.

Authored by: Lesmiscore
Thanks: J.Chung at Discord (581418557871620106)
Yipten 96b49af01c
[bandcamp] Exclude merch links ()
Closes 
Authored by: Yipten
Teemu Ikonen 52c2af8298
[icareus] Add extractor ()
Authored by: tpikonen, pukkandan
pukkandan a1ddaa899c
[hotstar] Refactor extractors
Closes 
pukkandan 90f4229409
[telegram] Fix metadata extraction
Closes 
pukkandan b0f636beb4
[Sponsorblock] Don't crash when duration is unknown
CLoses 
Ha Tien Loi d14b920c33
[PearVideo] Add fallback for formats ()
Closes 
Authored by: hatienl0i261299
Evan Spensley 7774db5bf9
[EmbedThumbnail] Disable thumbnail conversion for mkv ()
Closes 
Authored by: evansp
pukkandan 9b8ee23b99
[dependencies] Create module with all dependency imports
pukkandan 62f6f1cbf2
Don't imply `-s` for later stages of `-O`
mehq e08585b0f8
[Gofile] Support password-protected links ()
Closes 
Authored by: mehq
pukkandan 2d3b3feb7e
[Olympics] Fix format extension
Closes 
pukkandan 6f638d325e
Fix `Makefile`
Closes , 

Authored by: putnam
Lesmiscore fdfc8149e1
[openrec:movie] Enable fallback for /movie/ URLs
Closes 
pukkandan 1e9969f4f5
bugfix for a44ca5a470, 19a0394044, 77f9033095
Closes 
pukkandan 43cc91ad75
bugfix for 19a0394044, 3d3bb1688b
felix 77f9033095
[compat] Split into sub-modules ()
Authored by: fstirlitz, pukkandan
pukkandan 19a0394044
[cleanup] Misc cleanup and refactor ()
pukkandan b6dc37fe2a
[test] Convert warnings into errors
* And fix some existing warnings

Authored by: fstirlitz
pukkandan 3d3bb1688b
[docs] Improve embedding docs and other minor fixes
pukkandan 2e25ce3a05
[niconico] Set `expected_protocol` to a public field
Closes 
Lesmiscore (Naoya Ozaki) c854208ccf
[downloader/fragment] Make single thread download work for --live-from-start ()
Authored by: Lesmiscore
pukkandan e06bd8800f
Fix `--skip-unavailable-fragments`
Bug in d71fd41249
Closes 
pukkandan abfecb7bc1
[utils] Fix WebSocketsWrapper
Bug in 3cea3edd1a
Closes 
pukkandan 3b9d9f4374
Do not change fragment chunk-size when `--test`
Closes 
coletdjnz affc4fefea
[youtube] Fix episode metadata extraction
pukkandan 583910682f
[chingari] Fix archiving and tests
Felix S a49e777d59
[spotify] Detect iframe embeds ()
Authored by: fstirlitz
Akmal cda1bc5197
[facebook] Improve thumbnail extraction ()
Authored by: Wikidepia
pukkandan 743f39750c
Fix bug in 66cf3e1001
pukkandan 66cf3e1001
[EmbedSubtitle] Enable for more video extensions
Closes 
pukkandan b07897ef5b
[utils] certifi: Make sure the pem file exists
Closes 
pukkandan e5a998f368
[cleanup] Misc cleanup ()
Authored by: fstirlitz, pukkandan
pukkandan f82711587c
[cleanup] Sort imports
Using https://github.com/PyCQA/isort

    isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
pukkandan 86e5f3ed2e
[cleanup] Upgrade syntax
Using https://github.com/asottile/pyupgrade

1. `__future__` imports and `coding: utf-8` were removed
2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format`
3. f-strings were cherry-picked from `pyupgrade --py36-plus`

Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
pukkandan f9934b9614
[cleanup] Mark some compat variables for removal ()
Authored by fstirlitz, pukkandan
felix cfb0511d82
[cleanup] Remove unused code paths ()
Notes:

* `_windows_write_string`: Fixed in 3.6
  * https://bugs.python.org/issue1602
  * PEP: https://www.python.org/dev/peps/pep-0528

* Windows UTF-8 fix: Fixed in 3.3
  * https://bugs.python.org/issue13216

* `__loader__`: is always present in 3.3+
  * https://bugs.python.org/issue14646

* `workaround_optparse_bug9161`: Fixed in 2.7
  * https://bugs.python.org/issue9161

Authored by: fstirlitz
felix ab96d1ad1b
[cleanup] Remove unused scripts/tests ()
Authored by fstirlitz, pukkandan