yt-dlp

Commit Graph

Author	SHA1	Message	Date
Samantaz Fox	224b5a35f7	[extractor/youtube] Update iOS Innertube clients (#4792 ) Authored by: SamantazFox	2 years ago
coletdjnz	50ac0e5416	[extractor/youtube] Use device-specific user agent (#4770 ) Thwart latest fingerprinting attempt (see https://github.com/iv-org/invidious/issues/3230#issuecomment-1226887639) Authored by: coletdjnz	2 years ago
pukkandan	5e01315aa1	[cache, extractor/youtube] Invalidate old cache	2 years ago
pukkandan	992dc6b486	[jsinterp] Implement timeout Workaround for #4716	2 years ago
pukkandan	b25cac650f	[extractor/youtube] Fix bug in format sorting	2 years ago
pukkandan	90a1df305b	[test] Fix test_youtube_signature	2 years ago
pukkandan	a831c2ea90	[cleanup] Misc	2 years ago
pukkandan	25836db6be	[extractor/youtube] Add fallback to phantomjs Related #4635	2 years ago
pukkandan	580ce00782	[youtube] Improve signature caching and refactor related functions	2 years ago
pukkandan	f6ca640b12	[jsinterp] Fix for youtube player 1f7d5369 Closes #4635 again	2 years ago
pukkandan	3ce2933693	[youtube] Fix error reporting of "Incomplete data" Related: #4669	2 years ago
pukkandan	5c6d2ef9d1	[youtube] Improve format sorting for IOS formats When no itag/resolution is available for reference, use the closest resolution	2 years ago
Lesmiscore	62b58c0936	[docs] Consistent use of `e.g.` (#4643 ) Authored by: Lesmiscore	2 years ago
pukkandan	8f53dc44a0	[jsinterp] Handle new youtube signature functions Closes #4635	2 years ago
pukkandan	7e798d725e	[extractor] Fix format sorting of `channels`	2 years ago
coletdjnz	c7dcf0b31e	[extractor/youtube] Add `androidSdkVersion` parameter to Android Innertube clients Required to prevent YouTube returning a bad player response in some cases. See: https://github.com/yt-dlp/yt-dlp/pull/4593, https://github.com/TeamNewPipe/NewPipe/issues/8713, https://github.com/iv-org/invidious/issues/3230, https://github.com/Tyrrrz/YoutubeExplode/issues/647 Authored by: coletdjnz	2 years ago
pukkandan	a416623436	[extractor/youtube] Extract more format info	2 years ago
coletdjnz	a3e9642116	[extractor/youtube] Prevent redirect to unwanted videos (#4593 ) Example: https://www.youtube.com/watch?v=aQvGIIdgFDM Authored by: coletdjnz	2 years ago
coletdjnz	a0c830f488	[extractor/youtube] Bump Innertube client versions YouTube may be requiring new versions soon. See https://github.com/iv-org/invidious/issues/3230, https://github.com/TeamNewPipe/NewPipe/issues/8713 Authored by: coletdjnz	2 years ago
pukkandan	be5c1ae862	Standardize retry mechanism (#1649 ) * [utils] Create `RetryManager` * Migrate all retries to use the manager * [extractor] Add wrapper methods for convenience * Standardize console messages for retries * Add `--retry-sleep` for extractors	2 years ago
pukkandan	bfd973ece3	[extractors] Use new framework for existing embeds (#4307 ) `Brightcove` is difficult to migrate because it's subclasses may depend on the signature of the current functions. So it is left as-is for now Note: Tests have not been migrated	2 years ago
pukkandan	f2e8dbcc00	[extractor, test] Basic framework for embed tests (#4307 ) and split download tests so they can be more easily run in CI Authored by: coletdjnz	2 years ago
lazypete365	e325a21a1f	[extractor/youtube] Add `live_status=post_live` (#4495 ) Related: https://github.com/yt-dlp/yt-dlp/issues/1564 Authored by: lazypete365	2 years ago
pukkandan	31b532a1f2	[cleanup] Misc	2 years ago
pukkandan	c646d76f67	[webvtt, extractor/youtube] Extract auto-subs from livestream VODs Closes #4130 Authored by: pukkandan, fstirlitz	2 years ago
pukkandan	07b47084ba	[extractor/youtube] Parse translated subtitles only when requested Closes #4274	2 years ago
pukkandan	693f060040	[youtube,twitch] Allow waiting for channels to become live Closes #2597	2 years ago
ftk	45e8a04e48	[extractor/youtube] More metadata for storyboards (#4334 ) Authored by: ftk	3 years ago
pukkandan	a3fb1ca5ab	[extractor/youtube] Fix duration check for post-live manifestless mode	3 years ago
Andrew	12a1b2254d	[extractor/youtube, cleanup] Fix tests (#4293 ) Authored by: sheerluck	3 years ago
pukkandan	a3976e0760	Improve chapter sanitization	3 years ago
pukkandan	ae61d108dd	[cleanup] Misc cleanup	3 years ago
crazymoose77756	962ffcf89c	[cleanup] Fix some typos (#4194 ) Authored by: crazymoose77756	3 years ago
pukkandan	14f25df2b6	[compat] Remove deprecated functions from core code	3 years ago
pukkandan	ac66811112	[compat] Remove more functions Removing any more will require changes to a large number of extractors	3 years ago
Brett824	06cc8f103b	[extractor/youtube] Mark videos as fully watched (#4146 ) * Also fixes videos appearing as shorts in watch history Closes #2555 Authored by: Brett824	3 years ago
pukkandan	9809740ba5	[extractor, cleanup] Reduce direct use of `_downloader`	3 years ago
pukkandan	471d0367c7	[youtube:clips] Support downloading clips Closes #2543	3 years ago
pukkandan	a70635b8a1	[cleanup, utils] Don't use kwargs for `format_field`	3 years ago
pukkandan	0df111a371	[youtube] Extract `comment_count` from webpage Closes #4091	3 years ago
coletdjnz	4ce05f5759	[extractor/youtube] Fix live chat for videos with content warning Fixes #4051 Authored by: coletdjnz	3 years ago
pukkandan	56ba69e4c9	[cleanup] Misc fixes Closes #4027	3 years ago
coletdev	2ae778b8fc	[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args (#3916 ) Allows user to override Innertube API host or key for all requests Authored by: coletdjnz	3 years ago
MMM	36195c4461	[dash] Show fragment count with `--live-from-start` (#3493 ) Authored by: flashdagger	3 years ago
coletdjnz	65141660ab	[extractor/youtube] Fix bug in `b7c47b7438` Closes #3997 Authored by: coletdjnz	3 years ago
pukkandan	b7c47b7438	[extractor] Add `_search_json` All fetching of JSON objects should eventually be done with this function but only `youtube` is being refactored for now	3 years ago
pukkandan	1890fc6389	[cleanup] Misc fixes Cherry-picks from: #3498, #3947 Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836 Authored by: pukkandan, flashdagger, gamer191	3 years ago
coletdev	c7a7baaa13	[extractor/youtube] Fix `:ytnotifications` extractor (#3775 ) Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775 Authored by: coletdjnz	3 years ago
pukkandan	6b0b0a289a	[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries`	3 years ago
coletdjnz	ee27297f82	[extractor/youtube] Fix initial player response extraction Authored by: pukkandan, coletdjnz	3 years ago
pukkandan	0fe51254cb	[extractor/youtube] Bring back `_extract_chapters_from_description` Closes #3886	3 years ago
pukkandan	52023f1291	[extractor/youtube] Make signature extraction non-fatal and reduce verbosity of it's warning Closes #3882	3 years ago
pukkandan	829bbd1d05	[youtube] Add warning for PostLiveDvr Closes #3746, Related #1564	3 years ago
pukkandan	2762dbb17e	[compat] Add `functools.cached_property`	3 years ago
pukkandan	2414649192	[cleanup] Misc cleanup	3 years ago
Jordan Weatherby	d1c4f6d4da	[youtube] Added piped instance urls (#3714 ) Closes #3661 Authored by: JordanWeatherby	3 years ago
pukkandan	82d020804d	[extractor] Use classmethod/property where possible and refactor lazy extractors accordingly. This reduces the need to create extractor instances	3 years ago
pukkandan	0f06bcd759	[cleanup] Minor fixes (See desc) * [youtube] Fix `--youtube-skip-dash-manifest` * [build] Use `$()` in `Makefile`. Closes #3684 * Fix bug in `385ffb467b` * Fix bug in `43d7f5a5d0` * [cleanup] Remove unnecessary `utf-8` from `str.encode`/`bytes.decode` * [utils] LazyList: Expose unnecessarily "protected" attributes and other minor cleanup	3 years ago
pukkandan	91e5e839d3	[youtube] Deprioritize format 22 Reduces chance of encountering #3372	3 years ago
coletdev	6e634cbe42	[youtube] Add YoutubeStoriesIE (#3362 ) Get channel stories with `ytstories:<channel UCID>` Authored-by: coletdjnz	3 years ago
pukkandan	bfec31bec8	[youtube] De-prioritize auto-generated thumbnails Closes #3112	3 years ago
pukkandan	1d485a1a79	[cleanup] Misc fixes Closes #3565, https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364	3 years ago
pukkandan	0a41f331cc	[doc] Minor improvements Closes #3518, Closes #3560	3 years ago
pukkandan	19a0394044	[cleanup] Misc cleanup and refactor (#2173 )	3 years ago
coletdjnz	affc4fefea	[youtube] Fix episode metadata extraction	3 years ago
pukkandan	f82711587c	[cleanup] Sort imports Using https://github.com/PyCQA/isort isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .	3 years ago
pukkandan	86e5f3ed2e	[cleanup] Upgrade syntax Using https://github.com/asottile/pyupgrade 1. `__future__` imports and `coding: utf-8` were removed 2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format` 3. f-strings were cherry-picked from `pyupgrade --py36-plus` Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts	3 years ago
krichbanana	ca5300c7ed	[youtube] Add `:ytnotifications` extractor (#3347 ) Authored by: krichbanana	3 years ago
pukkandan	a25bca9f89	[youtube, cleanup] Minor refactoring Authored by: coletdjnz, pukkandan	3 years ago
coletdev	61d3665d9d	[youtube] Fix uploader for collaborative playlists (#3332 ) Authored by: coletdjnz	3 years ago
pukkandan	a44ca5a470	[cleanup] Misc fixes Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117 Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, `a825ffbffa (commitcomment-68538986)`, https://github.com/yt-dlp/yt-dlp/issues/2360, `5fa3c9a88f (r70393519)`, `5fa3c9a88f (r70393254)`	3 years ago
pukkandan	a17526e427	[youtube:tab] Minor improvements (See desc) * Support shorts on channel homepage * Extract thumbnail of OLAK playlists	3 years ago
coletdev	ad210f4fd4	[youtube:search] Support hashtag entries (#3265 ) Authored-by: coletdjnz	3 years ago
David	e7870111e8	[YouTube] Add new age-gate bypass (#3233 ) Closes #3182 Authored by: zerodytrash, pukkandan	3 years ago
coletdev	1c1b2f96ae	[youtube:tab] Fix duration extraction for shorts (#3171 ) Related: https://github.com/TeamNewPipe/NewPipe/issues/8034 Authored-by: coletdjnz	3 years ago
pukkandan	1235d333ab	[youtube] Fix auto-translated automatic captions `d49669acad` only covered ASR Closes #2956	3 years ago
pukkandan	18e4940825	[youtube] Add extractor-arg to skip auto-translated subs	3 years ago
shirt	727029c508	[youtube] Detect DRM better Authored by: shirt-dev	3 years ago
coletdev	fd2ad7cb24	[youtube:tab] Return shorts url if video is a short (#3168 ) Allows filtering out shorts from feeds with `--match-filter` Closes #3165 Authored-by: coletdjnz	3 years ago
pukkandan	ae72962643	[youtube] Try embedded client variants before agegate agegate variants appears to be broken, but don't remove them for the time-being	3 years ago
pukkandan	52efa4b312	[extractor] Add `_perform_login` function (#2943 ) * Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API * Adds `ie.supports_login` to the public API	3 years ago
pukkandan	e4b98809cf	[youtube] Fix pagination of `membership` tab	3 years ago
pukkandan	a1b2d84360	[youtube] Avoid false positives when detecting damaged formats Closes #3083	3 years ago
coletdjnz	5dbc77df26	[youtube:api] Prefer minified JSON response Authored-by: coletdjnz	3 years ago
coletdev	b3edc8068e	[downloader/mhtml] Fix fragments with absolute urls (#3044 ) Authored-by: coletdjnz	3 years ago
coletdev	17322130a9	[youtube] Improve video upload date handling (#3029 ) * Don't prefer UTC upload date for past live streams/premieres * Improve regex (fixes a regression) Authored-by: coletdjnz	3 years ago
pukkandan	ff91cf7483	[utils] Add `get_first`	3 years ago
pukkandan	a405b38f20	[youtube] Further de-prioritize 3gp format	3 years ago
pukkandan	08d30158ec	[cleanup, docs] Misc cleanup Closes #2828, closes #2734, closes #2802, closes #2937	3 years ago
coletdev	992f9a730b	[youtube] Prefer UTC upload date for videos (#2223 ) Except for live/scheduled streams/premieres. Closes #1881 Related: #2402 Authored-by: coletdjnz	3 years ago
pukkandan	d49669acad	[youtube] Fix automatic captions Closes #2956	3 years ago
pukkandan	e48b3875ec	Revert `2e4cacd038` Closes #2923	3 years ago
coletdev	7c219ea601	[youtube:tab] Follow redirect to regional channel (#2884 ) Closes #2694 Authored by: coletdjnz	3 years ago
Lesmiscore (Naoya Ozaki)	a539f06570	[downloader/fragment] Improve `--live-from-start` for YouTube livestreams (#2870 )	3 years ago
pukkandan	1108613f02	[youtube:tab] Reject webpage data if redirected to home page Closes #2660	3 years ago
pukkandan	a30a6ed3e4	[youtube:tab] Add `approximate_date` extractor-arg	3 years ago
Lesmiscore	a7d4acc018	[youtube] Escape possible `$` in `_extract_n_function_name` regex	3 years ago
pukkandan	0ad92dfb18	[youtube] De-prioritize potentially damaged formats Closes #2823	3 years ago
pukkandan	2e4cacd038	[youtube] Fix intermittent failure of embed-based age-gate bypass	3 years ago
MinePlayersPE	c571b3a6ab	[youtube] Fix n-sig extraction for phone player JS (#2816 ) Authored by: MinePlayersPE	3 years ago
coletdev	60f393e48b	[youtube] Ensure subtitle urls are absolute (#2765 ) Closes #2755 Authored by: coletdjnz	3 years ago
pukkandan	ab6df717d1	[youtube] Differentiate descriptive audio by language code Related: #2677	3 years ago
pukkandan	0c8d9e5fec	[youtube] Label original auto-subs Closes #2655	3 years ago
pukkandan	84bbc54599	[youtube:search] Add tests	3 years ago
coletdjnz	af5c1c553e	[youtube] Fix search extractor Regression introduced in `16aa9ea41d`. Closes #2628 Authored-by: coletdjnz	3 years ago
pukkandan	455a15e2dc	[cleanup,docs] Minor fixes Closes #2541, #2484	3 years ago
pukkandan	182bda88e8	[youtube, cleanup] Misc fixes and cleanup	3 years ago
pukkandan	16aa9ea41d	[youtube] Add extractor `YoutubeMusicSearchURLIE` Closes #2568	3 years ago
pukkandan	48416bc4a8	[youtube] Fix n-sig for player e06dea74	3 years ago
coletdjnz	87e8e8a7d0	[youtube:api] Do not use seek when reading HTTPError response Authored-by: coletdjnz	3 years ago
pukkandan	6970b6005e	[cleanup] Minor fixes Closes #2334	3 years ago
pukkandan	e0ddbd02bd	[cleanup] Use format_field where applicable	3 years ago
coletdjnz	6c73052c0a	[youtube] Extract channel subscriber count (#2399 ) Closes #2350 * Adds `channel_follower_count` field Authored-by: coletdjnz	3 years ago
coletdjnz	396a76f7bf	[youtube] Enforce UTC (#2402 ) and [utils] use `utcnow` in `datetime_from_str` Related: #2223 Authored by: coletdjnz	3 years ago
coletdjnz	301d07fc4b	[youtube:tab] Extract channel banner (#2400 ) Closes #2237 Authored by: coletdjnz	3 years ago
krichbanana	64f36541c9	[youtube:tab] Raise error on tab redirect (#2318 ) Closes #2306 Authored by: krichbanana, coletdjnz	3 years ago
pukkandan	66f7c6a3e0	[youtube] Do not return `upload_date` for playlists Closes #2349 Partially reverts #1018 Re-opens #1883	3 years ago
pukkandan	596379e260	[youtube] Make invalid storyboard URL non-fatal Closes #2382	3 years ago
pukkandan	b6ce9bb038	[youtube] Detect live-stream embeds Closes #2380	3 years ago
Unit 193	4c968755fc	[PornHub,YouTube] Refresh onion addresses (#2272 ) Authored by: unit193	3 years ago
pukkandan	976ae3eabb	[youtube] Update tests	3 years ago
coletdjnz	f0d785d3ed	[youtube:tab] Extract more playlist metadata (#2069 ) * Add fields modified_date, modified_timestamp * Add field playlist_count * [youtube:tab] Extract view_count, playlist_count, modified_date Authored by: coletdjnz, pukkandan	3 years ago
coletdjnz	18c7683d27	[youtube:api] Update Innertube clients (#2163 ) * Updated iOS clients to support 60fps formats (see: https://github.com/TeamNewPipe/NewPipeExtractor/issues/680#issuecomment-1002724558) * General update of versions and keys of other clients Authored-by: coletdjnz	3 years ago
pukkandan	185bf31070	[youtube] End `live-from-start` properly when stream ends with 403 Closes #2089	3 years ago
coletdjnz	a709d87335	[youtube:tab] Extract video thumbnails from playlist (#2096 ) closes #1184 Co-Authored-by: coletdjnz, pukkandan	3 years ago
The Hatsune Daishi	adbc4ec4bb	[dash,youtube] Download live from start to end (#888 ) * Add option `--live-from-start` to enable downloading live videos from start * Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start * [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments * [fragment] Allow multiple live dash formats to download simultaneously * [youtube] Implement fragment re-fetching for the live dash formats * [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs) * [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats Closes #1521 Authored by: nao20010128nao, pukkandan	3 years ago
coletdjnz	f3aa3c3f98	[youtube:tab] Extract more metadata from feeds/channels/playlists (#1018 ) Parse relative time text, extract live, upcoming status, availability and channel id from feeds/channels/playlists (where applicable). Closes #1883 Authored-by: coletdjnz	3 years ago
pukkandan	37e57a9fd4	[youtube:tab] Ignore query when redirecting channel to playlist and cleanup of related code Closes #2046	3 years ago
pukkandan	39ca3b5c7f	[extractor] Standardize `_live_title`	3 years ago
coletdjnz	46383212b3	[youtube:comments] Add more options for limiting number of comments extracted (#1626 ) Extends `max_comments` extractor arg to support `max-parents,max-replies,max-replies-per-thread`. Authored-by: coletdjnz	3 years ago
pukkandan	ff9f925b63	[test/download] Add more fields	3 years ago
pukkandan	5f7cb91ae9	[youtube] Fix `ytsearchdate` Related: #1851	3 years ago
pukkandan	b29165267f	[youtube] Decrypt n-sig for URLs with `ratebypass` Closes #1796	3 years ago
pukkandan	a61fd4cf6f	[youtube:search_url] Add playlist/channel support Closes #1213, #1214	3 years ago
pukkandan	a6213a4925	[cleanup,youtube] Reorganize Tab and Search extractor inheritances	3 years ago
pukkandan	dd2a987d3f	[tests] Fix tests	3 years ago
pukkandan	9222c38182	[cleanup] Minor cleanup Closes #1696, Closes #1673	3 years ago
pukkandan	720c309932	[youtube] Add storyboard formats Closes: #1553, https://github.com/ytdl-org/youtube-dl/issues/9868 Related: https://github.com/ytdl-org/youtube-dl/pull/14951	3 years ago
coletdjnz	d0d012d4e7	[youtube] Add `default` player client (#1685 ) Authored-by: coletdjnz	3 years ago
pukkandan	e339d25a0d	[youtube] Minor improvement to format sorting	3 years ago
pukkandan	c586f9e8de	[cleanup] minor fixes	3 years ago
pukkandan	aa9369a2d8	[cleanup] Minor improvements to error and debug messages	3 years ago
Ryan Hendrickson	d9190e4467	[youtube] Add Invidious list for playlists/channels (#1567 ) Authored by: rhendric	3 years ago
pukkandan	34921b4345	[utils] Add `join_nonempty`	3 years ago
pukkandan	c18d4482b1	[youtube] Fix sorting for some videos	3 years ago
pukkandan	a4211baff5	[cleanup] Minor cleanup	3 years ago
pukkandan	d89257f398	[youtube] Remove unnecessary no-playlist warning	3 years ago
pukkandan	a0bb6ce58d	[youtube] refactor itag processing	3 years ago
pukkandan	404f611f1c	[youtube] Fix throttling by decrypting n-sig (#1437 )	3 years ago
pukkandan	fccf502118	[youtube] Populate `thumbnail` with the best "known" thumbnail Closes #402, Related: https://github.com/yt-dlp/yt-dlp/issues/340#issuecomment-950290624	3 years ago

1 2 3 4 5 ...

399 Commits (81b4712bca608b9015aa68a4d96661d56e9cb894)