Commit Graph

458 Commits (dbf7eca917e7189ad0224fd3b7b6068b4940b71b)

Author SHA1 Message Date
pukkandan 60bdb7bd9e
[youtube] Fix sorting of 3gp format
pukkandan 4bb6b02f93
Improve `extractor_args` parsing
pukkandan 51f8a31d65
Update to ytdl-commit-a803582
[peertube] only call description endpoint if necessary
a803582717
Tom-Oliver Heidel be05d5cff1
[soundcloud] Allow login using oauth token ()
Authored by: blackjack4494
zenerdi0de 30d569d2ac
[fancode] Fix extraction, support live and allow login with refresh token ()
Authored-by: zenerdi0de
OhMyBahGosh 08625e4125
[AdobePass] Add Spectrum MSO ()
From: https://github.com/ytdl-org/youtube-dl/pull/26792

Co-authored by: kevinoconnor7, ohmybahgosh
pukkandan 3acf6d3856
[Funimation] Rewrite extractor (See desc) ()
* Support direct `/player/` URL
* Treat the different versions of an episode as different formats of a single video. So `experience_id` can no longer be used as the video `id` and the `episode_id` is used instead. This means that all existing archives will break
* Extractor options `language` and `version` to pre-select them
* Compat option `seperate-video-versions` to fall back to old behavior (including using the old video IDs)

Closes 
pukkandan 46890374f7
[extractor] Minor improvements (See desc)
1. Allow removal of login hint - extractors can set their own login hint as part of `msg`
2. Cleanup `_merge_subtitles` signature
pukkandan 60755938b3
[extractor] Prevent unnecessary download of hls manifests
and refactor `hls_split_discontinuity` code
pukkandan bc97cdae67
[cleanup] Fix linter and some typos
Related: https://github.com/ytdl-org/youtube-dl/pull/29398
nyuszika7h e010672ab5
[videa] Fix extraction ()
Authored by: nyuszika7h
MinePlayersPE 17f0eb66b8
[RCTIPlus] Add extractor ()
Authored by: MinePlayersPE
pukkandan b1e60d1806 [facebook] Extract description and fix title
Partially fixes: 
krichbanana f6745c4980
[Youtube] Choose correct Live chat API for upcoming streams ()
Authored by: krichbanana
coletdjnz 109dd3b237
[youtube] Use new API for additional video extraction requests ()
Co-authored-by: colethedj, pukkandan
Closes https://github.com/yt-dlp/yt-dlp/issues/427
Workarounds for https://github.com/ytdl-org/youtube-dl/issues/29326, https://github.com/yt-dlp/yt-dlp/issues/319, https://github.com/ytdl-org/youtube-dl/issues/29086
LE 1e79316e20
[TBS] Support livestreams ()
Authored by: llacb47
coletdjnz 45261e063b
[youtube:comments] Fix error handling and add `itct` to params ()
Should close  (untested)

Authored by: colethedj
pukkandan 49c258e18d
[youtube] Fix subtitle names for age-gated videos
Related: https://github.com/iv-org/invidious/pull/2205#issuecomment-868680486
pukkandan 5d3a0e794b
Add `--extractor-args` to pass extractor-specific arguments
Mevious 125728b038
[funimation] Add `FunimationShowIE` ()
Closes 

Authored by: Mevious
LE 412cce82b0
[yahoo] Fix extraction ()
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28290

Co-authored-by: llacb47, pukkandan
pukkandan 2b18a8c590
[plutotv] Improve `_VALID_URL`
Closes 
pukkandan ed807c1837
Update to ytdl-commit-379f52a
[liveleak] Remove extractor
379f52a495
Mevious 29f63c9672
[funimation] Extract subtitles ()
Closes , https://github.com/ytdl-org/youtube-dl/issues/25645
Related: https://github.com/ytdl-org/youtube-dl/pull/24906

Authored by: Mevious
pukkandan 9fc0de5796
[hotstar] Use server time for authentication instead of local time
Closes 
siikamiika c60ee3a218
[youtube_live_chat] Support ongoing live chat ()
Authored by: siikamiika
pukkandan e6779b9400
[twitcasting] Websocket support ()
Closes 
Authored by: nao20010128nao
pukkandan e36d50c5dd
[websockets] Add `WebSocketFragmentFD` ()
Necessary for 

Co-authored by: nao20010128nao, pukkandan
pukkandan 4e6767b5f2
[youtube] Temporary fix for age-gate
Related:
https://stackoverflow.com/a/67629882
https://github.com/yt-dlp/yt-dlp/issues/319
https://github.com/ytdl-org/youtube-dl/issues/29333
https://github.com/ytdl-org/youtube-dl/issues/29086
pukkandan d0fb4bd16f
[pornhub] Extract `cast`
Closes , https://github.com/ytdl-org/youtube-dl/pull/27384
felix 3fd4c2a543
[mediasite] Extract slides ()
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

Authored by: fstirlitz
felix cdb19aa4c2
[downloader/mhtml] Add new downloader ()
This downloader is intended to be used for streams that consist of a
timed sequence of stand-alone images, such as slideshows or thumbnail
streams

This can be used for implementing:

https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

https://github.com/ytdl-org/youtube-dl/issues/9868
https://github.com/ytdl-org/youtube-dl/pull/14951


Authored by: fstirlitz
pukkandan 8326b00aab
Allow `images` formats
Necessary for .

* They are identified by `vcodec=acodec='none'`
* These formats show as the worst in `-F`
* Any postprocessor that expects audio/video will be skipped
* `b*` and all related selectors will skip such formats
* This commit also does not add any selector for downloading such formats. They have to be explicitly requested by the `format_id`. Implementation of a selector is left for when  is resolved
pukkandan 45db527fa6
[youtube] Login is not needed for `:ytrec`
coletdjnz 4ba001080f
[youtube] Non-fatal alert reporting for unavailable videos page ()
Co-Authored by: colethedj, pukkandan
coletdjnz 1974e99f4b
[youtube] Improve SAPISID cookie handling (closes ) ()
Author: colethedj
pukkandan 3b1fe47d84
Release 2021.06.08
pukkandan 46358f647d
Update to ytdl-commit-c2350ca
Update MSVC 2010 redist URL
c2350cac24
pukkandan 89ee4cf8ae
[viki] Fix extraction
Closes 
Code from: 59e583f7e8
pukkandan eb0f9d6838
[zoom] Extract transcripts as subtitles
pukkandan d3d8d8184a
[extractor] Fix pre-checking archive for some extractors
The `id` regex group must be present for `_match_id` and pre-checking archive to work correctly
pukkandan e85a39717a
[twitcasting] Add TwitCastingUserIE, TwitCastingLiveIE
Closes 

Code adapted from: f1fb9222bb/youtube_dl/extractor/twitcasting.py
Authored by: pukkandan, nao20010128nao
MinePlayersPE f2cd7060fc
[vidio] Add VidioPremierIE and VidioLiveIE ()
Authored-by: MinePlayersPE
felix e2efe599aa
[common] Fix FourCC fallback when parsing ISM ()
In some DASH manifests, the FourCC attribute is actually present,
but empty.  We thus apply the same fallback to 'AACL' that we do
when the attribute is entirely absent.

Authored by: fstirlitz
pukkandan 5e1dba8ed6
Remove duplicate file `trovolive.py`
pukkandan bea742222f
[youtube] Support shorts URL
Closes 
Ashish 6e6390321c
[Hotstar] Add HotStarSeriesIE ()
Authored by: Ashish0804
pukkandan 14eb1ee1cb
Update to ytdl-commit-d495292
[ard] Relax _VALID_URL and fix video ids
d495292852

Closes 
coletdjnz 879e7199bb
[archiveorg] Add YoutubeWebArchiveIE ()
Co-authored by: colethedj, pukkandan, alex-gedeon
MinePlayersPE 10bb7e51e8
[vidio] Add login support ()
Authored by: MinePlayersPE
pukkandan b0089e8992
[fancode] Add extractor (#316,#354)
Closes , 

Authored by: rmsmachine
Ashish a3ed14cbaf
[Voot] Add VootSeriesIE ()
Authored by: Ashish0804
LE 9dee4df559
[Saitosan] Add new extractor ()
Closes 
Authored by: llacb47
pukkandan adddc50cbf
[extractor] Functions to parse socket.io response as json
Authored by: pukkandan, llacb47
MinePlayersPE 46c43ffc9d
[vidio] Support premium videos ()
Authored by: MinePlayersPE
pukkandan 37a3bb66a7
[extractor] Allow `note=False` when extracting manifests
pukkandan 46953e7e6e
[youtube:playlist] fix bug
pukkandan 077c476276
[zee5] Fix m3u8 formats extension
rhsmachine 65af1839c6
[patreon] Support vimeo embeds ()
Authored by: rhsmachine
pukkandan 177877c544
[extractor] Always prefer native hls downloader by default
When the manifest is not downloadable by native downloader, it already is able to detect it and switch to `ffmpeg`. So there doesn't seem to be a reason anymore to use ffmpeg as the preferred downloader
Oliver Freyermuth f17c702270
[ard] Allow URLs without `-` before id
https://github.com/ytdl-org/youtube-dl/pull/29091

Authored by: olifre
pukkandan 3907333c5d
[extractor] Skip subtitles without URI in m3u8 manifests
Closes 

Authored by: hheimbuerger
Ashish 09d18ad07e
[Sonyliv] Add subtitle support ()
Authored by: Ashish0804
Ashish 9572eaaa11
[ShemarooMe] Add extractor ()
Closes 
Co-authored-by: Ashish0804, pukkandan
pukkandan 8d68ab98a7
[youtube] Fix bug where not all hls formats were extracted
Bug introduced in 9297939ec3
Ashish 135e6b93f4
[SonyLIV] Add SonyLIVSeriesIE ()
Authored by: Ashish0804
king-millez 13a49340ed
[telemundo] add extractor ()
Closes 
Authored by: king-millez
pukkandan 09f1580e2d
[youtube] `/live` URLs should raise error if channel is not live
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29090
pukkandan b73612a254
Update to ytdl-commit-dfbbe29
[redbulltv] fix embed data extraction
dfbbe2902f
king-millez 5014558ab9
[parlview] Add extractor ()
Authored by: king-millez
coletdjnz 00ae27690d
[youtube] Add `html5=1` param to `get_video_info` page requests ()
Workaround for , https://github.com/ytdl-org/youtube-dl/issues/29086
Authored by: colethedj
pukkandan 9d5d4d64f8
[youtube] Better message when login required
king-millez 98784ef8d6
[audius:artist] Add extractor ()
Authored by: king-millez
pukkandan d3fc8074a4
[youtube] Sort audio-only formats correctly
Closes 
pukkandan 07cce701de
[cleanup] linter, code formatting and readme
king-millez 74e001af1d
[tenplay] Fix extractor ()
Authored by: king-millez
pukkandan ff2751ac9c
[youtube] Always extract `maxresdefault` thumbnail
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29049
pukkandan abcdd12b26
[youtube:tab] Support youtube music `MP` pages
pukkandan 18db754858
[youtube:tab] Redirect `UC` channels that doesn't have a `videos` tab
Many topic URLs don't have a videos tab, but has an equivalent `UU` playlist.
If there is no playlist, fallback to using channel page
pukkandan fe03a6cdc8
[youtube:tab] Support youtube music `VL` and `browse` pages
pukkandan cd684175ad
[youtube:tab] Support channel search
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29071
pukkandan da692b7920
[cleanup] youtube tests
pukkandan 95c01b6c16
[youtube:tab] Show alerts only from the final webpage
pukkandan a06916d98e
[extractor] Add `write_debug` and `get_param`
coletdjnz 9297939ec3
[Youtube] Extract more formats for `music.youtube` URLs ()
Based on: https://github.com/ytdl-org/youtube-dl/pull/28778, https://github.com/ytdl-org/youtube-dl/pull/26160

Co-authored-by: craftingmod, colethedj, pukkandan
pukkandan 774d79cc4c
[youtube] Add language names
Co-authored by: nixxo, tpikonen
Based on: https://github.com/ytdl-org/youtube-dl/pull/26112
Closes: 
pukkandan 2412044c90
Add field `name` for subtitles
Co-authored by: pukkandan, tpikonen

Based on: , https://github.com/ytdl-org/youtube-dl/pull/26112
pukkandan 120916dac2
[youtube] multiple subtitles in same language
Fixes: https://github.com/ytdl-org/youtube-dl/issues/21164
Related: , https://github.com/ytdl-org/youtube-dl/pull/26112
pukkandan 0fb983f62d
[youtube] Extract audio language
pukkandan 0760b0a7e2
Standardize `write_debug`
pukkandan d908aa636a
[cleanup] Fix typos
pukkandan 3d89341b47
[common] bugfix for when `compat_opts` is not given
pukkandan d8ec40b39f
[rmcdecouverte] Generalize `_VALID_URL`
Closes 
pukkandan fac988053f
Release 2021.05.11
* and some documentation improvements
pukkandan 61241abbb0
[generic] Respect the encoding in manifest
pukkandan 53ed7066ab
Option `--compat-options` to revert some of yt-dlp's changes
* Deprecates `--list-formats-as-table`, `--list-formats-old`
pukkandan 2f567473c6
[Plugins] Prioritize plugins over standard extractors
and prevent plugins from overwriting the standard extractor classes

Closes 
pukkandan 41d1cca328
Update to ytdl-commit-a726009
[blinkx] Remove extractor
a726009987
pukkandan 12e73423f1
[plutotv] Fix format extraction for some urls
* And fallback to the first urls if ad-free urls can't be found
Closes 
pukkandan 7700b37f39
[plutotv] Extract subtitles from manifests
Ashish c28cfda81f
[SonyLiv] Fix `title` and `series` extraction ()
Authored by: Ashish0804
pukkandan 3158150cb7
[utils] Add `network_exceptions`
pukkandan 06425e9621
[blinkx] Minor fix
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941
pukkandan 1815d1028b
[zee5] Fix py2 compatibility
The Hatsune Daishi 0fa9a1e236
[whowatch] Add extractor
closes 

Authored by: nao20010128nao 
Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py
pukkandan 80185155a1
[ukcolumn] Add Extractor
Closes 
pukkandan c755f1901f
[CBS] Improve `_VALID_URL` to support movies
Closes 
Tested by: BeeMuffins
pukkandan 68b91dc905
[youtube] Add `oembed` to reserved names
pukkandan 88f06afc0c
[rmcdecouverte] Improve `_VALID_URL`
Closes 
CXwudi 40078a55e2
[niconico] Fix bug in thumbnail extraction
Bug from: 6b1d8c1e30
Authored by: CXwudi
pukkandan 07e4a40a9a
[crackle] Improve extraction (See desc)
Closes 

* Refactor authorization as an extension to `_download_json`
* Better error messages and warnings
* Respect `--ignore-no-formats-error`
* Extract subtitles from manifests
* Try with crackle's geo-location service if all hard-coded countries fail
pukkandan e28f1c0ae8
[cleanup] Fix linter and some typos
* Also remove inconsistent use of `"` in setup.py
pukkandan ef39f8600a
[curiositystream] Fix collections
Closes 

* A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721> but cannot be tested without an account
pukkandan 2291dbce2a
[niconico] Fix HLS formats
Closes 

* The structure of the API JSON was changed
* Smile Video seems to be no longer available. So remove the warning
* Move ping to downloader
* Change heartbeat interval to 40sec
* Remove unnecessary API headers

Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan
Tested by: tsukumijima
pukkandan 895b0931e5
[youtube:tab] Detect playlists inside community posts
pukkandan 1ad047d0f7
[nebula] Move to nebula.app
Closes 
Tested by: Lamieur
pukkandan be6202f12b
Subtitle extraction from streaming media manifests
Authored by fstirlitz
Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144

Closes: 
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/6106
https://github.com/ytdl-org/youtube-dl/issues/14977
https://github.com/ytdl-org/youtube-dl/issues/21438
https://github.com/ytdl-org/youtube-dl/issues/23609
https://github.com/ytdl-org/youtube-dl/issues/28132

Might also fix (untested):
https://github.com/ytdl-org/youtube-dl/issues/15424
https://github.com/ytdl-org/youtube-dl/issues/18267
https://github.com/ytdl-org/youtube-dl/issues/23899
https://github.com/ytdl-org/youtube-dl/issues/24375
https://github.com/ytdl-org/youtube-dl/issues/24595
https://github.com/ytdl-org/youtube-dl/issues/27899

Related:
https://github.com/ytdl-org/youtube-dl/issues/22379
https://github.com/ytdl-org/youtube-dl/pull/24517
https://github.com/ytdl-org/youtube-dl/pull/24886
https://github.com/ytdl-org/youtube-dl/pull/27215

Notes:
* The functions `extractor.common._extract_..._formats` are still kept for compatibility
* Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles`
* Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats
* AES support is untested
* The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players
    * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`.
        Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file
    * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit>
* Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools
    * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg`
    * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac>
    * But validity of the those extracted from ISM are untested
Felix S e8f834cd8d [threeqsdn] Extract subtitles from streaming manifests
Felix S e0e624ca7f [canvas] Extract subtitles from streaming manifests
Felix S ec4f374c05 [wat] Extract subtitles from streaming manifests
Felix S c811e8d8bd [atresplayer] Extract subtitles from streaming manifests
Felix S b2cd5da460 [francetv] Extract subtitles from the HLS manifest
Felix S 2de3b21e05 [uplynk] Extract subtitles from HLS manifests
Felix S 4bed436371 [twitter] Extract subtitles from HLS manifests
Felix S efe9dba595 [srgssr] Extract subtitles from HLS manifests
Felix S 47f4203dd3 [nytimes] Extract subtitles from HLS manifests
Felix S 015c10aeec [roosterteeth] Use common code for subtitle extraction
Felix S a00d781b73 [elonet] Use common code for subtitle extraction
Felix S 0c541b563f [tv4] Extract subtitles from streaming manifests
Felix S 64a5cf7929 [byutv] Extract subtitles from streaming manifests
Felix S 7a450a3b1c [generic] Extract subtitles from direct SSTR manifest links
Felix S 7de27caf16 [generic] Extract subtitles from direct DASH manifest links
Felix S c26326c1be [generic] Extract subtitles from direct HLS manifest links
Felix S 66a1b8643a [downloader/ism] Support muxing TTML subtitles
Felix S 4a2f19abbd [downloader/hls] Assemble single-file WebVTT subtitles from HLS segments
Felix S f6a1d69a87 [extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks
Felix S fd76a14259 [extractor/common, downloader/ism] Extract SSTR subtitle tracks
_parse_ism_formats was extended into _parse_ism_formats_and_subtitles;
all direct users were updated, though _extract_ism_formats was left
as a compatibility wrapper.

The SSTR downloader was also modified in order to prepare for muxing
subtitle streams, although no support for any subtitle codecs was
added in this commit.
Felix S 171e59edd4 [extractor/common] Extract DASH subtitle tracks
_extract_mpd_formats and _parse_mpd_formats were extended into
_…_formats_and_subtitles; wrappers with old names are provided
for compatibility.
Felix S a0c3b2d5cf [extractor/common] Extract HLS subtitle tracks
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles
and extended to handle subtitle tracks instead of skipping them;
a wrapper with the old name is provided for compatibility.

_parse_m3u8_formats is likewise renamed and extended, but without adding
the compatibility wrapper; the test suite is adjusted to test the enhanced
method instead.
Felix S 19bb39202d [extractor/common] Generalise _merge_subtitles
This allows modifying a subtitles dictionary in-place.
Hadi0609 db9a564b6a
[zee5] Fix extraction for some URLs ()
Closes: 
Felix S c72967d5de
[mediasite] Generalize URL pattern ()
Authored by: fstirlitz
pukkandan b982cbdd0e
[limelight] Obey `allow_unplayable_formats`
pukkandan 6a04a74e8b
[FormatSort] Fix for when some formats have quality and others don't
CXwudi 6b1d8c1e30
[niconico] Fix title and thumbnail extraction ()
Authored by: CXwudi
Ashish 87c3d06271
[Mxplayer] Add MxplayerShowIE ()
Authored by: Ashish0804
pukkandan cf9d6cfb0c
[tubi] Raise "no video formats" error when video url is empty
Related: 
pukkandan bbed5763f1
[francetvinfo] Improve video id extraction
Closes 
pukkandan 1bdae7d312
Update to ytdl-commit-7e8b3f9
[youtube] Remove unused code
7e8b3f9439
Felix S a471f21da6
[mildom] Remove proxy ()
Closes 
Makes 2cff495997, ab406a1c0e,  obsolete

Authored by: fstirlitz
pukkandan 6efb071135
[BilibiliChannel] Fix pagination
Closes 

ccca21d7f5
Coauthored by: nao20010128nao, pukkandan
pukkandan 3b4775e021
[go] Fix `_VALID_URL`
Closes 
pukkandan ab406a1c0e
[mildom] Warn user of proxy
pukkandan 8c54a3051d
[youtube] Bugfix in `_extract_ytcfg`
pukkandan 3097d9e512
[mildom:user:vod] Download only necessary amount of pages
pukkandan c1df120eda
[mildom:vod] Remove proxy
* Proxy is needed only for live videos
pukkandan 2cff495997
[mildom] Change proxy
Related: 
Closes 
pukkandan d0491a1ebe
[twitcasting] Fix extractor
* `Origin: https://twitcasting.tv` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502`
* Fix regex for when `data-movie-playlist` is a dict containing the needed list
* media initialization is fully supported; so change downloader to native

Closes 
nixxo b9d68c199b
[rai] Add support for http formats ()
Authored by: nixxo
pukkandan 201c145953
Update to ytdl-commit-9f6c03
[cbsnews] Fix extraction for python <3.6
9f6c03a006
pukkandan 5d34200268
[youtube:tab] Reload with unavailable videos for all playlists
If the unavailable video is in a later page, the warning and button are not shown in the initial webpage
So we force all playlists' initial page to reload with the correct params
pukkandan b7da73eb19
Add option `--ignore-no-formats-error`
* Ignores the "no video format" and similar errors
* Experimental - Some extractors may still throw these errors
pukkandan 6a39ee13f7
Fix inconsistent use of `report_warning`
coletdjnz 358de58c4d
[youtube:tab] Show unavailable videos in playlists ()
Closes 

Authored by: colethedj
pukkandan a7191c6f57
Fix some linter and typos
lkho baa5873942
[viu:ott] Fix extractor (see desc)
* add language_flag_id query param
* add support for premium account (untested since I dont have a premium account)
* support entire series

Code from:
https://github.com/blackjack4494/youtube-dlc/pull/211
https://github.com/ytdl-org/youtube-dl/pull/15182
https://github.com/ytdl-org/youtube-dl/pull/26775

Fixes:
https://github.com/yt-dlp/yt-dlp/issues/219
https://github.com/ytdl-org/youtube-dl/issues/27946
https://github.com/ytdl-org/youtube-dl/issues/27863
https://github.com/ytdl-org/youtube-dl/issues/27812
https://github.com/ytdl-org/youtube-dl/issues/27464
https://github.com/ytdl-org/youtube-dl/issues/26788
https://github.com/blackjack4494/yt-dlc/issues/136

Possibly also fixes (untested):
https://github.com/ytdl-org/youtube-dl/issues/16992
https://github.com/ytdl-org/youtube-dl/issues/26701

Co-authored by: lkho, pukkandan
coletdjnz 79360d99d3
[youtube] Standardize API calls for tabs, mixes and search ()
Authored by: colethedj
pukkandan 46fff7105e
[youtube] Ignore invalid stretch ratio
Closes 
Ashish b5be6dd504
[TubiTv] Add TubiTvShowIE ()
Authored by: Ashish0804
coletdjnz 8ea3f7b909
[youtube] Improve channel syncid extraction to support ytcfg ()
Authored by: colethedj
pukkandan b31fdeedfd
[documentation] Improvements
coletdjnz f4f751af40
[youtube] Parse API parameters from initial webpage ()
* Obtain innertube_context, api_key and x-goog-visitor-id from webpage
* Generalize the header & Innertube_context extraction across YouTube extractors

Related: 1b0a13f33c

Authored by: colethedj
pukkandan 1988fab7e3
[youtube] Fix thumbnail URL
Closes: https://github.com/yt-dlp/yt-dlp/issues/233 https://github.com/ytdl-org/youtube-dl/issues/28023
pukkandan f7ad71607d
Update to ytdl-commit-4fb25ff
[maoritv] Add new extractor
4fb25ff5a3

Except:
[vimeo] improve extraction 3ae9c0f410
[youtube:tab] Pass innertube context... 1b0a13f33c
pukkandan f37468c41f
Fix default of `dynamic_mpd`
pukkandan 3ffc7c89b0
[youtube] Fix _extract_alerts
* Sometimes one warning is split between multiple runs
* Also simplified code
Henrik Heimbuerger f1823403b0
[nebula] Add extractor (watchnebula.com) ()
Authored by: hheimbuerger
LE 384fb069ec
[NFHSNetwork] Add extractor ()
Authored by: llacb47
bopol a4ddaf231e
[nitter] Fix extraction of reply tweets ()
And update instance list

Closes  

Authored by: B0pol
pukkandan 7e60c06925
[bilibili] Fix uploader
Related: https://github.com/yt-dlp/yt-dlp/issues/222
coletdjnz d92f5d5a90
[youtube] Extract comments' approximate timestamp ()
Authored by: colethedj
bopol c24ce07a84
[nitter] Fix thumbnails ()
Authored by: B0pol
Ashish de6758128e
[DiscoveryPlusIndia] Add DiscoveryPlusIndiaShowIE ()
Co-authored-by: Ashish <ashish@pop-os.localdomain>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
pukkandan 73d4343e39
Fix some `m3u8` not obeying `--allow-unplayable-formats`
pukkandan 39ed931e53
Update to ytdl-commit-654b4f4
[youtube] prioritize information from YoutubeIE for playlist entries
654b4f4ff2
Matthew b28f8d244a
[YouTube] Show premium state in `availability` ()
Authored by colethedj
pukkandan 54df8fc5b2
[ViewSource] Add extractor to handle `view-source:`
The Hatsune Daishi 5d39972ed0
[mildom] Update extractor to comply with current proxy ()
Authored by nao20010128nao
pukkandan 0481374e1d
[DiscoveryPlus] Add discoveryplus.in ()
Closes 
pukkandan df0c81513e
[generic] Detect Invidious' link element (Closes )
pukkandan 3f6a90eb63
[ard:mediathek] Fix video id extraction (Closes )
pukkandan b050d210df
Fix some typos and linter
pukkandan cce889b900 Update to ytdl v2021-04-01
14f29f087e

Closes 
nixxo a6ae61a4c2
[la7] Add podcasts and podcast playlists ()
Authored by: nixxo
pukkandan b704fc1a68
Revert commit 8562218
[ard] improve clip id extraction
8562218350

This was merged incorrectly
pukkandan 1418a0437f
Update to ytdl-commit-8562218
[ard] improve clip id extraction
8562218350
pukkandan 3700c7ef10
[linuxacadamy] Fix login
pukkandan 394dcd4486
Write current epoch to infojson when using `--no-clean-infojson`
Closes 
pukkandan 83b20a970d
[youtube_live_chat] fix bug when trying to set cookies
Closes 
pukkandan e1feb88fdf
[niconico] Fix for when logged in
Related: https://github.com/yt-dlp/yt-dlp/issues/171#issuecomment-803692716
Co-authored by: CXwudi, xtkoba
pukkandan 421a459573
Update to ytdl-commit-7e79ba7
7e79ba7dd6
[vimeo:album] Fix extraction for albums with number of videos multiple to page size
Matthew c224251aad
[youtube] Show if video is `private`, `unlisted` etc in new field `availability` ()
Closes: , https://github.com/ytdl-org/youtube-dl/issues/25631

Authored by: colethedj, pukkandan
pukkandan 037cc66ec8
[linuxacadamy] Improve regex
TODO: We need to make a more robust standard regex for fetching js objects from html
Two Sheds" Jackson 9160a0c6a2
[nbc] Improve metadata extraction ()
Authored by: 2ShedsJackson
2ShedsJackson 5c5fae6d2f
[amcnetworks] Fix extractor ()
* Prefer use of manifest based on `releasePid` since the one based on `videoPid` may have Fairplay
* Additional thumbnail images were added
* Don't add `season_number` and `series` to `title`
* `series` is now set to `None` rather than "_" when empty
* fix bug with age limit

Authored by: 2ShedsJackson
pukkandan c1d3a4a8f0
[niconico] Add user extractor
Co-authored by: animelover1984
pukkandan adc74b3c6d
[bilibili] Add anthology support
Closes: 

Co-authored by: animelover1984
pukkandan beb4b92a66
More consistent warning messages ()
Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>
pukkandan e167860ce7
[documentation] Add deprecated options and aliases in readme
pukkandan e3c076970e
[youtube] bugfix for channel playlist extraction
Bug introduced in cd7c66cf01
pukkandan 7978e172f3
[niconico] Partial fix
TODO:
Smile formats don't work
Extraction code that no longer works needs to be removed

Adapted from:
b5eff52dd9
by animelover1984

Related:
https://github.com/yt-dlp/yt-dlp/issues/171
https://github.com/animelover1984/youtube-dl/issues/29
https://github.com/ytdl-org/youtube-dl/issues/28470
nixxo 605d299f83
[stitcher] Merge from youtube-dl ()
This cherry-picks the commits:
a563c97c5c (diff-cc37718b18689c1c0588c4c74518853ef43ab020bbd674f3c04d4eae037798d2)
8522bcd97c (diff-cc37718b18689c1c0588c4c74518853ef43ab020bbd674f3c04d4eae037798d2)

Authored by: nixxo
nixxo 18c1f04362
[rcs] Improved extraction (See desc) ()
* improved `video_data` extraction
* added an extra fallback value for `description`
* improved regex in `RCSVariousIE`

Authored by: nixxo
pukkandan e4beae703d
[formatSort] Fix `quality` being ignored
Closes 
pukkandan 10db0d2f57
Update to ytdl-commit-3be0980
3be098010f
Matthew a1c5d2ca64
[Youtube] Rewrite comment extraction ()
Closes 

TODO:
* Add an option for the user to specify newest/popular and max number of comments
* Refactor the download code and generalize with TabIE
* Parse time_text to timestamp
CHJ85 ea3a012d2a
[pluto.tv] Add extractor ()
https://github.com/ytdl-org/youtube-dl/pull/27621

Authored by: kevinoconnor7
pukkandan 5b8917fb52
[zee5] Support zee5originals
nixxo 8eec0120a2
[rai] fix drm check ()
Bug introduced by 
Authored by: nixxo
nixxo e4edeb6226
[wimtv] Add extractor ()
Added support for VODs, live and embeds

Authored by: nixxo
Ashish d488e254d9
[Zee5] Add Show Extractor ()
Co-authored-by: Ashish <ashish@pop-os.localdomain>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
pukkandan 54759df586
[zee5] Improve regex
nixxo 605b684c2d
[mtv] Add mtv.it and extract series metadata ()
* New extractors: MTVItalia, MTVItaliaProgramma
* Extract fields: series, season_number, episode_number

Authored-by: nixxo
teesid 1f52a09e2e
[vimeo] Fix videos with password
https://github.com/ytdl-org/youtube-dl/pull/27992

Fixes: https://github.com/ytdl-org/youtube-dl/issues/28354

Authored by teesid
pukkandan fc21af505c
Fix some videos downloading with m3u8 extension
pukkandan 015f3b3120
[bilibili] Change `Accept` header (Closes )
This is a temporary fix. Ideally we should find a more reasonable accept string that just "*/*"

Fixes: https://github.com/ytdl-org/youtube-dl/issues/28363 https://github.com/ytdl-org/youtube-dl/issues/28341

Thanks to animelover1984 for identifying the problem
nixxo 0852947fcc
[rai] Check for DRM ()
Authored by: nixxo <nixxo@protonmail.com>
pukkandan 2be71994c0
[youtube] Detect when Mixes end or wrap around
pukkandan 26fe8ffed0
[youtube] Fix community page continuation (Closes )
nixxo feee67ae88
[gedi] Improvements from youtube-dl ()
Authored-by: nixxo <c.nixxo@gmail.com>
Ashish 1caaf92d47
[MXPlayer] Rewrite extractor with show support ()
Co-authored-by: Ashish <ashish@pop-os.localdomain>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Matthew d069eca7a3
[Youtube] Fix private feeds/playlists on multi-channel accounts ()
Authored by: colethedj
Matthew f3eaa8dd1c
[Youtube] Extract alerts from continuation ()
Related: 

Authored by: colethedj
pukkandan 36147a63e3
[trovo] Pass origin header (Closes )
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28346
pukkandan 57db6a87ef
[lbry] Support lbry:// url
https://github.com/ytdl-org/youtube-dl/pull/28207

Fixes: https://github.com/ytdl-org/youtube-dl/issues/28084

Authored by: nixxo <nixxo@protonmail.com>
pukkandan cd7c66cf01
[youtube] Fix history, trending and mix playlists ()
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: Matthew <colethedj@protonmail.com>
shirt-dev 2c736b4f61
[cbs] Add support for ParamountPlus ()
Related: https://github.com/ytdl-org/youtube-dl/issues/28342

Authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com>
pukkandan 3721515bde
Update to ytdl-2021.03.03
Matthew a5c5623470
[YouTube] Use new browse API for continuation page extraction. ()
Known issues (these issues existed in previous API as well)
* Mix playlists only give 1 page (25 vids)
* Trending only gives 1 video
* History gives 5 pages (200 vids)

Co-authored-by: colethedj, pukkandan
pukkandan c705177da2
[youtube] Throw error when `--extractor-retries` are exhausted (Closes )
Ashutosh Chaudhary 097b056c5a
[mxplayer] Add new extractor
https://github.com/ytdl-org/youtube-dl/pull/27325
Authored by: codeasashu
Han Dai f3b737ed19
[nick] fix extraction
https://github.com/ytdl-org/youtube-dl/pull/27900
Authored by: DennyDai
pukkandan ee1e05581e
[mtv] Fix extractor by reverting changes made in youtube-dlc
youtube-dl has since fixed the extractor and the changes from the two sources are incompatible
pukkandan ec5e77c558
Update to ytdl-2021.03.02
shirt-dev b3b30a4bca
Fix HLS playlist downloading ()
Co-authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com>
pukkandan 5ef7d9bdd8
Release 2021.03.01
pukkandan 62bff2c170
Add option `--extractor-retries` to retry on known extractor errors
* Currently only used by youtube

Fixes https://github.com/ytdl-org/youtube-dl/issues/28194
Possibly also fixes: https://github.com/ytdl-org/youtube-dl/issues/28289 (can not confirm since the issue isn't reliably reproducible)
pukkandan f0884c8b3f Cleanup some code (see desc)
* `--get-comments` doesn't imply `--write-info-json` if `-J`, `-j` or `--print-json` are used
* Don't pass `config_location` to `YoutubeDL` (it is unused)
* [bilibiliaudio] Recognize the file as audio-only
* Update gitignore
* Fix typos
pukkandan 277d6ff5f2
Extract comments only when needed (Closes )
pukkandan 1cf376f55a Add option `--sleep-requests` to sleep b/w requests (Closes )
* Also fix documentation of `sleep_interval_subtitles`

Related issues:
https://github.com/blackjack4494/yt-dlc/issues/158
https://github.com/blackjack4494/youtube-dlc/issues/195
https://github.com/ytdl-org/youtube-dl/pull/28270
https://github.com/ytdl-org/youtube-dl/pull/28144
https://github.com/ytdl-org/youtube-dl/issues/27767
https://github.com/ytdl-org/youtube-dl/issues/23638
https://github.com/ytdl-org/youtube-dl/issues/26287
https://github.com/ytdl-org/youtube-dl/issues/26319