Commit Graph

285 Commits (9b5efaf86b99a2664fff9fc725d275f766c3221d)

Author SHA1 Message Date
pukkandan 6993f78d1b
[extractor,utils] Detect more codecs/mimetypes
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29943
pukkandan a2160aa45f
[extractor] Generalize `getcomments` implementation
pukkandan cc16383ff3
[extractor] Simplify search extractors
pukkandan ba10757412 [extractor] Detect `EXT-X-KEY` Apple FairPlay
pukkandan b5ae35ee6d
[cleanup] Misc cleanup
pukkandan 819e05319b
Improved progress reporting (See desc) ()
* Separate `--console-title` and `--no-progress`
* Add option `--progress` to show progress-bar even in quiet mode
* Fix and refactor `minicurses`
* Use `minicurses` for all progress reporting
* Standardize use of terminal sequences and enable color support for windows 10
* Add option `--progress-template` to customize progress-bar and console-title
* Add postprocessor hooks and progress reporting

Closes: , , , 
Felix S 9359f3d4f0
[extractor] Extract storyboards from SMIL manifests ()
Authored by: fstirlitz
pukkandan e6f21b3d92
[docs,cleanup] Some minor refactoring and improve docs
ChillingPepper 3cf4b91dc5
[SovietsCloset] Add duration from m3u8 ()
Authored by: ChillingPepper
pukkandan 1813a6ccd4
[youtube] Fix `--mark-watched` with `--cookies-from-browser`
Closes 
pukkandan bd6f722de8
dump files should obey `--trim-filename` ()
Authored by: sulyi
DigitalDJ f9cc0161e6
[extractor] Fix root-relative URLs in MPD ()
Authored by: DigitalDJ
pukkandan 0001fcb586
Add option `--netrc-location`
Closes , 
pukkandan 198e3a04c9
[FormatSort] Remove priority of `lang`
pukkandan 6251555f1c
[downloader/ffmpeg] Support for DASH manifests (experimental)
Closes 
pukkandan 1151c4079a
[extractor] Show video id in error messages if possible
pukkandan 88acdbc269
[extractor] Better error message for DRM ()
Closes 
pukkandan 3fb4e21b38
[lazy_extractors] Fix `suitable` and add flake8 test
pukkandan 5ad28e7ffd
[extractor] Common function `_match_valid_url`
pukkandan a8731fcc1d minor bugfixes
bugs due to be2fc5b212, e9f4ccd19e
pukkandan be2fc5b212
[extractor] Detect `sttp` as subtitles in MPD
Closes 
Solution by: fstirlitz
pukkandan b868936cd6 [cleanup] Misc
pukkandan 28f436bad0 [extractor] Reset non-repeating warnings per video
MinePlayersPE 3dbb2a9dcb
[RCTIPlus] Support events and TV ()
Authored by: MinePlayersPE
LE 68f5867cf0
[CBS] Add fallback ()
Related: https://github.com/ytdl-org/youtube-dl/issues/29564
Authored-by: llacb47, pukkandan
pukkandan dbf5416a20 [cleanup] Refactor some code
pukkandan f5510afef0
[FormatSort] Fix bug for audio with unknown codec
pukkandan ae30b84072
Add field `live_status`
pukkandan 0ba692acc8
[youtube] Extract more thumbnails
* The thumbnail URLs are hard-coded and their actual existence is tested lazily
* Added option `--no-check-formats` to not test them

Closes , Related: , , https://github.com/ytdl-org/youtube-dl/issues/29049
Felix S da1c94ee45
[generic] Extract previously missed subtitles ()
* [generic] Extract subtitles in cases missed previously
* [common] Detect discarded subtitles in SMIL manifests
* [generic] Extract everything in the SMIL manifest

Authored by: fstirlitz
felix 198f7ea89e
[extractor] Allow extracting multiple groups in `_search_regex`
From , Authored by: fstirlitz
pukkandan 6606817a86
[utils] Add `variadic`
pukkandan 4bb6b02f93
Improve `extractor_args` parsing
pukkandan 46890374f7
[extractor] Minor improvements (See desc)
1. Allow removal of login hint - extractors can set their own login hint as part of `msg`
2. Cleanup `_merge_subtitles` signature
pukkandan 60755938b3
[extractor] Prevent unnecessary download of hls manifests
and refactor `hls_split_discontinuity` code
pukkandan 5d3a0e794b
Add `--extractor-args` to pass extractor-specific arguments
pukkandan e36d50c5dd
[websockets] Add `WebSocketFragmentFD` ()
Necessary for 

Co-authored by: nao20010128nao, pukkandan
pukkandan d0fb4bd16f
[pornhub] Extract `cast`
Closes , https://github.com/ytdl-org/youtube-dl/pull/27384
felix cdb19aa4c2
[downloader/mhtml] Add new downloader ()
This downloader is intended to be used for streams that consist of a
timed sequence of stand-alone images, such as slideshows or thumbnail
streams

This can be used for implementing:

https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

https://github.com/ytdl-org/youtube-dl/issues/9868
https://github.com/ytdl-org/youtube-dl/pull/14951


Authored by: fstirlitz
pukkandan 8326b00aab
Allow `images` formats
Necessary for .

* They are identified by `vcodec=acodec='none'`
* These formats show as the worst in `-F`
* Any postprocessor that expects audio/video will be skipped
* `b*` and all related selectors will skip such formats
* This commit also does not add any selector for downloading such formats. They have to be explicitly requested by the `format_id`. Implementation of a selector is left for when  is resolved
pukkandan 3b1fe47d84
Release 2021.06.08
felix e2efe599aa
[common] Fix FourCC fallback when parsing ISM ()
In some DASH manifests, the FourCC attribute is actually present,
but empty.  We thus apply the same fallback to 'AACL' that we do
when the attribute is entirely absent.

Authored by: fstirlitz
pukkandan b0089e8992
[fancode] Add extractor (#316,#354)
Closes , 

Authored by: rmsmachine
pukkandan adddc50cbf
[extractor] Functions to parse socket.io response as json
Authored by: pukkandan, llacb47
pukkandan 37a3bb66a7
[extractor] Allow `note=False` when extracting manifests
pukkandan 177877c544
[extractor] Always prefer native hls downloader by default
When the manifest is not downloadable by native downloader, it already is able to detect it and switch to `ffmpeg`. So there doesn't seem to be a reason anymore to use ffmpeg as the preferred downloader
pukkandan 3907333c5d
[extractor] Skip subtitles without URI in m3u8 manifests
Closes 

Authored by: hheimbuerger
pukkandan 9d5d4d64f8
[youtube] Better message when login required
pukkandan 07cce701de
[cleanup] linter, code formatting and readme
pukkandan a06916d98e
[extractor] Add `write_debug` and `get_param`
pukkandan 2412044c90
Add field `name` for subtitles
Co-authored by: pukkandan, tpikonen

Based on: , https://github.com/ytdl-org/youtube-dl/pull/26112
pukkandan 0760b0a7e2
Standardize `write_debug`
pukkandan 3d89341b47
[common] bugfix for when `compat_opts` is not given
pukkandan fac988053f
Release 2021.05.11
* and some documentation improvements
pukkandan 53ed7066ab
Option `--compat-options` to revert some of yt-dlp's changes
* Deprecates `--list-formats-as-table`, `--list-formats-old`
pukkandan 3158150cb7
[utils] Add `network_exceptions`
The Hatsune Daishi 0fa9a1e236
[whowatch] Add extractor
closes 

Authored by: nao20010128nao 
Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py
Felix S 66a1b8643a [downloader/ism] Support muxing TTML subtitles
Felix S 4a2f19abbd [downloader/hls] Assemble single-file WebVTT subtitles from HLS segments
Felix S f6a1d69a87 [extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks
Felix S fd76a14259 [extractor/common, downloader/ism] Extract SSTR subtitle tracks
_parse_ism_formats was extended into _parse_ism_formats_and_subtitles;
all direct users were updated, though _extract_ism_formats was left
as a compatibility wrapper.

The SSTR downloader was also modified in order to prepare for muxing
subtitle streams, although no support for any subtitle codecs was
added in this commit.
Felix S 171e59edd4 [extractor/common] Extract DASH subtitle tracks
_extract_mpd_formats and _parse_mpd_formats were extended into
_…_formats_and_subtitles; wrappers with old names are provided
for compatibility.
Felix S a0c3b2d5cf [extractor/common] Extract HLS subtitle tracks
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles
and extended to handle subtitle tracks instead of skipping them;
a wrapper with the old name is provided for compatibility.

_parse_m3u8_formats is likewise renamed and extended, but without adding
the compatibility wrapper; the test suite is adjusted to test the enhanced
method instead.
Felix S 19bb39202d [extractor/common] Generalise _merge_subtitles
This allows modifying a subtitles dictionary in-place.
pukkandan 6a04a74e8b
[FormatSort] Fix for when some formats have quality and others don't
pukkandan b7da73eb19
Add option `--ignore-no-formats-error`
* Ignores the "no video format" and similar errors
* Experimental - Some extractors may still throw these errors
pukkandan 6a39ee13f7
Fix inconsistent use of `report_warning`
pukkandan b31fdeedfd
[documentation] Improvements
pukkandan f7ad71607d
Update to ytdl-commit-4fb25ff
[maoritv] Add new extractor
4fb25ff5a3

Except:
[vimeo] improve extraction 3ae9c0f410
[youtube:tab] Pass innertube context... 1b0a13f33c
pukkandan f37468c41f
Fix default of `dynamic_mpd`
pukkandan 73d4343e39
Fix some `m3u8` not obeying `--allow-unplayable-formats`
pukkandan 39ed931e53
Update to ytdl-commit-654b4f4
[youtube] prioritize information from YoutubeIE for playlist entries
654b4f4ff2
pukkandan b050d210df
Fix some typos and linter
Matthew c224251aad
[youtube] Show if video is `private`, `unlisted` etc in new field `availability` ()
Closes: , https://github.com/ytdl-org/youtube-dl/issues/25631

Authored by: colethedj, pukkandan
pukkandan e167860ce7
[documentation] Add deprecated options and aliases in readme
pukkandan e4beae703d
[formatSort] Fix `quality` being ignored
Closes 
pukkandan 10db0d2f57
Update to ytdl-commit-3be0980
3be098010f
Matthew a1c5d2ca64
[Youtube] Rewrite comment extraction ()
Closes 

TODO:
* Add an option for the user to specify newest/popular and max number of comments
* Refactor the download code and generalize with TabIE
* Parse time_text to timestamp
pukkandan fc21af505c
Fix some videos downloading with m3u8 extension
shirt-dev b3b30a4bca
Fix HLS playlist downloading ()
Co-authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com>
pukkandan 5ef7d9bdd8
Release 2021.03.01
pukkandan 277d6ff5f2
Extract comments only when needed (Closes )
pukkandan 1cf376f55a Add option `--sleep-requests` to sleep b/w requests (Closes )
* Also fix documentation of `sleep_interval_subtitles`

Related issues:
https://github.com/blackjack4494/yt-dlc/issues/158
https://github.com/blackjack4494/youtube-dlc/issues/195
https://github.com/ytdl-org/youtube-dl/pull/28270
https://github.com/ytdl-org/youtube-dl/pull/28144
https://github.com/ytdl-org/youtube-dl/issues/27767
https://github.com/ytdl-org/youtube-dl/issues/23638
https://github.com/ytdl-org/youtube-dl/issues/26287
https://github.com/ytdl-org/youtube-dl/issues/26319
pukkandan ed9b7e3dd3 Fix bug with m3u8 format extraction
Pccode66 7a5c1cfe93
Completely change project name to yt-dlp ()
* All modules and binary names are changed
* All documentation references changed
* yt-dlp no longer loads youtube-dlc config files
* All URLs changed to point to organization account

Co-authored-by: Pccode66
Co-authored-by: pukkandan