yt-dlc/Changelog.md

Changelog

2021.03.24

• Merge youtube-dl: Upto commit/8562218
• Parse metadata from multiple fields using --parse-metadata
• Ability to load playlist infojson using --load-info-json
• Write current epoch to infojson when using --no-clean-infojson
• [youtube_live_chat] fix bug when trying to set cookies
• [niconico] Fix for when logged in by: @CXwudi and @xtkoba
• [linuxacadamy] Fix login

2021.03.21

• Merge youtube-dl: Upto commit/7e79ba7

• Option --no-clean-infojson to keep private keys in the infojson

• [aria2c] Support retry/abort unavailable fragments by damianoamatruda

• [aria2c] Better default arguments

• [movefiles] Fix bugs and make more robust

• [formatSort] Fix quality being ignored

• [splitchapters] Fix for older ffmpeg

• [sponskrub] Pass proxy to sponskrub

• Make sure post_hook gets the final filename

• Recursively remove any private keys from infojson

• Embed video URL metadata inside mp4 by damianoamatruda and pukkandan

• Merge webm formats into mkv if thumbnails are to be embedded by damianoamatruda

• Use headers and cookies when downloading subtitles by damianoamatruda

• Parse resolution in info dictionary by damianoamatruda

• More consistent warning messages by damianoamatruda and pukkandan

• [documentation] Add deprecated options and aliases in readme

• [documentation] Fix some minor mistakes

• [niconico] Partial fix adapted from animelover1984/youtube-dl@b5eff52 (login and smile formats still don't work)

• [niconico] Add user extractor by animelover1984

• [bilibili] Add anthology support by animelover1984

• [amcnetworks] Fix extractor by 2ShedsJackson

• [stitcher] Merge from youtube-dl by nixxo

• [rcs] Improved extraction by nixxo

• [linuxacadamy] Improve regex

• [youtube] Show if video is private, unlisted etc in info (availability) by colethedj and pukkandan

• [youtube] bugfix for channel playlist extraction

• [nbc] Improve metadata extraction by 2ShedsJackson

2021.03.15

• Split video by chapters: using option --split-chapters
  • The output file of the split files can be set with -o/-P using the prefix chapter:
  • Additional keys section_title, section_number, section_start, section_end are available in the output template
• Parallel fragment downloads by shirt
  • Use option --concurrent-fragments (-N) to set the number of threads (default 1)
• Merge youtube-dl: Upto commit/3be0980
• [zee5] Add Show Extractor by Ashish0804 and pukkandan
• [rai] fix drm check nixxo
• [wimtv] Add extractor by nixxo
• [mtv] Add mtv.it and extract series metadata by nixxo
• [pluto.tv] Add extractor by kevinoconnor7
• [youtube] Rewrite comment extraction by colethedj
• [embedthumbnail] Set mtime correctly
• Refactor some postprocessor/downloader code by pukkandan and shirt

2021.03.07

• [youtube] Fix history, mixes, community pages and trending by pukkandan and colethedj
• [youtube] Fix private feeds/playlists on multi-channel accounts by colethedj
• [youtube] Extract alerts from continuation by colethedj
• [cbs] Add support for ParamountPlus by shirt
• [mxplayer] Rewrite extractor with show support by pukkandan and Ashish0804
• [gedi] Improvements from youtube-dl by nixxo
• [vimeo] Fix videos with password by teesid
• [lbry] Support lbry:// url by nixxo
• [bilibili] Change Accept header by pukkandan and animelover1984
• [trovo] Pass origin header
• [rai] Check for DRM by nixxo
• [downloader] Fix bug for ffmpeg/httpie
• [update] Fix updater removing the executable bit on some UNIX distros
• [update] Fix current build hash for UNIX
• [documentation] Include wget/curl/aria2c install instructions for Unix by Ashish0804
• Fix some videos downloading with m3u8 extension
• Remove "fixup is ignored" warning when fixup wasn't passed by user

2021.03.03.2

• [build] Fix bug

2021.03.03

• [youtube] Use new browse API for continuation page extraction by colethedj and pukkandan
• Fix HLS playlist downloading by shirt
• Merge youtube-dl: Upto 2021.03.03
• [mtv] Fix extractor
• [nick] Fix extractor by DennyDai
• [mxplayer] Add new extractor by codeasashu
• [youtube] Throw error when --extractor-retries are exhausted
• Reduce default of --extractor-retries to 3
• Fix packaging bugs by hseg

2021.03.01

• Allow specifying path in --external-downloader
• Add option --sleep-requests to sleep b/w requests
• Add option --extractor-retries to retry on known extractor errors
• Extract comments only when needed
• --get-comments doesn't imply --write-info-json if -J, -j or --print-json are used
• Fix get_executable_path by shirt
• [youtube] Retry on more known errors than just HTTP-5xx
• [youtube] Fix inconsistent webpage_url
• [tennistv] Fix format sorting
• [bilibiliaudio] Recognize the file as audio-only
• [hrfensehen] Fix wrong import
• [viki] Fix viki play pass authentication by RobinD42
• [readthedocs] Improvements by shirt
• [hls] Fix bug with m3u8 format extraction
• [hls] Enable --hls-use-mpegts by default when downloading live-streams
• [embedthumbnail] Fix bug with deleting original thumbnail
• [build] Fix completion paths, zsh pip completion install by hseg
• [ci] Disable download tests unless specifically invoked
• Cleanup some code and fix typos

2021.02.24

• Moved project to an organization yt-dlp
• Completely changed project name to yt-dlp by Pccode66 and pukkandan
  • Also, youtube-dlc config files are no longer loaded
• Merge youtube-dl: Upto commit/4460329 (except tmz, gedi)
• Readthedocs support by shirt
• [youtube] Show if video was a live stream in info (was_live)
• [Zee5] Add new extractor by Ashish0804 and pukkandan
• [jwplatform] Add support for hyland.com
• [tennistv] Fix extractor
• [hls] Support media initialization by shirt
• [hls] Added options --hls-split-discontinuity to better support media discontinuity by shirt
• [ffmpeg] Allow passing custom arguments before -i using --ppa "ffmpeg_i1:ARGS" syntax
• Fix --windows-filenames removing / from UNIX paths
• [hls] Show warning if pycryptodome is not found
• [documentation] Improvements
  • Fix documentation of Extractor Options
  • Document all in format selection
  • Document playable_in_embed in output templates

2021.02.19

• Merge youtube-dl: Upto commit/cf2dbec (except kakao)
• [viki] Fix extractor
• [niconico] Extract channel and channel_id by kurumigi
• [youtube] Multiple page support for hashtag URLs
• [youtube] Add more invidious instances
• [youtube] Fix comment extraction when comment text is empty
• Option --windows-filenames to force use of windows compatible filenames
• [ExtractAudio] Bugfix
• Don't raise parser.error when exiting for update
• [MoveFiles] Fix for when merger can't run
• Changed --trim-file-name to --trim-filenames to be similar to related options
• Format Sort improvements:
  • Prefer vp9.2 more than other vp9 codecs
  • Remove forced priority of quality
  • Remove unnecessary field_preference and misuse of preference from extractors
• Build improvements:
  • Fix hash output by shirt
  • Lock python package versions for x86 and use wheels by shirt
  • Exclude vcruntime140.dll from UPX by jbruchon
  • Set version number based on UTC time, not local time
  • Publish on PyPi only if token is set
• [documentation] Better document --prefer-free-formats and add --no-prefer-free-format

2021.02.15

• Merge youtube-dl: Upto 2021.02.10 (except archive.org)
• [niconico] Improved extraction and support encrypted/SMILE movies by kurumigi, tsukumi, bbepis, pukkandan
• Fix HLS AES-128 with multiple keys in external downloaders by shirt
• [youtube_live_chat] Fix by using POST API by siikamiika
• [rumble] Add support for video page
• Option --allow-unplayable-formats to allow downloading unplayable video formats
• [ExtractAudio] Don't re-encode when file is already in a common audio format
• [youtube] Fix search continuations
• [youtube] Fix for new accounts
• Improve build/updater: by pukkandan and shirt
  • Fix SHA256 calculation in build and implement hash checking for updater
  • Exit immediately in windows once the update process starts
  • Fix updater for x86.exe
  • Updater looks for both yt-dlp and youtube-dlc in releases for future-proofing
  • Change optional dependency to pycryptodome
• Fix issue with unicode filenames in aria2c by shirt
• Fix allow_playlist_files not being correctly passed through
• Fix for empty HTTP head requests by shirt
• Fix get_executable_path in UNIX
• [sponskrub] Print ffmpeg output and errors to terminal
• __real_download should be false when ffmpeg unavailable and no download
• Show exe/zip/source and 32/64bit in verbose message

2021.02.09

• aria2c support for DASH/HLS: by shirt
• Implement Updater (-U) by shirt
• [youtube] Fix comment extraction
• [youtube_live_chat] Improve extraction
• [youtube] Fix for channel URLs sometimes not downloading all pages
• [aria2c] Changed default arguments to --console-log-level=warn --summary-interval=0 --file-allocation=none -x16 -j16 -s16
• Add fallback for thumbnails
• [embedthumbnail] Keep original thumbnail after conversion if write_thumbnail given
• [embedsubtitle] Keep original subtitle after conversion if write_subtitles given
• [pyinst.py] Move back to root dir
• [youtube] Simplified renderer parsing and bugfixes
• [movefiles] Fix compatibility with python2
• [remuxvideo] Fix validation of conditional remux
• [sponskrub] Don't raise error when the video does not exist
• [documentation] Crypto is an optional dependency

2021.02.04

• Merge youtube-dl: Upto 2021.02.04.1
• Date/time formatting in output template:
  • You can use strftime to format date/time fields. Example: %(upload_date>%Y-%m-%d)s
• Multiple output templates:
  • Separate output templates can be given for the different metadata files by using -o TYPE:TEMPLATE
  • The allowed types are: subtitle|thumbnail|description|annotation|infojson|pl_description|pl_infojson
• [youtube] More metadata extraction for channel/playlist URLs (channel, uploader, thumbnail, tags)
• New option --no-write-playlist-metafiles to prevent writing playlist metadata files
• [audius] Fix extractor
• [youtube_live_chat] Fix parse_yt_initial_data and add fragment_retries
• [postprocessor] Raise errors correctly
• [metadatafromtitle] Fix bug when extracting data from numeric fields
• Fix issue with overwriting files
• Fix "Default format spec" appearing in quiet mode
• [FormatSort] Allow user to prefer av01 over vp9 (The default is still vp9)
• [FormatSort] fix bug where quality had more priority than hasvid
• [pyinst] Automatically detect python architecture and working directory
• Strip out internal fields such as _filename from infojson

2021.01.29

• Features from animelover1984/youtube-dl: by animelover1984 and bbepis
  • Add --get-comments
  • [youtube] Extract comments
  • [billibilli] Added BiliBiliSearchIE, BilibiliChannelIE
  • [billibilli] Extract comments
  • [billibilli] Better video extraction
  • Write playlist data to infojson
  • [FFmpegMetadata] Embed infojson inside the video
  • [EmbedThumbnail] Try embedding in mp4 using ffprobe and -disposition
  • [EmbedThumbnail] Treat mka like mkv and mov like mp4
  • [EmbedThumbnail] Embed in ogg/opus
  • [VideoRemuxer] Conditionally remux video
  • [VideoRemuxer] Add -movflags +faststart when remuxing to mp4
  • [ffmpeg] Print entire stderr in verbose when there is error
  • [EmbedSubtitle] Warn when embedding ass in mp4
  • [anvato] Use NFLTokenGenerator if possible
• Parse additional metadata: New option --parse-metadata to extract additional metadata from existing fields
  • The extracted fields can be used in --output
  • Deprecated --metadata-from-title
• [Audius] Add extractor
• [youtube] Extract playlist description and write it to .description file
• Detect existing files even when using recode/remux (extract-audio is partially fixed)
• Fix wrong user config from v2021.01.24
• [youtube] Report error message from youtube as error instead of warning
• [FormatSort] Fix some fields not sorting from v2021.01.24
• [postprocessor] Deprecate avconv/avprobe. All current functionality is left untouched. But don't expect any new features to work with avconv
• [postprocessor] fix write_debug to not throw error when there is no _downloader
• [movefiles] Don't give "cant find" warning when move is unnecessary
• Refactor update-version, pyinst.py and related files
• [ffmpeg] Document more formats that are supported for remux/recode

2021.01.24

• Merge youtube-dl: Upto 2021.01.24
• Plugin support (documentation)
• Multiple paths: New option -P/--paths to give different paths for different types of files
  • The syntax is -P "type:path" -P "type:path" (documentation)
  • Valid types are: home, temp, description, annotation, subtitle, infojson, thumbnail
  • Additionally, configuration file is taken from home directory or current directory (documentation)
• Allow passing different arguments to different external downloaders (documentation)
• [mildom] Add extractor by nao20010128nao
• Warn when using old style --external-downloader-args and --post-processor-args
• Fix --no-overwrite when using --write-link
• [sponskrub] Output unrecognized argument error message correctly
• [cbs] Make failure to extract title non-fatal
• Fix typecasting when pre-checking archive
• Fix issue with setting title on UNIX
• Deprecate redundant aliases in formatSort. The aliases remain functional for backward compatibility, but will be left undocumented
• [tests] Fix test_post_hooks
• [tests] Split core and download tests

2021.01.20

• [TrovoLive] Add extractor (only VODs)
• [pokemon] Add /#/player URLs
• Improved parsing of multiple postprocessor-args, add --ppa as alias
• [EmbedThumbnail] Simplify embedding in mkv
• [sponskrub] Encode filenames correctly, better debug output and error message
• [readme] Cleanup options

2021.01.16

• Merge youtube-dl: Upto 2021.01.16
• Configuration files:
  • Portable configuration file: ./yt-dlp.conf
  • Allow the configuration files to be named yt-dlp instead of youtube-dlc. See this for details
• Add PyPI release

2021.01.14

• Added option --break-on-reject
• [roosterteeth.com] Fix for bonus episodes by Zocker1999NET
• [tiktok] Fix for when share_info is empty
• [EmbedThumbnail] Fix bug due to incorrect function name
• [documentation] Changed sponskrub links to point to yt-dlp/SponSkrub since I am now providing both linux and windows releases
• [documentation] Change all links to correctly point to new fork URL
• [documentation] Fixes typos

2021.01.12

• [roosterteeth.com] Add subtitle support by samiksome
• Added --force-overwrites, --no-force-overwrites by alxnull
• Changed fork name to yt-dlp
• Fix typos by FelixFrog
• [ci] Option to skip
• [changelog] Added unreleased changes in blackjack4494/yt-dlc

2021.01.10

• [archive.org] Fix extractor and add support for audio and playlists by wporr
• [Animelab] Added by mariuszskon
• [youtube:search] Fix view_count by ohnonot
• [youtube] Show if video is embeddable in info (playable_in_embed)
• Update version badge automatically in README
• Enable test_youtube_search_matching
• Create to_screen and similar functions in postprocessor/common

2021.01.09

• [youtube] Fix bug in automatic caption extraction
• Add post_hooks to YoutubeDL by alexmerkel
• Batch file enumeration improvements by glenn-slayden
• Stop immediately when reaching --max-downloads by glenn-slayden
• Fix incorrect ANSI sequence for restoring console-window title by glenn-slayden
• Kill child processes when yt-dlc is killed by Unrud

2021.01.08

• Merge youtube-dl: Upto 2021.01.08 except stitcher (1, 2)
• Moved changelog to seperate file

2021.01.07-1

• [Akamai] fix by nixxo
• [Tiktok] merge youtube-dl tiktok extractor by GreyAlien502
• [vlive] add support for playlists by kyuyeunk
• [youtube_live_chat] make sure playerOffsetMs is positive by siikamiika
• Ignore extra data streams in ffmpeg by jbruchon
• Allow passing different arguments to different postprocessors using --postprocessor-args
• Deprecated --sponskrub-args. The same can now be done using --postprocessor-args "sponskrub:<args>"
• [CI] Split tests into core-test and full-test

2021.01.07

• Removed priority of av01 codec in -S since most devices don't support it yet
• Added duration_string to be used in --output
• Created First Release

2021.01.05-1

• Changed defaults:
  • Enabled --ignore
  • Disabled --video-multistreams and --audio-multistreams
  • Changed default format selection to bv*+ba/b when --audio-multistreams is disabled
  • Changed default format sort order to res,fps,codec,size,br,asr,proto,ext,has_audio,source,format_id
  • Changed webm to be more preferable than flv in format sorting
  • Changed default output template to %(title)s [%(id)s].%(ext)s
  • Enabled --list-formats-as-table

2021.01.05

• Format Sort: Added --format-sort (-S), --format-sort-force (--S-force) - See Sorting Formats for details
• Format Selection: See Format Selection for details
  • New format selectors: best*, worst*, bestvideo*, bestaudio*, worstvideo*, worstaudio*
  • Changed video format sorting to show video only files and video+audio files together.
  • Added --video-multistreams, --no-video-multistreams, --audio-multistreams, --no-audio-multistreams
  • Added b,w,v,a as alias for best, worst, video and audio respectively
• Shortcut Options: Added --write-link, --write-url-link, --write-webloc-link, --write-desktop-link by h-h-h-h - See Internet Shortcut Options for details
• Sponskrub integration: Added --sponskrub, --sponskrub-cut, --sponskrub-force, --sponskrub-location, --sponskrub-args - See SponSkrub Options for details
• Added --force-download-archive (--force-write-archive) by h-h-h-h
• Added --list-formats-as-table, --list-formats-old
• Negative Options: Makes it possible to negate most boolean options by adding a no- to the switch. Usefull when you want to reverse an option that is defined in a config file
  • Added --no-ignore-dynamic-mpd, --no-allow-dynamic-mpd, --allow-dynamic-mpd, --youtube-include-hls-manifest, --no-youtube-include-hls-manifest, --no-youtube-skip-hls-manifest, --no-download, --no-download-archive, --resize-buffer, --part, --mtime, --no-keep-fragments, --no-cookies, --no-write-annotations, --no-write-info-json, --no-write-description, --no-write-thumbnail, --youtube-include-dash-manifest, --post-overwrites, --no-keep-video, --no-embed-subs, --no-embed-thumbnail, --no-add-metadata, --no-include-ads, --no-write-sub, --no-write-auto-sub, --no-playlist-reverse, --no-restrict-filenames, --youtube-include-dash-manifest, --no-format-sort-force, --flat-videos, --no-list-formats-as-table, --no-sponskrub, --no-sponskrub-cut, --no-sponskrub-force
  • Renamed: --write-subs, --no-write-subs, --no-write-auto-subs, --write-auto-subs. Note that these can still be used without the ending "s"
• Relaxed validation for format filters so that any arbitrary field can be used
• Fix for embedding thumbnail in mp3 by pauldubois98 (ytdl-org/youtube-dl#21569)
• Make Twitch Video ID output from Playlist and VOD extractor same. This is only a temporary fix
• Merge youtube-dl: Upto 2021.01.03 - See blackjack4494/yt-dlc#280 for details
  • Extractors tiktok and hotstar have not been merged
• Cleaned up the fork for public use

PS: All uncredited changes above this point are authored by pukkandan

Unreleased changes in blackjack4494/yt-dlc

• Updated to youtube-dl release 2020.11.26 by pukkandan
• Youtube improvements by pukkandan
  • Implemented all Youtube Feeds (ytfav, ytwatchlater, ytsubs, ythistory, ytrec) and SearchURL
  • Fix some improper Youtube URLs
  • Redirect channel home to /video
  • Print youtube's warning message
  • Handle Multiple pages for feeds better
• [youtube] Fix ytsearch not returning results sometimes due to promoted content by colethedj
• [youtube] Temporary fix for automatic captions - disable json3 by blackjack4494
• Add --break-on-existing by gergesh
• Pre-check video IDs in the archive before downloading by pukkandan
• [bitwave.tv] New extractor by lorpus
• [Gedi] Add extractor by nixxo
• [Rcs] Add new extractor by nixxo
• [skyit] New skyitalia extractor by nixxo
• [france.tv] Fix thumbnail URL by renalid
• [ina] support mobile links by B0pol
• [instagram] Fix thumbnail extractor by nao20010128nao
• [SouthparkDe] Support for English URLs by xypwn
• [spreaker] fix SpreakerShowIE test URL by pukkandan
• [Vlive] Fix playlist handling when downloading a channel by kyuyeunk
• [tmz] Fix extractor by diegorodriguezv
• [generic] Detect embedded bitchute videos by pukkandan
• [generic] Extract embedded youtube and twitter videos by diegorodriguezv
• [ffmpeg] Ensure all streams are copied by pukkandan
• [embedthumbnail] Fix for os.rename error by pukkandan
• make_win.bat: don't use UPX to pack vcruntime140.dll by jbruchon