Commit Graph

1904 Commits (84131d035130f40f98b71e43d6e680202c9da4c1)

Author SHA1 Message Date
pukkandan 2e25ce3a05
[niconico] Set `expected_protocol` to a public field
Closes 
Lesmiscore (Naoya Ozaki) c854208ccf
[downloader/fragment] Make single thread download work for --live-from-start ()
Authored by: Lesmiscore
pukkandan e06bd8800f
Fix `--skip-unavailable-fragments`
Bug in d71fd41249
Closes 
pukkandan abfecb7bc1
[utils] Fix WebSocketsWrapper
Bug in 3cea3edd1a
Closes 
pukkandan 3b9d9f4374
Do not change fragment chunk-size when `--test`
Closes 
coletdjnz affc4fefea
[youtube] Fix episode metadata extraction
pukkandan 583910682f
[chingari] Fix archiving and tests
Felix S a49e777d59
[spotify] Detect iframe embeds ()
Authored by: fstirlitz
Akmal cda1bc5197
[facebook] Improve thumbnail extraction ()
Authored by: Wikidepia
pukkandan 743f39750c
Fix bug in 66cf3e1001
pukkandan 66cf3e1001
[EmbedSubtitle] Enable for more video extensions
Closes 
pukkandan b07897ef5b
[utils] certifi: Make sure the pem file exists
Closes 
pukkandan e5a998f368
[cleanup] Misc cleanup ()
Authored by: fstirlitz, pukkandan
pukkandan f82711587c
[cleanup] Sort imports
Using https://github.com/PyCQA/isort

    isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
pukkandan 86e5f3ed2e
[cleanup] Upgrade syntax
Using https://github.com/asottile/pyupgrade

1. `__future__` imports and `coding: utf-8` were removed
2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format`
3. f-strings were cherry-picked from `pyupgrade --py36-plus`

Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
pukkandan f9934b9614
[cleanup] Mark some compat variables for removal ()
Authored by fstirlitz, pukkandan
felix cfb0511d82
[cleanup] Remove unused code paths ()
Notes:

* `_windows_write_string`: Fixed in 3.6
  * https://bugs.python.org/issue1602
  * PEP: https://www.python.org/dev/peps/pep-0528

* Windows UTF-8 fix: Fixed in 3.3
  * https://bugs.python.org/issue13216

* `__loader__`: is always present in 3.3+
  * https://bugs.python.org/issue14646

* `workaround_optparse_bug9161`: Fixed in 2.7
  * https://bugs.python.org/issue9161

Authored by: fstirlitz
felix ab96d1ad1b
[cleanup] Remove unused scripts/tests ()
Authored by fstirlitz, pukkandan
pukkandan 5a727063c5
[FFmpegMetadataPP] Remove `\0` from metadata
mehq fcdb8d6e88
[Gofile] Fix extraction ()
Closes 
Authored by: mehq
krichbanana ca5300c7ed
[youtube] Add `:ytnotifications` extractor ()
Authored by: krichbanana
pukkandan 97ec5bc550
[cookies] Report progress when importing cookies
pukkandan a25bca9f89
[youtube, cleanup] Minor refactoring
Authored by: coletdjnz, pukkandan
pukkandan f894294636
[EmbedThumbnail] Do not remove id3v1 tags
Lesmiscore 98804d034d
[utils] locked_file: Do not give executable bits for newly created files
Authored by: Lesmiscore
pukkandan 4abea8ca0a
[utils] `sanitize_path`: Fix when path is empty string
pukkandan d46a3e7a12
[rai] Add `release_year`
Closes 
Ashish Gupta 2d2b5493ee [ZEE5] Fix extractor.
Authored by: Ashish0804
Closes: https://github.com/yt-dlp/yt-dlp/issues/3105
github-actions dee1d65dc3 [version] update
Created by: pukkandan

:ci skip all
Jacek Nowacki 89fabf1125
[bilibili] Fix extraction of title with quotes ()
Closes 
Authored by: dzek69
pukkandan 11e1c2e3f8
[TikTokVM] Fix redirect to user URL
Closes , Closes 
pukkandan ebc7d3ff1f
[docs] Minor improvements (, )
Authored by: cffswb, danielyli


Co-authored-by: Daniel Li <dan@danielyli.com>
Co-authored-by: cffswb <karte577@gmail.com>
pukkandan d8a58ddce7
De-prioritize automatic-subtitles when no `--sub-lang` is given
Closes 
mehq 4d57133095
[Jable] Add extractor ()
Closes 
Authored by: mehq
Alexander Seiler 9b8b7a7b5e
[Zattoo] Fix extractors ()
Closes: 
Authored by: goggle
Ha Tien Loi ab0970b233
[NRK] Extract timestamp ()
Closes 
Authored by: hatienl0i261299
Lesmiscore b52e788eb2
[Piapro] Extract description with break lines
Authored by: Lesmiscore
Closes 
pukkandan 316f2650f8
Ignore `mhtml` formats from `-f mergeall`
Closes 
Ha Tien Loi bd4073c535
[AfreecaTV] Add `AfreecaTVUserIE` ()
Closes 
Authored by: hatienl0i261299
pukkandan 22fba53fbd
[FfmpegMetadata] Write id3v1 tags
coletdev 61d3665d9d
[youtube] Fix uploader for collaborative playlists ()
Authored by: coletdjnz
Lesmiscore (Naoya Ozaki) 870efdee28
[TVer] Fix extractor ()
Authored by: Lesmiscore
pukkandan b506289fe2
[test] Add `test_locked_file`
pukkandan b63837bce0
[utils] locked_file: Fix non-blocking non-exclusive lock
Justin Keogh fcfa8853e4
[utils] locked_file: Do not truncate files before locking ()
Authored by: jakeogh, pukkandan
Lesmiscore (Naoya Ozaki) 06b1628d3e
[twitcasting] Don't return multi_video for archive with single hls manifest ()
Authored by: Lesmiscore
panatexxa da1ffde15d
[Moviepilot] Add extractor ()
Authored by: panatexxa
Ha Tien Loi 42a4f21a03
[fptplay] Fix metadata extraction ()
Authored by: hatienl0i261299
pukkandan 8973767198
Do not lock downloading file on Windows
Closes 
pukkandan 0edb3e336c
Do not prevent download if locking is unsupported
Closes 

Failure to lock download-archive is still fatal.
This is consistent with youtube-dl's behavior
pukkandan ce0593ef61
[http] Fix
pukkandan a44ca5a470
[cleanup] Misc fixes
Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117

Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, a825ffbffa (commitcomment-68538986), https://github.com/yt-dlp/yt-dlp/issues/2360, 5fa3c9a88f (r70393519), 5fa3c9a88f (r70393254)
Teemu Ikonen 0a8a7e68fa
[ruutu] Detect embeds ()
Authored by: tpikonen
Jeff Huffman f4d706a931
[crunchyroll:playlist] Implement beta API ()
Closes , 

Authored by: tejing1
Ha Tien Loi 5fa3c9a88f
[TikTok] Fix URLs with user id ()
Closes 
Authored by: hatienl0i261299
pukkandan 04f3fd2c89
[cleanup] Use `_html_extract_title`
pukkandan 85e801a9db
Fallback to video-only format when selecting by extension
Closes 
pukkandan 5127e92a94
Fix filepath sanitization in `--print-to-file`
Ha Tien Loi 18eac302a2
[Imdb] Improve extractor ()
Closes 
Authored by: hatienl0i261299
Tim Schindler 12e022d074
[Cybrary] Add extractor ()
Authored by: aaearon
Lesmiscore (Naoya Ozaki) 265e586d96
[openrec] Download archived livestreams ()
Authored by: Lesmiscore
Fam0r fbfde1c3e6
[elonet] Rewrite extractor ()
Closes 
Authored by: Fam0r, pukkandan
aarubui dc57e74a7f
[tenplay] Improve extractor ()
Authored by: aarubui
pukkandan a17526e427
[youtube:tab] Minor improvements (See desc)
* Support shorts on channel homepage
* Extract thumbnail of OLAK playlists
coletdev ad210f4fd4
[youtube:search] Support hashtag entries ()
Authored-by: coletdjnz
coletdjnz c8e856a551
[web.archive:youtube] Make CDX API requests non-fatal
Partial fix for https://github.com/yt-dlp/yt-dlp/issues/3278
Authored-by: coletdjnz
nixxo c085e4ec47
[rai] Fix extraction of http formats ()
Closes 
Authored by: nixxo
pukkandan 4c268f9cb7
[Nebula] Fix bug in 52efa4b312
Lesmiscore (Naoya Ozaki) 5d45484cc7
[niconico] Fix extraction of thumbnails and uploader ()
pukkandan e6f868a63c
[utils] `traverse_obj`: Allow filtering by value
pukkandan c4f60dd7cd
[utils] Add `try_call`
pukkandan f189faf1ce
[BRMediathek] Fix VALID_URL
Closes 
Alexander Seiler 504f789ad5
[AZMedien] Support `tv.telezueri.ch` ()
Authored by: goggle
Bricio bb5a7cb8ad
[Craftsy] Add extractor ()
Authored by: Bricio
zackmark29 c418e6b5a6
[viu] Fix bypass for preview ()
Authored by: zackmark29
pukkandan 11078c6d57
[crunhyroll] Fix inheritance
https://github.com/yt-dlp/yt-dlp/pull/2955#issuecomment-1083060465
Daniel ab2579bb45
[xnxx] Add `xnxx3.com` ()
Authored by: rozari0
Ha Tien Loi 48e15bb6b1
[dailymotion] Support `geo.dailymotion.com` ()
Closes 
Authored by: hatienl0i261299
pukkandan af4944d84b
Fix bug in 8a7f68d0b1
Closes 
David e7870111e8
[YouTube] Add new age-gate bypass ()
Closes 
Authored by: zerodytrash, pukkandan
pukkandan 8a7f68d0b1
[ffmpeg] Cache version data
Related: https://github.com/dasl-/pifi/issues/9
Ha Tien Loi 9139d2fae0
[WasdTV] Add extractor ()
Closes 
Authored by: un-def, hatienl0i261299
nyuszika7h bdd60588b0
[viki] Don't attempt to modify URLs with signature ()
Closes 
Authored by: nyuszika7h
Luc Ritchie f5f15c9993
[BiliIntl] Support user-generated videos ()
Authored by: wlritchi
pukkandan cb96c5be70
Fix `--no-overwrite` for playlist infojson
Fixes: https://github.com/yt-dlp/yt-dlp/issues/1467#issuecomment-1079922971
pukkandan 90137ca4be
[utils] Add `filter_dict`
coletdev 1c1b2f96ae
[youtube:tab] Fix duration extraction for shorts ()
Related: https://github.com/TeamNewPipe/NewPipe/issues/8034
Authored-by: coletdjnz
Felix S 47b8bf207b
[go,viu] Extract subtitles from the m3u8 manifest ()
Authored by: fstirlitz
Tim Schindler 4628a3aa75
[ITProTV] Add extractor ()
Authored by: aaearon
mehq 5b4bb715e6
[BanBye] Add extractor ()
Closes 
Authored by: mehq
pukkandan 1235d333ab
[youtube] Fix auto-translated automatic captions
d49669acad only covered ASR

Closes 
pukkandan 18e4940825
[youtube] Add extractor-arg to skip auto-translated subs
pukkandan c0b6e5c74d
Show warning when all media formats have DRM
Related: 
shirt 727029c508
[youtube] Detect DRM better
Authored by: shirt-dev
pukkandan 5c3895fff1
[outtmpl] Limit changes during sanitization
Closes 
coletdev fd2ad7cb24
[youtube:tab] Return shorts url if video is a short ()
Allows filtering out shorts from feeds with `--match-filter`
Closes 
Authored-by: coletdjnz
pukkandan 4a3175fc4c
[VideoConvertor] Ensure all streams are copied
Closes 
pukkandan 5cf34021f5
[Concat] Ensure final directory exists
Fixes https://github.com/yt-dlp/yt-dlp/issues/3181#issuecomment-1079622589
pukkandan 34baa9fdf0
[outtmpl] Fix replacement/default when used with alternate
pukkandan 6db9c4d57d
Ignore format-specific fields in initial pass of `--match-filter`
Closes 
Lesmiscore (Naoya Ozaki) 3cea3edd1a
[utils] WebSocketsWrapper: Allow omitting `__enter__` invocation ()
Authored by: Lesmiscore
pukkandan b1a7cd056a
Treat multiple `--match-filters` as OR
Closes 
pukkandan 28787f16c6
[downloader] Fix invocation of `HttpieFD`
Closes 
zackmark29 1fb707badb
[viu] Fixed extractor ()
Closes 
Authored by: zackmark29, pukkandan
pukkandan a3f2445e29
[postprocessor,cleanup] Create `_download_json`
pukkandan ae72962643
[youtube] Try embedded client variants before agegate
agegate variants appears to be broken, but don't remove them for the time-being
pukkandan ae6a1b9585
[docs] Minor improvements
Closes , Closes , Closes 
pukkandan 231025c463
Fix bug in 52efa4b312
Closes 
pukkandan 700ccbe3f1
[extractor] Allow control characters inside json
Closes 
vvto33 12a64f2777
[TVer] Support landing page ()
Authored by: vvto33
mehq b8f2f8f6b3
[LastFM] Add extractors ()
Closes 
Authored by: mehq
coletdev af14914baa
Remove `Accept-Encoding` header from `std_headers` ()
This should be set by each downloader to what it supports.
Fixes https://github.com/yt-dlp/yt-dlp/issues/3142
Authored-by: coletdjnz
pukkandan ea5ca8e7fc
[ellentube] Extract subtitles from manifest
Fixes https://github.com/ytdl-org/youtube-dl/issues/30761
Lesmiscore (Naoya Ozaki) c2d2ee40eb
[generic] Extract subtitles from video.js ()
Authored by: Lesmiscore
pukkandan c70c418d33
Fix `--abort-on-error` for subtitles
Closes 
pukkandan b9c7b1e9b4
[cleanup, vimeo] Fix tests
coletdev d5820461e8
Use certificates from `certifi` if installed ()
Fixes  and most `CERTIFICATE_VERIFY_FAILED` issues

Authored by: coletdjnz
coletdev 8a23db9519
[wget] Fix proxy ()
Upstream PR: https://github.com/ytdl-org/youtube-dl/pull/29343
Authored-by: kikuyan, coletdjnz
CplPwnies 1f1df1251e
[adobepass] Fix Suddenlink MSO ()
Authored by: CplPwnies
1-Byte 84842aee2b
[azmedien] Add TVO Online to supported hosts ()
Authored by: 1-Byte
Lesmiscore (Naoya Ozaki) be4685ab7b
[http] Reject broken range before request ()
* And fix filesize estimate for byterange downloads

Closes 
Authored by: Lesmiscore, Jules-A, pukkandan
coletdev e6552207da
[panopto] Improve subtitle extraction and support slides ()
Related: , 
Authored-by: coletdjnz
coletdev a2e77303e3
[downloader/http] Retry on more errors ()
Closes , 
Related: , 
Authored-by: coletdjnz
foghawk 510809f1aa
[nitter] Minor fixes and update instance list ()
Authored by: foghawk
i6t f4ad919298
[Veo] Fix extractor ()
Authored by: i6t
s0u1h eeb2a770f3
[utils] `format_decimal_suffix`: Fix for very large numbers ()
Authored by: s0u1h
pukkandan 0c14d66ad9
Fix `autonumber`
Bug in 09b49e1f68
pukkandan 52efa4b312
[extractor] Add `_perform_login` function ()
* Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API
* Adds `ie.supports_login` to the public API
Luc Ritchie 028f6437f1
[afreecatv] Match new vod url ()
Authored by: wlritchi
Sipherdrakon 43c38abd1f
[ParamountPlus,CBS] Change VALID_URL ()
Closes 

Authored by: Sipherdrakon
pukkandan e4b98809cf
[youtube] Fix pagination of `membership` tab
pukkandan 16c620bc55
Handle float in `--wait-for-video`
Closes 
pukkandan 5a373d9768
[veo] Fix `_VALID_URL`
Closes 
Ha Tien Loi 7e6a187096
[Huya] Add extractor ()
Closes 
Authored by: hatienl0i261299
Lesmiscore (Naoya Ozaki) 3f168f0e45
[RUTV] Fix format sorting ()
Closes 
Authored by: Lesmiscore
Lesmiscore (Naoya Ozaki) 7bdcb4a40e
[niconico] Rewrite NiconicoIE ()
Closes https://github.com/yt-dlp/yt-dlp/issues/2636, partially fixes https://github.com/yt-dlp/yt-dlp/issues/367
Authored by: Lesmiscore
Soebb 497a6c5f57
[daftsex] Fix extractor ()
Closes 

Authored by: Soebb
BohwaZ 4b3c5d1b81
[FranceCulture] Support playlists ()
Authored by: bohwaz
Dorian Westacott ec47c12f69
[ParamountPlusSeries] Support multiple pages ()
Authored by: dodrian
pukkandan 25791435b7
[arte] Add `format_note` to m3u8 formats
Related: 
pukkandan 4e34889f1c
[rumble] unescape title
pukkandan a1b2d84360
[youtube] Avoid false positives when detecting damaged formats
Closes 
coletdjnz 5dbc77df26
[youtube:api] Prefer minified JSON response
Authored-by: coletdjnz
Lesmiscore (Naoya Ozaki) d71fd41249
[fragment] Read downloaded fragments only when needed ()
Authored by: Lesmiscore
pukkandan aeb21b98f1
[phantomjs] Fix bug in 8b7539d27c
Closes 
coletdev b3edc8068e
[downloader/mhtml] Fix fragments with absolute urls ()
Authored-by: coletdjnz
coletdev 17322130a9
[youtube] Improve video upload date handling ()
* Don't prefer UTC upload date for past live streams/premieres
* Improve regex (fixes a regression)

Authored-by: coletdjnz
pukkandan 5ca764c506
[FFmpegVideoConvertor] Add more formats to `--remux-video`
pukkandan e880c92c65
Exit after `--dump-user-agent`
Bug in d1b5f70bc9

Closes 
coletdjnz a825ffbffa
[extractor] Support merging subtitles with data
Authored-by: coletdjnz
pukkandan 592b748582
[cleanup] Minor cleanup
Closes 
pukkandan cf4f42cb97
Protect stdout from unexpected progress and console-title
Closes 
pukkandan da1d734fbe
Remove incorrect warning for `--dateafter`
Closes 
pukkandan 2b38f7b2bc
[MetadataParser] Validate outtmpl early
pukkandan 76aa991374
Fix case of `http_headers`
Bug in 8b7539d27c

Fixes https://github.com/yt-dlp/yt-dlp/issues/1346#issuecomment-1064527765
Lesmiscore (Naoya Ozaki) 24e3d87431
[PokemonSoundLibrary] Add extractor ()
Authored by: Lesmiscore
Ha Tien Loi 63b2f88bc7
[Zingmp3] Fix signature ()
Authored by: hatienl0i261299
pukkandan 07ff290dce
Fix `--sleep-interval`
Bug in d1b5f70bc9

Closes 
pukkandan 51c22ef4e2
Fix `--throttled-rate`
Typo in d1b5f70bc9

Closes 
Ha Tien Loi 33b8c411bc
[MangoTV] Improve extractor ()
Authored by: hatienl0i261299
MMM 10331a2672
Fix `--print` with `--ignore-no-formats` when url is `None` ()
Authored by: flashdagger
Lesmiscore (Naoya Ozaki) 6e6beffd04
[openrec] Refactor extractors ()
Authored by: Lesmiscore
pukkandan e491d06d34
[utils] ExtractorError: Fix for older python versions
Closes 
coletdev e248be3319
[panopto] Add extractors ()
Based on https://github.com/ytdl-org/youtube-dl/pull/13449
Closes 
Authored by: coletdjnz, kmark
pukkandan ff91cf7483
[utils] Add `get_first`
github-actions a3b7dff015 [version] update
Created by: pukkandan

:ci skip all
pukkandan d1b5f70bc9
[cleanup] Refactor `__init__.py` ()
* Split `__init__` code into multiple functions
* Clean up validation code by grouping similar types of options
* Expose `parse_options` to third parties
github-actions 1eae7f94c1
[version] update
Created by: pukkandan

:ci skip all
P-reducible 9461cb586a
[Rokfin] Fix `availability` ()
Authored by: P-reducible
pukkandan a405b38f20
[youtube] Further de-prioritize 3gp format
pukkandan 08d30158ec
[cleanup, docs] Misc cleanup
Closes , closes , closes , closes 
Ha Tien Loi c89bec262c
[xinpianchang] Add extractor ()
Authored by: hatienl0i261299
Ha Tien Loi 151f8f1c02
[fptplay] Add extractor ()
Closes 
Authored by: hatienl0i261299
Max Mehl a35155be17
[peertube] Add media.fsfe.org ()
Authored by: mxmehl
nyuszika7h e66662b1e0
[ccma] Fix timestamp parsing ()
Authored by: nyuszika7h
coletdev 4390d5ec12
Add brotli content-encoding support ()
Authored by: coletdjnz
CplPwnies 9e0e6adb2d
[adobepass] Add Suddenlink MSO ()
Closes 
Authored by: CplPwnies
Lesmiscore b637c4e22e
[mildom] Fix linter
Lesmiscore (Naoya Ozaki) fb6e3f4389
[mildom] Rework extractors ()
Authored by: Lesmiscore
pukkandan 409cdd1ec9
[ard] Fix valid URL
Partial fix for 
coletdev 992f9a730b
[youtube] Prefer UTC upload date for videos ()
Except for live/scheduled streams/premieres. 
Closes 
Related:  
Authored-by: coletdjnz
pukkandan 497d2fab6c
[utils] Better traceback for `ExtractorError`
pukkandan 2807d1709b
[nrk] Add fallback API
Closes 
Lesmiscore 1ed7953a74
[utils] render_table: Fix character calculation for removing extra gap
without this fix, the column next to delimiter will lack leading spaces on terminal (see https://github.com/yt-dlp/yt-dlp/pull/920#issuecomment-1059914615 for the situation)
pukkandan d49669acad
[youtube] Fix automatic captions
Closes 
foghawk bed30106f5
[tumblr] Fix extractor ()
Authored by: foghawk
Zenon Mousmoulas 27231526ae
[ant1newsgr] Add extractor ()
Authored by: zmousm
pukkandan 50e93e03a7
Update to ytdl-commit-6508688
Make default upload_/release_date a compat_str
6508688e88

Except:
* "[NDR] Overhaul NDR and NJoy extractors" https://github.com/ytdl-org/youtube-dl/pull/30531
    - 01824d275b
    - 39a98b09a2
    - f0a05a55c2
    - 4186e81777
FestplattenSchnitzel 72e995f122
[VideocampusSachsen] Add extractors ()
Authored by: FestplattenSchnitzel
pukkandan 8b7539d27c
Implement `--add-header` without modifying `std_headers`
Closes , 
pukkandan e48b3875ec
Revert 2e4cacd038
Closes 
pukkandan 2a938746f3
Fix verbose log when stdout/stderr encoding is `None`
See: 5c10453827
pukkandan 933dbf5a55
[bandcamp] Detect acodec
pukkandan a10aa588b0
[FormatSort] Consider `acodec`=`ogg` as `vorbis`
pukkandan be8cd3cb1d
[twitch] Fix field name of `view_count`
pukkandan 319b6059d2
Better error message when no --live-from-start format
pukkandan 4c3f8c3fb6
Handle negative duration from extractor
Closes 
pukkandan 7265a2190c
Fix doubling of `video_id` in `ExtractorError`
pukkandan 3a4bb9f751
[lbry] Fix `--ignore-no-formats-error`
Closes 
i6t b90dbe6c19
[Gettr] Improve extractor ()
Authored by: i6t