Commit Graph

3089 Commits (131d132da5c98c6c78bd7eed4b37f4458561b3d9)

Author SHA1 Message Date
bashonly 4f7b11cc1c
[extractor/voot] Fix extractor ()
Closes 
Authored by: bashonly
bashonly d1795f4a6a
[extractor/twitter] Add login support ()
Closes 
Authored by: bashonly
bashonly 44c0d66442
[extractor/lbry] Extract original quality formats ()
Closes 
Authored by: bashonly
coletdjnz 8213ce28a4
[extractor/youtube] Extract `channel_is_verified` ()
Authored by: coletdjnz
pukkandan 14a14335b2
[extractor/youtube] Misc cleanup
Authored by: coletdjnz
stanoarn c2b801fea5
[extractor/rozhlas] `MujRozhlas`: Add extractor ()
Authored by: stanoarn
bashonly 59d9fe0831
[extractor/mgtv] Fix formats extraction ()
Closes 
Authored by: bashonly
bashonly ee0ed0338d
[extractor/zdf] Fix formats extraction
Closes , Closes 
Authored by: bashonly
bashonly c2a1bdb009
[extractor/tiktok] Extract 1080p adaptive formats ()
Closes 
Authored by: bashonly
bashonly 7f8ddebbb5
[extractor/hotstar] Support `/shows/` URLs ()
Closes 
Authored by: bashonly
bashonly 7bc9251746
[extractor/shemaroome] Pass `stream_key` header to downloader ()
Closes 
Authored by: bashonly
bashonly 4815d35c19
[extractor/sonyliv] Fix login with token ()
Authored by: bashonly
bashonly 97d60ad8cd
[extractor/foxnews] Fix extractors ()
Closes 
Authored by: bashonly
bashonly 5ee9a7d6e1
[extractor/sverigesradio] Support slug URLs ()
Closes 
Authored by: bashonly
bashonly 971d901d12
[extractor/tencent] Fix fatal metadata extraction ()
Closes 
Authored by: bashonly
bashonly 12037d8b0a
[extractor/substack] Fix extraction ()
Closes 
Authored by: bashonly
Paul Wise c91ac833ea
[extractor/acast] Support embeds ()
Authored by: pabs3
coletdjnz 2fb35f6004
[extractor/youtube] Support shorter relative time format ()
See: https://github.com/TeamNewPipe/NewPipeExtractor/issues/1067

Authored by: coletdjnz
Jeroen Jacobs 1a7dcca378
[extractor/vrt] Overhaul extractors ()
* Fixes `VrtNU` extractor to work with the VRT MAX site change
* Adapts `VRT`, `Ketnet` and `DagelijkseKost` extractors to the new VRT API
* Removes `Canvas` and `CanvasEen` extractors; the sites and API no longer exist
* Moves all remaining VRT-related extractors into the `vrt` module

Closes 
Authored by: jeroenj, bergoid, bashonly

Co-authored-by: bergoid <bergoid@users.noreply.github.com>
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>
Mohamed Al Mehairbi 55ed4ff734
[extractor/DigitalConcertHall] Support films ()
Authored by: ItzMaxTV
Closes 
bashonly 01231feb14
[extractor/twitch] Update `_CLIENT_ID` and add extractor-arg ()
Closes , Closes 
Authored by: bashonly
Daniel Rich f41b949a2e
[extractor/nhk] Fix API extraction ()
Closes 
Authored by: sjthespian, menschel

Co-authored-by: Patrick Menschel <menschel.p@posteo.de>
coletdjnz c35448b7b1
[extractor/youtube] Extract more metadata for comments ()
Adds new comment fields:
* `author_url` - The url to the comment author's page
* `author_is_verified` - Whether the author is verified on the platform
* `is_pinned` - Whether the comment is pinned to the top of the comments

Closes https://github.com/yt-dlp/yt-dlp/issues/5411

Authored by: coletdjnz
CeruleanSky 1c16d9df53
[extractor/twitter:spaces] Add `release_timestamp` ()
Authored by: CeruleanSky
Mohamed Al Mehairbi ecfe47973f
[extractor/elevensports] Add extractor ()
Closes 
Authored by: ItzMaxTV
coletdjnz 18f8fba7c8
[extractor/youtube] Fix continuation loop with no comments ()
Deep check the response for incomplete data.

Authored by: coletdjnz
mrscrapy c2502cfed9
[extractor/recurbate] Add extractor ()
Authored by: mrscrapy
bashonly 1fe5bf240e
[extractor/bravotv] Detect DRM ()
Authored by: bashonly
Mohamed Al Mehairbi 26c517b29c
[extractor/crtvg] Add extractor ()
Closes 
Authored by: ItzMaxTV
Elyse 6f10cdcf7e
[extractor/bilibili:SpaceVideo] Extract signature ()
Authored by: elyse0
Closes , closes 
HobbyistDev 03789976d3
[extractor/europarl] Rewrite extractor ()
Authored by: HobbyistDev
Closes 
Mohamed Al Mehairbi dc3c44f349
[extractor/Mzaalo] Add extractor ()
Authored by: ItzMaxTV
Ivan Skodje 937264419f
[extractor/tvplay] Remove outdated domains ()
Closes 
Authored by: ivanskodje
Ivan Skodje 372a0f3b9d
Auto-select default format in `-f-` ()
Authored by: ivanskodje, pukkandan
Closes 
garret 4cbfa570a1
[extractor/camfm] Add extractors ()
Authored by: garret1317
HobbyistDev 45e87ea106
[extractor/eurosport] Improve `_VALID_URL` ()
Closes 
Authored by: HobbyistDev
Florian Albrechtskirchinger dbce5afa6b
[extractor/twitch:vod] Support links from schedule tab ()
Authored by: falbrechtskirchinger
Stefan Lobbenmeier f78eb41e1c
[extractor/ARDBetaMediathek] Add thumbnail ()
Closes 
Authored by: StefanLobbenmeier
Matt Broadway b38d4c941d
[cookies] Update for chromium changes ()
Authored by: mbway
hasezoey 489f51279d
[extractor/nekohacker] Add extractor ()
Authored by: hasezoey
JChris246 2d306c03d6
[extractor/rottentomatoes] Fix extractor ()
Closes 
Authored by: JChris246
bashonly f6e43d6fa9
[extractor/cbsnews] Overhaul extractors ()
Closes 
Authored by: bashonly
bashonly fd5d93f704
Bugfix for b844a3f8b1
[extractor/weverse] Avoid unnecessary duplicate login

Authored by: bashonly
Lesmiscore f8f9250fe2
[extractor/niconico:live] Add extractor ()
Authored by: Lesmiscore
Lesmiscore 3459d3c5af
[extractor/JStream] Add extractor ()
Authored by: Lesmiscore
bashonly c25cac2f8e
[extractor/dacast] Add extractors ()
Closes 
Authored by: bashonly
Nam Vu a58182b75a
[cookies] Support custom Safari cookies path ()
Authored by: NextFire
jo-nike 4afb208cf0
[extractor/cbc] Ignore 426 from API ()
Closes 
Authored by: jo-nike
ping 5c14b21367
[extractor/idolplus] Add extractor ()
Authored by:  ping
Closes 
bepvte 02312c03cf
[extractor/twitch] Support mobile clips ()
Authored by: bepvte
Stefan Borer 94627c5dde
[extractor/playsuisse] Support new url format ()
Authored by: sbor23
Daniel Vogt c6d4b82a8b
[extractor/owncloud] Add extractor ()
Authored by: C0D3D3V
Ha Tien Loi 17d7ca84ea
[extractor/zingmp3] Fix and improve extractors ()
Authored by: hatienl0i261299
Mohit Tokas bfdf144c7e
[extractor/livestream] Support videos with account id ()
Authored by: theperfectpunk
Closes 
nixxo c6d3f81a40
[extractor/rai] Rewrite extractors ()
Authored by: nixxo, danog
Closes , closes 

Co-authored-by: Daniil Gentili <daniil@daniil.it>
lauren n. liberda aed945e1b9
[extractor/wykop] Add extractors ()
Authored by: selfisekai
JChris246 fc5a7f9b27
[extractor/daftsex] Update domain and embed player url ()
Closes 
Authored by: JChris246
lauren n. liberda 738c90a463
[extractor/polskieradio] Improve extractors ()
Authored by: selfisekai
coletdjnz 93e12ed76e
[extractor/youtube] Extract uploader metadata for feed/playlist items
Fixes https://github.com/yt-dlp/yt-dlp/issues/7104

Authored by: coletdjnz
Mohamed Al Mehairbi 6dc00acf0f
[extractor/weyyak] Add extractor ()
Closes 
Authored by: ItzMaxTV
coletdjnz daafbf49b3
[core] Support decoding multiple content encodings ()
Authored by: coletdjnz
coletdjnz 3f66b6fe50
[core] Workaround erroneous urllib Windows proxy parsing ()
Convert proxies extracted from windows registry to http for older Python versions.
See: https://github.com/python/cpython/issues/86793

Authored by: coletdjnz
coletdjnz b87e01c123
[cookies] Move `YoutubeDLCookieJar` to cookies module ()
Authored by: coletdjnz
coletdjnz 08916a49c7
[core] Improve HTTP redirect handling ()
Aligns HTTP redirect handling with what browsers commonly do and RFC standards. 

Fixes issues afac4caa7d missed.

Authored by: coletdjnz
sqrtNOT 66468bbf49
[extractor/comedycentral] Add support for movies ()
Closes 
Authored by: sqrtNOT
bashonly b844a3f8b1
[extractor/weverse] Add extractors ()
Closes 
Authored by: bashonly
Audrey 5caf30dbc3
[extractor/youtube] Extract `heatmap` data ()
Closes 
Authored by: tntmod54321
MMM 4ad58667c1
[extractor/bibeltv] Fix extraction, support live streams and series ()
Authored by: flashdagger
Simon Sawicki edbe5b589d
Bugfixes for 4823ec9f46
Hotfix for fragmented downloads

Authored by: bashonly
Simon Sawicki 032de83ea9
[extractor/crunchyroll] Rework with support for movies, music and artists ()
This adds `CrunchyrollMusicIE` and `CrunchyrollArtistIE` extractors using the new, reworked base class and expands the `CrunchyrollBetaIE` with support for movies and movie listings and more complete metadata extraction

Authored by: Grub4K
Simon Sawicki 8417f26b8a
[core] Implement `--color` flag ()
Authored by: Grub4K
pukkandan 7aeda6cc9e
[jsinterp] Do not compile regex
pukkandan 4823ec9f46
Update to ytdl-commit-d1c6c5
[YouTube] [core] Improve platform debug log, based on yt-dlp
d1c6c5c4d6

Except:
    * 6ed34338285f722d0da312ce0af3a15a077a3e2a [jsinterp] Add short-cut evaluation for common expression
        * There was no performance improvement when tested with https://github.com/ytdl-org/youtube-dl/issues/30641
    * e8de54bce50f6f77a4d7e8e80675f7003d5bf630 [core] Handle `/../` sequences in HTTP URLs
        * We plan to implement this differently
pukkandan 46f1370e9a
[devscripts/cli_to_api] Add script
kangalio 69a40e4a7f
[extractor/youtube:music:search_url] Extract title ()
Authored by: kangalio
Closes 
coletdjnz 955c89584b
[core] Deprecate internal `Youtubedl-no-compression` header ()
Authored by: coletdjnz
coletdjnz 69bec6730e
[cleanup, utils] Split into submodules ()
Closes https://github.com/yt-dlp/yt-dlp/pull/2173

Authored by: pukkandan, coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Simon Sawicki 665472a7de
[update] Implement `--update-to` repo
Authored by: Grub4K, pukkandan
Simon Sawicki d2e84d5eb0
[update] Better error handling
Authored by: pukkandan
coletdjnz 447afb9eaa
[extractor/youtube] Support podcasts and releases tabs
Closes https://github.com/yt-dlp/yt-dlp/issues/6893

Authored by: coletdjnz
pukkandan 6f2287cb18
[cleanup] Misc
Closes , closes 
pukkandan 1d7656184c
[jsinterp] Handle `NaN` in bitwise operators
Closes 
pukkandan f7f7a877bf
[extractor/booyah] Remove extractor
Site shut down. Closes 
pukkandan c8bc203fbf
[docs] Misc improvements
Closes , closes , closes , closes , closes , closes , closes 
toomyzoom 21b9413cf7
[extractor/iwara] Implement login ()
Authored by: toomyzoom
bashonly ef8fb7f029
[extractor/wrestleuniverse] Fix extraction, add login ()
Closes 
Authored by: bashonly, Grub4K

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
ringus1 3b52a60688
[extractor/facebook] Fix metadata extraction ()
Closes 
Authored by: ringus1
Lesmiscore c449c0655d
[extractor/abematv] Add fallback for title and description extraction and extract more metadata ()
Authored by: Lesmiscore
lauren n. liberda 0c7ce146e4
[extractor/tvp] Use new API ()
Authored by: selfisekai
Closes 
pukkandan ddae33754a
[extractor/youporn] Extract m3u8 formats
Closes 
Eveldee 45998b3e37
[utils] `locked_file`: Fix for virtiofs ()
Authored by: brandon-dacrib
Closes 
bashonly 2f07c4c1da
[extractor/clipchamp] Add extractor ()
Closes 
Authored by: bashonly
Nicholas Defranco b423b6a48e
[extractor/dlf] Add extractors ()
Closes 
Authored by: nick-cd
bashonly 147e62fc58
[extractor/twitter] Default to GraphQL, handle auth errors ()
Closes 
Authored by: bashonly
Simon Sawicki b079c26f0a
[utils] `traverse_obj`: More fixes ()
- Fix result when branching with `traverse_string`
- Fix `slice` path on `dict`s
- Fix tests and docstrings from 21b5ec86c2
- Add `is_iterable_like` helper function

Authored by: Grub4K
bashonly 4d9280c9c8
[extractor/reddit] Add login support ()
Closes 
Authored by: bashonly
pukkandan 17ba4343cf
Fix f005a35aa7
Printing inside `finally` causes the order of logging to change
when there is an error, which is undesirable. So this is reverted.

The issue of `--print` being blocked by pre-processors was an
unintentional side-effect of changing the operation orders in
170605840e, and this is also partially
reverted.
pukkandan f005a35aa7
Ensure pre-processor errors do not block `--print`
Closes 
makeworld 7a7b1376fb
[extractor/cbc] Fix live extractor, playlist `_VALID_URL` ()
Authored by: makew0rld
pukkandan b5f61b69d4
Fix bug in 170605840e
and related refactor
pukkandan 7cf51f2191
[jsinterp] Handle negative numbers better
Closes 
pukkandan 170605840e
Populate `filename` and `urls` fields at all stages of `--print`
Closes https://github.com/yt-dlp/yt-dlp/issues/6920
garret 30647668a9
[extractor/globalplayer] Add extractors ()
Authored by: garret1317
Alex Klapheke ed81b74802
[extractor/aeonco] Support Youtube embeds ()
Authored by: alexklapheke
Noah 62beefa818
[extractor/pornhub] Set access cookies to fix extraction ()
Closes 
Authored by: Schmoaaaaah, arobase-che

Co-authored-by: Noah <nkempers@outlook.de>
Co-authored-by: ache <ache@ache.one>
Neurognostic 0c4e0fbcad
[extractor/bitchute] Add more fallback subdomains ()
Authored by: Neurognostic
sqrtNOT c86e433c35
[extractor/NiconicoSeries] Fix extraction ()
Authored by: sqrtNOT
Elyse 9b30cd3dfc
[extractors/rtvc] Add extractors ()
* Add `RTVCPlay` extractor
* Add `RTVCPlayEmbed` extractor
* Add `RTVCKaltura` extractor
* Add `SenalColombiaLive` extractor

Closes 
Authored by: elyse0
Simon Sawicki 21b5ec86c2
[utils] `traverse_obj`: Allow iterables in traversal ()
Authored by: Grub4K
pukkandan c16644642b
Add option `--xff`
Deprecates `--geo-bypass`, `--no-geo-bypass, `--geo-bypass-country`, `--geo-bypass-ip-block`
pukkandan 04f8018a05
[extractor/hentaistigma] Remove extractor
Piracy site

Closes 
pukkandan d669772c65
Add `--no-quiet`
Closes 
pukkandan ec9311c41b
[outtmpl] Support `str.format` syntax inside replacements
Closes 
pukkandan 78fde6e339
[outtmpl] Allow `\n` in replacements and default.
Fixes: https://github.com/yt-dlp/yt-dlp/issues/6808#issuecomment-1510055357
Fixes: https://github.com/yt-dlp/yt-dlp/issues/6808#issuecomment-1510363645
JC-Chung 80b732b7a9
[extractor/twitch] Extract original size thumbnail ()
Authored by: JC-Chung
truedread 1ea15603d8
[extractor/wevidi] Add extractor ()
Closes 
Authored by: truedread
garret 8f0be90ecb
[extractor/nhk] Add `NhkRadiru` extractor ()
* Add `NhkRadioNewsPage` extractor

Authored by: garret1317
vidiot720 6a765f135c
[extractor/sbs] Overhaul extractor for new API ()
Closes 
Authored by: vidiot720, dirkf, bashonly
qbnu ab29e47029
[extractor/bilibili] Support festival videos ()
Closes 
Authored by: qbnu
bashonly e5265dc651
[extractor/stageplus] Add extractor ()
Closes 
Authored by: bashonly
zhgwn cbdf9408e6
[extractor/pornez] Support new URL formats ()
Closes , Closes 
Authored by: zhgwn
CoryTibbettsDev 2c566ed141
[extractor/whyp] Add extractor ()
Authored by: CoryTibbettsDev
satan1st 9c92b803fa
[extractor/gronkh] Extract duration and chapters ()
Authored by: satan1st
bashonly 7a6f6f2459
[extractor/reddit] Support cookies and short URLs ()
Closes , Closes 
Authored by: bashonly
bashonly ea05708203
[extractor/adobepass] Handle `Charter_Direct` MSO as `Spectrum` ()
Authored by: bashonly
pukkandan 9874e82b5a
Do not translate newlines in `--print-to-file`
Fixes https://github.com/yt-dlp/yt-dlp/issues/6808#issuecomment-1509361107
pukkandan 84ffeb7d5e
[extractor] Do not warn for invalid chapter data in description
Fixes https://github.com/yt-dlp/yt-dlp/issues/6811#issuecomment-1509876209
coletdjnz 7666b93604
[extractor/youtube] Define strict uploader metadata mapping ()
New mapping:
```
channel -> channel name
channel_id -> UCID
channel_url -> UCID channel url

uploader -> channel name (same as channel field)
uploader_id -> @handle
uploader_url -> @handle channel url 
```

Authored by: coletdjnz
bashonly 93e7c6995e
[extractor/generic] Attempt to detect live HLS ()
* Extract duration for non-live generic HLS videos
* Add extractor-arg `is_live` to bypass live HLS check

Closes 
Authored by: bashonly
bashonly 3f7e2bd80e
[FFmpegFixupM3u8PP] Check audio codec before fixup ()
Closes 
Authored by: bashonly
bashonly 925936908a
[extractor/tiktok] Fix and improve metadata extraction ()
Authored by: bashonly
bashonly 90c1f51206
[extractor/zoom] Fix share URL extraction ()
Authored by: bashonly
hasezoey 56793f74c3
[extractor/iwara] Fix format sorting ()
Authored by: hasezoey
Lesmiscore d1483ec693 [extractor/iwara] Fix typo
Authored by: Lesmiscore

Closes 
MyNey 979568f26e
[extractor/BrainPOP] Add extractors ()
Authored by: MinePlayersPE
Based on https://github.com/ytdl-org/youtube-dl/pull/10025
HobbyistDev b093c38cc9
[extractor/biliIntl] Add comment extraction ()
Authored by: HobbyistDev
HobbyistDev 2d97d154fe
[extractor/gmanetwork] Add extractor ()
Authored by: HobbyistDev
Partially fixes 
pukkandan c3f624ef0a
Relaxed validation for numeric format filters
Continued from f96bff99cb

Closes 
Lesmiscore 52ecc33e22
[extractor/niconico] Download comments from the new endpoint ()
Authored by: Lesmiscore
pukkandan 26010b5cec
[postprocessor/FixupDuplicateMoov] Fix bug in triggering
pukkandan c6786ff3ba
[extractor/youtube] Revert default formats to `https`
Shreyas Minocha 79c77e85b7
[extractor/zoom] Fix extractor ()
Authored by: shreyasminocha
Closes 
sian1468 faa0332ed6
[extractor/line] Remove extractors ()
Service has shut down - https://archive.ph/txVKy
Authored by: sian1468
lauren n. liberda 7e35526d5b
[extractor/hrefli] Add extractor ()
Authored by: selfisekai
Chris Caruso ef0848abd4
[extractor/youku] Improve error message ()
Authored by: carusocr
Closes 
bashonly 0a6918a4a1
[extractor/kick] Make initial request non-fatal
Authored by: bashonly
coletdjnz 141a8dff98
[extractor/youtube] Fix comment loop detection for pinned comments ()
Pinned comments may repeat a second time - this is expected.

Fixes https://github.com/yt-dlp/yt-dlp/issues/6712

Authored by: coletdjnz
Lesmiscore 68be95bd0c
[extractor/YahooGyaOIE,extactor/YahooGyaOPlayerIE] Delete extractors due to website close ()
Authored by: Lesmiscore
Lesmiscore ab92d8651c
[extractor/iwara] Accept old URLs
Authored by: Lesmiscore

Closes 
Lesmiscore 0f0875ed55
[postprocessor/EmbedThumbnail,postprocessor/FFmpegMetadata] Fix error on attaching thumbnails and info json for mkv/mka ()
Authored by: Lesmiscore

Current yt-dlp code never hit this bug, but would hit once filename sanitization gets better