Commit Graph

1640 Commits (c70c418d33cb6b840f27f03ec020577bc86203c0)

Author SHA1 Message Date
pukkandan 334b1c4800
[rokfin] Add extractor (#1534)
Authored by: P-reducible, pukkandan
3 years ago
coletdev 7c219ea601
[youtube:tab] Follow redirect to regional channel (#2884)
Closes #2694
Authored by: coletdjnz
3 years ago
Lesmiscore (Naoya Ozaki) 93c8410d33
[downloader/fragment] Fix bugs around resuming with Range (#2901)
Authored by: Lesmiscore
3 years ago
Lesmiscore 195c22840c
[downloader/fragment] Ignore `FileNotFoundError` when downloading livestreams
when `--live-from-start` is used for YouTube and the live ends, request for the last segment prematurely ends (or 404, 403).
this is causing lack of the file and `FileNotFoundError`
lacking segment doesn't have any data, so it's safe to ignore
3 years ago
Lesmiscore f0734e1190
[downloader/fragment] Fix problem where multiple threads can share one iterator
which causes "ValueError: generator already executing" error

Closes #2881
3 years ago
Lesmiscore (Naoya Ozaki) 15dfb3929c
[fc2:live] Add extractor (#2418)
Authored by: Lesmiscore
3 years ago
Lesmiscore (Naoya Ozaki) 3e9b66d761
[AbemaTV] Add extractors (#1688)
Authored by: Lesmiscore
3 years ago
Lesmiscore (Naoya Ozaki) a539f06570
[downloader/fragment] Improve `--live-from-start` for YouTube livestreams (#2870) 3 years ago
Lesmiscore (Naoya Ozaki) 03f830040a
[YoutubeDL] Fill more fields for playlists (#2824) 3 years ago
pukkandan 09b49e1f68
Add pre-processor stage `after_filter`
* Move `_match_entry` and `post_extract` to `process_video_result`. It is also left in `process_info` for API compat
* `--list-...` options and `--force-write-archive` now obey filtering options
* Move `SponsorBlockPP` to `after_filter`. Closes https://github.com/yt-dlp/yt-dlp/issues/2536
* Reverts 4ec82a72bb since this commit addresses the issue it was solving
3 years ago
pukkandan 1108613f02
[youtube:tab] Reject webpage data if redirected to home page
Closes #2660
3 years ago
pukkandan a30a6ed3e4
[youtube:tab] Add `approximate_date` extractor-arg 3 years ago
pukkandan 65d151d58f
[spiegel] Fix `_VALID_URL`
Closes #2842
3 years ago
pukkandan 72073451be
[ThumbnailsConvertor] Support `webp`
Closes #2226
3 years ago
Lesmiscore (Naoya Ozaki) 77cc7c6e60
[nhk] Add support for NHK for School (#2850)
Authored by: Lesmiscore
3 years ago
i6t 971c4847d7
[Gettr] Fix formats order (#2832)
Closes #2557

Authored by: i6t
3 years ago
Nil Admirari 7a34b5d628
[SponsorBlock] Fixes for highlight and "full video labels" (#2849)
Authored by: nihil-admirari
3 years ago
Aniruddh Joshi 4d4f9a029f
[zee5] Support web-series (#2827)
Authored by: Aniruddh-J
3 years ago
Lesmiscore (Naoya Ozaki) f099df1463
[TwitCasting] Check for password protection (#2838)
Authored by: Lesmiscore
3 years ago
pukkandan 3f4faff748
[generic] Pass referer to extracted formats
Closes #2839
3 years ago
Daniel.Zeng be8d623455
[Bilibili] Pass referer for all formats (#2834)
Authored by: blackgear
3 years ago
Lesmiscore a7d4acc018
[youtube] Escape possible `$` in `_extract_n_function_name` regex 3 years ago
Bepis febff4c119
[tubitv] Fix/improve TV series extraction (#2829)
Authored by: bbepis
3 years ago
pukkandan ed66a17ef0
[FFmpegConcat] Abort on `--simulate` 3 years ago
Bricio 5625e6073f
[Biqle] Fix extractor (#2731)
Closes #193
Authored by: Bricio
3 years ago
pukkandan 0ad92dfb18
[youtube] De-prioritize potentially damaged formats
Closes #2823
3 years ago
pukkandan 60f3e99592
Tolerate failure to `--write-link` due to unknown URL
Closes #2724
3 years ago
pukkandan 8d93e69d67
Create necessary directories for `--print-to-file`
Closes #2721
3 years ago
pukkandan 3aa915400d
Fix `-all` for `--sub-langs`
Closes #2703
3 years ago
pukkandan dcd55f766d
[aria2c] Add `--http-accept-gzip=true`
Closes #1936, #1236
3 years ago
pukkandan 2e4cacd038
[youtube] Fix intermittent failure of embed-based age-gate bypass 3 years ago
Ronnnny c15c316b21
[abc] Support 1080p (#2819)
Authored by: Ronnnny
3 years ago
Bricio 549cb2a836
[rtvs] Fix extractor (#2795)
Closes #2758

Authored by: Bricio
3 years ago
MinePlayersPE c571b3a6ab
[youtube] Fix n-sig extraction for phone player JS (#2816)
Authored by: MinePlayersPE
3 years ago
Bricio 5b804e3906
[washingtonpost] Fix extractor (#2796)
Closes #2778
Authored by: Bricio
3 years ago
Lesmiscore (Naoya Ozaki) 6bb608d055
[piapro] Add extractor (#2801)
Based on https://github.com/ytdl-org/youtube-dl/pull/25922
Closes #2710, https://github.com/ytdl-org/youtube-dl/issues/5856

Authored by: pycabbage, Lesmiscore
3 years ago
Nil Admirari ae419aa94f
[Sponsorblock] minor fixes (#2793)
* preserve mtime - Closes #2769
* keep concat spec on failure

Authored by: nihil-admirari
3 years ago
ajj8 ac184ab742
[bbc] Fix extraction of news articles (#2811)
Closes #1374

Authored by: ajj8
3 years ago
pukkandan 5c10453827
Fix for when stdout/stderr encoding is None
Closes #2711
3 years ago
pukkandan ffa89477ea
[extractor] Fix for manifests without period duration
Closes #2705
Authored by: dirkf, pukkandan
3 years ago
zenerdi0de db74de8c54
[dropbox] fix regex (#2814)
Closes #2812
Authored by: zenerdi0de
3 years ago
Grabien edecb5f81f
[extractor/cspan] Support of C-Span congress videos (#2295)
Authored by: Grabien
3 years ago
lyz-code 85a0ad0117
[bandcamp] Fix user URLs (#2800)
Authored by: lyz-code
3 years ago
Lesmiscore (Naoya Ozaki) 07ea0014ae
[twitcasting] Add fallback for finding running live (#2803)
Authored by: Lesmiscore
3 years ago
schn0sch e1f7f235bd
[peekvids] Use JSON-LD (#2784)
Authored by: schn0sch
3 years ago
Lesmiscore (Naoya Ozaki) 9a5b012575
[niconico:tag] Add support for searching tags (#2789) 3 years ago
Lesmiscore (Naoya Ozaki) df635a09a4
[twitcasting] Fix extraction (#2788)
Authored by: Lesmiscore
3 years ago
cyberfox1691 812283199a
[murrtube] Add extractor (#2387)
Authored by: cyberfox1691
3 years ago
marieell 5c6dfc1f79
[ATVAt] Detect geo-restriction (#2777)
Authored by: marieell
3 years ago
schn0sch c2a8547fdc
[peekvids] Add extractor (#2414)
Authored by: schn0sch
3 years ago
Bricio 0a19532ead
[Caltrans] Add extractor (#2781)
Closes #2775

Authored by: Bricio
3 years ago
Ronald Ip 2d41e2eceb
[twitter] Fix for private videos (#2772)
Closes #2762, https://github.com/ytdl-org/youtube-dl/issues/27643
Authored by: iphoting
3 years ago
Lesmiscore (Naoya Ozaki) 81c5f44c0f
[fc2] Fix extraction (#2776)
Closes #2774

Authored by: Lesmiscore
3 years ago
Michael Pauley 1f7db8533a
[cookies] Update MacOS12 `Cookies.binarycookies` location (#2742)
Authored by: mdpauley
3 years ago
pukkandan e8969bda94
Obey `--abort-on-error` for "ffmpeg not installed"
Closes #1840
3 years ago
chris c82f051dbb
[ruv.is] Add extractor (#2665)
Closes: #2122

Authored by: iw0nderhow
3 years ago
pukkandan 49895f062e
[tiktok] Fix `vt.tiktok` URLs
and add test
3 years ago
coletdev 60f393e48b
[youtube] Ensure subtitle urls are absolute (#2765)
Closes #2755

Authored by: coletdjnz
3 years ago
pukkandan 88afe05695
[tiktok] Fix `vm.tiktok` URLs
Closes #2396
3 years ago
pukkandan 57ebfca39b
Set `webpage_url_...` from `webpage_url` and not input URL
Closes #2756
3 years ago
YuenSzeHong b1cb0525ac
[fujitv] Extract resolution for free sources (#2685)
Authored by: YuenSzeHong
3 years ago
Lesmiscore (Naoya Ozaki) da42679b87
[utils] WebSockets wrapper for non-async functions (#2417)
Authored by: Lesmiscore
3 years ago
Lesmiscore 2944835080
[bigo] Fix extractor to not to use `form_params` 3 years ago
Tom a3eb987e0e
[zoom] Add support for screen cast (#2699)
Authored by: Mipsters
3 years ago
Lesmiscore (Naoya Ozaki) 7bc33ad0e9
[bigo] Add extractor (#2749)
Fixes https://github.com/ytdl-org/youtube-dl/issues/18357

Authored by: Lesmiscore
3 years ago
Bricio 2068a60318
[generic] Set rss `guid` as video id (#2741)
Closes #2424
Authored by: Bricio
3 years ago
Lukas Fink 1ce9a3cb49
Add regex operator and quoting to format filters (#2698)
Closes #2681 
Authored by: lukasfink1
3 years ago
pukkandan d49f8db39f
[utils] Validate `DateRange` input
Closes #2641
3 years ago
pukkandan ab6df717d1
[youtube] Differentiate descriptive audio by language code
Related: #2677
3 years ago
pukkandan 0c8d9e5fec
[youtube] Label original auto-subs
Closes #2655
3 years ago
Felix S 3f047fc406
[extractor] Extract subtitles from manifests for more sites (#2686)
vimeo, globo, kaltura, svt

Authored by: fstirlitz
3 years ago
i6t 82b5176783
[Gettr] Add `GettrStreamingIE` (#2661)
Closes #2654
Authored by: i6t
3 years ago
Bricio 17b183886f
[globo] Expand valid URL (#2732)
Closes #2730 
Authored by: Bricio
3 years ago
Bricio cd170e8184
[beeg] Fix extractor (#2616)
Closes #2592

Authored by: Bricio
3 years ago
pukkandan 297e9952b6
[extractor] Allow `http_headers` to be specified for `thumbnails` 3 years ago
marieell dca4f46274
[cleanup] Remove extractors for some dead websites (#2739)
90tv.ir, HornBunny.com, 220.ro, 5min.com, Kankan.com, Roxwel.com,
FreshLive.tv, TheScene.com, Vube.com

Authored by: marieell
3 years ago
Luc Ritchie 5dee3ad037
[afreecatv] Support password-protected livestreams (#2738)
Authored by: wlritchi
3 years ago
pukkandan 079a7cfc71
[downloader] Do not use aria2c for non-native `m3u8`
Closes #2718
3 years ago
pukkandan 3856407a86
[options] Rename `--clean-infojson` to `--clean-info-json` 3 years ago
pukkandan db2e129ca0
[options] Better ambiguous option resolution
Eg: `--write-auto` no longer results in
> ambiguous option: --write-auto (--write-auto-subs, --write-automatic-subs?)
3 years ago
marieell 1209b6ca5b
[zaq1] Remove dead extractor (#2728)
Was already partially removed in 29f7c58aaf
Authored-by: marieell
3 years ago
Justin Keogh a3125791c7
[utils] Use `locked_file` for `sanitize_open` (#1066)
Authored by: jakeogh
3 years ago
ofkz f1657a98cb
[nfb] Add extractor (#2579)
Authored by: ofkz
3 years ago
github-actions b761428226 [version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan 84bbc54599
[youtube:search] Add tests 3 years ago
pukkandan 1e5d87beee
[websocket] Make syntax error in `websockets` module non-fatal
Closes #2633
3 years ago
nixxo 22219f2d1f
[mediaset] Fix extractor (#2158)
Closes #2149
Authored by: nixxo
3 years ago
Lesmiscore (Naoya Ozaki) 5a13fdd225
[twitcasting] Enforce UTF-8 for POST payload (#2521)
Authored by: Lesmiscore
3 years ago
coletdjnz af5c1c553e
[youtube] Fix search extractor
Regression introduced in 16aa9ea41d. Closes #2628
Authored-by: coletdjnz
3 years ago
github-actions 3cea9ec2eb [version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan d5a398988b
Update to ytdl-commit-78ce962
[youtube] Support channel search
78ce962f4f
3 years ago
pukkandan 455a15e2dc
[cleanup,docs] Minor fixes
Closes #2541, #2484
3 years ago
pukkandan 460a1c08b9
[FFmpegConcat] Abort on --skip-download and download errors
Closes #2470
3 years ago
pukkandan 4918522735
[utils] Strip double spaces in `clean_html`
Closes #2497
Authored by: dirkf
3 years ago
pukkandan 65662dffb1
Make nested --config-locations relative to parent file
* and allow environment variables in it so that you can use `$PWD`/`%cd%`
to specify paths relative to current directory
3 years ago
pukkandan 5e51f4a8ad
[glomex] Simplify embed detection (#2600)
Closes #2512
3 years ago
pukkandan 54bb39065c
[bilibili] Fix extractor
Closes #2599, Closes #2562
Fixes https://github.com/yt-dlp/yt-dlp/pull/1716#issuecomment-980512982
3 years ago
pukkandan c5332d7fbb
[instagram] Fix bug in 013322a95e
Closes #2552
3 years ago
pukkandan 35cd4c4d88
[cctv] De-prioritize sample format
Closes #2479
3 years ago
pukkandan 67fb99f193
[doodstream] Fix extractor
Closes #2584
3 years ago
pukkandan 85553414ae
[generic] Allow further processing of json_ld URL
Closes #2578
3 years ago
pukkandan d16df59db5
Fix `--compat-options list-formats`
Closes #2481
3 years ago
Bricio 63c3ee4f63
[globo] Fix extractor (#2589)
Closes #2524
Authored by: Bricio
3 years ago
pukkandan 182bda88e8
[youtube, cleanup] Misc fixes and cleanup 3 years ago
pukkandan 16aa9ea41d [youtube] Add extractor `YoutubeMusicSearchURLIE`
Closes #2568
3 years ago
Lesmiscore (Naoya Ozaki) d6bc443bde
[fc2] Fix extraction (#2572)
Closes #2566
Authored by: Lesmiscore
3 years ago
MinePlayersPE 046cab3915
[TikTok] Iterate through app versions (#2449)
Closes #2476
Authored by: MinePlayersPE
3 years ago
Sipherdrakon 7df07a3b55
[dplay] Add extractors for site changes (#2401)
Closes #2438
Authored by: Sipherdrakon
3 years ago
Zenon Mousmoulas 2d49720f89
[ertgr] Add new extractors (#2338)
Authored-by: zmousm, dirkf
3 years ago
pukkandan 48416bc4a8
[youtube] Fix n-sig for player e06dea74 3 years ago
pukkandan 6a0546e313
[outtmpl] Handle hard-coded file extension better
When we know that the user-provided extension is the correct final one,
replace it with intermediate extension during download
3 years ago
pukkandan dbcea0585f
[outtmpl] Handle `-o ""` better
Since the specific type of file is not downloaded when giving `-o "<type>:"`,
now `-o ""` acts as an alias to `--skip-download`
3 years ago
KiberInfinity f7d4854131
[Pladform] Fix redirection to external player (#2550)
Authored by: KiberInfinity
3 years ago
foghawk 403be2eefb
[tumblr] Fix 403 errors and handle vimeo embeds (#2542)
Fixes https://github.com/ytdl-org/youtube-dl/issues/29585
Authored by: foghawk
3 years ago
lazypete365 63bac931c2
[mildom] Fix extractor (#2533)
Closes #2519
Authored by: lazypete365
3 years ago
Jeff Huffman 7c74a01584
[crunchyroll] Fix login (#2530)
Closes #1424
Authored by: tejing1
3 years ago
pukkandan 1d3586d0d5
[aes] Add unpad_pkcs7 3 years ago
pukkandan c533c89ce1
[GoogleSearch] Fix extractor 3 years ago
KiberInfinity b8b3f4562a
[Odnoklassniki] Improve embedded players extraction (#2549)
Authored by: KiberInfinity
3 years ago
nyuszika7h 1c6f480160
[viki] Fix "Bad request" for manifest (#2540)
Closes #2499
Authored by: nyuszika7h
3 years ago
u-spec-png f8580bf02f
[Bilibili] Add 8k support (#1964)
Closes #1898, #1819
Authored by: u-spec-png
3 years ago
Zenon Mousmoulas 19afd9ea51
[GlomexEmbed] Avoid large match objects
Closes #2512
Authored by: zmousm
3 years ago
trasssh b72270d27e
[MySpass] Fix video url processing (#2510)
Closes #2507
Authored by: trassshhub
3 years ago
Jeff Huffman 706dfe441b
[crunchyroll:beta] Add cookies support (#2506)
* Extract directly from the beta API when cookies are passed. If login cookie is absent, the extraction is delegated to `CrunchyrollIE`. This causes different metadata to be extracted (including formats and video id) and therefore results in a different archive entry. For now, this issue is unavoidable since the browser also redirects to the old site when not logged in.

* Adds extractor-args `format` and `hardsub` to control the source and subtitles of the extracted formats

Closes #1911
Authored by: tejing1
3 years ago
YuenSzeHong c4da5ff971
[Fujitv] Extract metadata and support premium (#2505)
Authored by: YuenSzeHong
3 years ago
KiberInfinity e26f9cc1e5
[YandexVideoPreview] Add extractor (#2500)
Closes #1794
Authored by: KiberInfinity
3 years ago
pukkandan fa8fd95118
[cookies] Fix keyring selection for unsupported desktops
Closes #2450
3 years ago
MinePlayersPE 05b23b4156
[iq.com] Add VIP support (#2444)
Authored by: MinePlayersPE
3 years ago
Aleri Kaisattera 8f028b5f40
[Vimm] add recording extractor (#2441)
Authored by: alerikaisattera
3 years ago
MinePlayersPE 013322a95e
[Instagram] Fix extraction when logged in (#2439)
Closes #2435
Authored by: MinePlayersPE
3 years ago
Ashish Gupta fb62afd6f0
[Musicdex] Add extractors (#2421)
Closes #2204
Authored by: Ashish0804
3 years ago
Ashish Gupta 50600e833d
[ThisOldHouse] Improve Premium URL check (#2445)
Closes #2443
Authored by: Ashish0804
3 years ago
pukkandan fc08bdd6ab
[extractor] Allow non-fatal `title` extraction 3 years ago
pukkandan 2568d41f70
[bilibili] Make anthology title non-fatal 3 years ago
pukkandan 88f23a18e0
[docs,cleanup] Fix linter and misc cleanup
Closes #2419
3 years ago
pukkandan bb66c24797
Add option `--print-to-file`
Closes #2372
3 years ago
pukkandan 2edb38e8ca
[extractor] Extract video inside `Article` json_ld
Closes #2448
3 years ago
pukkandan af6793f804
[downloader/ffmpeg] Handle unknown formats better 3 years ago
pukkandan b695e3f9bd
[orf:tvthek] Lazy playlist extraction and obey --no-playlist
Closes #2411
3 years ago
pukkandan 6a5a30f9e2
Ensure `_type` is present in `info.json`
Closes #2447
3 years ago
pukkandan d37707bda4
Fix/improve `InAdvancePagedList` 3 years ago
pukkandan f40ee5e9a0
[extractor] Add convinience function `_yes_playlist` 3 years ago
pukkandan 1f13021eca
[web.archive:youtube] Add `ytarchive:` prefix
and misc cleanup
3 years ago
pukkandan e612f66c7c
[archive.org] Ignore unnecessary files
Closes #2452
3 years ago
coletdjnz 87e8e8a7d0
[youtube:api] Do not use seek when reading HTTPError response
Authored-by: coletdjnz
3 years ago
Aleri Kaisattera e600a5c908
[CAM4] Add thumbnail extraction (#2425)
Authored by: alerikaisattera
3 years ago
github-actions 50ce204cc2
[version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan ed40877833
Fix 426764371f for Py3.6 3 years ago
sian1468 935f5a4209
[line] Remove `tv.line.me` (#2420)
Service is discontinued
Authored by: sian1468
3 years ago
pukkandan 6970b6005e
[cleanup] Minor fixes
Closes #2334
3 years ago