Commit Graph

15550 Commits (5a1fbbf8b7215aab0e6382e93eaa1561093352cf)

Author SHA1 Message Date
Sergey M․ 1e72660c9b
[svtplay] Fix test title 4 years ago
Sergey M․ 049f224248
[svtplay] Add support for svt.se/barnkanalen (closes #24817) 4 years ago
Mattias Wadman 0ada1b90b8
[svt] Extract timestamp and thumbnail in more cases (#27130)
Add timestamp, set to "valid from" which i think could been seen as publish time.
Add thumbnail in more cases, seems to was only done in the embedded data case for some reason.
Switch svtplay test url to an existing video and also one with no expire date.
Also add an additional thumbnail url test regex.
4 years ago
Josh Soref 71ddc222ad
Fix typos (#27084)
* spelling: authorization

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: brightcove

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: creation

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: exceeded

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: exception

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: extension

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: extracting

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: extraction

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: frontline

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: improve

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: length

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: listsubtitles

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: multimedia

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: obfuscated

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: partitioning

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: playlist

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: playlists

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: restriction

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: services

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: split

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: srmediathek

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: support

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: thumbnail

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: verification

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: whitespaces

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
4 years ago
Daniel Peukert 21292c0649
[youtube] Fix error reason extraction (#27081) 4 years ago
Sergey M․ 46a265a2da
[youtube] Fix like and dislike count extraction (closes #25977) 4 years ago
Sergey M․ e2096776b9
[youtube:tab] Add support for current video and fix lives extraction (closes #27126) 4 years ago
Remita Amine a1c88c4819 [infoq] fix format extraction(closes #25984) 4 years ago
renalid 51ca93d751
[francetv] Update to fix thumbnail URL issue (#27120)
Fix the thumbnail URL. The issue was here for many years, never fixed. It's done ! :-)

Example : https://www.france.tv/france-2/de-gaulle-l-eclat-et-le-secret/de-gaulle-l-eclat-et-le-secret-saison-1/2035247-solitude.html

failed thumbnail url generated : http://pluzz.francetv.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg

right thumbnail url fixed : https://sivideo.webservices.francetelevisions.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg
4 years ago
Sergey M․ a7e0531999
[downloader/http] Fix crash during urlopen caused by missing reason of URLError 4 years ago
Sergey M․ ab0eda99e1
[YoutubeDL] Fix --ignore-errors for playlists with generator-based entries of url_transparent (closes #27064) 4 years ago
Sergey M․ ec99f47108
[youtube:tab] Replace some test URLs with RIAA-friendly ones 4 years ago
Sergey M․ b31b5f4434
[youtube] Improve yt initial data extraction (closes #27093) 4 years ago
Remita Amine 86f2fa1590 [discoverynetworks] add support new TLC/DMAX URLs(closes #27100) 4 years ago
Remita Amine 7bc7fbce23 [rai] fix protocol relative relinker URLs(closes #22766) 4 years ago
Remita Amine a78e530c14 [rai] fix unavailable video format detection 4 years ago
Remita Amine af7bb684c0 [rai] improve extraction 4 years ago
Leonardo Taccari dd9e0f58f3
[rai] Fix extraction for recent raiplay.it updates (#27077)
- Remove first test of RaiPlayIE: it is no longer available
- Make RaiPlayIE extension-agnostic (passing possible `.json' URLs is now
  supported too)
- Adjust RaiPlayLiveIE to recent raiplay.it updates.  Passing it as
  `url_transparent' is no longer supported (there is no longer an accessible
  ContentItem)
- Adjust RaiPlayPlaylistIE to recent raiplay.it updates and instruct it about
  ContentSet-s.
- Update a RaiIE test and remove two tests that are no longer availables

Thanks to @remitamine for the review!
4 years ago
Remita Amine 59e583f7e8 [viki] improve format extraction 4 years ago
beefchop daa25d4142
[viki] fix stream extraction from mpd (#27092)
Co-authored-by: beefchop <beefchop@users.noreply.github.com>
4 years ago
Remita Amine 25a35cb38a [googledrive] fix format extraction(closes #26979) 4 years ago
Remita Amine 2cf8003638 [amara] improve extraction 4 years ago
Joost Verdoorn cf1a8668e8
[Amara] Add new extractor (#20618)
* [Amara] Add new extractor
4 years ago
Remita Amine 2dbb45ae82 [vimeo:album] fix extraction(closes #27079) 4 years ago
Remita Amine 4fe190df70 [mtv] fix mgid extraction(closes #26841) 4 years ago
Sergey M․ 039e715b30
release 2020.11.19 4 years ago
Sergey M․ b1347a5881
[youporn] Fix upload date extraction and make comment count optional (closes #26986) 4 years ago
Sergey M․ 91e954587f
[arte] Rework extractors
* Reimplement embed and playlist extractors to delegate to the single entrypoint artetv extractor
  Beware reluctant download archive extractor keys breakage.
* Improve embeds detection (closes #27057)
- Remove obsolete code
4 years ago
Sergey M․ 9b505185da
[arte] Extract m3u8 formats (closes #27061) 4 years ago
Remita Amine 444a68e0ec [mgtv] fix format extraction(closes #26415) 4 years ago
Sergey M․ c7178f0f7a
[extractor/common] Output error for invalid URLs in _is_valid_url (refs #21400, refs #24151, refs #25617, refs #25618, refs #25586, refs #26068, refs #27072) 4 years ago
Remita Amine 5c3f7014ef [lbry] add support for odysee.com domain(closes #26806) 4 years ago
Remita Amine d65628ef03 [francetv] improve info extraction 4 years ago
gdzx 8a6c5b0806
[francetv] Add fallback video url extraction (#27047)
Fallback on another API endpoint when no video formats are found.

Closes ytdl-org#22561
4 years ago
Sergey M․ 9360936f26
release 2020.11.18 4 years ago
Sergey M․ 2d7a29081c
[spiegel] Fix extraction (closes #24206, closes #24767)
Code picked from PR #24767 since original repo is not available due to takedown.
4 years ago
Sergey M․ 2864179293
[youtube] Improve extraction
+ Add support for --no-playlist (closes #27009)
* Improve playlist and mix extraction (closes #26390, closes #26509, closes #26534, closes #27011)
+ Extract playlist uploader data
* Update tests
4 years ago
Remita Amine 284f8306df [youtube:tab] fix view_count extraction(closes #27051) 4 years ago
Remita Amine aa613ef7e1 [malltv] fix extraction(closes #27035) 4 years ago
Remita Amine cb2b9a22a5 [bandcamp] extract playlist_description(closes #22684) 4 years ago
Remita Amine 5b867c15a8 [urplay] fix extraction(closes #26828) 4 years ago
Sergey M․ f8c749f12c
[youtube:tab] Fix playlist title extraction (closes #27015) 4 years ago
Sergey M․ 7d509c613b
[youtube] Fix chapters extraction (closes #26005) 4 years ago
Sergey M․ b92e95aa01
release 2020.11.17 4 years ago
Sergey M․ 6699b6ce41
[youtube:tab] Fix extraction with cookies provided (closes #27005) 4 years ago
Remita Amine 91dcde8a38 [lrt] fix extraction with empty tags(closes #20264) 4 years ago
Sergey M․ 11f3471c4b
[ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 4 years ago
Sergey M․ f4093b34f6
[servus] Add support for pm-wissen.com (closes #25869) 4 years ago
Sergey M․ a80b23c373
[servus] Fix extraction (closes #26872, closes #26967, closes #26983, closes #27000) 4 years ago
Sergey M․ 2e7fa18bb9
[xtube] Fix extraction (closes #26996) 4 years ago
Sergey M․ fe07e788bf
[utils] Skip ! prefixed code in js_to_json 4 years ago
Remita Amine 6d3bdcf217 [lrt] fix extraction 4 years ago
Remita Amine ec2a2ab441 [lbry] Add new extractor 4 years ago
Remita Amine 9448a20312 [condenast] fix extraction and extract subtitles 4 years ago
Remita Amine 3f1748b944 [bandcamp] fix extraction 4 years ago
Remita Amine fe13087cd1 [rai] fix RaiPlay extraction 4 years ago
Remita Amine f22fa82d7f [extractors] Remove VLivePlaylistIE import 4 years ago
Remita Amine 059fa9aa81 [vlive] fix extraction 4 years ago
Remita Amine 650aec4a98 [usanetwork] fix extraction 4 years ago
Remita Amine 2ea9c97432 [nbc] fix NBCNews/Today/MSNBC extraction 4 years ago
Remita Amine 1737ea69b9 [cnbc] fix extraction 4 years ago
Sergey M․ 1fb034d029
[youtube] Remove RIAA copyrighted media from tests as per [1]
1. Github dmca and 1201 notice re youtube-dl 9-21-20
4 years ago
Sergey M․ 28f9568a84
release 2020.11.12 4 years ago
Sergey M․ 2de2ca6659
[youtube] Rework extractors
WIP
4 years ago
Sergey M․ 051071203c
release 2020.11.01.1 4 years ago
Sergey M․ 34299510bb
release 2020.11.01 4 years ago
Sergey M․ 6d4733ce7b
[youtube] Fix JS player URL extraction 4 years ago
Sergey M․ 416da574ec
[ytsearch] Fix extraction (closes #26920) 4 years ago
Toan Nguyen 48c5663c5f
[afreecatv] Fix typo (#26970) 4 years ago
Hannu Hartikainen 7d740e7dc7
[23video] Relax _VALID_URL (#26870) 4 years ago
Kevin O'Connor 4eda10499e
[utils] Don't attempt to coerce JS strings to numbers in js_to_json (#26851)
The current logic in `js_to_json` tries to rewrite octal/hex numbers to
decimal. However, when the logic actually happens the `"` or `'` have
already been trimmed off. This causes what were originally strings, that
happen to look like octal/hex numbers, to get rewritten to decimal and
returned as a number rather than a string.

In practive something like:

```js
{
  "0x40": "foo",
  "040": "bar",
}
```

would get rewritten as:

```json
{
  64: "foo",
  32: "bar
}
```

This is problematic since this isn't valid JSON as you cannot have
non-string keys.
4 years ago
Sergio Livi 605535776a
[ustream] Add support for video.ibm.com (#26894) 4 years ago
Felix Yan 1050e0d09f
[iqiyi] Fix typo (#26884) 4 years ago
Sergey M․ d65d89183f
[expressen] Add support for di.se (closes #26670) 4 years ago
Surkal 0c92f1e96b
[iprima] Improve video id extraction (#26507) (closes #26494) 4 years ago
Sergey M․ c5764b3f89
[downloader/http] Properly handle missing message in SSLError (closes #26646) 4 years ago
Sergey M․ 0837992a22
[downloader/http] Fix access to not yet opened stream in retry 4 years ago
Sergey M․ b55715934b
release 2020.09.20 4 years ago
nixxo 1ca5f821c8
[redtube] Extend _VALID_URL (#26506) 4 years ago
Sergey M․ defc820b70
[twitch] Switch streams to GraphQL and refactor (closes #26535) 4 years ago
Sergey M․ 82ef02e936
[telequebec] Fix issues (closes #26368) 4 years ago
Patrick Dessalle b856b3997c
[telequebec] Add support for brightcove videos (closes #25833) 4 years ago
Sergey M․ cd85a1bb8b
[pornhub] Extract metadata from JSON-LD (closes #26614) 4 years ago
Sergey M․ ce5b904050
[extractor/common] Relax interaction count extraction in _json_ld 4 years ago
Sergey M․ ad06b99dd4
[extractor/common] Extract author as uploader for VideoObject in _json_ld 4 years ago
JChris246 540b9f5164
[pornhub] Fix view count extraction (#26621) (refs #26614) 4 years ago
Stefan Pöschel 6e65a2a67e
[downloader/hls] Fix incorrect end byte in Range HTTP header for media segments with EXT-X-BYTERANGE (#24512) (closes #14748)
The end of the byte range is the first byte that is NOT part of the to
be downloaded range. So don't include it into the requested HTTP
download range, as this additional byte leads to a broken TS packet and
subsequently to e.g. visible video corruption.

Fixes #14748.
4 years ago
Sergey M․ f8c7bed133
[extractor/common] Handle ssl.CertificateError in _request_webpage (closes #26601)
ssl.CertificateError is raised on some python versions <= 3.7.x
4 years ago
Sergey M․ cdc55e666f
[downloader/http] Improve timeout detection when reading block of data (refs #10935) 4 years ago
Ori Avtalion 86b7c00adc
[downloader/http] Retry download when urlopen times out (#26603) (refs #10935) 4 years ago
Sergey M․ e8c5d40bc8
release 2020.09.14 4 years ago
Sergey M․ bff857a8af
[postprocessor/embedthumbnail] Fix issues (closes #25717)
* Fix WebP with wrong extension processing
* Fix embedding of thumbnails with % character in path
4 years ago
Alex Merkel a31a022efd
[postprocessor/embedthumbnail] Add support for non jpeg/png thumbnails (closes #25687) 4 years ago
Sergey M․ 45f6362464
[rtlnl] Extend _VALID_URL for new embed URL schema 4 years ago
Derek Land 97f34a48d7
[rtlnl] Extend _VALID_URL (#26549) (closes #25821) 4 years ago
Daniel Peukert ea74e00b3a
[youtube] Fix empty description extraction (#26575) (closes #26006) 4 years ago
Sergey M․ 06cd4cdb25
[srgssr] Extend _VALID_URL (closes #26555, closes #26556, closes #26578) 4 years ago
Sergey M․ da2069fb22
[googledrive] Use redirect URLs for source format (closes #18877, closes #23919, closes #24689, closes #26565) 4 years ago
Sergey M․ 95c9810015
[svtplay] Fix id extraction (closes #26576) 4 years ago
Remita Amine b03eebdb6a [redbulltv] improve support for rebull.com TV localized URLS(#22063) 4 years ago
Remita Amine 1f7675451c [redbulltv] Add support for new redbull.com TV URLs(closes #22037)(closes #22063) 4 years ago
tfvlrue aa27253556
[soundcloud] Reduce pagination limit to fix 502 Bad Gateway errors when listing a user's tracks. (#26557)
Per the documentation here https://developers.soundcloud.com/blog/offset-pagination-deprecated the maximum limit is 200, so let's respect that (even if a higher value sometimes works).

Co-authored-by: tfvlrue <tfvlrue>
4 years ago
Sergey M․ d51e23d9fc
release 2020.09.06 4 years ago
Sergey M․ 50e9fcc1fd
[nrktv:episode] Improve video id extraction (closes #25594, closes #26369, closes #26409) 4 years ago
random-nick 16ee69c1b7
[youtube] Fix age gate content detection (#26100) (closes #26152, closes #26311, closes #26384) 4 years ago
Sergey M․ 67171ed7e9
[youtube:user] Extend _VALID_URL (closes #26443) 4 years ago
Sergey M․ 1d9bf655e6
[utils] Recognize wav mimetype (closes #26463) 4 years ago
TheRealDude2 62ae19ff76
[xhamster] Improve initials regex (#26526) (closes #26353) 4 years ago
Sergey M․ 5ed05f26ad
[svtplay] Fix svt id extraction (closes #26425, closes #26428, closes #26438) 4 years ago
Sergey M․ 841b683804
[twitch] Rework extractors (closes #12297, closes #20414, closes #20604, closes #21811, closes #21812, closes #22979, closes #24263, closes #25010, closes #25553, closes #25606)
* Switch to GraphQL.
+ Add support for collections.
+ Add support for clips and collections playlists.
4 years ago
Remita Amine f5863a3ea0 [biqle] improve video_ext extraction 4 years ago
Sergey M․ 10709fc7c6
[xhamster] Extend _VALID_URL (closes #25927) 4 years ago
TheRealDude2 a7e348556a
[xhamster] Fix extraction (closes #26157) (#26254) 4 years ago
JChris246 6cb30ea5ed
[xhamster] Extend _VALID_URL (closes #25789) (#25804) 4 years ago
Sergey M․ a4ed50bb84
release 2020.07.28 4 years ago
Sergey M․ e450f6cb63
[youtube] Fix sigfunc name extraction (closes #26134, closes #26135, closes #26136, closes #26137) 4 years ago
MRWITEK a115e07594
[youtube] Improve description extraction (closes #25937) (#25980) 5 years ago
Sergey M․ 718393c632
[wistia] Restrict embed regex (closes #25969) 5 years ago
Glenn Slayden 07af16b92e
[youtube] Prevent excess HTTP 301 (#25786) 5 years ago
Sergey M․ e942cfd1a7
[youtube:playlists] Extend _VALID_URL (closes #25810) 5 years ago
Remita Amine 9a7e5cb88a [bellmedia] add support for cp24.com clip URLs(closes #25764) 5 years ago
Sergey M․ 2391941f28
[brightcove] Improve embed detection (closes #25674) 5 years ago
Sergey M․ 9ff6165a81
release 2020.06.16.1 5 years ago
Sergey M․ ee0b726cd7
[youtube] Force old layout (closes #25682, closes #25683, closes #25680, closes #25686) 5 years ago
Sergey M․ dbeafce5d5
[youtube] Fix categories and improve tags extraction 5 years ago
Sergey M․ ed604ce7bc
release 2020.06.16 5 years ago
Sergey M․ a6211d237b
[youtube] Fix uploader id and uploader URL extraction 5 years ago
Sergey M․ 7b16239a49
[youtube] Improve view count extraction 5 years ago
Sergey M․ 37357d21a9
[youtube] Fix upload date extraction 5 years ago
Sergey M․ b477fc1314
[youtube] Fix thumbnails extraction and remove uploader id extraction warning (closes #25676) 5 years ago
Sergey M․ d84b21b427
[youtube] Fix playlist and feed extraction (closes #25675) 5 years ago
Philipp Hagemeister 48bd042ce7 [facebook] Support single-video ID links
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
5 years ago
Sergey M․ 84213ea8d4
[youtube] Extract chapters from JSON (closes #24819) 5 years ago
Sergey M․ 562de77f41
[kaltura] Add support for multiple embeds on a webpage (closes #25523) 5 years ago
Sergey M․ e1723c4bac
release 2020.06.06 5 years ago
Sergey M․ a5b6102ea8
[tele5] Bypass geo restriction 5 years ago
Sergey M․ b77888228d
[jwplatform] Add support for bypass geo restriction 5 years ago
Sergey M․ 0b1eaec3bc
[tele5] Prefer jwplatform over nexx (closes #25533) 5 years ago
Sergey M․ b37e47a3f9
[twitch:stream] Expect 400 and 410 HTTP errors from API 5 years ago
Sergey M․ ce3735df02
[twitch:stream] Fix extraction (closes #25528) 5 years ago
Sergey M․ a0455d0ffd
[twitch] Pass v5 accept header and fix thumbnails extraction (closes #25531) 5 years ago
Sergey M․ c8b232cc48
[brightcove] Sort imports 5 years ago
Sergey M․ b4eb0bc7bd
[brightcove] Fix subtitles extraction (closes #25540) 5 years ago
Matej Dujava d5147b65ac
[malltv] Add support for sk.mall.tv (#25445) 5 years ago
Sergey M․ 7b0b53ea69
[twitter:broadcast] Add untitled periscope broadcast test 5 years ago
Sergey M․ 7016e24ebe
[periscope] Fix untitled broadcasts (#25482) 5 years ago
Sergey M․ bef4688c72
[jwplatform] Improve embeds extraction (closes #25467) 5 years ago
Sergey M․ 228c1d685b
release 2020.05.29 5 years ago
Sergey M․ fe515e5c75
[ard:beta] Extend _VALID_URL (closes #25405) 5 years ago
striker.sh 1db5ab6b34
[youtube] Add support for more invidious instances (#25417) 5 years ago