Commit Graph

7961 Commits (be6217b26142491232fb697b125015d45437832d)

Author SHA1 Message Date
Sergey M․ d8d540cf0d
[nrk] Rework extractor (Closes #9470) 9 years ago
Sergey M․ 0df79d552a
[twitch:bookmarks] Remove extractor
Bookmarks no longer available
9 years ago
Sergey M․ 0db3a66162
[twitch] Skip dead tests 9 years ago
Yen Chi Hsuan a3fa6024d6
[bloomberg] Fix test_Bloomberg
In this test case, sometimes HLS is the best format while sometimes HDS
is. To prevent occasional test failures, force HDS to be the best
format. In the past, testing against HDS formats causes the same error
as #9214, which is fixed as #9377 landed.
9 years ago
Yen Chi Hsuan 7e8ddca1bb
[vevo] Delay the georestriction check to prevent false alerts
Fixes #9408
9 years ago
Yen Chi Hsuan 4540515cb3
[iqiyi] Fix 1080P extraction (closes #9446) 9 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 9 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 9 years ago
Sergey M․ 3951e7eb93
[ceskatelevize] Simplify, restore bonus video test and skip georestricted test (Closes #9431) 9 years ago
Tomáš Čech f1f6f5aa5e
[ceskatelevize] Add support for live streams
Live streams has no playlist title, use title of the stream containing
TV channel name. Internal m3u8 handler doesn't seem to handle well
continuous streams. Add test for live stream. Remove no longer
reachable test.
9 years ago
Sergey M․ c52f4efaee
[mva] Improve _VALID_URLs 9 years ago
Sergey M․ f23a92a0ce
[mva] Add extractor (Closes #6667) 9 years ago
Yen Chi Hsuan 3b01a9fbb6
[litv] Add new extractor
LiTV is a streaming platform providing free and paid legal contents in
Taiwan.
9 years ago
Sergey M․ 9c072d38c6
[arte] Improve language preference (Closes #9401, closes #9162) 9 years ago
Yen Chi Hsuan a0904c5d80
[telegraaf] Fix extractor (closes #9318) 9 years ago
Sergey M․ cb1fa58813
[flickr] Extract uploader URL (Closes #9426) 9 years ago
remitamine 3fd6332c05 [flickr] extract license field(closes #9425) 9 years ago
Sergey M 401d147893 Merge pull request #9400 from inondle/master
[liveleak] Adds support for thumbnails and updates tests
9 years ago
inondle e2ee97dcd5 [liveleak] Adds support for thumbnails, updates tests 9 years ago
Sergey M․ f745403b5b
[vevo] Revert videoplayer.vevo.com to api.vevo.com 9 years ago
Sergey M․ 3e80e6f40d
[vevo] Allow request to api.vevo.com to fail (Closes #9417)
I don't know whether this it's tempopary or api has just gone
9 years ago
Sergey M․ 25cb7a0eeb
[youtube] Allow empty attribute values in description regex 9 years ago
remitamine 04e88ca2ca [vk] improve extraction(fixes #7976) 9 years ago
Yen Chi Hsuan 6f59aa934b
[periscope:user] Add new extractor for user pages
Closes #9388
9 years ago
Sergey M․ 915620fd68
[redtube] PEP 8 9 years ago
Sergey M․ ac12e888f9
[redtube] Extract all formats, duration, upload date and view count (Closes #9397) 9 years ago
Yen Chi Hsuan 7d08f6073d
[kuwo:category] Update test 9 years ago
remitamine 758a059241 [dailymail] Add new extractor(closes #2667) 9 years ago
Yen Chi Hsuan 4f8c56eb4e
[fczenit] Fix extraction and update test
Closes #9359
9 years ago
Sergey M․ 9da526aae7
[yandexmusic:playlist] Update test 9 years ago
Sergey M․ 75b81df3af
[udemy] Modernize 9 years ago
Sergey M․ aabdc83d6e
[udemy] Fix course enroll (Closes #9393) 9 years ago
Sergey M․ 2a48e6f01a
[yandexmusic:playlist] Respect track order for long (>150) playlists 9 years ago
Sergey M․ 203a3c0e6a
[yandexmusic:playlist] Make title optional 9 years ago
Sergey M․ d36724cca4
[yandexmusic:playlist] Remove unused imports 9 years ago
Sergey M․ 15fc0658f7
[yandexmusic:playlist] Modernize 9 years ago
Sergey M․ e960c3c223
[yandexmusic:playlist] Improve extraction (Closes #6801) 9 years ago
Sergey M․ bc7e77a04b
[vevo] Use raise_geo_restricted 9 years ago
Sergey M․ 964f49336f
[aol] Improve _VALID_URL (Closes #9381) 9 years ago
Sergey M․ 57d8e32a3e
[xfileshare] Add support for streamin.to 9 years ago
Sergey M․ 4174552391
[xfileshare] Refactor _VALID_URL and remove ded sites 9 years ago
Sergey M․ 80bc4106af
[xfileshare] Add support for thevideobee.to (Closes #9374) 9 years ago
Yen Chi Hsuan 7759be38da
[xiami] Detect georestriction and skip tests 9 years ago
Yen Chi Hsuan a0a309b973
[kuwo:category] Fix description and update test 9 years ago
Sergey M․ 8a92e51c60
[extractor/common] Relax wording for creator metafield 9 years ago
Sergey M․ df5f4e8888
[vevo] Remove superfluous code 9 years ago
Sergey M․ 5c9ced9504
[vevo] Improve genre extraction 9 years ago
Sergey M․ 686cc89634
[discovery] Fix typo 9 years ago
Sergey M․ 9508738f9a
[vevo] Extract featured artist 9 years ago
Sergey M․ 78a3ff33ab
[vevo:playlist] Add fallback for playlist id 9 years ago
Sergey M․ 881dbc86c4
[vevo] Extract track related metafields and add artists to title (Closes #1684) 9 years ago
Sergey M․ 8e7d004888
[vevo] Add test for video only available via webpage 9 years ago
Sergey M․ 9618c44824
[vevo] Extract video versions from webpage as a last resort (Closes #8426, closes #9366) 9 years ago
Sergey M․ 516ea41a7d
[vevo] Fix _call_api 9 years ago
Sergey M․ e2bd301ce7
[vevo:playlist] Fix genre playlists 9 years ago
Sergey M․ 0c9d288ba0
[vevo:playlist] Remove debug params 9 years ago
Sergey M․ e0da32df6e
[vevo:playlist] Add extractor (Closes #9334, closes #9364) 9 years ago
Sergey M․ 68bb2fef95
[tagesschau] Restrict playlist entry regex 9 years ago
Sergey M․ 854cc54bc1
[tagesschau] Expand video id 9 years ago
Sergey M․ 651ad35ce0
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 6a0f9a24d0
[tagesschau] Separate player extractor 9 years ago
remitamine 9cf79e8f4b [ccc] improve extraction 9 years ago
Sergey M․ 2844b09336
[tagesschau] Fix article media ids 9 years ago
Sergey M․ 1a2b377cc2
[tagesschau] Fix audio support 9 years ago
Sergey M․ 4c1b2e5c0e
[tagesschau] Add support for playlists 9 years ago
Sergey M․ 9e1b96ae40
[rtlnl] Match formats only by height 9 years ago
Sergey M․ fc35cd9e0c
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 339fe7228a
[tagesschau] Update _FORMATS map 9 years ago
remitamine ea7e7fecbd [discovery] remove unused imports 9 years ago
remitamine d00b93d58c [discovery] extract more info using BrightcoveNewIE 9 years ago
remitamine 93f7a31bf3 [discovery] extract subtitle 9 years ago
remitamine 33a1ec950c [discovery] extract http formats 9 years ago
Sergey M․ 4e0c0c1508
[xiami] Improve extraction (Closes #9079)
* Switch to JSON source
* Add abstract IE for playlists
* Extract more track related metadata
9 years ago
BlahGeek 89c0dc9a5f
[xiami] Add xiami extractor 9 years ago
remitamine f628d800fb [ted] add support for youtube embeds and update tests 9 years ago
remitamine 11fa3d7f99 [ted] extract all http formats 9 years ago
Sergey M․ d41ee7b774
[vlive] Pass Referer as bytestring (Closes #9352) 9 years ago
remitamine e0e9bbb0e9 [pbs] extract srt and vtt subtitles 9 years ago
remitamine 7691184a31 [pbs] remove duplicate format 9 years ago
remitamine 35cd2f4c25 [pbs] extract only the formats that we know that they will be available as http format
https://projects.pbs.org/confluence/display/coveapi/COVE+Video+Specifications
9 years ago
remitamine 350d7963db [pbs] fix the least bitrate http url construction 9 years ago
remitamine cbc032c8b7 [pbs] extract all http formats 9 years ago
remitamine 69c4cde4ba [wsj] improve extraction 9 years ago
Sergey M․ ca278a182b
[rtlnl] Replace test 9 years ago
Sergey M․ 373e1230e4
[rtlnl] Clarify tests 9 years ago
Sergey M․ cd63d091ce
[rtlnl] Fix tests 9 years ago
Sergey M․ 0571ffda7d
[rtlnl] Improve extraction (Closes #9329)
* Make hls extraction non fatal and revert ext
* Extract progressive formats' metadata from corresponding hls formats
9 years ago
Reino17 5556047465
[rtlnl] Update 720p PG_URL_TEMPLATE
- Fixed the format_id for the 720p progressive videostream and added the video's resolution.
- The adaptive videostreams have the m3u8-extension, so I removed the confusing mp4-extension in order to make a better distinction between the these and the progressive videostreams.
9 years ago
remitamine 65a3bfb379 [dfb] extract m3u8 formats 9 years ago
Yen Chi Hsuan cef3f3011f
[funimation] Detect blocking and support CloudFlare cookies 9 years ago
Yen Chi Hsuan e9c6cdf4a1
[common] Fix format_id construction for HLS 9 years ago
Sergey M․ 00a17a9e12
[crunchyroll] Sort formats 9 years ago
Sergey M․ 8312b1a3d1
[crunchyroll] Add even more relaxed fmt fallback 9 years ago
Sergey M․ 6ff4469528
[crunchyroll] Relax fmt regex 9 years ago
Yen Chi Hsuan 68835d687a
Merge branch 'Kagami-vlive-hls' 9 years ago
Yen Chi Hsuan 9d186afac8
[vlive] Coding style and PEP8 9 years ago
Yen Chi Hsuan 151d98130b Merge branch 'vlive-hls' of https://github.com/Kagami/youtube-dl into Kagami-vlive-hls 9 years ago
Kagami Hiiragi b24d6336a7 [vlive] Add support for live videos 9 years ago
remitamine 065216d94f [crunchyroll] reduce requests for formats extraction 9 years ago
remitamine 67167920db [viewlift] replace SnagFilms extractors
- add support for other sites that use the same logic
- improve format extraction and sorting
9 years ago
Yen Chi Hsuan 14638e2915
[sexykarma] Rename to WatchIndianPornIE and fix extraction 9 years ago
Yen Chi Hsuan 1910077ed7
Revert "[sexykarma] Remove the extractor"
This reverts commit 31ff3c074e.
9 years ago
Yen Chi Hsuan 5819edef03
[ooyala] Skip an invalid test
Ooyala is used by lots of extractors and its correctness can be verified
by these websites.
9 years ago
Yen Chi Hsuan f5535ed0e3
[orf] Skip the expired test 9 years ago
Yen Chi Hsuan 31ff3c074e
[sexykarma] Remove the extractor
Its domain name is on sale.

Closes #9317
9 years ago
Sergey M․ 72670c39de
[arte:+7] Fix typo in _VALID_URL 9 years ago
Sergey M․ 683d892bf9
[viewster] Remove unused import 9 years ago
Sergey M․ 497971cd4a
[yandexmusic] Clarify blockage even more 9 years ago
remitamine e757fb3d05 [crunchyroll] improve extraction
- extract more metadata(series, episode, episode_number)
- reduce duplicate requests for extracting formats
- remove duplicate formats
9 years ago
remitamine 0ba9e3ca22 [viewster] extract formats for videos with multiple audios/subtitles 9 years ago
Sergey M․ 4b53762914
[yandexmusic] Clarify blockage 9 years ago
Sergey M․ eebe6b382e
[yandexmusic] Improve error handling 9 years ago
Yen Chi Hsuan 0cbcbdd89d
[nuvid] Fix extraction
Closes #7620
9 years ago
Yen Chi Hsuan 7f776fa4b5
[yandexmusic] Skip tests as Travis CI blocked 9 years ago
Yen Chi Hsuan a5941305b6
[mwave] Coding style 9 years ago
Yen Chi Hsuan f8dddaf456 Merge branch 'mwave-meetgreet' of https://github.com/pmrowla/youtube-dl into pmrowla-mwave-meetgreet 9 years ago
Yen Chi Hsuan 618c71dc64
[cloudy] New domain name for the test_cloudy_1
I'm sure whether videoraj.ch still works or not, so keep it.
9 years ago
Sergey M․ 52af8f222b
[cwtv] Relax _VALID_URL (Closes #9327) 9 years ago
Yen Chi Hsuan 3cc8649c9d
[20min] Detect embedded YouTube videos
Fixes #9331
9 years ago
Yen Chi Hsuan dcf094d626
[theplatform] Fix for Python 3.2
test_AENetworks{,_1} fails as in Python < 3.3, binascii.a2b_* functions
accepts only bytes-like objects
9 years ago
Peter Rowlands 5b5d7cc11e [mwave] Add Mwave Meet & Greet extractor 9 years ago
Yen Chi Hsuan 2ac2cbc0a3
[malemotion] Remove the extractor
Announcement from their homepage:

```
MaleMotion is closed

After another system crash, I'm forced to close the site

This week all content will be erased

Don't forget to cancel your subscription if any !
```

Closes #9311.
9 years ago
Yen Chi Hsuan a7e03861e8
[scivee] Skip the test
Not accessible from either Travis CI or my machine.

Closes #9315
9 years ago
Sergey M․ 175c2e9ec3
[youtube:search_url] Reimplement in terms of youtube:playlistbase 9 years ago
remitamine f1f879098a [viewster] extract more metadata for http formats 9 years ago
Sergey M․ c9fd530670
[ok] Extract start time 9 years ago
Sergey M․ 749b0046a8
[ok] Allow embeds without title (Closes #9303) 9 years ago
Yen Chi Hsuan e3de3d6f2f
[normalboots] Fix extraction
Now it's using ScreenwaveMedia
9 years ago
Yen Chi Hsuan ad58942d57
[muzu] Remove extractor
MUZU is shutting down in October 2015. [1]

[1] http://www.musicbusinessworldwide.com/youtube-rival-muzu-is-heading-into-liquidation/
9 years ago
Yen Chi Hsuan 4645432d7a
[eagleplatform] Checking direct HTTP links
Sometimes they fail with 404
9 years ago
Yen Chi Hsuan 6bdc2d5358
[mitele] Comment out unstable MD5
Also Akamai f4f fragments
9 years ago
Yen Chi Hsuan 2beff95da5
[nrk] Comment out unstable MD5 checksums
Both are Akamai f4f fragments.
9 years ago
Yen Chi Hsuan abc1723edd
[unistra] Sort formats
Originally URLs are passed to set() and not sorted, so the result is not
deterministic, causing occasional FAILs on Travis CI.
9 years ago
Yen Chi Hsuan d6712378e7
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv 9 years ago
remitamine fb72ec58ae [extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge 9 years ago
Sergey M․ c83a352227
[openload] Make thumbnail optional 9 years ago
Sergey M․ e9063b5de9
[openload] Add test 9 years ago
Sergey M․ 594b0c4c69
[openload] Fix ext extraction 9 years ago
Sergey M․ a1394b820d
[openload] Fix title extraction (Closes #9298) 9 years ago
Yen Chi Hsuan aa9dc24f5a
[douyutv] Improve extraction and update tests
The JSON API sometimes return HTML pages with errors
9 years ago
Yen Chi Hsuan 51762e1a31
[xminus] Fix extraction (closes #9228) 9 years ago
Yen Chi Hsuan a82398bd72
[kwuo:song] Fix extraction and update the test 9 years ago
remitamine c14dc00df3 [viewster] improve http formats extraction 9 years ago
Yen Chi Hsuan 03dd60ca41
[kuwo:category] Fix the test
Sometimes there are 24 songs and sometimes 30 lol
9 years ago
Yen Chi Hsuan 0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc 9 years ago
Yen Chi Hsuan a956cb6306
[onionstudios] Fix description extraction
\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537)
9 years ago
Yen Chi Hsuan a8062eabcd
[mwave] Skip checking unstable MD5
On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc
9 years ago
Yen Chi Hsuan 2a7dee8cc5
[yahoo] Improve error detection and update tests 9 years ago
Yen Chi Hsuan d9ed362116
[yahoo] Extract all <iframe>s
Fixes test_yahoo_6

(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html)
9 years ago
Yen Chi Hsuan 4f54958097
[yahoo] Update some tests
One has new fields as ThePlatformIE changed, and others have changed
files.
9 years ago
Yen Chi Hsuan 2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
Closes #9271
9 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
9 years ago
remitamine fda9a1ca9e [viewster] simplify qualities_basename regex 9 years ago
remitamine 864d5e7231 [viewster] extract all http formats 9 years ago
Sergey M․ 5448b781f6
[dplay] Sign unsigned final download hls URLs 9 years ago
Sergey M․ e239413fbc
[dplay] Extract subtitles (Closes #9284) 9 years ago
Sergey M․ fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests 9 years ago
Sergey M․ 397ec446f3
[dplay] Try secure api for no tld (Closes #9282) 9 years ago
Boris Wachtmeister 14f7a2b8af [WDRMaus] switch current show to new WDR extractor (fixes #8562)
It seems that the "current show" already uses the new WDR video-player,
while all the others videos still use the old player.

I just added the current show URL to the normal WDR-extractor, which
works fine. This commit needs my changes from PR #8842 that fix the
support for WDR.
9 years ago
Boris Wachtmeister c0837a12c8 [WDR] complete overhaul after relaunch of the site
The WDR relaunched their site on 2016-02-23 which not only changed the
URL-schema completely but also the layout of their pages.

Apparently the whole "mediathek" now runs on the wdr-domain, so no
separate URL for funkhauseuropa anymore.
There seems to be no explicit handling of video-sizes on the page or in
the URLs anymore. There seems to be only one size for HTML5, but still
several sizes for flash. The extractor adds all to the list of formats.

There is no metadata for the HTML5-stream, so that the best flash-stream
will always be considered as the "best" format. At least in my tests
this seemed to be true anyway.
9 years ago
remitamine 29a7e8f6f8 [nhl] Add new extractor(closes #8419)(closes #8798) 9 years ago
Yen Chi Hsuan eb01e97e10
[youku] Skip streams with channel_type=tail
Fixes #9275

These video segments look like ads and they don't appear in the web
player.
9 years ago
remitamine cb7d4d0efd [nbc] add support for today.com(closes #2909) 9 years ago
Yen Chi Hsuan c80037918b
[iqiyi] Improve error detection (#9276) 9 years ago
remitamine 237a41108a [eagleplatform] extract all http formats 9 years ago
remitamine e962ae15d3 [newstube] extract http formats(closes #9253) 9 years ago
remitamine 7c36ea7d54 [rtbf] improve extraction(fixes #9267) 9 years ago
remitamine 9260cf1d97 [tubitv] fix extraction(closes #8741) 9 years ago
Sergey M․ bdbb8530c7
[vimeo] Pass Referer for check-password request 9 years ago
Sergey M․ 09a9fadb84
[dump] Remove extractor 9 years ago
Sergey M․ 88296ac326
[planetaplay] Remove remainings of extractor 9 years ago
Sergey M․ 6577112890
[planetaplay] Remove extractor (Closes #9256) 9 years ago
Sergey M․ 1988647dda
[tvigle] Skip hls completely (#9259) 9 years ago
Yen Chi Hsuan a292cba256
[mgtv] Fix _VALID_URL and add localized name 9 years ago
Yen Chi Hsuan 982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking 9 years ago
Yen Chi Hsuan 748e730099
[dispeak] Several fixes 9 years ago
Yen Chi Hsuan 1da19488f9
[mgtv] Add new extractor (closes #9212) 9 years ago
Yen Chi Hsuan 442c4d361f
[dispeak/gdcvault] Add the test case from #5784 9 years ago
Yen Chi Hsuan ec59d657e7
[dispeak] Add new extractor
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
9 years ago
Yen Chi Hsuan 99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
Fixes #9248
9 years ago
Yen Chi Hsuan 4dccea8ad0
[streetvoice] Fix extraction
The old API results in URLs with HTTP 403 from time to time.

Hopefully fixes #9219.
9 years ago
Yen Chi Hsuan 2c0d9c6217
[extractor/common] Allow empty post data 9 years ago
Sergey M․ 12a5134596
[tvigle] Fix extraction (Closes #9259) 9 years ago
Sergey M․ 16e633a5d7
[quickvid] Remove extractor (Closes #9258) 9 years ago
Sergey M․ 494ab6db73
[youtube] Capture and output login error message 9 years ago
Sergey M․ 107701fcfc
[people] Remove bogus comment 9 years ago
Sergey M․ f77970765a
[people] Add extractor 9 years ago
Sergey M․ 241a318f27
[vimeo] Improve _VALID_URL (Closes #9229) 9 years ago
Sergey M․ 4fdf082375
[theonion] Remove extractor (Closes #9220)
It now uses generic onionstudios embed
9 years ago
Jaime Marquínez Ferrándiz 1b6182d8f7 [youtube:playlist] Fetch all the videos in a mix (fixes #3837)
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
9 years ago
remitamine 7bab22a402 [vice] remove unused import and variable 9 years ago
Yen Chi Hsuan 0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
In r'pl=\d+&play=\d+' pages, several metadata items are missing

Closes #9222.
9 years ago
Yen Chi Hsuan b1cf58f48f
[musicplayon] Fix extraction (closes #9222) 9 years ago
remitamine bbb3f730bb [onionstudios] extract m3u8 formats 9 years ago
Yen Chi Hsuan 21525bb8ca
[kuwo:category] Update the test
Now the webpage says there are 24 songs.
9 years ago
Sergey M․ d8f103159f
[nerdist] Remove extractor
It now uses brightcove
9 years ago
remitamine 663ee5f0a9 [vice] extract youtube embed 9 years ago
Sergey M․ b6b950bf58
[cbs] Remove unused import 9 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 9 years ago
Sergey M․ c23533a100
[instagram] Add support for iframe embeds 9 years ago