Commit Graph

8182 Commits (bf3ae6a543ee8825308e8427f60fceb125a77ab5)

Author SHA1 Message Date
Sergey M․ 4c93ee8d14
[imdb] Improve _VALID_URL (Closes #9788) 9 years ago
Yen Chi Hsuan 8bc4dbb1af
[wrzuta.pl] Detect error and update _TESTS 9 years ago
Sergey M․ 6c3760292c
[pornhub] Improve title extraction (Closes #9777) 9 years ago
Sergey M․ ff4af6ec59
[lynda] Remove superfluous _NETRC_MACHINE 9 years ago
Sergey M․ 1759672eed
[wrzuta:playlist] Improve and simplify (Closes #9341) 9 years ago
venth fea55ef4a9
[wrzuta.pl:playlist] Added playlist extraction from wrzuta.pl 9 years ago
Sergey M․ 16b6bd01d2
[rockstargames] Improve and add Youtube fallback (Closes #9737) 9 years ago
Dracony 14d0f4e0f3
Added extractor for rockstargames.com 9 years ago
Sergey M․ 778f969447
[twitch:clips] Add extractor (Closes #9767) 9 years ago
Sergey M․ 33b72ce64e
[xfileshare] Improve removed videos detection 9 years ago
Sergey M․ cf2bf840ba
[xfileshare] Fix test 9 years ago
Sergey M․ bccdac6874
[xfileshare:xvidstage] Add support for videos with packed codes (Closes #4335) 9 years ago
Sergey M․ 84dcd1c4e4
[streamcloud] Detect removed videos (Closes #3768) 9 years ago
Sergey M․ 971e3b7520
[nrk:skole] Fix extraction 9 years ago
Sergey M․ 4e79011729
[nrktv] Fix tests 9 years ago
Sergey M․ 98960c911c
[instagram] Extract metadata from JSON 9 years ago
Sergey M․ 2c3322e36e
[youporn] Fix metadata extraction 9 years ago
Sergey M․ 80ae228b34
[matchtv] Modernize 9 years ago
Yen Chi Hsuan 6d28c408cf
[viki] Do not use a fallback language for title in the first try
In test_Viki_3, 'titles' gives a Hebrew title.
9 years ago
Yen Chi Hsuan c83b35d4aa
[viki] Update _TESTS 9 years ago
Yen Chi Hsuan 94e5d6aedb
[viki] Skip a geo-restricted test 9 years ago
Yen Chi Hsuan 531a74968c
[vimeo] Fix extraction for VimeoReview videos 9 years ago
Yen Chi Hsuan c5edd147d1
[generic] Remove an invalid test
Now handled by telewebion.py
9 years ago
Yen Chi Hsuan 856150d056
[telewebion] Add new extractor (closes #5135) 9 years ago
Yen Chi Hsuan 7aab3696dd
[kuwo] Update _TESTS 9 years ago
Yen Chi Hsuan 47787efa2b
[leeco] Recognize Le Sports URLs (fixes #9750) 9 years ago
Sergey M․ fe458b6596
[limelight] Extract ttml subtitles (Closes #9739) 9 years ago
Sergey M․ 21ac1a8ac3
[limelight] Fix typo 9 years ago
Sergey M․ 79027c0ea0
[limelight] Improve _VALID_URLs 9 years ago
Sergey M․ 4cad2929cd
[limelight] Fix _VALID_URLs 9 years ago
Sergey M․ 62666af99f
[indavideo] Fix formats' height (Closes #9744) 9 years ago
Sergey M 1058f56e96 Merge pull request #9747 from TRox1972/lynda
[Lynda] Extract course description
9 years ago
TRox1972 0434358823 [Lynda] Extract course description 9 years ago
Sergey M․ 3841256c2c
[lynda] Skip login if already logged in 9 years ago
Sergey M․ bdf16f8140
[lynda] Add support for new authentication (Closes #9740) 9 years ago
Yen Chi Hsuan 6c0376fe4f
[dw] Skip an invalid test
DW documentaries only last for one or two weeks. See #9475
9 years ago
Yen Chi Hsuan 1fa309da40
[generic] Update test_Generic_40
The original link now redirects to an YouTube user channel.
9 years ago
Yen Chi Hsuan daa0df9e8b
[youtube:user] Support another URL form
Such an URL comes from http://www.gametrailers.com/. This is originally
a test case in GenericIE, but now seems all GameTrailers videos are on
YouTube.
9 years ago
Yen Chi Hsuan 09728d5fbc
[audiomack:album] Force video_id to be strings
Related: be6217b261
9 years ago
Yen Chi Hsuan c16f8a4659
[voicerepublic] Force video_id to be strings
Related: be6217b261
9 years ago
Yen Chi Hsuan a225238530
[vporn] Improve error detection and update _TESTS 9 years ago
Yen Chi Hsuan cc4444662c [generic] Remove Vulture embed detection
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
9 years ago
Yen Chi Hsuan de3eb07ed6
[generic] Detect NBC News embeds 9 years ago
Yen Chi Hsuan 5de008e8c3
[nbcnews] Support embed widgets
Used in some Vulture videos
9 years ago
Yen Chi Hsuan 3e74b444e7
[vulture] Remove the extractor
The first 10 URLs in google search "site:http://video.vulture.com/video"
is dead. I guess Vulture does not host videos on their own anymore.
9 years ago
Yen Chi Hsuan e1e0a10c56
[weibo] Remove the extractor
The Weibo weishipin (微視頻, tiny videos) service is dead and now all
videos are hosted on Sina videos, which is covered by sina.py
9 years ago
Yen Chi Hsuan 436214baf7
[xfileshare] Skip an invalid test 9 years ago
Yen Chi Hsuan 506d0e9693
[xuite] Skip the invalid test 9 years ago
Yen Chi Hsuan 55290788d3 [yahoo] Yahoo doesn't like region names in lower cases
Fix test_Yahoo_7
9 years ago
Yen Chi Hsuan bc7e7adf51 [wdr] Subtitles are TTML 9 years ago
Sergey M․ b0aebe702c
[godtv] Relax _VALID_URL 9 years ago
Sergey M․ 416878f41f
[godtv] Add more tests 9 years ago
Sergey M․ c0fed3bda5
[godtv] Improve and add support for playlists (Closes #9608) 9 years ago
TRox1972 bb1e44cc8e
[godtv] Add extractor
[GodTV] Improvements
9 years ago
N1k145 21efee5f8b
[openload] Relax _VALID_URL
[openload] added to _TESTS, removed escape
9 years ago
Yen Chi Hsuan e2713d32f4
[openload] Fix extraction. Thanks @perron375 for the solution
Closes #9706
9 years ago
Yen Chi Hsuan e21c26daf9 Merge pull request #9395 from pmrowla/afreecatv
[afreecatv] Add new extractor for afreecatv.com VODs
9 years ago
Yen Chi Hsuan 1594a4932f
[wdr] Misc changes 9 years ago
Yen Chi Hsuan 6869d634c6
[wdr] Simplify extraction 9 years ago
Yen Chi Hsuan 50918c4ee0
[wdr] Support radio players (closes #6147) 9 years ago
Sergey M․ 9d51a0a9a1
[vessel] Make hls formats non fatal 9 years ago
Sergey M․ 39da509f67
[vessel] Extract DASH formats 9 years ago
Sergey M․ a479b8f687
[vessel] Use native hls by default 9 years ago
Sergey M․ 48a5eabc48
[extractor/generic] Add support vessel embeds (Closes #7083) 9 years ago
Sergey M․ 11380753b5
[vessel] Add support for embed urls and improve extraction 9 years ago
Yen Chi Hsuan 411c590a1f
[youku:show] Add new extractor 9 years ago
Yen Chi Hsuan 6da8d7de69
[twitter] Update _TESTS 9 years ago
Yen Chi Hsuan c6308b3153
[twitter] Fix extraction for videos with HLS streams
Closes #9623
9 years ago
Yen Chi Hsuan fc0a45fa41
[twitter] Detect suspended accounts and update _TESTS 9 years ago
Yen Chi Hsuan e6e90515db
[nbc] Add the test case from #9578
Closes #9578
9 years ago
Yen Chi Hsuan 22a0a95247
[theplatform] Some NBC videos require an additional cookie
Related: #9578
9 years ago
Yen Chi Hsuan 7264e38591
[bilibili] Fix for videos without upload time (closes #9710) 9 years ago
Sergey M․ 33d9f3707c
[thesixtyone] Relax _VALID_URL (Closes #9714) 9 years ago
Sergey M․ a26a9d6239
[livestream:event] Ensure video id is string (Closes #9721) 9 years ago
Yen Chi Hsuan a4a8201c02
[wdr] Update _TESTS 9 years ago
Yen Chi Hsuan a6571f1073
[common] Fix <bootstrapInfo> detection in F4M manifests
Regression since 0a5685b26f
9 years ago
Sergey M․ 57b6e9652e
[canal+] Add support for d17.tv 9 years ago
Sergey M․ 3d9b3605a3
[canal+] Update tests 9 years ago
Sergey M․ 74193838f7
[canal+] Improve extraction (Closes #9718) 9 years ago
Sergey M fb94e260b5 Merge pull request #9720 from Kagami/vlive-new-statuses
[vlive] Acknowledge vlive+ streams statuses
9 years ago
Kagami Hiiragi 345dec937f [vlive] Acknowledge vlive+ streams statuses
Same as common statuses just with "PRODUCT_" prefix:
PRODUCE_LIVE_END, PRODUCT_COMING_SOON, etc.
9 years ago
Philipp Hagemeister 4315f74fa8 Merge remote-tracking branch 'Boris-de/wdrmaus_fix#8562' 9 years ago
Sergey M․ 631d4c87ee
[twitch:vod] Use native hls 9 years ago
Sergey M․ 2c34735267
[youtube] Add itags 256 and 258 9 years ago
Sergey M․ 0fc832e1b2
[vidio] Improve (Closes #9562) 9 years ago
TRox1972 7def35712a
[vidio] Add extractor (Closes #7195)
[Vidio] fix fallback value and wrap duration in int_or_none

[Vidio] don't use video_id for _html_search_regex()
9 years ago
Sergey M․ 762d44c956
[channel9] Add support for rss links (Closes #9673) 9 years ago
Sergey M․ 4d8856d511
[loc] Extract direct download links 9 years ago
Sergey M․ c917106be4
[loc] Extract subtites 9 years ago
Sergey M․ 76e9cd7f24
[loc] Add support for another URL schema and simplify 9 years ago
Sergey M․ 7f3c3dfa52
[loc] Improve (Closes #9521) 9 years ago
TRox1972 9c3c447eb3
[loc] Add extractor (Closes #3188)
Added extractor of loc.gov, which closes #3188. I am not an experienced programmer, so I am sure I did a bunch of mistakes, but the extractor works (for me at least).

[LibraryOfCongress] don't use video_id for _search_regex()

[LibraryOfCongress] Improvements
9 years ago
Yen Chi Hsuan ad73083ff0
[bilibili] Add _part%d suffixes back (closes #9660) 9 years ago
Remita Amine 4a684895c0 [seeker] Add new extractor(closes #9619) 9 years ago
Remita Amine f4e4aa9b6b [revision3:embed] Add new extractor 9 years ago
Sergey M․ 6e6b9f600f
[arte] Add support for playlists and rework tests (Closes #9632) 9 years ago
Sergey M․ 6a1df4fb5f
[spankwire] Add support for new URL format (Closes #9657) 9 years ago
Yen Chi Hsuan dde1ce7c06
[tf1] Fix a regular expression (closes #9656)
This is a Python bug fixed in 2.7.6 [1]

[1] https://github.com/rg3/youtube-dl/issues/9656#issuecomment-222968594
9 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 9 years ago
Yen Chi Hsuan 0ff3749bfe
[udn] Fix m3u8 and f4m extraction as well as improve 9 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 9 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
9 years ago
Peter Rowlands e7d85c4ef7 use /track/video/file to determine if video exists 9 years ago
Sergey M․ 197a5da1d0
[yandexmusic] Improve captcha detection 9 years ago
Yen Chi Hsuan 9ed6d8c6c5
[youku] Extract resolution 9 years ago
Yen Chi Hsuan 6461f2b7ec
[bilibili] Fix extraction, improve and cleanup 9 years ago
Sergey M․ 807cf7b07f
[udemy] Fix authentication for localized layout (Closes #9594) 9 years ago
Sergey M․ de7d76af52
[coub] Add another test 9 years ago
Sergey M․ 11c70deba7
[coub] Add extractor (Closes #9609) 9 years ago
Sergey M․ f36532404d
[vk] Remove superfluous code 9 years ago
Sergey M․ 77b8b4e696
[extractor/common] Borrow quality metadata from parent set-level manifest for f4m 9 years ago
Boris Wachtmeister 3a686853e1 [WDR] fixed parsing of playlists 9 years ago
Boris Wachtmeister 949fc42e00 [WDR] the other wdrmaus.de pages also changed to the new player 9 years ago
Boris Wachtmeister 33a1ff7113 [WDR] extract jsonp-url by parsing data-extension of mediaLink 9 years ago
Boris Wachtmeister bec2c14f2c [WDR] add special handling if alt-url is a m3u8 9 years ago
Boris Wachtmeister 37f972954d [WDR] use _download_json with a strip_jsonp 9 years ago
Boris Wachtmeister 3874e6ea66 [WDR] use single quotes for strings 9 years ago
Yen Chi Hsuan fac2af3c51
[common] Fix m3u8 extraction in f4m manifests 9 years ago
Sergey M․ 6f8cb24219
[tvp] Expand _VALID_URL and improve naming (Closes #9602) 9 years ago
Yen Chi Hsuan 448bb5f333
[common] Fix non-bootstrapped support in f4m 9 years ago
Yen Chi Hsuan ac88d2316e
[dw] Support documentaries (closes #9475) 9 years ago
Yen Chi Hsuan 761052db92
[playwire] Add the test (closed #9531) 9 years ago
Yen Chi Hsuan 240b60453e
[common] Support m3u8 in f4m manifests
Related: #9531
9 years ago
Yen Chi Hsuan 85b0fe7d64
[playwire] Use _extract_f4m_formats
Related: #9531
9 years ago
Yen Chi Hsuan 0a5685b26f
[common] Support non-bootstraped streams in f4m manifests
Related: #9531
9 years ago
Sergey M․ 6f748df43f
[eporner] Make test only_matching 9 years ago
Yen Chi Hsuan b410cb83d4 Merge pull request #9595 from Kagami/vlive-site-update
[vlive] Address site update
9 years ago
Yen Chi Hsuan da9d82840a Merge pull request #9600 from wankerer/master
[eporner] fix for the new URL layout
9 years ago
wankerer 4ee0b8afdb [eporner] fix for the new URL layout
Recently eporner slightly changed the URL layout, the ID that used to be
digits only are now digits and letters, so youtube-dl falls back to
the generic extractor that doesn't work.

Fix the matching regex to allow letters in ID.

[v2: added a test case]
9 years ago
remitamine 1de32771e1 [eyedotv] Add new extractor(closes #9582) 9 years ago
remitamine 688c634b7d skip some tests to reduce test time 9 years ago
Sergey M․ 6b43132ce9
[xhamster] Update tests 9 years ago
mexican porn commits a4690b3244
[xhamster] url regex fix for videos with empty title. 9 years ago
remitamine 444417edb5 [radiocanada] Add new extractor(#4020) 9 years ago
remitamine 277c7465f5 [ooyala] check manifest ext with determine_ext and update tests for related extractors 9 years ago
Kagami Hiiragi 25bcd3550e [vlive] Address site update
Changes:
* Fix video params extraction
* Don't make status request since status info now available on the page
* Remove unneeded code
* Fix test
9 years ago
remitamine a4760d204f [ooyala] use api v2 to reduce requests for format extraction 9 years ago
remitamine e8593f346a [ooyala] extract subtitles 9 years ago
remitamine 05b651e3a5 [washingtonpost] reduce requests for m3u8 manifests 9 years ago
remitamine 42a7439717 [cbs] allow to pass content id to the extractor(closes #9589) 9 years ago
remitamine b1e9ebd080 [washingtonpost] remove unnecessary code 9 years ago
remitamine 0c50eeb987 [reuters] Add new extractor 9 years ago
remitamine 4b464a6a78 [washingtonpost] improve format extraction and add support for video pages extraction 9 years ago
Sergey M․ 5db9df622f
[life:embed] Use native hls 9 years ago
Sergey M․ 5181759c0d
[life] Update _VALID_URL 9 years ago
Sergey M․ e54373204a
[lifenews] Fix metadata extraction 9 years ago
remitamine 102810ef04 [voxmedia] fix volume embed extraction 9 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 9 years ago
Yen Chi Hsuan 7a46542f97
[livestream] Video IDs should always be strings (#2234) 9 years ago
remitamine db3b8b2103 [tf1] add support for more related web sites 9 years ago
remitamine c5f5155100 [wat] extract all formats 9 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 9 years ago
Thor77 70346165fe [bandcamp] raise ExtractorError when track not streamable (#9465)
* [bandcamp] raise ExtractorError when track not streamable

* [bandcamp] update md5 for second test

* don't rely on json-data, but just check for 'file'

* don't rely on presence of 'file'
9 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 9 years ago
Sergey M․ 898f4b49cc
[theplatform] Add _extract_urls 9 years ago
Sergey M․ 0150a00f33
[cc] Add test for tosh.cc (Closes #9566) 9 years ago
TRox1972 c8831015f4
[ComedyCentral] Add support for tosh.cc.com and cc.com/video-clips 9 years ago
Sergey M․ 92d221ad48
[periscope] Update uploader_id (Closes #9565) 9 years ago
Sergey M․ 0db9a05f88
[periscope:user] Adapt to layout changes (Closes #9563) 9 years ago
Jaime Marquínez Ferrándiz 4c718d3c50 [rtve] Recognize 'filmoteca' URLs 9 years ago
Yen Chi Hsuan 115c65793a
[jwplatform] Don't fail with RTMP URLs without mp4:, mp3: or flv: 9 years ago
Yen Chi Hsuan 661d46b28f
[cbslocal] Add new extractor (closes #9522) 9 years ago
Yen Chi Hsuan 5ce3d5bd1b
[sendtonews] Add new extractor
Used in CBSLocal. Part of #9522
9 years ago
Yen Chi Hsuan 612b5f403e
[jwplatform] Improved m3u8 and rtmp support
Changes made for SendtoNewsIE. Part of #9522
9 years ago
Yen Chi Hsuan 9f54e692d2
[anvato] Add new extractor
Used in CBSLocal (#9522)
9 years ago
Yen Chi Hsuan 7b2fcbfd4e
[common] Skip TYPE=CLOSED-CAPTIONS lines in m3u8 manifests
According to [1], valid values for TYPE are AUDIO, VIDEO, SUBTITLES
and CLOSED-CAPTIONS. Such a value is found in Anvato master playlists,
though I don't use _extract_m3u8_formats() in the end.

Part of #9522.

[1] https://tools.ietf.org/html/draft-pantos-http-live-streaming-19#section-4.3.4.1
9 years ago
Yen Chi Hsuan 16da9bbc29
[common] Add _m3u8_meta_format() template
For extractors who handle m3u8 manifests by themselves. (eg., AnvatoIE)

Part of #9522
9 years ago
Sergey M․ c8602b2f9b
[nrk] Unquote subtitles' URLs 9 years ago
Sergey M․ b219f5e51b
[brightcove:new] Improve error reporting 9 years ago
Sergey M․ 1846e9ade0
[localnews8] Fix extractor (Closes #9539) 9 years ago
TRox1972 6756602be6
[LocalNews8] add extractor (Closes #9200) 9 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 9 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 9 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 9 years ago
remitamine 64413f7563 [cbc] fix extraction for flv only videos(fixes #5309) 9 years ago
Sergey M․ 45f160a43c
[wistia] Improve hls support 9 years ago
Sergey M․ 36ca2c55db
[wistia] Skip storyboard and improve extraction 9 years ago
Sergey M․ f0c96af9cb
[wistia] Add alias and modernize 9 years ago
Yen Chi Hsuan 31a70191e7
[cbc] Add the test case from #5156 9 years ago
Yen Chi Hsuan ad96b4c8f5
[common] Extract audio formats in SMIL
Found in http://www.cbc.ca/player/play/2657631896

Closes #5156
9 years ago
Yen Chi Hsuan 043dc9d36f
[cbc] Fix for old-styled URLs
The URL http://www.cbc.ca/player/News/ID/2672225049/ (#6342) redirects
to http://www.cbc.ca/player/play/2672224672, while youtube-dl wasn't
able to handle it correctly.
9 years ago
remitamine 52f7c75cff [cbc] extract http formats and update tests 9 years ago
Sergey M․ f6e588afc0
[24video] Fix description extraction 9 years ago
remitamine a001296703 [learnr] Add new extractor(closes #4284) 9 years ago
Sergey M․ dd81769c62
[ndtv] Fix extraction 9 years ago
remitamine b78531a36a [formula1] Add new extractor(closes #3617) 9 years ago
Sergey M․ 11e6a0b641
[nfb] Modernize and extract subtitles 9 years ago
Sergey M․ 15cda1ef77
[nfb] Fix uploader extraction 9 years ago
Yen Chi Hsuan 055f0d3d06
[abcnews] Added a new extractor (closes #3992)
Related: #6108, #8664, #9459
9 years ago
Sergey M․ f7199423e5
[groupon] Add support for Youtube embeds (Closes #9508) 9 years ago
Sergey M․ a0a81918f1
[collegehumor] Remove extractor
It now uses brightcove
9 years ago
Yen Chi Hsuan 5572d598a5
[hearthisat] Update the first test 9 years ago
Yen Chi Hsuan cec9727c7f
[hearthisat] Detect invalid download links (fixes #9440) 9 years ago
Sergey M․ 69c9cc2716
[xvideos] Extract html5 player formats (Closes #9495) 9 years ago
Sergey M․ ed56f26039
[extractor/common] Improve name extraction for m3u8 formats 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
Sergey M․ 5c86bfe70f
[3qsdn] Add extractor 9 years ago
Sergey M․ ca950f49e9
[ora] Revert extraction to regexes
It's less fragile than using js_to_json with ora js
9 years ago
felix 640eea0a0c
[ora] minimise fragile regex shenanigans; recognise unsafespeech.com URLs 9 years ago