Commit Graph

8126 Commits (c58ed8563d37e39235332b35e7feafe32711c623)

Author SHA1 Message Date
Yen Chi Hsuan e21c26daf9 Merge pull request #9395 from pmrowla/afreecatv
[afreecatv] Add new extractor for afreecatv.com VODs
9 years ago
Yen Chi Hsuan 1594a4932f
[wdr] Misc changes 9 years ago
Yen Chi Hsuan 6869d634c6
[wdr] Simplify extraction 9 years ago
Yen Chi Hsuan 50918c4ee0
[wdr] Support radio players (closes #6147) 9 years ago
Sergey M․ 9d51a0a9a1
[vessel] Make hls formats non fatal 9 years ago
Sergey M․ 39da509f67
[vessel] Extract DASH formats 9 years ago
Sergey M․ a479b8f687
[vessel] Use native hls by default 9 years ago
Sergey M․ 48a5eabc48
[extractor/generic] Add support vessel embeds (Closes #7083) 9 years ago
Sergey M․ 11380753b5
[vessel] Add support for embed urls and improve extraction 9 years ago
Yen Chi Hsuan 411c590a1f
[youku:show] Add new extractor 9 years ago
Yen Chi Hsuan 6da8d7de69
[twitter] Update _TESTS 9 years ago
Yen Chi Hsuan c6308b3153
[twitter] Fix extraction for videos with HLS streams
Closes #9623
9 years ago
Yen Chi Hsuan fc0a45fa41
[twitter] Detect suspended accounts and update _TESTS 9 years ago
Yen Chi Hsuan e6e90515db
[nbc] Add the test case from #9578
Closes #9578
9 years ago
Yen Chi Hsuan 22a0a95247
[theplatform] Some NBC videos require an additional cookie
Related: #9578
9 years ago
Yen Chi Hsuan 7264e38591
[bilibili] Fix for videos without upload time (closes #9710) 9 years ago
Sergey M․ 33d9f3707c
[thesixtyone] Relax _VALID_URL (Closes #9714) 9 years ago
Sergey M․ a26a9d6239
[livestream:event] Ensure video id is string (Closes #9721) 9 years ago
Yen Chi Hsuan a4a8201c02
[wdr] Update _TESTS 9 years ago
Yen Chi Hsuan a6571f1073
[common] Fix <bootstrapInfo> detection in F4M manifests
Regression since 0a5685b26f
9 years ago
Sergey M․ 57b6e9652e
[canal+] Add support for d17.tv 9 years ago
Sergey M․ 3d9b3605a3
[canal+] Update tests 9 years ago
Sergey M․ 74193838f7
[canal+] Improve extraction (Closes #9718) 9 years ago
Sergey M fb94e260b5 Merge pull request #9720 from Kagami/vlive-new-statuses
[vlive] Acknowledge vlive+ streams statuses
9 years ago
Kagami Hiiragi 345dec937f [vlive] Acknowledge vlive+ streams statuses
Same as common statuses just with "PRODUCT_" prefix:
PRODUCE_LIVE_END, PRODUCT_COMING_SOON, etc.
9 years ago
Philipp Hagemeister 4315f74fa8 Merge remote-tracking branch 'Boris-de/wdrmaus_fix#8562' 9 years ago
Sergey M․ 631d4c87ee
[twitch:vod] Use native hls 9 years ago
Sergey M․ 2c34735267
[youtube] Add itags 256 and 258 9 years ago
Sergey M․ 0fc832e1b2
[vidio] Improve (Closes #9562) 9 years ago
TRox1972 7def35712a
[vidio] Add extractor (Closes #7195)
[Vidio] fix fallback value and wrap duration in int_or_none

[Vidio] don't use video_id for _html_search_regex()
9 years ago
Sergey M․ 762d44c956
[channel9] Add support for rss links (Closes #9673) 9 years ago
Sergey M․ 4d8856d511
[loc] Extract direct download links 9 years ago
Sergey M․ c917106be4
[loc] Extract subtites 9 years ago
Sergey M․ 76e9cd7f24
[loc] Add support for another URL schema and simplify 9 years ago
Sergey M․ 7f3c3dfa52
[loc] Improve (Closes #9521) 9 years ago
TRox1972 9c3c447eb3
[loc] Add extractor (Closes #3188)
Added extractor of loc.gov, which closes #3188. I am not an experienced programmer, so I am sure I did a bunch of mistakes, but the extractor works (for me at least).

[LibraryOfCongress] don't use video_id for _search_regex()

[LibraryOfCongress] Improvements
9 years ago
Yen Chi Hsuan ad73083ff0
[bilibili] Add _part%d suffixes back (closes #9660) 9 years ago
Remita Amine 4a684895c0 [seeker] Add new extractor(closes #9619) 9 years ago
Remita Amine f4e4aa9b6b [revision3:embed] Add new extractor 9 years ago
Sergey M․ 6e6b9f600f
[arte] Add support for playlists and rework tests (Closes #9632) 9 years ago
Sergey M․ 6a1df4fb5f
[spankwire] Add support for new URL format (Closes #9657) 9 years ago
Yen Chi Hsuan dde1ce7c06
[tf1] Fix a regular expression (closes #9656)
This is a Python bug fixed in 2.7.6 [1]

[1] https://github.com/rg3/youtube-dl/issues/9656#issuecomment-222968594
9 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 9 years ago
Yen Chi Hsuan 0ff3749bfe
[udn] Fix m3u8 and f4m extraction as well as improve 9 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 9 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
9 years ago
Peter Rowlands e7d85c4ef7 use /track/video/file to determine if video exists 9 years ago
Sergey M․ 197a5da1d0
[yandexmusic] Improve captcha detection 9 years ago
Yen Chi Hsuan 9ed6d8c6c5
[youku] Extract resolution 9 years ago
Yen Chi Hsuan 6461f2b7ec
[bilibili] Fix extraction, improve and cleanup 9 years ago
Sergey M․ 807cf7b07f
[udemy] Fix authentication for localized layout (Closes #9594) 9 years ago
Sergey M․ de7d76af52
[coub] Add another test 9 years ago
Sergey M․ 11c70deba7
[coub] Add extractor (Closes #9609) 9 years ago
Sergey M․ f36532404d
[vk] Remove superfluous code 9 years ago
Sergey M․ 77b8b4e696
[extractor/common] Borrow quality metadata from parent set-level manifest for f4m 9 years ago
Boris Wachtmeister 3a686853e1 [WDR] fixed parsing of playlists 9 years ago
Boris Wachtmeister 949fc42e00 [WDR] the other wdrmaus.de pages also changed to the new player 9 years ago
Boris Wachtmeister 33a1ff7113 [WDR] extract jsonp-url by parsing data-extension of mediaLink 9 years ago
Boris Wachtmeister bec2c14f2c [WDR] add special handling if alt-url is a m3u8 9 years ago
Boris Wachtmeister 37f972954d [WDR] use _download_json with a strip_jsonp 9 years ago
Boris Wachtmeister 3874e6ea66 [WDR] use single quotes for strings 9 years ago
Yen Chi Hsuan fac2af3c51
[common] Fix m3u8 extraction in f4m manifests 9 years ago
Sergey M․ 6f8cb24219
[tvp] Expand _VALID_URL and improve naming (Closes #9602) 9 years ago
Yen Chi Hsuan 448bb5f333
[common] Fix non-bootstrapped support in f4m 9 years ago
Yen Chi Hsuan ac88d2316e
[dw] Support documentaries (closes #9475) 9 years ago
Yen Chi Hsuan 761052db92
[playwire] Add the test (closed #9531) 9 years ago
Yen Chi Hsuan 240b60453e
[common] Support m3u8 in f4m manifests
Related: #9531
9 years ago
Yen Chi Hsuan 85b0fe7d64
[playwire] Use _extract_f4m_formats
Related: #9531
9 years ago
Yen Chi Hsuan 0a5685b26f
[common] Support non-bootstraped streams in f4m manifests
Related: #9531
9 years ago
Sergey M․ 6f748df43f
[eporner] Make test only_matching 9 years ago
Yen Chi Hsuan b410cb83d4 Merge pull request #9595 from Kagami/vlive-site-update
[vlive] Address site update
9 years ago
Yen Chi Hsuan da9d82840a Merge pull request #9600 from wankerer/master
[eporner] fix for the new URL layout
9 years ago
wankerer 4ee0b8afdb [eporner] fix for the new URL layout
Recently eporner slightly changed the URL layout, the ID that used to be
digits only are now digits and letters, so youtube-dl falls back to
the generic extractor that doesn't work.

Fix the matching regex to allow letters in ID.

[v2: added a test case]
9 years ago
remitamine 1de32771e1 [eyedotv] Add new extractor(closes #9582) 9 years ago
remitamine 688c634b7d skip some tests to reduce test time 9 years ago
Sergey M․ 6b43132ce9
[xhamster] Update tests 9 years ago
mexican porn commits a4690b3244
[xhamster] url regex fix for videos with empty title. 9 years ago
remitamine 444417edb5 [radiocanada] Add new extractor(#4020) 9 years ago
remitamine 277c7465f5 [ooyala] check manifest ext with determine_ext and update tests for related extractors 9 years ago
Kagami Hiiragi 25bcd3550e [vlive] Address site update
Changes:
* Fix video params extraction
* Don't make status request since status info now available on the page
* Remove unneeded code
* Fix test
9 years ago
remitamine a4760d204f [ooyala] use api v2 to reduce requests for format extraction 9 years ago
remitamine e8593f346a [ooyala] extract subtitles 9 years ago
remitamine 05b651e3a5 [washingtonpost] reduce requests for m3u8 manifests 9 years ago
remitamine 42a7439717 [cbs] allow to pass content id to the extractor(closes #9589) 9 years ago
remitamine b1e9ebd080 [washingtonpost] remove unnecessary code 9 years ago
remitamine 0c50eeb987 [reuters] Add new extractor 9 years ago
remitamine 4b464a6a78 [washingtonpost] improve format extraction and add support for video pages extraction 9 years ago
Sergey M․ 5db9df622f
[life:embed] Use native hls 9 years ago
Sergey M․ 5181759c0d
[life] Update _VALID_URL 9 years ago
Sergey M․ e54373204a
[lifenews] Fix metadata extraction 9 years ago
remitamine 102810ef04 [voxmedia] fix volume embed extraction 9 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 9 years ago
Yen Chi Hsuan 7a46542f97
[livestream] Video IDs should always be strings (#2234) 9 years ago
remitamine db3b8b2103 [tf1] add support for more related web sites 9 years ago
remitamine c5f5155100 [wat] extract all formats 9 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 9 years ago
Thor77 70346165fe [bandcamp] raise ExtractorError when track not streamable (#9465)
* [bandcamp] raise ExtractorError when track not streamable

* [bandcamp] update md5 for second test

* don't rely on json-data, but just check for 'file'

* don't rely on presence of 'file'
9 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 9 years ago
Sergey M․ 898f4b49cc
[theplatform] Add _extract_urls 9 years ago
Sergey M․ 0150a00f33
[cc] Add test for tosh.cc (Closes #9566) 9 years ago
TRox1972 c8831015f4
[ComedyCentral] Add support for tosh.cc.com and cc.com/video-clips 9 years ago
Sergey M․ 92d221ad48
[periscope] Update uploader_id (Closes #9565) 9 years ago
Sergey M․ 0db9a05f88
[periscope:user] Adapt to layout changes (Closes #9563) 9 years ago
Jaime Marquínez Ferrándiz 4c718d3c50 [rtve] Recognize 'filmoteca' URLs 9 years ago
Yen Chi Hsuan 115c65793a
[jwplatform] Don't fail with RTMP URLs without mp4:, mp3: or flv: 9 years ago
Yen Chi Hsuan 661d46b28f
[cbslocal] Add new extractor (closes #9522) 9 years ago
Yen Chi Hsuan 5ce3d5bd1b
[sendtonews] Add new extractor
Used in CBSLocal. Part of #9522
9 years ago
Yen Chi Hsuan 612b5f403e
[jwplatform] Improved m3u8 and rtmp support
Changes made for SendtoNewsIE. Part of #9522
9 years ago
Yen Chi Hsuan 9f54e692d2
[anvato] Add new extractor
Used in CBSLocal (#9522)
9 years ago
Yen Chi Hsuan 7b2fcbfd4e
[common] Skip TYPE=CLOSED-CAPTIONS lines in m3u8 manifests
According to [1], valid values for TYPE are AUDIO, VIDEO, SUBTITLES
and CLOSED-CAPTIONS. Such a value is found in Anvato master playlists,
though I don't use _extract_m3u8_formats() in the end.

Part of #9522.

[1] https://tools.ietf.org/html/draft-pantos-http-live-streaming-19#section-4.3.4.1
9 years ago
Yen Chi Hsuan 16da9bbc29
[common] Add _m3u8_meta_format() template
For extractors who handle m3u8 manifests by themselves. (eg., AnvatoIE)

Part of #9522
9 years ago
Sergey M․ c8602b2f9b
[nrk] Unquote subtitles' URLs 9 years ago
Sergey M․ b219f5e51b
[brightcove:new] Improve error reporting 9 years ago
Sergey M․ 1846e9ade0
[localnews8] Fix extractor (Closes #9539) 9 years ago
TRox1972 6756602be6
[LocalNews8] add extractor (Closes #9200) 9 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 9 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 9 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 9 years ago
remitamine 64413f7563 [cbc] fix extraction for flv only videos(fixes #5309) 9 years ago
Sergey M․ 45f160a43c
[wistia] Improve hls support 9 years ago
Sergey M․ 36ca2c55db
[wistia] Skip storyboard and improve extraction 9 years ago
Sergey M․ f0c96af9cb
[wistia] Add alias and modernize 9 years ago
Yen Chi Hsuan 31a70191e7
[cbc] Add the test case from #5156 9 years ago
Yen Chi Hsuan ad96b4c8f5
[common] Extract audio formats in SMIL
Found in http://www.cbc.ca/player/play/2657631896

Closes #5156
9 years ago
Yen Chi Hsuan 043dc9d36f
[cbc] Fix for old-styled URLs
The URL http://www.cbc.ca/player/News/ID/2672225049/ (#6342) redirects
to http://www.cbc.ca/player/play/2672224672, while youtube-dl wasn't
able to handle it correctly.
9 years ago
remitamine 52f7c75cff [cbc] extract http formats and update tests 9 years ago
Sergey M․ f6e588afc0
[24video] Fix description extraction 9 years ago
remitamine a001296703 [learnr] Add new extractor(closes #4284) 9 years ago
Sergey M․ dd81769c62
[ndtv] Fix extraction 9 years ago
remitamine b78531a36a [formula1] Add new extractor(closes #3617) 9 years ago
Sergey M․ 11e6a0b641
[nfb] Modernize and extract subtitles 9 years ago
Sergey M․ 15cda1ef77
[nfb] Fix uploader extraction 9 years ago
Yen Chi Hsuan 055f0d3d06
[abcnews] Added a new extractor (closes #3992)
Related: #6108, #8664, #9459
9 years ago
Sergey M․ f7199423e5
[groupon] Add support for Youtube embeds (Closes #9508) 9 years ago
Sergey M․ a0a81918f1
[collegehumor] Remove extractor
It now uses brightcove
9 years ago
Yen Chi Hsuan 5572d598a5
[hearthisat] Update the first test 9 years ago
Yen Chi Hsuan cec9727c7f
[hearthisat] Detect invalid download links (fixes #9440) 9 years ago
Sergey M․ 69c9cc2716
[xvideos] Extract html5 player formats (Closes #9495) 9 years ago
Sergey M․ ed56f26039
[extractor/common] Improve name extraction for m3u8 formats 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
Sergey M․ 5c86bfe70f
[3qsdn] Add extractor 9 years ago
Sergey M․ ca950f49e9
[ora] Revert extraction to regexes
It's less fragile than using js_to_json with ora js
9 years ago
felix 640eea0a0c
[ora] minimise fragile regex shenanigans; recognise unsafespeech.com URLs 9 years ago
Jakub Wilk 791ff52f75 [teamcoco] Fix base64 regexp 9 years ago
Sergey M․ b5abf86148
[cinemassacre] Remove extractor (Closes #9457)
It now uses jwplatform
9 years ago
remitamine 0730be9022 [sina] fix extraction(fixes #1146) 9 years ago
Sergey M․ 96c2e3e909
[imdb] Improve extraction 9 years ago
Sergey M․ f196508f7b
[imdb] Relax _VALID_URL (Closes #9481) 9 years ago
Yen Chi Hsuan cc1028aa6d
[openload] Fix extraction (closes #9472) 9 years ago
remitamine ad55e10165 [brightcove] change the protocol for m3u8 formats to m3u8_native 9 years ago
remitamine 18cf6381f6 [nrk] extract m3u8 formats 9 years ago
remitamine cdf32ff15d [extractors] add import for UstudioEmbedIE 9 years ago
remitamine 99d79b8692 [ustudio] add support ustudio app/embed urls 9 years ago
remitamine b9e7bc55da [mgtv] extract http formats 9 years ago
Sergey M․ d8d540cf0d
[nrk] Rework extractor (Closes #9470) 9 years ago
Sergey M․ 0df79d552a
[twitch:bookmarks] Remove extractor
Bookmarks no longer available
9 years ago
Sergey M․ 0db3a66162
[twitch] Skip dead tests 9 years ago
Yen Chi Hsuan a3fa6024d6
[bloomberg] Fix test_Bloomberg
In this test case, sometimes HLS is the best format while sometimes HDS
is. To prevent occasional test failures, force HDS to be the best
format. In the past, testing against HDS formats causes the same error
as #9214, which is fixed as #9377 landed.
9 years ago
Yen Chi Hsuan 7e8ddca1bb
[vevo] Delay the georestriction check to prevent false alerts
Fixes #9408
9 years ago
Yen Chi Hsuan 4540515cb3
[iqiyi] Fix 1080P extraction (closes #9446) 9 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 9 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 9 years ago
Sergey M․ 3951e7eb93
[ceskatelevize] Simplify, restore bonus video test and skip georestricted test (Closes #9431) 9 years ago
Tomáš Čech f1f6f5aa5e
[ceskatelevize] Add support for live streams
Live streams has no playlist title, use title of the stream containing
TV channel name. Internal m3u8 handler doesn't seem to handle well
continuous streams. Add test for live stream. Remove no longer
reachable test.
9 years ago
Sergey M․ c52f4efaee
[mva] Improve _VALID_URLs 9 years ago
Sergey M․ f23a92a0ce
[mva] Add extractor (Closes #6667) 9 years ago
Yen Chi Hsuan 3b01a9fbb6
[litv] Add new extractor
LiTV is a streaming platform providing free and paid legal contents in
Taiwan.
9 years ago
Peter Rowlands 93fdb14177 don't use selection by attribute 9 years ago
Peter Rowlands 370d4eb8ad use stricter file selector
in case of empty in case of empty ./track/video/file entries
9 years ago
Peter Rowlands 3452c3a27c update tests 9 years ago
Sergey M․ 9c072d38c6
[arte] Improve language preference (Closes #9401, closes #9162) 9 years ago
Peter Rowlands 81f35fee2f fix extractors.py import order 9 years ago
Peter Rowlands 0fdbe3146c use dict.get in case upload_date does not exist 9 years ago
Yen Chi Hsuan a0904c5d80
[telegraaf] Fix extractor (closes #9318) 9 years ago
Sergey M․ cb1fa58813
[flickr] Extract uploader URL (Closes #9426) 9 years ago
remitamine 3fd6332c05 [flickr] extract license field(closes #9425) 9 years ago
Sergey M 401d147893 Merge pull request #9400 from inondle/master
[liveleak] Adds support for thumbnails and updates tests
9 years ago
inondle e2ee97dcd5 [liveleak] Adds support for thumbnails, updates tests 9 years ago
Sergey M․ f745403b5b
[vevo] Revert videoplayer.vevo.com to api.vevo.com 9 years ago
Sergey M․ 3e80e6f40d
[vevo] Allow request to api.vevo.com to fail (Closes #9417)
I don't know whether this it's tempopary or api has just gone
9 years ago
Sergey M․ 25cb7a0eeb
[youtube] Allow empty attribute values in description regex 9 years ago
remitamine 04e88ca2ca [vk] improve extraction(fixes #7976) 9 years ago
Peter Rowlands 8d93c21466 add multi_video test case 9 years ago
Peter Rowlands 1dbfd78754 fix multi_video part naming, add upload_date field 9 years ago
Peter Rowlands 22e35adefd use url instead of single formats entry 9 years ago
Yen Chi Hsuan 6f59aa934b
[periscope:user] Add new extractor for user pages
Closes #9388
9 years ago
Peter Rowlands 833b644fff use xpath_text 9 years ago
Sergey M․ 915620fd68
[redtube] PEP 8 9 years ago
Sergey M․ ac12e888f9
[redtube] Extract all formats, duration, upload date and view count (Closes #9397) 9 years ago
Yen Chi Hsuan 7d08f6073d
[kuwo:category] Update test 9 years ago
remitamine 758a059241 [dailymail] Add new extractor(closes #2667) 9 years ago
Yen Chi Hsuan 4f8c56eb4e
[fczenit] Fix extraction and update test
Closes #9359
9 years ago
Peter Rowlands 57cf9b7f06 [afreecatv] Add new extractor for afreecatv.com VODs 9 years ago
Sergey M․ 9da526aae7
[yandexmusic:playlist] Update test 9 years ago
Sergey M․ 75b81df3af
[udemy] Modernize 9 years ago
Sergey M․ aabdc83d6e
[udemy] Fix course enroll (Closes #9393) 9 years ago
Sergey M․ 2a48e6f01a
[yandexmusic:playlist] Respect track order for long (>150) playlists 9 years ago
Sergey M․ 203a3c0e6a
[yandexmusic:playlist] Make title optional 9 years ago
Sergey M․ d36724cca4
[yandexmusic:playlist] Remove unused imports 9 years ago