Commit Graph

10738 Commits (c5edd147d1d2cf0502f5ef48652c88a75ef62529)

Author SHA1 Message Date
remitamine 4b464a6a78 [washingtonpost] improve format extraction and add support for video pages extraction 9 years ago
Sergey M․ 5db9df622f
[life:embed] Use native hls 9 years ago
Sergey M․ 5181759c0d
[life] Update _VALID_URL 9 years ago
Sergey M․ e54373204a
[lifenews] Fix metadata extraction 9 years ago
remitamine 102810ef04 [voxmedia] fix volume embed extraction 9 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 9 years ago
Yen Chi Hsuan 7a46542f97
[livestream] Video IDs should always be strings (#2234) 9 years ago
Yen Chi Hsuan eb7941e3e6
[compat] Fix for XML with <!DOCTYPE> in Python 2.7 and 3.2
Such XML documents cause DeprecationWarning if python is run
with `-W error`
9 years ago
remitamine db3b8b2103 [tf1] add support for more related web sites 9 years ago
remitamine c5f5155100 [wat] extract all formats 9 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 9 years ago
Thor77 70346165fe [bandcamp] raise ExtractorError when track not streamable (#9465)
* [bandcamp] raise ExtractorError when track not streamable

* [bandcamp] update md5 for second test

* don't rely on json-data, but just check for 'file'

* don't rely on presence of 'file'
9 years ago
Sergey M․ e9297256d4
[update] Fix youtube-dl.exe updating from arbitrary directory (Closes #2718) 9 years ago
Sergey M․ c6b9cf05e1
[utils] Do not fail on unknown date formats in unified_strdate 9 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 9 years ago
Sergey M․ 898f4b49cc
[theplatform] Add _extract_urls 9 years ago
Sergey M․ 0150a00f33
[cc] Add test for tosh.cc (Closes #9566) 9 years ago
TRox1972 c8831015f4
[ComedyCentral] Add support for tosh.cc.com and cc.com/video-clips 9 years ago
Sergey M․ 92d221ad48
[periscope] Update uploader_id (Closes #9565) 9 years ago
Sergey M․ 0db9a05f88
[periscope:user] Adapt to layout changes (Closes #9563) 9 years ago
Philipp Hagemeister e03b35b8f9 release 2016.05.21.2 9 years ago
Philipp Hagemeister 598869afb1 release 2016.05.21.1 9 years ago
Philipp Hagemeister c8cc3745fb release 2016.05.21 9 years ago
Jaime Marquínez Ferrándiz 4c718d3c50 [rtve] Recognize 'filmoteca' URLs 9 years ago
Yen Chi Hsuan 115c65793a
[jwplatform] Don't fail with RTMP URLs without mp4:, mp3: or flv: 9 years ago
Yen Chi Hsuan 661d46b28f
[cbslocal] Add new extractor (closes #9522) 9 years ago
Yen Chi Hsuan 5ce3d5bd1b
[sendtonews] Add new extractor
Used in CBSLocal. Part of #9522
9 years ago
Yen Chi Hsuan 612b5f403e
[jwplatform] Improved m3u8 and rtmp support
Changes made for SendtoNewsIE. Part of #9522
9 years ago
Yen Chi Hsuan 9f54e692d2
[anvato] Add new extractor
Used in CBSLocal (#9522)
9 years ago
Yen Chi Hsuan 7b2fcbfd4e
[common] Skip TYPE=CLOSED-CAPTIONS lines in m3u8 manifests
According to [1], valid values for TYPE are AUDIO, VIDEO, SUBTITLES
and CLOSED-CAPTIONS. Such a value is found in Anvato master playlists,
though I don't use _extract_m3u8_formats() in the end.

Part of #9522.

[1] https://tools.ietf.org/html/draft-pantos-http-live-streaming-19#section-4.3.4.1
9 years ago
Yen Chi Hsuan 16da9bbc29
[common] Add _m3u8_meta_format() template
For extractors who handle m3u8 manifests by themselves. (eg., AnvatoIE)

Part of #9522
9 years ago
Sergey M․ c8602b2f9b
[nrk] Unquote subtitles' URLs 9 years ago
Sergey M․ b219f5e51b
[brightcove:new] Improve error reporting 9 years ago
Sergey M․ 1846e9ade0
[localnews8] Fix extractor (Closes #9539) 9 years ago
TRox1972 6756602be6
[LocalNews8] add extractor (Closes #9200) 9 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 9 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 9 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 9 years ago
remitamine 64413f7563 [cbc] fix extraction for flv only videos(fixes #5309) 9 years ago
Sergey M․ 45f160a43c
[wistia] Improve hls support 9 years ago
Sergey M․ 36ca2c55db
[wistia] Skip storyboard and improve extraction 9 years ago
Sergey M․ f0c96af9cb
[wistia] Add alias and modernize 9 years ago
Yen Chi Hsuan 31a70191e7
[cbc] Add the test case from #5156 9 years ago
Yen Chi Hsuan ad96b4c8f5
[common] Extract audio formats in SMIL
Found in http://www.cbc.ca/player/play/2657631896

Closes #5156
9 years ago
Yen Chi Hsuan 043dc9d36f
[cbc] Fix for old-styled URLs
The URL http://www.cbc.ca/player/News/ID/2672225049/ (#6342) redirects
to http://www.cbc.ca/player/play/2672224672, while youtube-dl wasn't
able to handle it correctly.
9 years ago
remitamine 52f7c75cff [cbc] extract http formats and update tests 9 years ago
Sergey M․ f6e588afc0
[24video] Fix description extraction 9 years ago
remitamine a001296703 [learnr] Add new extractor(closes #4284) 9 years ago
Sergey M․ dd81769c62
[ndtv] Fix extraction 9 years ago
Sergey M․ 46bc9b7d7c
[utils] Allow None in remove_{start,end} 9 years ago
remitamine b78531a36a [formula1] Add new extractor(closes #3617) 9 years ago
Sergey M․ 11e6a0b641
[nfb] Modernize and extract subtitles 9 years ago
Sergey M․ 15cda1ef77
[nfb] Fix uploader extraction 9 years ago
Yen Chi Hsuan 055f0d3d06
[abcnews] Added a new extractor (closes #3992)
Related: #6108, #8664, #9459
9 years ago
Yen Chi Hsuan cdd94c2eae
[utils] Check for None values in SOCKS proxy
Originally reported at
https://github.com/rg3/youtube-dl/pull/9287#issuecomment-219617864
9 years ago
Philipp Hagemeister 36755d9d69 release 2016.05.16 9 years ago
Sergey M․ f7199423e5
[groupon] Add support for Youtube embeds (Closes #9508) 9 years ago
Sergey M․ a0a81918f1
[collegehumor] Remove extractor
It now uses brightcove
9 years ago
Yen Chi Hsuan 5572d598a5
[hearthisat] Update the first test 9 years ago
Yen Chi Hsuan cec9727c7f
[hearthisat] Detect invalid download links (fixes #9440) 9 years ago
Yen Chi Hsuan 79298173c5
[utils] Fix getheader in urlhandle_detect_ext
Fixes #7049, related to #9440
9 years ago
Sergey M․ 69c9cc2716
[xvideos] Extract html5 player formats (Closes #9495) 9 years ago
Sergey M․ ed56f26039
[extractor/common] Improve name extraction for m3u8 formats 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ cda6d47aad
[utils] Simplify integer conversion in js_to_json 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
Sergey M․ 5c86bfe70f
[3qsdn] Add extractor 9 years ago
Sergey M․ ca950f49e9
[ora] Revert extraction to regexes
It's less fragile than using js_to_json with ora js
9 years ago
Sergey M․ 89ac4a19e6
[utils] Process non-base 10 integers in js_to_json 9 years ago
felix 640eea0a0c
[ora] minimise fragile regex shenanigans; recognise unsafespeech.com URLs 9 years ago
felix bd1e484448
[utils] js_to_json: various improvements
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
9 years ago
Yen Chi Hsuan a834622b89 Merge pull request #9492 from jwilk/teamcoco
[teamcoco] Fix base64 regexp
9 years ago
Jakub Wilk 66e7ace17a Don't hardcode errno constant
The value of ENOENT is architecture-dependent, so don't assume it's
always 2.
9 years ago
Jakub Wilk 791ff52f75 [teamcoco] Fix base64 regexp 9 years ago
Sergey M․ b5abf86148
[cinemassacre] Remove extractor (Closes #9457)
It now uses jwplatform
9 years ago
Sergey M․ 134c6ea856
[YoutubeDL] Sanitize url for url and url_transparent extraction results 9 years ago
remitamine 0730be9022 [sina] fix extraction(fixes #1146) 9 years ago
Sergey M․ 96c2e3e909
[imdb] Improve extraction 9 years ago
Sergey M․ f196508f7b
[imdb] Relax _VALID_URL (Closes #9481) 9 years ago
Yen Chi Hsuan cc1028aa6d
[openload] Fix extraction (closes #9472) 9 years ago
remitamine ad55e10165 [brightcove] change the protocol for m3u8 formats to m3u8_native 9 years ago
remitamine 18cf6381f6 [nrk] extract m3u8 formats 9 years ago
remitamine cdf32ff15d [extractors] add import for UstudioEmbedIE 9 years ago
remitamine 99d79b8692 [ustudio] add support ustudio app/embed urls 9 years ago
remitamine b9e7bc55da [mgtv] extract http formats 9 years ago
Sergey M․ d8d540cf0d
[nrk] Rework extractor (Closes #9470) 9 years ago
Sergey M․ 0df79d552a
[twitch:bookmarks] Remove extractor
Bookmarks no longer available
9 years ago
Sergey M․ 0db3a66162
[twitch] Skip dead tests 9 years ago
Yen Chi Hsuan 7581bfc958
[utils] Unquote crendentials passed to SOCKS proxies
Fixes #9450
9 years ago
Yen Chi Hsuan a3fa6024d6
[bloomberg] Fix test_Bloomberg
In this test case, sometimes HLS is the best format while sometimes HDS
is. To prevent occasional test failures, force HDS to be the best
format. In the past, testing against HDS formats causes the same error
as #9214, which is fixed as #9377 landed.
9 years ago
Yen Chi Hsuan 1b405bb47d
[downloader/f4m] Tolerate truncate segments when testing
Replaces #9216

Fixes #9214 and test_Bloomberg partially
9 years ago
Yen Chi Hsuan 7e8ddca1bb
[vevo] Delay the georestriction check to prevent false alerts
Fixes #9408
9 years ago
Yen Chi Hsuan 778a1ccca7
[utils] Add Œ and œ found in French to ACCENT_CHARS
Fixes #9463
9 years ago
Yen Chi Hsuan 4540515cb3
[iqiyi] Fix 1080P extraction (closes #9446) 9 years ago
Sergey M․ e0741fd449
[__init__] Simplify colon presence check 9 years ago
teemuy e73b9c65e2
Bugfix: Allow colons in custom HTTP header values. 9 years ago
Yen Chi Hsuan 702ccf2dc0
[compat] Rename shlex_quote and remove unused subprocess_check_output 9 years ago
Philipp Hagemeister 28b4f73620 release 2016.05.10 9 years ago
Yen Chi Hsuan 6ddb4888d2
[options] Update --proxy description for SOCKS proxies 9 years ago
Yen Chi Hsuan fa5cb8d021
[socks] Remove a superfluous clause 9 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 9 years ago
Yen Chi Hsuan d5ae6bb501
[utils] Add rationale for register_socks_protocols 9 years ago
Yen Chi Hsuan 51fb4995a5
[utils] Register SOCKS protocols in urllib and support SOCKS4A 9 years ago
Yen Chi Hsuan 9e9cd7248d
[socks] Eliminate magic constants and improve 9 years ago
Yen Chi Hsuan 71aff18809
[socks] Support SOCKS proxies 9 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 9 years ago
Yen Chi Hsuan 4350b74545
[socks] Add socks.py from @bluec0re's public domain implementation
https://gist.github.com/bluec0re/cafd3764412967417fd3
9 years ago
Sergey M․ 2937590e8b
[downloader/hls] PEP 8 9 years ago
Sergey M․ e62d9c5caa
[downloader/external] Call ffmpeg with with HTTP_PROXY env variable set (#9437) 9 years ago
Sergey M․ fe40f9eef2
[compat] Add compat_setenv 9 years ago
Sergey M․ 6104cc2985
[downloader/hls] Add event media playlists to unsupported features of hlsnative 9 years ago
Sergey M․ c15c47d19b
[downloader/hls] Remove EXT-X-MEDIA-SEQUENCE from unsupported features for hlsnative 9 years ago
Sergey M․ 3951e7eb93
[ceskatelevize] Simplify, restore bonus video test and skip georestricted test (Closes #9431) 9 years ago
Tomáš Čech f1f6f5aa5e
[ceskatelevize] Add support for live streams
Live streams has no playlist title, use title of the stream containing
TV channel name. Internal m3u8 handler doesn't seem to handle well
continuous streams. Add test for live stream. Remove no longer
reachable test.
9 years ago
Sergey M eb785b856f Merge pull request #9358 from dstftw/hls-native-to-ffmpeg-delegation
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected
9 years ago
Sergey M․ c52f4efaee
[mva] Improve _VALID_URLs 9 years ago
Sergey M․ f23a92a0ce
[mva] Add extractor (Closes #6667) 9 years ago
Yen Chi Hsuan 3b01a9fbb6
[litv] Add new extractor
LiTV is a streaming platform providing free and paid legal contents in
Taiwan.
9 years ago
Peter Rowlands 93fdb14177 don't use selection by attribute 9 years ago
Peter Rowlands 370d4eb8ad use stricter file selector
in case of empty in case of empty ./track/video/file entries
9 years ago
Peter Rowlands 3452c3a27c update tests 9 years ago
Sergey M․ 9c072d38c6
[arte] Improve language preference (Closes #9401, closes #9162) 9 years ago
Peter Rowlands 81f35fee2f fix extractors.py import order 9 years ago
Peter Rowlands 0fdbe3146c use dict.get in case upload_date does not exist 9 years ago
Sergey M․ 3e169233da
Expanduser for more options with input files 9 years ago
Sergey M․ f5436c5d9e
[downloader/external] Add temp fix ffmpeg m3u8 downloads (Closes #9394) 9 years ago
Kevin Deldycke e2eca6f65e Expand user's home in batch file path. 9 years ago
Yen Chi Hsuan a0904c5d80
[telegraaf] Fix extractor (closes #9318) 9 years ago
Sergey M․ cb1fa58813
[flickr] Extract uploader URL (Closes #9426) 9 years ago
remitamine 3fd6332c05 [flickr] extract license field(closes #9425) 9 years ago
Sergey M 401d147893 Merge pull request #9400 from inondle/master
[liveleak] Adds support for thumbnails and updates tests
9 years ago
inondle e2ee97dcd5 [liveleak] Adds support for thumbnails, updates tests 9 years ago
Sergey M․ f745403b5b
[vevo] Revert videoplayer.vevo.com to api.vevo.com 9 years ago
Sergey M․ 3e80e6f40d
[vevo] Allow request to api.vevo.com to fail (Closes #9417)
I don't know whether this it's tempopary or api has just gone
9 years ago
Sergey M․ 25cb7a0eeb
[youtube] Allow empty attribute values in description regex 9 years ago
Sergey M․ abc97b5eda
[utils] Allow empty attribute values in get_element_by_attribute (Closes #9415) 9 years ago
remitamine 04e88ca2ca [vk] improve extraction(fixes #7976) 9 years ago
Peter Rowlands 8d93c21466 add multi_video test case 9 years ago
Peter Rowlands 1dbfd78754 fix multi_video part naming, add upload_date field 9 years ago
Peter Rowlands 22e35adefd use url instead of single formats entry 9 years ago
Yen Chi Hsuan 6f59aa934b
[periscope:user] Add new extractor for user pages
Closes #9388
9 years ago
Yen Chi Hsuan 109db8ea64 Merge pull request #9367 from codesparkle/master
Feature: --restrict-filenames: replace accented characters by their unaccented counterpart instead of "_"
9 years ago
Peter Rowlands 833b644fff use xpath_text 9 years ago
Sergey M․ 915620fd68
[redtube] PEP 8 9 years ago
Sergey M․ ac12e888f9
[redtube] Extract all formats, duration, upload date and view count (Closes #9397) 9 years ago
Yen Chi Hsuan 7d08f6073d
[kuwo:category] Update test 9 years ago
remitamine 758a059241 [dailymail] Add new extractor(closes #2667) 9 years ago
Yen Chi Hsuan 4f8c56eb4e
[fczenit] Fix extraction and update test
Closes #9359
9 years ago
Peter Rowlands 57cf9b7f06 [afreecatv] Add new extractor for afreecatv.com VODs 9 years ago
Sergey M․ 9da526aae7
[yandexmusic:playlist] Update test 9 years ago
Sergey M․ 75b81df3af
[udemy] Modernize 9 years ago
Sergey M․ aabdc83d6e
[udemy] Fix course enroll (Closes #9393) 9 years ago
Sergey M․ 2a48e6f01a
[yandexmusic:playlist] Respect track order for long (>150) playlists 9 years ago
Sergey M․ 203a3c0e6a
[yandexmusic:playlist] Make title optional 9 years ago
Sergey M․ d36724cca4
[yandexmusic:playlist] Remove unused imports 9 years ago
Sergey M․ 15fc0658f7
[yandexmusic:playlist] Modernize 9 years ago
Sergey M․ e960c3c223
[yandexmusic:playlist] Improve extraction (Closes #6801) 9 years ago
Sergey M․ bc7e77a04b
[vevo] Use raise_geo_restricted 9 years ago
Sergey M․ 964f49336f
[aol] Improve _VALID_URL (Closes #9381) 9 years ago
Sergey M․ 57d8e32a3e
[xfileshare] Add support for streamin.to 9 years ago
Sergey M․ 4174552391
[xfileshare] Refactor _VALID_URL and remove ded sites 9 years ago
Sergey M․ 80bc4106af
[xfileshare] Add support for thevideobee.to (Closes #9374) 9 years ago
Yen Chi Hsuan 7759be38da
[xiami] Detect georestriction and skip tests 9 years ago
Yen Chi Hsuan a0a309b973
[kuwo:category] Fix description and update test 9 years ago
Adam Thalhammer c587cbb793 improved performance by extracting accented chars to top level 9 years ago
Sergey M․ 8a92e51c60
[extractor/common] Relax wording for creator metafield 9 years ago
Sergey M․ f0e14fdd43
[YoutubeDL] Skip non-relevant field types when building output template 9 years ago
Sergey M․ df5f4e8888
[vevo] Remove superfluous code 9 years ago
Sergey M․ 7960b0563b
[YoutubeDL] Properly process unable-to-download-error on python2 9 years ago
Sergey M․ 5c9ced9504
[vevo] Improve genre extraction 9 years ago
Adam Thalhammer 79a2e94e79 Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347 9 years ago
Sergey M․ 686cc89634
[discovery] Fix typo 9 years ago
Sergey M․ 9508738f9a
[vevo] Extract featured artist 9 years ago
Sergey M․ 78a3ff33ab
[vevo:playlist] Add fallback for playlist id 9 years ago
Sergey M․ 881dbc86c4
[vevo] Extract track related metafields and add artists to title (Closes #1684) 9 years ago
Sergey M․ 8e7d004888
[vevo] Add test for video only available via webpage 9 years ago
Sergey M․ 9618c44824
[vevo] Extract video versions from webpage as a last resort (Closes #8426, closes #9366) 9 years ago
Sergey M․ 516ea41a7d
[vevo] Fix _call_api 9 years ago
Sergey M․ e2bd301ce7
[vevo:playlist] Fix genre playlists 9 years ago
Sergey M․ 0c9d288ba0
[vevo:playlist] Remove debug params 9 years ago
Sergey M․ e0da32df6e
[vevo:playlist] Add extractor (Closes #9334, closes #9364) 9 years ago
Philipp Hagemeister 174aba3223 release 2016.05.01 9 years ago
Sergey M․ 0d66bd0eab
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected 9 years ago
Sergey M․ 4bd143a3a0
[postprocessor/ffmpeg] Simplify metadata preparation and add track related metafields (Closes #9357) 9 years ago
Sergey M․ 68bb2fef95
[tagesschau] Restrict playlist entry regex 9 years ago
Sergey M․ 854cc54bc1
[tagesschau] Expand video id 9 years ago
Sergey M․ 651ad35ce0
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 6a0f9a24d0
[tagesschau] Separate player extractor 9 years ago
remitamine 9cf79e8f4b [ccc] improve extraction 9 years ago
Sergey M․ 2844b09336
[tagesschau] Fix article media ids 9 years ago
Sergey M․ 1a2b377cc2
[tagesschau] Fix audio support 9 years ago
Sergey M․ 4c1b2e5c0e
[tagesschau] Add support for playlists 9 years ago
Sergey M․ 9e1b96ae40
[rtlnl] Match formats only by height 9 years ago
Sergey M․ fc35cd9e0c
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 339fe7228a
[tagesschau] Update _FORMATS map 9 years ago
remitamine ea7e7fecbd [discovery] remove unused imports 9 years ago
remitamine d00b93d58c [discovery] extract more info using BrightcoveNewIE 9 years ago
remitamine 93f7a31bf3 [discovery] extract subtitle 9 years ago
remitamine 33a1ec950c [discovery] extract http formats 9 years ago
Sergey M․ 4e0c0c1508
[xiami] Improve extraction (Closes #9079)
* Switch to JSON source
* Add abstract IE for playlists
* Extract more track related metadata
9 years ago