Commit Graph

10754 Commits (33b72ce64e8705a71f8ab0e6a322e5f9f3b99276)

Author SHA1 Message Date
Sergey M․ c917106be4
[loc] Extract subtites 9 years ago
Sergey M․ 76e9cd7f24
[loc] Add support for another URL schema and simplify 9 years ago
Sergey M․ bf4c6a38e1 release 2016.06.03 9 years ago
Sergey M․ 7f3c3dfa52
[loc] Improve (Closes #9521) 9 years ago
TRox1972 9c3c447eb3
[loc] Add extractor (Closes #3188)
Added extractor of loc.gov, which closes #3188. I am not an experienced programmer, so I am sure I did a bunch of mistakes, but the extractor works (for me at least).

[LibraryOfCongress] don't use video_id for _search_regex()

[LibraryOfCongress] Improvements
9 years ago
Yen Chi Hsuan ad73083ff0
[bilibili] Add _part%d suffixes back (closes #9660) 9 years ago
bzc6p c88270271e Added sanitization support for Hungarian letters Ő and Ű 9 years ago
Yen Chi Hsuan 9a4aec8b7e [utils] Use bytes-like objects as header values on Python 2 9 years ago
Yen Chi Hsuan 0ea590076f [utils] Always decode Location header
escape_url is broken for bytes-like objects
9 years ago
Remita Amine 4a684895c0 [seeker] Add new extractor(closes #9619) 9 years ago
Remita Amine f4e4aa9b6b [revision3:embed] Add new extractor 9 years ago
Sergey M․ 5e3856a2c5 release 2016.06.02 9 years ago
Sergey M․ 6e6b9f600f
[arte] Add support for playlists and rework tests (Closes #9632) 9 years ago
Sergey M․ 6a1df4fb5f
[spankwire] Add support for new URL format (Closes #9657) 9 years ago
Yen Chi Hsuan dde1ce7c06
[tf1] Fix a regular expression (closes #9656)
This is a Python bug fixed in 2.7.6 [1]

[1] https://github.com/rg3/youtube-dl/issues/9656#issuecomment-222968594
9 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 9 years ago
Yen Chi Hsuan 0ff3749bfe
[udn] Fix m3u8 and f4m extraction as well as improve 9 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 9 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
9 years ago
Peter Rowlands e7d85c4ef7 use /track/video/file to determine if video exists 9 years ago
Sergey M․ 8ec2b2c41c
[options] Add --limit-rate alias for rate limiting option
Closes #9644
In order to follow regular --verb-noun pattern and better conformity with wget and curl
9 years ago
Sergey M․ 197a5da1d0
[yandexmusic] Improve captcha detection 9 years ago
Sergey M․ abbb2938fa release 2016.05.30.2 9 years ago
Sergey M․ f657b1a5f2 release 2016.05.30.1 9 years ago
Sergey M․ 8267423652 release 2016.05.30 9 years ago
Yen Chi Hsuan 9ed6d8c6c5
[youku] Extract resolution 9 years ago
Yen Chi Hsuan 6461f2b7ec
[bilibili] Fix extraction, improve and cleanup 9 years ago
Sergey M․ 807cf7b07f
[udemy] Fix authentication for localized layout (Closes #9594) 9 years ago
Sergey M․ de7d76af52
[coub] Add another test 9 years ago
Sergey M․ 11c70deba7
[coub] Add extractor (Closes #9609) 9 years ago
Sergey M․ f36532404d
[vk] Remove superfluous code 9 years ago
Sergey M․ 77b8b4e696
[extractor/common] Borrow quality metadata from parent set-level manifest for f4m 9 years ago
Sergey M․ 2615fa7584
[downloader/f4m] Simply select format when it's the only one 9 years ago
Boris Wachtmeister 3a686853e1 [WDR] fixed parsing of playlists 9 years ago
Boris Wachtmeister 949fc42e00 [WDR] the other wdrmaus.de pages also changed to the new player 9 years ago
Boris Wachtmeister 33a1ff7113 [WDR] extract jsonp-url by parsing data-extension of mediaLink 9 years ago
Boris Wachtmeister bec2c14f2c [WDR] add special handling if alt-url is a m3u8 9 years ago
Boris Wachtmeister 37f972954d [WDR] use _download_json with a strip_jsonp 9 years ago
Boris Wachtmeister 3874e6ea66 [WDR] use single quotes for strings 9 years ago
Yen Chi Hsuan fac2af3c51
[common] Fix m3u8 extraction in f4m manifests 9 years ago
Sergey M․ 6f8cb24219
[tvp] Expand _VALID_URL and improve naming (Closes #9602) 9 years ago
Yen Chi Hsuan 448bb5f333
[common] Fix non-bootstrapped support in f4m 9 years ago
Yen Chi Hsuan 293c255688
[utils] Remove debugging codes 9 years ago
Yen Chi Hsuan ac88d2316e
[dw] Support documentaries (closes #9475) 9 years ago
Yen Chi Hsuan 5950cb1d6d
[utils] Support a new form of date
Found in dw.com (#9475)
9 years ago
Yen Chi Hsuan 761052db92
[playwire] Add the test (closed #9531) 9 years ago
Yen Chi Hsuan 240b60453e
[common] Support m3u8 in f4m manifests
Related: #9531
9 years ago
Yen Chi Hsuan 85b0fe7d64
[playwire] Use _extract_f4m_formats
Related: #9531
9 years ago
Yen Chi Hsuan 0a5685b26f
[common] Support non-bootstraped streams in f4m manifests
Related: #9531
9 years ago
Sergey M․ 6f748df43f
[eporner] Make test only_matching 9 years ago
Yen Chi Hsuan b410cb83d4 Merge pull request #9595 from Kagami/vlive-site-update
[vlive] Address site update
9 years ago
Yen Chi Hsuan da9d82840a Merge pull request #9600 from wankerer/master
[eporner] fix for the new URL layout
9 years ago
wankerer 4ee0b8afdb [eporner] fix for the new URL layout
Recently eporner slightly changed the URL layout, the ID that used to be
digits only are now digits and letters, so youtube-dl falls back to
the generic extractor that doesn't work.

Fix the matching regex to allow letters in ID.

[v2: added a test case]
9 years ago
remitamine 1de32771e1 [eyedotv] Add new extractor(closes #9582) 9 years ago
remitamine 688c634b7d skip some tests to reduce test time 9 years ago
Sergey M․ 6b43132ce9
[xhamster] Update tests 9 years ago
mexican porn commits a4690b3244
[xhamster] url regex fix for videos with empty title. 9 years ago
remitamine 444417edb5 [radiocanada] Add new extractor(#4020) 9 years ago
remitamine 277c7465f5 [ooyala] check manifest ext with determine_ext and update tests for related extractors 9 years ago
Kagami Hiiragi 25bcd3550e [vlive] Address site update
Changes:
* Fix video params extraction
* Don't make status request since status info now available on the page
* Remove unneeded code
* Fix test
9 years ago
remitamine a4760d204f [ooyala] use api v2 to reduce requests for format extraction 9 years ago
remitamine e8593f346a [ooyala] extract subtitles 9 years ago
remitamine 05b651e3a5 [washingtonpost] reduce requests for m3u8 manifests 9 years ago
remitamine 42a7439717 [cbs] allow to pass content id to the extractor(closes #9589) 9 years ago
remitamine b1e9ebd080 [washingtonpost] remove unnecessary code 9 years ago
remitamine 0c50eeb987 [reuters] Add new extractor 9 years ago
remitamine 4b464a6a78 [washingtonpost] improve format extraction and add support for video pages extraction 9 years ago
Sergey M․ 5db9df622f
[life:embed] Use native hls 9 years ago
Sergey M․ 5181759c0d
[life] Update _VALID_URL 9 years ago
Sergey M․ e54373204a
[lifenews] Fix metadata extraction 9 years ago
remitamine 102810ef04 [voxmedia] fix volume embed extraction 9 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 9 years ago
Yen Chi Hsuan 7a46542f97
[livestream] Video IDs should always be strings (#2234) 9 years ago
Yen Chi Hsuan eb7941e3e6
[compat] Fix for XML with <!DOCTYPE> in Python 2.7 and 3.2
Such XML documents cause DeprecationWarning if python is run
with `-W error`
9 years ago
remitamine db3b8b2103 [tf1] add support for more related web sites 9 years ago
remitamine c5f5155100 [wat] extract all formats 9 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 9 years ago
Thor77 70346165fe [bandcamp] raise ExtractorError when track not streamable (#9465)
* [bandcamp] raise ExtractorError when track not streamable

* [bandcamp] update md5 for second test

* don't rely on json-data, but just check for 'file'

* don't rely on presence of 'file'
9 years ago
Sergey M․ e9297256d4
[update] Fix youtube-dl.exe updating from arbitrary directory (Closes #2718) 9 years ago
Sergey M․ c6b9cf05e1
[utils] Do not fail on unknown date formats in unified_strdate 9 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 9 years ago
Sergey M․ 898f4b49cc
[theplatform] Add _extract_urls 9 years ago
Sergey M․ 0150a00f33
[cc] Add test for tosh.cc (Closes #9566) 9 years ago
TRox1972 c8831015f4
[ComedyCentral] Add support for tosh.cc.com and cc.com/video-clips 9 years ago
Sergey M․ 92d221ad48
[periscope] Update uploader_id (Closes #9565) 9 years ago
Sergey M․ 0db9a05f88
[periscope:user] Adapt to layout changes (Closes #9563) 9 years ago
Philipp Hagemeister e03b35b8f9 release 2016.05.21.2 9 years ago
Philipp Hagemeister 598869afb1 release 2016.05.21.1 9 years ago
Philipp Hagemeister c8cc3745fb release 2016.05.21 9 years ago
Jaime Marquínez Ferrándiz 4c718d3c50 [rtve] Recognize 'filmoteca' URLs 9 years ago
Yen Chi Hsuan 115c65793a
[jwplatform] Don't fail with RTMP URLs without mp4:, mp3: or flv: 9 years ago
Yen Chi Hsuan 661d46b28f
[cbslocal] Add new extractor (closes #9522) 9 years ago
Yen Chi Hsuan 5ce3d5bd1b
[sendtonews] Add new extractor
Used in CBSLocal. Part of #9522
9 years ago
Yen Chi Hsuan 612b5f403e
[jwplatform] Improved m3u8 and rtmp support
Changes made for SendtoNewsIE. Part of #9522
9 years ago
Yen Chi Hsuan 9f54e692d2
[anvato] Add new extractor
Used in CBSLocal (#9522)
9 years ago
Yen Chi Hsuan 7b2fcbfd4e
[common] Skip TYPE=CLOSED-CAPTIONS lines in m3u8 manifests
According to [1], valid values for TYPE are AUDIO, VIDEO, SUBTITLES
and CLOSED-CAPTIONS. Such a value is found in Anvato master playlists,
though I don't use _extract_m3u8_formats() in the end.

Part of #9522.

[1] https://tools.ietf.org/html/draft-pantos-http-live-streaming-19#section-4.3.4.1
9 years ago
Yen Chi Hsuan 16da9bbc29
[common] Add _m3u8_meta_format() template
For extractors who handle m3u8 manifests by themselves. (eg., AnvatoIE)

Part of #9522
9 years ago
Sergey M․ c8602b2f9b
[nrk] Unquote subtitles' URLs 9 years ago
Sergey M․ b219f5e51b
[brightcove:new] Improve error reporting 9 years ago
Sergey M․ 1846e9ade0
[localnews8] Fix extractor (Closes #9539) 9 years ago
TRox1972 6756602be6
[LocalNews8] add extractor (Closes #9200) 9 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 9 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 9 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 9 years ago
remitamine 64413f7563 [cbc] fix extraction for flv only videos(fixes #5309) 9 years ago
Sergey M․ 45f160a43c
[wistia] Improve hls support 9 years ago
Sergey M․ 36ca2c55db
[wistia] Skip storyboard and improve extraction 9 years ago
Sergey M․ f0c96af9cb
[wistia] Add alias and modernize 9 years ago
Yen Chi Hsuan 31a70191e7
[cbc] Add the test case from #5156 9 years ago
Yen Chi Hsuan ad96b4c8f5
[common] Extract audio formats in SMIL
Found in http://www.cbc.ca/player/play/2657631896

Closes #5156
9 years ago
Yen Chi Hsuan 043dc9d36f
[cbc] Fix for old-styled URLs
The URL http://www.cbc.ca/player/News/ID/2672225049/ (#6342) redirects
to http://www.cbc.ca/player/play/2672224672, while youtube-dl wasn't
able to handle it correctly.
9 years ago
remitamine 52f7c75cff [cbc] extract http formats and update tests 9 years ago
Sergey M․ f6e588afc0
[24video] Fix description extraction 9 years ago
remitamine a001296703 [learnr] Add new extractor(closes #4284) 9 years ago
Sergey M․ dd81769c62
[ndtv] Fix extraction 9 years ago
Sergey M․ 46bc9b7d7c
[utils] Allow None in remove_{start,end} 9 years ago
remitamine b78531a36a [formula1] Add new extractor(closes #3617) 9 years ago
Sergey M․ 11e6a0b641
[nfb] Modernize and extract subtitles 9 years ago
Sergey M․ 15cda1ef77
[nfb] Fix uploader extraction 9 years ago
Yen Chi Hsuan 055f0d3d06
[abcnews] Added a new extractor (closes #3992)
Related: #6108, #8664, #9459
9 years ago
Yen Chi Hsuan cdd94c2eae
[utils] Check for None values in SOCKS proxy
Originally reported at
https://github.com/rg3/youtube-dl/pull/9287#issuecomment-219617864
9 years ago
Philipp Hagemeister 36755d9d69 release 2016.05.16 9 years ago
Sergey M․ f7199423e5
[groupon] Add support for Youtube embeds (Closes #9508) 9 years ago
Sergey M․ a0a81918f1
[collegehumor] Remove extractor
It now uses brightcove
9 years ago
Yen Chi Hsuan 5572d598a5
[hearthisat] Update the first test 9 years ago
Yen Chi Hsuan cec9727c7f
[hearthisat] Detect invalid download links (fixes #9440) 9 years ago
Yen Chi Hsuan 79298173c5
[utils] Fix getheader in urlhandle_detect_ext
Fixes #7049, related to #9440
9 years ago
Sergey M․ 69c9cc2716
[xvideos] Extract html5 player formats (Closes #9495) 9 years ago
Sergey M․ ed56f26039
[extractor/common] Improve name extraction for m3u8 formats 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ cda6d47aad
[utils] Simplify integer conversion in js_to_json 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
Sergey M․ 5c86bfe70f
[3qsdn] Add extractor 9 years ago
Sergey M․ ca950f49e9
[ora] Revert extraction to regexes
It's less fragile than using js_to_json with ora js
9 years ago
Sergey M․ 89ac4a19e6
[utils] Process non-base 10 integers in js_to_json 9 years ago
felix 640eea0a0c
[ora] minimise fragile regex shenanigans; recognise unsafespeech.com URLs 9 years ago
felix bd1e484448
[utils] js_to_json: various improvements
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
9 years ago
Yen Chi Hsuan a834622b89 Merge pull request #9492 from jwilk/teamcoco
[teamcoco] Fix base64 regexp
9 years ago
Jakub Wilk 66e7ace17a Don't hardcode errno constant
The value of ENOENT is architecture-dependent, so don't assume it's
always 2.
9 years ago
Jakub Wilk 791ff52f75 [teamcoco] Fix base64 regexp 9 years ago
Sergey M․ b5abf86148
[cinemassacre] Remove extractor (Closes #9457)
It now uses jwplatform
9 years ago
Sergey M․ 134c6ea856
[YoutubeDL] Sanitize url for url and url_transparent extraction results 9 years ago
remitamine 0730be9022 [sina] fix extraction(fixes #1146) 9 years ago
Sergey M․ 96c2e3e909
[imdb] Improve extraction 9 years ago
Sergey M․ f196508f7b
[imdb] Relax _VALID_URL (Closes #9481) 9 years ago
Yen Chi Hsuan cc1028aa6d
[openload] Fix extraction (closes #9472) 9 years ago
remitamine ad55e10165 [brightcove] change the protocol for m3u8 formats to m3u8_native 9 years ago
remitamine 18cf6381f6 [nrk] extract m3u8 formats 9 years ago
remitamine cdf32ff15d [extractors] add import for UstudioEmbedIE 9 years ago
remitamine 99d79b8692 [ustudio] add support ustudio app/embed urls 9 years ago