Commit Graph

6163 Commits (472404953a22811cc8156da110ea872a924f1f18)

Author SHA1 Message Date
Sergey M․ 75f105d455 [adultswim] Clarify no media message
remitamine 00cde0b8dc [adultswim] raise ExtractorError if no clips in video_info
remitamine 58cd7e173e [adultswim] detect when video needs authentication
remitamine f4076bb736 [vimeo] extract m3u8 manifest and bitrate
Sergey M․ 6f7893653c [bbc] PEP 8
Sergey M․ 55ebae26f9 [bbc] Prefer iptv-all mediaset
Sergey M․ ae8bdfd1a1 [bbc] Extract article JSON and actualize tests
Sergey M․ 6a74719060 [bbc] Update tests
Sergey M․ f6295bcb04 [bbc] Remove duration
Sergey M․ 78f9d84318 [bbc] Support playlists of data-playable
Sergey M․ b1ec70e4a9 [bbc] Improve data-playable regex
Sergey M․ c936d8cc7b [bbc] Add another test
Sergey M․ e6174ee975 [bbc] Extract legacy playlist embedded media
Sergey M․ f790c43f6e [zingmp3:album] Skip broken items
Sergey M․ 8119597d6f [zingmp3] Add fatal flag
Sergey M․ 43abd79950 [zingmp3:album] Style
Phạm Ngọc Quang Nam 97ae4d166c [zingmp3:album] Add support for playlists
Update for work with playlist, it same album but different url
Ex:
http://mp3.zing.vn/playlist/Duong-Hong-Loan-apollobee/IWCAACCB.html
http://mp3.zing.vn/album/Duong-Hong-Loan-apollobee/IWCAACCB.html
Sergey M․ 87cc0fbd18 [bbc] Make summary optional in legacy playlist
Sergey M․ baf39a1aa8 [bbc] Add one more scenario for data-playable embeds
Sergey M․ 975977860d [bbc] Make playlist title optional
Sergey M․ b5d48cb1ef [bbc] Add test for atricle with multiple videos embedded with playlist.sxml
Sergey M․ de66571371 [bbc] Support multiple videos in articles embedded with playlist.sxml
Sergey M․ dab062fb6e [bbc] Add support for videos in news articles embedded with data-playable
Yen Chi Hsuan 6a959f2e52 [iqiyi] Update enc_key
Sergey M․ 47c165c3a9 [vimeo] Fix authentication (Closes )
Sergey M․ 4180a3d8b7 [extractor/common] Allow quoteless content attribute in og regexes (Closes )
Yen Chi Hsuan 57935b2564 [extractor/common] Allow HTML5 unquoted attribute values
Fixes 

HTML5 allows unquoted attribute values. See the "Unquoted attribute value
syntax" section [1] for more information

[1] http://www.w3.org/TR/html5/syntax.html
Sergey M․ 54a5428518 [dailymotion] Update player v5 regex (Closes )
Sergey M․ 9d5fb3b58d [pbs] Carry long line
remitamine 0553d0ee40 [pbs] place errors into a dict
remitamine 7faf7e7523 [pbs] detect errors from http error code
Sergey M․ 4356d907c1 [4tube] Try extracting sources from the webpage before fetching player.js (Closes )
Sergey M․ c677e49bd1 [4tube] Revert uploader regexes and make non fatal
Sergey M․ 96c4855331 [4tube] Style and make more robust
kitty b90b0c4ffa Fixed 4tube.com extractor to pull metadata from associated Javascript and not the HTML of the desired page.
AndroKev db7a28eccb FIX: nowtv
now the download works for me
thx to http://board.gulli.com/thread/1251646-videos-von-webseiten-runterladen-sammelthread-alle-fragen-hier-rein-/?p=14980081#post14980081
Sergey M․ fc10824cb6 [canalplus] PEP 8
Sergey M․ 83a5668694 [canalplus] Extend video id regex (Closes )
Sergey M․ f648e682a7 [bandcamp] Prepend download URL with scheme when necessary (Closes )
Sergey M․ 40fbb05e1c [ustream] Fix tests
Sergey M․ dc5756fd77 [ustream] Fix typo
Sergey M․ 41db733308 [ustream] Move filesize
Sergey M․ 0bf219889e [ustream] Remove unused import
Sergey M․ f2a7ed77ef [tumblr] Remove redundant field
Sergey M․ 4853eb63fe [ustream] Modernize
Sergey M․ 5820c4a29e [ustream] Switch extraction to api
David Rabinowitz 7fd4ed9939 Fixed the ustream extractor to use the current ustream API
Sergey M․ 88c86d211b [tumblr] Add missing fields for vidme test
Sergey M․ 5d84b79a30 [tumblr] Remove redundant test
Sergey M․ 140ac73965 [tumblr] Simplify and extract duration
Oli Allen 2a27e66234 [tumblr] Added support for HD video where available ()
[tumblr] Replaced test URL for HD video as old one lead to 404

[tumblr] Don't make assumptions about video resolution, cleaner handling of no HD version available

[tumblr] Removed extraneous resolution key in HD video tests
Sergey M․ e759a00119 [appletrailers] Quotes consistency
Sergey M. 9d5332518c Merge pull request from remitamine/appledaily
[nextmedia] update AppleDailyIE tests
Sergey M․ 90ab741e90 [pbs] Add test for
Sergey M․ 96229998c2 [pbs] Allow empty attribute in player regex
Sergey M․ 0659dfccfe [pbs] Improve player regex (Closes )
Sergey M․ 9c544e2537 [limelight] Add test video with subtitles
Sergey M․ d7fc56318b [limelight] Fix python 2.6, simplify, make more robust (Closes )
Sergey M․ 4bba371644 [YoutubeDL] Autocalculate ext for subtitles when missing
remitamine ef5acfe32d [limelight] Add new extractor
Sergey M. 85557f635a Merge pull request from remitamine/engadget
[engadget] accept short video urls
Naglis Jonaitis 60d23e5e59 [tapely] Improve _VALID_URL
remitamine 97d5bfcba6 [engadget] accept short video urls
Jaime Marquínez Ferrándiz b203095d4c [europa] Style fix: add whitespace after comma
Sergey M․ f3b098fb90 [europa] Add support for audio URLs
Sergey M․ af17794c65 [europa] Improve extraction
ngld 3bb3f04108 [europa] Add new extractor
Sergey M․ 59a9efe85b [ruutu] Limit resolution split to 2 pieces (Closes , closes )
fluks 0facd2af3e Fix ruutu extractor bug
If there's no resolution attribute in xml, only width gets a
value, height doesn't and ValueError is raised.
Jaime Marquínez Ferrándiz 44451f22d5 [naver] Remove unused import
Sergey M․ 06c6efa970 [videolecturesnet] Add test video with broken direct format links
Sergey M․ e5851b963a [extractor/common] Make f4m extraction for SMIL non fatal
Sergey M․ 4de6131090 [extractor/common] Add fatal to _extract_f4m_formats
Sergey M․ 3a1341a7bc [extractor/common] Make m3u8 extraction for SMIL non fatal
Sergey M․ c78e48177c [extractor/common] Check validity of direct URLs
Sergey M․ 6edaa0e25b [videolecturesnet] Add playlist test
Sergey M․ fb97809e64 [videolecturesnet] Improve playlist extraction
Sergey M․ 0c996b9f48 [videolecturesnet] Add support for playlists (Closes )
Sergey M․ acfb717a18 [videolecturesnet] Use generic SMIL extraction
Sergey M․ 647eab4541 [extractor/common] Extract upload date from SMIL
Sergey M․ 1e5bcdec02 [extractor/common] Extract images from SMIL
Sergey M․ e7d8e98a9f [extractor/common] Allow float bitrates
Sergey M․ 2b3f951a2e [nrktv] Rework subtitles and eliminate downloading twice
Joakim Fremstad b83831df1f [nrk] Spelling
Sergey M․ f540b93706 [naver] Improve error regex
Sergey M․ 8466336104 [vk] Detect vimeo embeds (Closes )
Sergey M․ ee2d190253 [nfl] Add test for
remitamine aedb930cfc [nfl] fix content id regex(fixes )
Philipp Hagemeister c596ce91cd [comedycentral] Fix youtube-dl :thedailyshow
We'll let the generic IE follow the redirect and call back to us with the episode URL
Sergey M․ 8a64969404 [adultswim] Prefer stream (Closes )
Sergey M․ 86692c019c [keek] Strip title
Sergey M․ 1ab1c4ef57 [keek] Improve uploader fields regexes
Sergey M․ 926fb62eec [keek] Remove description
Since it equals title plus static suffix
Sergey M․ 817690ff73 [keek] Make uploader fields non fatal
remitamine 98e1c935a1 [keek] extract uploader and uploader id with _search_regex
remitamine f30e9976d6 [keek] add utf-8 coding cookie
remitamine 80e98aed69 [keek] fix test title
remitamine 6a24cb3d22 [keek] extract more info
remitamine e13b9e7885 [keek] fix info extraction
Sergey M․ dd467d33d0 [extractor/generic] Add support for condenast script embeds (Closes , closes )
Sergey M․ c6b8f4d0c9 [condenast] Add support for JS embeds
Sergey M․ 2f962d0a91 [eagleplatform] Use http scheme for thumbnail
Sergey M․ 3c63e1bb57 [eagleplatform] Make _handle_error staticmethod
Sergey M․ c471b34575 [eagleplatform] Simplify secure mp4 construction and clarify rationale
remitamine d045f0bdb7 [eagleplatform] use http urls explicitly
remitamine 22becac4bd [eagleplatform] return the code to handle errors in all _download_json requests
remitamine 9d632b1b27 [eagleplatform] extract mp4 url and fix thumbnail url
Sergey M․ 95c5e10103 [qqmusic] Allow [mm:ss] timestamps
Sergey M․ a5d09d684e [qqmusic] Use release_date
Sergey M․ 8aab976bbd [extractor/common] Document release_date field
Sergey M․ cd1bb54990 [qqmusic] Add test for a song with non .lrc lyrics
Sergey M․ d4cd06138c [qqmusic] Do not capture braced text from the middle of the string
Sergey M․ 961c5cbf17 [qqmusic] Eliminate _filter_lrc and use single quotes
Qijiang Fan b65e5bb72f [qqmusic] Add subtitles for QQMusic
Use .lrc lyrics as subtitles if lyrics in lrc format exist.
Sergey M․ 54914380c0 [bbc] Add test for programme that fails with iptv-all mediaset
Sergey M․ 26ccc68bed [bbc] Clarify iptv-all mediaset rationale
Sergey M․ ee3d5a6d47 [bbc] Skip mediaselection on gelocation error (Closes )
Sergey M․ 46fde8a1a2 [extractor/generic] Use _extract_url for mtvservices
Sergey M․ fe1d858e35 [mtvservices:embedded] Add _extract_url
Sergey M․ fc42bc6ec9 [mtv] Look for sm4:video:embed (Closes , closes )
Yen Chi Hsuan fe6ad195ae Merge pull request from remitamine/kuwo
[kuwo] fix title extraction and update test
remitamine 7193650641 [kuwo] treat the offline error as an expected ExtractorError
remitamine 5db34f680f [kuwo] check for the offline error page
remitamine 3706fb5dc8 [fktv] get format_id from video file ext
Jaime Marquínez Ferrándiz 4866b72eb2 [fktv] Don't redefine 'url' in list comprehension
Detected with flake8.
remitamine 3d09aa4c82 [kuwo] extract title inside element with class title exactly
remitamine c44c7895b8 [kuwo] fix title extraction and update test
Yen Chi Hsuan 8de28761c4 [fktv] Fix a regex
Yen Chi Hsuan 711762f0b7 [fktv] Coding style
Yen Chi Hsuan 5773803961 [fktv] Correct thumbnail extraction and add the test
Yen Chi Hsuan 140359fc2c [fktv] Correct and improve some regexs
Yen Chi Hsuan 8ddf48d59f [fktv] Raise an error is no videos found
Yen Chi Hsuan 2e40a12225 [fktv] Correct spellings
Yen Chi Hsuan dade7245af Merge branch 'fktv' of https://github.com/remitamine/youtube-dl into remitamine-fktv
remitamine 1f9fb20fcd [nextmedia] update AppleDailyIE tests
Sergey M․ 0940c5b4c6 [condenast] Do not capture unused group in _VALID_URL
Sergey M․ 42ca72dff3 [condenast] Keep acute accent
remitamine 2949a6cda9 [condenast] fix video info regex
remitamine 882fc9052e [condenast] fix extraction and add support for other sites
Sergey M․ 9b166fc1f8 [iconosquare] Extract comments
Sergey M․ d4364f30bd [iconosquare] Revert title (Closes )
remitamine 857421024d [iconosquare] fix info extraction
atomic83 545a23f11b More title extraction fixing.
remitamine 47024eb564 [hostingbulk] remove extractor
Sergey M․ 9c58885c70 [nhl:news] Add support for iframe embeds (Closes )
Sergey M․ 9fbd4b35a2 [nhl] Add support for embedded URLs
Sergey M․ 05b476a270 [vidme] Prefer non clip (Closes )
Sergey M․ 4395ca2e04 [xhamster] Fix title extraction (Closes )
Yen Chi Hsuan 19f93d906e [iqiyi] Use md5_text for all MD5 calls
Yen Chi Hsuan 57565375c8 [iqiyi] Fix extraction (fixes )
Sergey M․ eb11cbe867 [soundcloud] Update client id (Closes )
Sergey M․ 78f9fb902b [9gag] Support embed URLs
Sergey M․ d8fef8faac [9gag] Quotes consistency
Sergey M․ 8ea6bd2802 [9gag] Add vimeo test
Sergey M․ c659022b5c [9gag] Modernize
Sergey M․ 8ca2e93e1a [9gag] Relax optional fields
Sergey M․ 5600e214c3 [9gag] Make post view regex more robust
Sergey M․ 6400f8ec0f [9gag] Allow old .tv domain
There are still references to it in webpage's source
Sergey M․ c3a4e2ec40 [9gag] Remove redundant test
Sergey M․ e28c794699 [9gag] Make display_id optional
remitamine da9f180835 [ninegag] remove unnecessary condition
remitamine 6b8ce312e3 [ninegag] extract source url
remitamine de3fc356e1 [ninegag] fix _VALID_URL regex and handle the use of other external providers
Sergey M․ d0fed4ac02 [viewster] Use tuple
Sergey M․ 7ce50a355c [viewster] Add geo restricted tests
Sergey M․ 9612f23399 [viewster] Detect video geo restriction
Sergey M․ cccedc1aa4 [voewster] Detect series geo restriction
Sergey M․ c430802e32 [extractor/common] Add raise_geo_restricted
Sergey M․ cb4e421901 [voewster] Update tests
Sergey M․ 8e97596b7b [viewster] Extract height from bitrate and prefer mp4 videos
remitamine 92085e7099 [viewster] accept https links and fix api_token extraction and extract mp4 video link(fixes )
Sergey M․ c6aa838b51 [youtube:history] Enable exractor
Sergey M․ 9f5e8d16b3 [youtube:history] Disable exractor
Sergey M․ 82c06a40ac Fix typo
Sergey M․ 4423eba49b [nfl] Add support for URLs without id (Closes )
Sergey M․ 5b4c54631a [nfl] Add team domains ()
Jaime Marquínez Ferrándiz f005f96ea5 [youtube:history] Explain why it has disabled and skip test
Sergey M․ 5e39123b3b [arte:+7] Fix typo
Sergey M․ 393ca8c94d [arte:+7] Look for json vp url in iframe (Closes )
Sergey M․ f817adc468 [youtube:history] Disable extractor until is investigated
Wiped out part of my history as well
Sergey M․ 6c91a5a7f5 [extractor/generic] Fix following redirect in Refresh HTTP header on python 2
remitamine 5de5ab89b4 [shahid] change test ext
remitamine 1d67c96640 [shahid] fix api request url
Sergey M․ d1c694ea4a [bbc] Switch extraction to hq iptv hls (Closes , closes , closes , closes , closes )
Sergey M․ 06368a232a [playwire] Fix test
Sergey M․ 131d05033b [ok] Skip test
Sergey M․ 1806a75415 [ok] Capture error message
Sergey M․ 659ffe204c [divxstage] Remove extractor
DivxStage is offline for quite some time already
Sergey M․ 4647fd8910 [telecinco] Fix typo
Sergey M․ d492dad8f4 [telecinco] Add support for mediaset.es
Sergey M․ 3368d70dce [mitele] Clarify IE_DESC
Sergey M․ 0e1b2566ff [telecinco] Clarify IE_DESC
Sergey M․ 369e60162e [telecinco] Update test
Sergey M․ d5e7657fe2 [telecinco] Add support or cuatro.com
Sergey M․ f84ce1ebaf [mitele] Fix extraction (Closes )
Sergey M․ 12bc242944 [telecinco] Incorporate mitele code
Sergey M․ 88060cce10 [rai] Add support for videos embedded with drawMediaRaiTV (Closes )
Sergey M․ 272e4db5c7 [pornhub] Relax _VALID_URL (Closes )
Philipp Hagemeister 2b3c254678 [youtube:channel] Correct 404 handling
Previously, when we encountered a 404 - such as youtube-dl https://www.youtube.com/ohJeiboh8oorehai - we crashed with a regexp error. Instead, make sure to go on and eventually report a 404.
Philipp Hagemeister 287be8c615 [youtube:truncated_url] Add ?t=
Sometimes found in links - ?t=123&v=ABCD starts the video at position 123.
Sergey M․ e2ff3df314 [clubic] Relax _VALID_URL (Closes )
Sergey M․ c246773599 [nowness] Add vimeo test
Sergey M․ 82c18e2a53 [nowness] Simplify
Sergey M․ d5d38d16ae Merge branch 'nowness' of https://github.com/remitamine/youtube-dl into remitamine-nowness
Sergey M․ 2ffe3bc14b [ndr] Rework and cover with tests
Sergey M․ d5867276a9 Merge branch 'master' of github.com:rg3/youtube-dl into remitamine-ndr
Yen Chi Hsuan f665ef8fc5 Merge remote-tracking branch 'upstream/master'
Yen Chi Hsuan b264c21302 [tudou] Use single quotes and compat_str
Yen Chi Hsuan 349b3a2ea0 [tudou] Improve regexs
Yen Chi Hsuan 87813a8570 [tudou] Use _download_xml
Yen Chi Hsuan aab135516b [tudou] Avoid shadowing builtin names
Yen Chi Hsuan 141ba36996 [tudou] Modernize
Yen Chi Hsuan 94e507aea7 [tudou] A more comprehensive _VALID_URL
Sergey M․ 3ebc121293 Merge branch 'ndr' of https://github.com/remitamine/youtube-dl into remitamine-ndr
Yen Chi Hsuan 41ebd6530b [tudou] Add the test case ()
Yen Chi Hsuan 2ec7b7b79b Merge branch 'master' of https://github.com/linhua55/youtube-dl into linhua55-master
Sergey M․ 60ed60353b [openfilm] Remove extractor
OpenFilm has been shut down
Sergey M․ 586f1cc532 [extractor/common] Skip html comment tags (Closes )
Sergey M․ 73eb13dfc7 [extractor/common] Case insensitive inputs extraction
Sergey M․ 1721fef28b [yahoo] Fix test
Sergey M․ 364ca0582e [yahoo] Process query result embedded in webpage
Sergey M․ cc1ac11017 [vier:videos] Fix extraction with old approach (Closes )
Sergey M․ 482aa3fecc [vidme] Simplify, make more robust, extract more metadata and capture errors (Closes )
Lukáš Lalinský d9c19db340 Extract all vid.me formats
Sergey M. 6c4d243de5 Merge pull request from remitamine/xuite-tests
[xuite] fix test md5
remitamine 7b4137c351 [fktv] fix info extraction
remitamine 1072336249 [washingtonpost] fix test info
remitamine 75bb5c7028 [xuite] fix test md5
remitamine 376e1ad081 [ndr] use utils.qualites
remitamine b58a22b963 [ndr] make NDREmbed and NJoyEmbed _VALID_URL regex unique
Sergey M․ 47004d9579 [crunchyroll] Fix uploader and upload date extraction
Sergey M․ 12810c9cd3 [crunchyroll] Force Accept-Language to any for all requests (Closes )
Sergey M․ 7a459170fa [__init__] Remove musicvault
Sergey M. 3cf0df568a Merge pull request from remitamine/musicvault
[musicvault] remove extractor
remitamine b88ebd472e [musicvault] remove extractor
remitamine 64997815c4 [ndr] add support for embeds
remitamine b1b7d1ffba [wimp] fix tests info
Jaime Marquínez Ferrándiz 4003bd82b0 [youtube:shows] Use https
remitamine 8801255d7d [youtube] fix show extraction (fixes )
Closes )
remitamine 3b18f539a7 [ndr] fix info extraction
Yen Chi Hsuan bc973e06d0 Merge pull request from remitamine/yahoo-tests
[yahoo] change test md5 checksum
remitamine cf33a47df0 [ajazzera] skip test
remitamine daeb0f04cd [yahoo] change test md5 checksum
Sergey M․ 97243fe395 [ceskatelevize] Extract playlists (Closes )
Sergey M․ 9dbdb65abe [techtvmit] Update test
Sergey M․ 9af461de35 [techtvmit] Fix extraction
Sergey M. 4d71e200c6 Merge pull request from remitamine/academicearth
[academicearth] fix test info
Sergey M. 8e0bdabed2 Merge pull request from remitamine/airmozilla
[airmozilla] fix test info
Sergey M․ bca553caac [eagleplatform] Fix extraction
remitamine a2f42a3baf [academicearth] fix test info