Commit Graph

6728 Commits (8f7c4f7d2ec712e890519aa7133b0d6dc5ee778b)

Author SHA1 Message Date
remitamine 77302fe5c9 [bliptv] remove extractor and add support for site replacement(makertv)
remitamine 497ca088a6 [ooyala] remove print statment
remitamine 90bddb6cdd [ooyala] extract more formats and metadata
Sergey M․ fafc7950e2 [channel9] Update tests' thumbnails
Sergey M․ a13d06de42 [channel9] Add test for low quality mp4
Sergey M․ 1db82381e3 [channel9] Add low quality formats and modernize
remitamine 9fb66c780c [megavideoz] remove extractor
Sergey M․ ab953c64a0 [yandexmusic:track] Extract original size thumbnail (Closes )
Sergey M․ 7a6d76a64d [extractor/common] Require closing quote in _og_regexes (Closes )
E.g. do not match `property='og:video:type'` when `og:video` is requested.
Sergey M․ 4aa353673b Merge branch 'master' of github.com:rg3/youtube-dl
remitamine 36bb63fad1 [criterion] fix description extraction
Jaime Marquínez Ferrándiz 1f36085df9 [vimeo] Fix extraction of password protected videos (fixes )
remitamine 26669ea3cf [5min] extract more video info and formats
Closes .
remitamine db8e38b8cf [ign] add tests for me.ign specific language urls
remitamine e09f58b3bc [srgssr] change the url chortcut, fix image extraction ,add a test and extract format id
kaspi 3dc582e5ea [fczenit] Add extractor
Closes .
Jaime Marquínez Ferrándiz 506e261d20 [channel9] strip 'session_day'
Jaime Marquínez Ferrándiz b30c4992a9 [channel9] Return a single dictionary for single videos (closes )
Returning a list is deprecated.
DesweR 3eeff489e8 Extract thumbnail url
Sergey M․ 5946cda7c6 [beeg] Fix extraction (Closes )
Yen Chi Hsuan 73e732eb6b [vimeo] Fix m3u8 formats
Reported at
https://github.com/rg3/youtube-dl/pull/7126#issuecomment-147327584
Jaime Marquínez Ferrándiz 57d1db8dd0 [rtbf] Fix extraction (closes )
Sergey M․ 0f61db4469 [chaturbate] Improve and capture error message
PC 1bd3903582 chaturbate streams
Sergey M․ da4daed5ef [vimeo] Do not fail when no hls formats
Sergey M․ 7d49502ab0 [bild] Make more robust and improve hls extraction
remitamine 03e3b4e119 [expotv] parse m3u8 manifest
Sergey M․ d8348c351d [bild] Strip title
remitamine 70cb4d51c9 [bild] extract info from json request
Sergey M․ 7c84562945 [vimeo] Fix password protected videos
Sergey M․ 68f3b61f0e [vimeo] Update tests
Sergey M. 08fd433f3e Merge pull request from remitamine/vimeo
[vimeo] extract m3u8 manifest and bitrate
remitamine 35a3ff1d33 [vimeo] always convert width, height and bitrate to int
remitamine fff496c689 [vimeo] remove check for empty formats
remitamine e5c209a1bc [vimeo] add parameters to _extract_m3u8_formats and sort formats
Sergey M․ 75f105d455 [adultswim] Clarify no media message
remitamine 00cde0b8dc [adultswim] raise ExtractorError if no clips in video_info
remitamine 58cd7e173e [adultswim] detect when video needs authentication
remitamine f4076bb736 [vimeo] extract m3u8 manifest and bitrate
Sergey M․ 6f7893653c [bbc] PEP 8
Sergey M․ 55ebae26f9 [bbc] Prefer iptv-all mediaset
Sergey M․ ae8bdfd1a1 [bbc] Extract article JSON and actualize tests
Sergey M․ 6a74719060 [bbc] Update tests
Sergey M․ f6295bcb04 [bbc] Remove duration
Sergey M․ 78f9d84318 [bbc] Support playlists of data-playable
Sergey M․ b1ec70e4a9 [bbc] Improve data-playable regex
Sergey M․ c936d8cc7b [bbc] Add another test
Sergey M․ e6174ee975 [bbc] Extract legacy playlist embedded media
Sergey M․ f790c43f6e [zingmp3:album] Skip broken items
Sergey M․ 8119597d6f [zingmp3] Add fatal flag
Sergey M․ 43abd79950 [zingmp3:album] Style
Phạm Ngọc Quang Nam 97ae4d166c [zingmp3:album] Add support for playlists
Update for work with playlist, it same album but different url
Ex:
http://mp3.zing.vn/playlist/Duong-Hong-Loan-apollobee/IWCAACCB.html
http://mp3.zing.vn/album/Duong-Hong-Loan-apollobee/IWCAACCB.html
Sergey M․ 87cc0fbd18 [bbc] Make summary optional in legacy playlist
Sergey M․ baf39a1aa8 [bbc] Add one more scenario for data-playable embeds
Sergey M․ 975977860d [bbc] Make playlist title optional
Sergey M․ b5d48cb1ef [bbc] Add test for atricle with multiple videos embedded with playlist.sxml
Sergey M․ de66571371 [bbc] Support multiple videos in articles embedded with playlist.sxml
Sergey M․ dab062fb6e [bbc] Add support for videos in news articles embedded with data-playable
Yen Chi Hsuan 6a959f2e52 [iqiyi] Update enc_key
Sergey M․ 47c165c3a9 [vimeo] Fix authentication (Closes )
Sergey M․ 4180a3d8b7 [extractor/common] Allow quoteless content attribute in og regexes (Closes )
remitamine 05ad5409b4 [srgssr] fix regex for swissinfo.ch
remitamine 1ef1563649 [srgssr] Add generic extractor for SRGSSR Group sites
Yen Chi Hsuan 57935b2564 [extractor/common] Allow HTML5 unquoted attribute values
Fixes 

HTML5 allows unquoted attribute values. See the "Unquoted attribute value
syntax" section [1] for more information

[1] http://www.w3.org/TR/html5/syntax.html
Sergey M․ 54a5428518 [dailymotion] Update player v5 regex (Closes )
Sergey M․ 9d5fb3b58d [pbs] Carry long line
remitamine 0553d0ee40 [pbs] place errors into a dict
remitamine 7faf7e7523 [pbs] detect errors from http error code
Sergey M․ 4356d907c1 [4tube] Try extracting sources from the webpage before fetching player.js (Closes )
Sergey M․ c677e49bd1 [4tube] Revert uploader regexes and make non fatal
Sergey M․ 96c4855331 [4tube] Style and make more robust
kitty b90b0c4ffa Fixed 4tube.com extractor to pull metadata from associated Javascript and not the HTML of the desired page.
AndroKev db7a28eccb FIX: nowtv
now the download works for me
thx to http://board.gulli.com/thread/1251646-videos-von-webseiten-runterladen-sammelthread-alle-fragen-hier-rein-/?p=14980081#post14980081
remitamine 6a11bb77ba [nba] add support for team subsites
remitamine ecf6de5b02 [nba] extract width,height and bitrate from format key
remitamine 139f27827e [nba] skip Legacy Video Files
Sergey M․ fc10824cb6 [canalplus] PEP 8
Sergey M․ 83a5668694 [canalplus] Extend video id regex (Closes )
Sergey M․ f648e682a7 [bandcamp] Prepend download URL with scheme when necessary (Closes )
Sergey M․ 40fbb05e1c [ustream] Fix tests
Sergey M․ dc5756fd77 [ustream] Fix typo
Sergey M․ 41db733308 [ustream] Move filesize
Sergey M․ 0bf219889e [ustream] Remove unused import
Sergey M․ f2a7ed77ef [tumblr] Remove redundant field
Sergey M․ 4853eb63fe [ustream] Modernize
Sergey M․ 5820c4a29e [ustream] Switch extraction to api
David Rabinowitz 7fd4ed9939 Fixed the ustream extractor to use the current ustream API
Sergey M․ 88c86d211b [tumblr] Add missing fields for vidme test
Sergey M․ 5d84b79a30 [tumblr] Remove redundant test
Sergey M․ 140ac73965 [tumblr] Simplify and extract duration
Oli Allen 2a27e66234 [tumblr] Added support for HD video where available ()
[tumblr] Replaced test URL for HD video as old one lead to 404

[tumblr] Don't make assumptions about video resolution, cleaner handling of no HD version available

[tumblr] Removed extraneous resolution key in HD video tests
Sergey M․ e759a00119 [appletrailers] Quotes consistency
Sergey M. 9d5332518c Merge pull request from remitamine/appledaily
[nextmedia] update AppleDailyIE tests
Sergey M․ 90ab741e90 [pbs] Add test for
Sergey M․ 96229998c2 [pbs] Allow empty attribute in player regex
Sergey M․ 0659dfccfe [pbs] Improve player regex (Closes )
Sergey M․ 9c544e2537 [limelight] Add test video with subtitles
Sergey M․ d7fc56318b [limelight] Fix python 2.6, simplify, make more robust (Closes )
Sergey M․ 4bba371644 [YoutubeDL] Autocalculate ext for subtitles when missing
remitamine ef5acfe32d [limelight] Add new extractor
remitamine 30787f7259 [cspan] correct the clip info extraction
Sergey M. 85557f635a Merge pull request from remitamine/engadget
[engadget] accept short video urls
Naglis Jonaitis 60d23e5e59 [tapely] Improve _VALID_URL
remitamine 97d5bfcba6 [engadget] accept short video urls
remitamine c233e6bcc3 [nba] extract video info from xml feed
remitamine 28809ab07a [nba] extract more formats
remitamine adccf33632 [ign] add support for pcmag and extract all formats and more metadata
Jaime Marquínez Ferrándiz b203095d4c [europa] Style fix: add whitespace after comma
Sergey M․ f3b098fb90 [europa] Add support for audio URLs
Sergey M․ af17794c65 [europa] Improve extraction
remitamine 8fc226ef99 [nba] extract all video formats and extract more info
ngld 3bb3f04108 [europa] Add new extractor
Sergey M․ 59a9efe85b [ruutu] Limit resolution split to 2 pieces (Closes , closes )
fluks 0facd2af3e Fix ruutu extractor bug
If there's no resolution attribute in xml, only width gets a
value, height doesn't and ValueError is raised.
Jaime Marquínez Ferrándiz 44451f22d5 [naver] Remove unused import
Sergey M․ 06c6efa970 [videolecturesnet] Add test video with broken direct format links
Sergey M․ e5851b963a [extractor/common] Make f4m extraction for SMIL non fatal
Sergey M․ 4de6131090 [extractor/common] Add fatal to _extract_f4m_formats
Sergey M․ 3a1341a7bc [extractor/common] Make m3u8 extraction for SMIL non fatal
Sergey M․ c78e48177c [extractor/common] Check validity of direct URLs
Sergey M․ 6edaa0e25b [videolecturesnet] Add playlist test
Sergey M․ fb97809e64 [videolecturesnet] Improve playlist extraction
Sergey M․ 0c996b9f48 [videolecturesnet] Add support for playlists (Closes )
Sergey M․ acfb717a18 [videolecturesnet] Use generic SMIL extraction
Sergey M․ 647eab4541 [extractor/common] Extract upload date from SMIL
Sergey M․ 1e5bcdec02 [extractor/common] Extract images from SMIL
Sergey M․ e7d8e98a9f [extractor/common] Allow float bitrates
Sergey M․ 2b3f951a2e [nrktv] Rework subtitles and eliminate downloading twice
Joakim Fremstad b83831df1f [nrk] Spelling
Sergey M․ f540b93706 [naver] Improve error regex
Sergey M․ 8466336104 [vk] Detect vimeo embeds (Closes )
Sergey M․ ee2d190253 [nfl] Add test for
remitamine aedb930cfc [nfl] fix content id regex(fixes )
Philipp Hagemeister c596ce91cd [comedycentral] Fix youtube-dl :thedailyshow
We'll let the generic IE follow the redirect and call back to us with the episode URL
remitamine c01e1a96aa [brightcove] fix test and fields extraction
Sergey M․ 8a64969404 [adultswim] Prefer stream (Closes )
Sergey M․ 86692c019c [keek] Strip title
Sergey M․ 1ab1c4ef57 [keek] Improve uploader fields regexes
Sergey M․ 926fb62eec [keek] Remove description
Since it equals title plus static suffix
Sergey M․ 817690ff73 [keek] Make uploader fields non fatal
remitamine 98e1c935a1 [keek] extract uploader and uploader id with _search_regex
remitamine f30e9976d6 [keek] add utf-8 coding cookie
remitamine 80e98aed69 [keek] fix test title
remitamine 6a24cb3d22 [keek] extract more info
remitamine e13b9e7885 [keek] fix info extraction
Sergey M․ dd467d33d0 [extractor/generic] Add support for condenast script embeds (Closes , closes )
Sergey M․ c6b8f4d0c9 [condenast] Add support for JS embeds
Sergey M․ 2f962d0a91 [eagleplatform] Use http scheme for thumbnail
Sergey M․ 3c63e1bb57 [eagleplatform] Make _handle_error staticmethod
Sergey M․ c471b34575 [eagleplatform] Simplify secure mp4 construction and clarify rationale
remitamine d045f0bdb7 [eagleplatform] use http urls explicitly
remitamine 22becac4bd [eagleplatform] return the code to handle errors in all _download_json requests
remitamine 9d632b1b27 [eagleplatform] extract mp4 url and fix thumbnail url
Sergey M․ 95c5e10103 [qqmusic] Allow [mm:ss] timestamps
Sergey M․ a5d09d684e [qqmusic] Use release_date
Sergey M․ 8aab976bbd [extractor/common] Document release_date field
Sergey M․ cd1bb54990 [qqmusic] Add test for a song with non .lrc lyrics
Sergey M․ d4cd06138c [qqmusic] Do not capture braced text from the middle of the string
Sergey M․ 961c5cbf17 [qqmusic] Eliminate _filter_lrc and use single quotes
Qijiang Fan b65e5bb72f [qqmusic] Add subtitles for QQMusic
Use .lrc lyrics as subtitles if lyrics in lrc format exist.
Sergey M․ 54914380c0 [bbc] Add test for programme that fails with iptv-all mediaset
Sergey M․ 26ccc68bed [bbc] Clarify iptv-all mediaset rationale
Sergey M․ ee3d5a6d47 [bbc] Skip mediaselection on gelocation error (Closes )
Sergey M․ 46fde8a1a2 [extractor/generic] Use _extract_url for mtvservices
Sergey M․ fe1d858e35 [mtvservices:embedded] Add _extract_url
Sergey M․ fc42bc6ec9 [mtv] Look for sm4:video:embed (Closes , closes )
Yen Chi Hsuan fe6ad195ae Merge pull request from remitamine/kuwo
[kuwo] fix title extraction and update test
remitamine 7193650641 [kuwo] treat the offline error as an expected ExtractorError
remitamine 5db34f680f [kuwo] check for the offline error page
remitamine 3706fb5dc8 [fktv] get format_id from video file ext
Jaime Marquínez Ferrándiz 4866b72eb2 [fktv] Don't redefine 'url' in list comprehension
Detected with flake8.
remitamine 3d09aa4c82 [kuwo] extract title inside element with class title exactly
remitamine c44c7895b8 [kuwo] fix title extraction and update test
Yen Chi Hsuan 8de28761c4 [fktv] Fix a regex
Yen Chi Hsuan 711762f0b7 [fktv] Coding style
Yen Chi Hsuan 5773803961 [fktv] Correct thumbnail extraction and add the test
remitamine 6aeba407db [jukebox] remove extractor and handle it using generic extractor
Yen Chi Hsuan 140359fc2c [fktv] Correct and improve some regexs
Yen Chi Hsuan 8ddf48d59f [fktv] Raise an error is no videos found
Yen Chi Hsuan 2e40a12225 [fktv] Correct spellings
Yen Chi Hsuan dade7245af Merge branch 'fktv' of https://github.com/remitamine/youtube-dl into remitamine-fktv
remitamine 1f9fb20fcd [nextmedia] update AppleDailyIE tests
Sergey M․ 0940c5b4c6 [condenast] Do not capture unused group in _VALID_URL
Sergey M․ 42ca72dff3 [condenast] Keep acute accent
remitamine 2949a6cda9 [condenast] fix video info regex
remitamine 882fc9052e [condenast] fix extraction and add support for other sites
Sergey M․ 9b166fc1f8 [iconosquare] Extract comments
Sergey M․ d4364f30bd [iconosquare] Revert title (Closes )
remitamine 857421024d [iconosquare] fix info extraction
atomic83 545a23f11b More title extraction fixing.
remitamine 47024eb564 [hostingbulk] remove extractor
Sergey M․ 9c58885c70 [nhl:news] Add support for iframe embeds (Closes )
Sergey M․ 9fbd4b35a2 [nhl] Add support for embedded URLs
Sergey M․ 05b476a270 [vidme] Prefer non clip (Closes )
Sergey M․ 4395ca2e04 [xhamster] Fix title extraction (Closes )
Yen Chi Hsuan 19f93d906e [iqiyi] Use md5_text for all MD5 calls
Yen Chi Hsuan 57565375c8 [iqiyi] Fix extraction (fixes )
Sergey M․ eb11cbe867 [soundcloud] Update client id (Closes )
remitamine 53407e3f38 [brightcove] fix streaming_src extraction
remitamine b306c439d7 [cnet] fix extraction and extract more formats
Sergey M․ 78f9fb902b [9gag] Support embed URLs
Sergey M․ d8fef8faac [9gag] Quotes consistency
Sergey M․ 8ea6bd2802 [9gag] Add vimeo test
Sergey M․ c659022b5c [9gag] Modernize
Sergey M․ 8ca2e93e1a [9gag] Relax optional fields
Sergey M․ 5600e214c3 [9gag] Make post view regex more robust
Sergey M․ 6400f8ec0f [9gag] Allow old .tv domain
There are still references to it in webpage's source
Sergey M․ c3a4e2ec40 [9gag] Remove redundant test
Sergey M․ e28c794699 [9gag] Make display_id optional
remitamine da9f180835 [ninegag] remove unnecessary condition
remitamine 6b8ce312e3 [ninegag] extract source url
remitamine de3fc356e1 [ninegag] fix _VALID_URL regex and handle the use of other external providers
Sergey M․ d0fed4ac02 [viewster] Use tuple
Sergey M․ 7ce50a355c [viewster] Add geo restricted tests
Sergey M․ 9612f23399 [viewster] Detect video geo restriction
Sergey M․ cccedc1aa4 [voewster] Detect series geo restriction
Sergey M․ c430802e32 [extractor/common] Add raise_geo_restricted
Sergey M․ cb4e421901 [voewster] Update tests
Sergey M․ 8e97596b7b [viewster] Extract height from bitrate and prefer mp4 videos
remitamine 92085e7099 [viewster] accept https links and fix api_token extraction and extract mp4 video link(fixes )
Sergey M․ c6aa838b51 [youtube:history] Enable exractor
Sergey M․ 9f5e8d16b3 [youtube:history] Disable exractor
Sergey M․ 82c06a40ac Fix typo
Sergey M․ 4423eba49b [nfl] Add support for URLs without id (Closes )
Sergey M․ 5b4c54631a [nfl] Add team domains ()
Jaime Marquínez Ferrándiz f005f96ea5 [youtube:history] Explain why it has disabled and skip test
Sergey M․ 5e39123b3b [arte:+7] Fix typo
Sergey M․ 393ca8c94d [arte:+7] Look for json vp url in iframe (Closes )
Sergey M․ f817adc468 [youtube:history] Disable extractor until is investigated
Wiped out part of my history as well
Sergey M․ 6c91a5a7f5 [extractor/generic] Fix following redirect in Refresh HTTP header on python 2
remitamine 5de5ab89b4 [shahid] change test ext
remitamine 1d67c96640 [shahid] fix api request url
Sergey M․ d1c694ea4a [bbc] Switch extraction to hq iptv hls (Closes , closes , closes , closes , closes )
Sergey M․ 06368a232a [playwire] Fix test
Sergey M․ 131d05033b [ok] Skip test
Sergey M․ 1806a75415 [ok] Capture error message
Sergey M․ 659ffe204c [divxstage] Remove extractor
DivxStage is offline for quite some time already
Sergey M․ 4647fd8910 [telecinco] Fix typo
Sergey M․ d492dad8f4 [telecinco] Add support for mediaset.es
Sergey M․ 3368d70dce [mitele] Clarify IE_DESC
Sergey M․ 0e1b2566ff [telecinco] Clarify IE_DESC
Sergey M․ 369e60162e [telecinco] Update test
Sergey M․ d5e7657fe2 [telecinco] Add support or cuatro.com
Sergey M․ f84ce1ebaf [mitele] Fix extraction (Closes )
Sergey M․ 12bc242944 [telecinco] Incorporate mitele code
Sergey M․ 88060cce10 [rai] Add support for videos embedded with drawMediaRaiTV (Closes )
Sergey M․ 272e4db5c7 [pornhub] Relax _VALID_URL (Closes )
Philipp Hagemeister 2b3c254678 [youtube:channel] Correct 404 handling
Previously, when we encountered a 404 - such as youtube-dl https://www.youtube.com/ohJeiboh8oorehai - we crashed with a regexp error. Instead, make sure to go on and eventually report a 404.
Philipp Hagemeister 287be8c615 [youtube:truncated_url] Add ?t=
Sometimes found in links - ?t=123&v=ABCD starts the video at position 123.
Sergey M․ e2ff3df314 [clubic] Relax _VALID_URL (Closes )
Sergey M․ c246773599 [nowness] Add vimeo test
Sergey M․ 82c18e2a53 [nowness] Simplify
Sergey M․ d5d38d16ae Merge branch 'nowness' of https://github.com/remitamine/youtube-dl into remitamine-nowness
Sergey M․ 2ffe3bc14b [ndr] Rework and cover with tests
Sergey M․ d5867276a9 Merge branch 'master' of github.com:rg3/youtube-dl into remitamine-ndr
Yen Chi Hsuan f665ef8fc5 Merge remote-tracking branch 'upstream/master'
Yen Chi Hsuan b264c21302 [tudou] Use single quotes and compat_str
Yen Chi Hsuan 349b3a2ea0 [tudou] Improve regexs
Yen Chi Hsuan 87813a8570 [tudou] Use _download_xml
Yen Chi Hsuan aab135516b [tudou] Avoid shadowing builtin names
Yen Chi Hsuan 141ba36996 [tudou] Modernize
Yen Chi Hsuan 94e507aea7 [tudou] A more comprehensive _VALID_URL
Sergey M․ 3ebc121293 Merge branch 'ndr' of https://github.com/remitamine/youtube-dl into remitamine-ndr
Yen Chi Hsuan 41ebd6530b [tudou] Add the test case ()
Yen Chi Hsuan 2ec7b7b79b Merge branch 'master' of https://github.com/linhua55/youtube-dl into linhua55-master
Sergey M․ 60ed60353b [openfilm] Remove extractor
OpenFilm has been shut down
Sergey M․ 586f1cc532 [extractor/common] Skip html comment tags (Closes )
Sergey M․ 73eb13dfc7 [extractor/common] Case insensitive inputs extraction
remitamine ed1269000f [brightcove] add support for brightcove in page embed(fixes )
Sergey M․ 1721fef28b [yahoo] Fix test
Sergey M․ 364ca0582e [yahoo] Process query result embedded in webpage
Sergey M․ cc1ac11017 [vier:videos] Fix extraction with old approach (Closes )
Sergey M․ 482aa3fecc [vidme] Simplify, make more robust, extract more metadata and capture errors (Closes )
Lukáš Lalinský d9c19db340 Extract all vid.me formats
Sergey M. 6c4d243de5 Merge pull request from remitamine/xuite-tests
[xuite] fix test md5
remitamine 7b4137c351 [fktv] fix info extraction
remitamine 1072336249 [washingtonpost] fix test info
remitamine 75bb5c7028 [xuite] fix test md5
remitamine 376e1ad081 [ndr] use utils.qualites
remitamine b58a22b963 [ndr] make NDREmbed and NJoyEmbed _VALID_URL regex unique
Sergey M․ 47004d9579 [crunchyroll] Fix uploader and upload date extraction
Sergey M․ 12810c9cd3 [crunchyroll] Force Accept-Language to any for all requests (Closes )
Sergey M․ 7a459170fa [__init__] Remove musicvault
Sergey M. 3cf0df568a Merge pull request from remitamine/musicvault
[musicvault] remove extractor
remitamine b88ebd472e [musicvault] remove extractor
remitamine 436416afe2 [tele13] skip test
remitamine 64997815c4 [ndr] add support for embeds
remitamine 8b55cadc83 [canal13cl] fix info extraction
remitamine b1b7d1ffba [wimp] fix tests info
Jaime Marquínez Ferrándiz 4003bd82b0 [youtube:shows] Use https
remitamine 8801255d7d [youtube] fix show extraction (fixes )
Closes )
remitamine 3b18f539a7 [ndr] fix info extraction
Yen Chi Hsuan bc973e06d0 Merge pull request from remitamine/yahoo-tests
[yahoo] change test md5 checksum
remitamine cf33a47df0 [ajazzera] skip test
remitamine daeb0f04cd [yahoo] change test md5 checksum
Sergey M․ 97243fe395 [ceskatelevize] Extract playlists (Closes )
Sergey M․ 9dbdb65abe [techtvmit] Update test
Sergey M․ 9af461de35 [techtvmit] Fix extraction
Sergey M. 4d71e200c6 Merge pull request from remitamine/academicearth
[academicearth] fix test info
Sergey M. 8e0bdabed2 Merge pull request from remitamine/airmozilla
[airmozilla] fix test info
Sergey M․ bca553caac [eagleplatform] Fix extraction
remitamine a2f42a3baf [academicearth] fix test info
remitamine 7465222a9c [airmozilla] fix test info
Sergey M․ 12bbd32ad0 [kuwo:singer] Skip test
Sergey M․ cf83f532ae [niconico] Use encode_dict
Sergey M․ cd019668dc [niconico] Use encode_dict
Sergey M․ 515fc8776f [youtube] Use encode_dict
Sergey M․ c7c0996d8c [gorillavid] Add test for filehoot.com (Closes )
Sergey M․ b3e64671cc [gorillavid] Improve title
Sergey M․ 4abe214499 [gorillavid] Encode fields
Sergey M․ e94cb5ae7e [gorillavid] Add support for filehoot.com
Sergey M․ e213c98df1 [gorillavid] Build correct URL
Sergey M․ be0e5dbd83 [extractor/common] Extract submit inputs
Sergey M․ eb387896e9 [adultswim] Fix extraction on python 2.6
remitamine f43c163158 [nowness] pass cinematique
remitamine 673bf566fc [nowness] more api abstraction
remitamine f95c5e1218 [nowness] change id variable name
remitamine f33f32f159 [nowness] add api abstration function adn extend _VALID_URL regex
remitamine 75b399f455 [nowness] fix _VALID_URL regex
felix 12439dd5ec [generic] Capture <audio> tags in addition to <video> tags
remitamine c23c3d7d7d [nowness] fix video extraction and add support serie and playlist extraction (fixes )
remitamine 486375154c correct season info extraction and simplify
Yen Chi Hsuan 9dd73ef4a4 [dcn] PEP8
Yen Chi Hsuan 08354db47b [vlive] PEP8
Yen Chi Hsuan 027eb5a6b0 Merge branch 'vlive' of https://github.com/ping/youtube-dl into ping-vlive
Jaime Marquínez Ferrándiz c482b3c69a [ruutu] Update test url
Sergey M․ 22889ab175 [ruutu] Fix extraction (Closes )
remitamine 8e2898edf9 [dcn] add support for live streams and catchup videos
Marco Ferragina 26c61e0809 Added ec extension to nowvideo extractor
remitamine b477da2094 correct the extractor name and id and remove unnecessary request
Jaime Marquínez Ferrándiz 725d1c58aa [crunchyroll] Extract width and height (closes )
remitamine 9f4921bfa0 [dcn] add show extraction and support for other types of urls
Sergey M․ e8dcfa3d69 [ok] Sort formats
Sergey M․ 88720ed09b [ok] Add support for youtube embeds
Sergey M․ 1e804244d0 [ok] Improve player regex
Sergey M․ 198492bbf0 [ok] Extract correct data-options (Closes )
Jaime Marquínez Ferrándiz 080997b808 [rtve] Fix extraction (fixes )
Adding the 'Referer' header to the png request is enough.
Sergey M․ 77306e8b97 [francetv] Update tests (2)
Sergey M․ 6917d2a2f0 [francetv] Update tests
Sergey M․ 36c15522c1 [francetv] Use subtitle when present (Closes )
Sergey M․ cd5d75427e [youku] Fix videopassword test
Sergey M․ 5ddc127da6 [youku] Simplify (Closes )
PSJay cb3d2eb9e9 Fix coding styple in YouKuIE.
PSJay 33eae08f04 Support video-password on Youku.
Jaime Marquínez Ferrándiz aa3f98677d [dumpert] Support 'embed/' urls (fixes )
Sergey M․ fffccaaf41 [globo] Fix extraction and make more robust (Closes )
Yen Chi Hsuan cdc8d0c373 [odnoklassniki] Fix extraction and extend _VALID_URL (closes )
ping d14f0c45fc [vlive] Add info about www. to m. redirects for mobile
Sergey M․ 39955b0451 [fc2] Fix refer
Sergey M․ 52dfb7ffe2 [fc2] Add test for
Sergey M․ 93462856e1 [fc2] Relax _VALID_URL (Closes )
ping 615f155a3a [vlive] Fixes for review
Sergey M․ 8875b3d572 [imgut:album] Add extractor (Closes )
Sergey M․ aabc2be693 [youtube] Simplify and extract more metadata from url_encoded_fmt_stream_map (Closes )
Anssi Hannula c9afb51cea [youtube] Fix missing format details for 60fps DASH formats
60fps DASH formats do not appear in the DASH manifest, but the non-DASH
video info page does contain additional parameters for DASH formats that
we can parse.

Use those when they exist.

This fixes "bestvideo" not selecting 60fps formats over similar 30fps
formats just because the file size is unknown.
Yen Chi Hsuan c0a656876c [abc] Use int_or_none
Yen Chi Hsuan 17a647630b [abc] Support YouTube embeds (fixes )
Sergey M․ c88e118b3c [nowtv] Fix display_id (Closes )
Sergey M․ ae6a802106 [kaltura] Fix _VALID_URL formatting
Sergey M․ b184f94413 [kaltura] Clarify html5 player comment
Sergey M․ ee3ec091f4 [kaltura] Strictify _VALID_URL
sourcerect ef49b59053 [kaltura] add html5 player urls
Sergey M․ 1f8125805e [generic] Add test for screenwavemedia embed
Sergey M․ efd712c69b [generic] Use screenwavemedia embed pattern
Sergey M․ 109a4156e1 [cinemassacre] Use screenwavemedia embed pattern
Sergey M․ 678d33295b [screenwavemedia] Improve _VALID_URL
Sergey M․ 5e58956d0a [screenwavemedia] Add EMBED_PATTERN
felix e276fd2cb3 [screenwavemedia] warn when falling back to a hardcoded list of streams
felix 9b22cb10c4 [screenwavemedia] use the true JS value instead of a comment
felix 8ca31a0e05 [generic] Look for ScreenwaveMedia embeds
Sergey M․ 20149a5da1 [mtvservices] Fix title extraction under python 2
Sergey M․ 054d43bb11 [mtvservices] Catch more georestriction errors
Sergey M․ 65488b820c [mtvde] Add support for news
Sergey M․ c3c9f87954 [mtvde] Add test for mediagen URL without query
Sergey M․ 56f447be9f [mtvservices] Fix mediagen URL generation
Sergey M․ 79fa9db0da [mtvde] Simplify (Closes )
Paul Hartmann 071c10137b [MTV] move German mtv site to new class
Sergey M․ 5307c33232 [foxnews] Clarify IE_DESC
Sergey M․ 1b660cce12 [foxnews] Simplify (Closes )
nmrugg 8df8c278b6 Added matching test for FoxBusiness.
nmrugg d7e8264517 Make FoxBusiness work.
Sergey M․ f11c316347 [shared] Add filesize to test
Sergey M․ f62e02c24f [shared] Add test for vivo
Sergey M․ 70113c38c9 [shared] Clarify IE_DESC
Sergey M․ 3d8132f5e2 [shared] Extend _VALID_URL to support vivo.sx (Closes )
Sergey M․ 39affb5aa4 [crunchyroll] Fix typo
Sergey M․ a882c5f474 [udemy] Use raise_login_required
Sergey M․ 61a7ff1622 [tubitv] Use raise_login_required
Sergey M․ 42e7373bd3 [smotri] Use raise_login_required
Sergey M․ e269d3ae7d [safari] Use raise_login_required
Sergey M․ e7ddaef5bd [pluralsight] Use raise_login_required
Sergey M․ 62984e4584 [lynda] Use raise_login_required
Sergey M․ 3c53455d15 [eroprofile] Use raise_login_required
Sergey M․ bbb43a39fd [crunchyroll] Use raise_login_required
Sergey M․ 43e7d3c945 [extractor/common] Add raise_login_required
Sergey M․ 2f72e83bbd [crunchyroll] Detect required login ()
Jaime Marquínez Ferrándiz 4bc8eec4eb [youtube] Adapt player version regex to handle urls ending in '/html5player-new.js'
It was always extracting 'new' as the version, breaking the cache system.
Sergey M․ baf510bf8c [yandexmusic:playlist] Handle playlists with more than 150 tracks (Closes )
Sergey M․ 6d53cdd6ce [yandexmusic] Skip removed tracks ()
Sergey M․ ebbf078c7d [krasview] Skip download for test
Sergey M․ 95e431e9ec [mailru] Skip tests
ping eba470f2f2 [vlive] Remove upload_date extraction & cleanup
Sergey M․ e4df2f98cc [yandexmusic:track] Eliminate base class
Sergey M․ e7c14660d3 [yandexmusic] Defer link resolve till actual download time to prevent link expiry (Closes )
Sergey M․ 90076b6172 [spankwire] Preserve old uploader pattern
Sergey M․ 28b83495d8 [spankwire] Simplify
Sergey M․ 551c7837ac [spankwire] Simplify and properly format
clauderains 59e6acc757 [spankwire] Support new cdn video url format
clauderains 9990c960f2 [spankwire] Fixed uploader_id field extraction so that test case passes
Sergey M․ 2006a06eff [kontrtube] Fix extraction (Closes )
Sergey M․ 2b6bda1ed8 [pluralsight] Do not yet rely on userMayViewClip
Sergey M․ 468083d2f5 [pluralsight] Remove unused const
Sergey M․ 483fc223bb [pluralsight] Add extractor (Closes )
Sergey M․ 66ce97024d [soundcloud:user] Update tests
Jaime Marquínez Ferrándiz 8c97f81943 [common] Follow convention of using 'cls' in classmethods
Yen Chi Hsuan d7c1630570 [rtl2] Remove MD5 checksums
Yen Chi Hsuan 5e1a5ac8de [rtl2] Fix extraction for test_RTL2_1
Yen Chi Hsuan 9eb4ab6ad9 [rtl2] Remove an unused line
Yen Chi Hsuan 4932a817a0 [rtl2] Add skip_download for test
Sergey M․ 5d003e29b1 [rtp] Add skip_download for test
Sergey M․ dc95bd503e [folketinget] Add skip_download for test
Yen Chi Hsuan f738dd7b7c [common] Remove debugging codes
Yen Chi Hsuan c687ac745b [theplatform] Use subtitles from SMIL, too
Yen Chi Hsuan 912e0b7e46 [common] Add _merge_subtitles()
Yen Chi Hsuan 03bc7237ad [common] _parse_smil_subtitles: accept `lang` as the subtitle language
ping 061f62da54 [vlive] New extractor for vlive.tv
Yen Chi Hsuan dd565ac1ad [theplatform] Use _download_json
Sergey M․ 5cdefc4625 [extractor/common] Add more subtitle mime types for guess when ext is missing
Sergey M․ ce00af8767 [extractor/common] Add default subtitles lang
Yen Chi Hsuan 51047444aa Merge branch 'master' into HEAD
Yen Chi Hsuan aa6cd05ed8 [theplatform] Fix Python 2: declare coding
Yen Chi Hsuan dac14bf311 [nbc] Add MSNBCIE
Yen Chi Hsuan 05fe2594e4 [theplatform] Support URLs with 'guid='
Yen Chi Hsuan 26e1c3514f [theplatform] Add ThePlatformFeedIE
Sergey M․ 22c83245c5 [mwave] Improve
ping 7900aede14 [mwave] New extractor for mwave.interest.me
Yen Chi Hsuan f877c6ae5a [theplatform] Use InfoExtractor._parse_smil_formats()
Sergey M․ ca681f7041 [videobam] Remove extractor
videobam.com redirects to sendvid.com now
Sergey M․ a01da8bbf8 [crunchyroll] Workaround fplive.net rtmp URLs (Closes )
Sergey M․ 559f4c550f [playtvak] PEP 8
Sergey M․ 03c635a4b5 [twitch] Fix login (Closes )
Sergey M․ 34a4cd0a34 [telecinco] Relax _VALID_URL (Closes )
Philipp Hagemeister 3b9b32f404 [libsyn] Strip options from player URL
Sergey M․ 9c724a9802 [twitch:vod] Add test for
Sergey M․ 7a6e8a1b17 [twitch] Make more robust
Sergey M․ 369c12e038 [twitch] Allow untitled videos (Closes )
Philipp Hagemeister c00c7c0af0 [sportdeutschland] Fix extraction
Sergey M․ cbaed4bb5e [youtube] Expand _VALID_URL to support vid.plus
Sergey M․ f74a7348f6 [youtube:search_url] Fix extraction (Closes )
Sergey M․ 8626b23e4e [screenwavemedia] Make more robust
Sergey M․ 0086874277 [playtvak] Use tuples
Sergey M․ 7fc18d9309 [screenwavemedia] Fix extraction (Closes )
Sergey M․ 974f1a385a [playtvak] Improve description extraction and add test for metro
Sergey M․ 276c989772 [playtvak] Improve and simplify
Sergey M․ ea99110d24 Merge branch 'playtvak' of https://github.com/oskar456/youtube-dl into oskar456-playtvak
Ondřej Caletka 221a59fe6f [playtvak] Initial support for videos from Mafra group servers
Support for videos in articles from idnes.cz, lidovky.cz, metro.cz, as
well as video and live streams from playtvak.cz

Signed-off-by: Ondřej Caletka <ondrej@caletka.cz>
Sergey M․ 041bc3adc5 [youtube] Simplify two-factor authentication
Sergey M․ e64b756943 [extractor/common] Interactive TFA code input
Sergey M․ 201ea3ee8e [extractor/common] Improve _hidden_inputs
reddraggone9 9303ce3e69 [youtube] Fix two-factor authentication
Sergey M․ c576ef1e7c [shahid] Improve and simplify
Sergey M․ 11bed5827d Merge branch 'shahid' of https://github.com/remitamine/youtube-dl into remitamine-shahid
Sergey M․ 1d25e9d173 [extractor/__init__] Fix order
Sergey M․ 9c21f22923 [esri:video] Rename extractor
Sergey M․ 3aa697f993 [esri:video] Extract all formats and simplify
Sergey M․ 8b9848ac56 [extractor/common] Expand meta regex
Shaun Walbridge 8b8c1093b6 [EsriVideo] Add new extractor
Add extractor for [videos.esri.com](https://videos.esri.com), a collection
of videos relating to GIS.
Yen Chi Hsuan d0d6c097fc [moniker] Support embed- URLs ()
Sergey M․ 41dbc50f9c [lynda] Capture and output login error (Closes )
Sergey M․ 594f51b859 [indavideo] Remove unused import
Sergey M․ a34e19629c [indavideo] Relax _VALID_URL to match subdomains and add tests
Sergey M․ 3c12a027d4 [indavideo] Split in two extractors, extract all formats and fix timestamp
nyuszika7h cb28e03386 [indavideo] Add new extractor
Closes .
Yen Chi Hsuan 28479149cc [theplatform] Fallback to hardcoded releaseUrl if not available
Fixes .

Not adding a test case as test_NBC has the same problem.
Sergey M․ 237c03c8ea [dhm] Remove unused import
Sergey M․ e73c85cb23 [iqiyi] PEP 8
Sergey M․ b6b2711298 [tweakers] Remove unused imports
Sergey M․ 2c919adb74 [rtvnh] Check status code
Sergey M․ 60231c65b9 [rtvnh] Make SMIL not fatal
Sergey M․ f196047832 [rtvnh] Make thumbnail optional
Sergey M․ 240ca32e57 [rtvnh] Carry long lines
Sergey M. fa37c26c4d Merge pull request from ngld/rtvnhnl
[rtvnhnl] Added new extractor
ngld d7dbfc7cc1 Use native HLS implementation by default.
ngld d9ab5262b1 [rtvnh] Renamed rtvnhnl -> rtvnh
ngld fb124e3741 [rtvnhnl] Relax the thumbnail check
Sergey M. 479bf783d2 Merge pull request from ngld/fix-funnyordie
[funnyordie] Handle protocol-relative URLs (fixes )
ngld f0f3a6c99d [rtvnhnl] Added new extractor
Sergey M․ f57b7835e2 [youtube] Update tests
ngld 1df3186e0e [funnyordie] Handle protocol-relative URLs (fixes )
sceext 0a19d4ccd6 [iqiyi] update md5 salt (2015-08-10 Zombie)
Sergey M․ b1ac38fadc [tvplay] Add age limit to tests
Sergey M․ fb0d12c6cb [pbs] Add age limit to tests
Sergey M․ 34952f09e1 [youtube] Add age limit to tests
Sergey M․ 34a7de2970 [youtube] Skip download for multiple v= test
Sergey M. 0ff827419e Merge pull request from puckipedia/master
[youtube] Use the first v= argument in the URL
Sergey M․ b29440aee6 [vimeo:user] Do not match watchlater
Puck Meerburg 11b5605815 [youtube] Use the first v= argument in the URL
This is according to how youtube handles multiple v= values in one URL.
Before this, it was possible to make a single URL show up differently
 on youtube itself, and if you downloaded/viewed it with youtube-dl/mpv
Sergey M․ 844587669e [vimeo:watchlater] Fix extraction (Closes )
Sergey M․ f6c3664d71 [vimeo] Fix login (Closes )
Sergey M․ c5864a8ce6 [fc2] Fix python 2.6 (Closes )
Sergey M․ 0791ac1b44 [extractor/generic] Clarify comment
Sergey M․ 1de5cd3ba5 [extractor/generic] Add test for xspf playlist
Sergey M․ 729accb482 [extractor/generic] Add support for xspf playlists
Sergey M․ 942acef594 [extractor/common] Extract _parse_xspf
Sergey M․ fb2f339fec [dhm] Use _extract_xspf_playlist
Sergey M․ 98044462b1 [extractor/common] Use playlist id as default title
Sergey M․ 0dcb318f62 [tweakers] Fix test
Sergey M․ f32143469f [tweakers] Use _extract_xspf_playlist
Sergey M․ 3a30508b94 [telegraaf] Add extractor (Closes )
Sergey M․ e0b9d78fab [extractor/common] Clarify playlists can have description field
Sergey M․ 8d6765cf48 [extractor/generic] Add generic support for xspf playist extraction
Sergey M․ 12bb392a0f [vimeo] Fix password protected videos (Closes )
Sergey M․ 08df685fe7 [videolectures] Fix _VALID_URL for test_no_duplicates to pass
Sergey M․ c8d1be772d [rutube] Add age_limit to test
Sergey M․ 887e9bc7b5 [ok] Update tests
Sergey M․ 9f2e7c2f34 [ok] Add age_limit to tests
Sergey M․ d7bb8884af [break] Add age_limit to test
Sergey M․ 464e792496 [vpro] Override npo IE_NAME
Sergey M․ 18c3281f9e [24video] Fix test
Sergey M․ b61b7787cb [91porn] Extract age limit
Sergey M․ b465083f45 [sexykarma] Fix test
remitamine 59e89e62d7 [shahid] add default fallbacks for extracting api vars
Sergey M. d5d7bdaeb5 Merge pull request from dstftw/improve-generic-smil-support
Improve generic SMIL support
Sergey M․ b2f82948ee [quickscope] Fix typo
Sergey M․ 428e4e4a85 [quickscope] Add extractor
Sergey M․ 1e83741c9a [periscope] Add support for running streams
Sergey M․ 621d6a9516 [periscope] Switch to API for broadcast data
Sergey M․ 3550821fb4 [periscope] Add extractor (Closes , closes )
Sergey M․ 5b0c40da24 [extractor/common] Expand meta regex
remitamine c29458f3ec [shahid] change the tests
Sergey M․ bf94d763ba [extractor/generic] Add test for
Sergey M․ 8a37aa1517 [extractor/generic] Expand ooyala regex (Closes )
Sergey M․ fd5d8270dc [clipfish] Fix extraction, minimize requests, get rid of drm hds, extract m3u8 and more metadata
Sergey M․ be612d9e0c Merge branch 'clipfish' of https://github.com/remitamine/youtube-dl into remitamine-clipfish
Sergey M․ 4a7434d0b0 [dcn] Simplify _VALID_URL
Sergey M․ f94639fadf [dcn] Improve
Sergey M․ 89faae660f Merge branch 'dcn' of https://github.com/remitamine/youtube-dl into remitamine-dcn
Sergey M․ 0f422256d6 [nowtv] Add .at test
Sergey M․ acc1adbe7a [nowtv] Add support for .ch TLD
Sergey M․ 8002ac9e0a [nowtv] Add support for .at TLD
remitamine 6d30cf04db [dcn] fix type and key errors
Sergey M․ 9663bd3abb [southpark:de] Enable non-ASCII redirect URL test
remitamine 3be3c622dc [shahid] generic errors handling and check with flake8
remitamine cd6b555e19 [dcn] add origin to api request and fix the test and check with flake8
Sergey M․ 4f34cdb0a8 [southpark:de] Skip test
Sergey M․ bd690a9f93 [southpark:de] Add test for non-ASCII in URLs
Sergey M․ c73cdd800f [xhamster] flake8
Sergey M․ f535ec8278 [xhamster] Remove unused import
Sergey M․ 238755752f [tudou] Extract player URL from the webpage
Delon c71a3195af [tudou] Fix extracion
Sergey M․ 54a9328b20 [generic] Expand jwplayer support
Sergey M․ 3e48522477 [xhamster] Fix uploader extraction
Sergey M․ 251a44b776 [xhamster] Fix thumbnail extraction
Sergey M․ be7a8379b4 [xhamster] Make more robust
Sergey M. defce60385 Merge pull request from vijayanandnandam/master
fixing xhamster file extraction
vijayanand nandam 354b4b8604 fixing xhamster file extraction
Sergey M․ 5b7dab2dd6 [lynda] Make login more robust
Sergey M․ 8a5601e42f [lynda] Fix login (Closes )
Sergey M․ a346b1ff57 [bbc] Add support for vxp-playlist-data embeds (Closes )
Niklas Haas e704f87f86 [twitch] Parse start_time from 't' (closes )
Eg. for VOD links like http://www.twitch.tv/gamesdonequick/v/9136645?t=14h29m15s
Sergey M․ 8f5639afcb [pornhub] Improve video quality regex
Jaime Marquínez Ferrándiz 47a8b7c14a [mdr] Change XPath to make it work in python 2.6 (fixes )
The 'progressiveDownloadUrl' element is a direct child, so they should be equivalent.
Sergey M. 2a04d2c799 Merge pull request from remitamine/facebook
[facebook] extract uploader
remitamine 67b8a28a2f [facebook] add uploader value to the tests
remitamine 51a575159a [facebook] extract uploader
Sergey M․ 524229a297 [pornhub] Improve
George Brighton 754e70cf3e [pornhub] Fix video url regular expression.
PornHub seems to have subtly changed their JavaScript. Before, video URL strings were embedded directly in the video's `flashvars_*` object, but they are now assigned to variables of the form `player_quality_*`, which are then added to this object later under the relevant quality key.
Jaime Marquínez Ferrándiz 25a4c5a9ed [dailymotion:playlist] Use an iterator for the entries
So that using '--playlist-end' only downloads the required pages (reported in ).
Jaime Marquínez Ferrándiz 5c45bbe57b [nowtv] Remove unused import
Sergey M․ d41d04c0f5 [videolectures] Fix _VALID_URL
Sergey M․ e422d7f4f7 [nowtv] Expand _VALID_URL
Sergey M․ cdc682d5a4 [nowtv] Fix extraction (Closes )
Jaime Marquínez Ferrándiz 9cc93c64aa [screenwavemedia] Use the IP for the videoserver (fixes )
For http://cinemassacre.com/2015/07/28/avgn-seaman-for-dreamcast/ the other server returns a 403 error.
remitamine fa7a1cc5ef [screenwavemedia] fix info extraction (fixes )
Closes .
Sergey M․ 17712eeb19 [extractor/common] Extract namespace parse routine
Sergey M․ 41c3a5a7be [extractor/common] Fix python 3
Sergey M․ 8765222d22 [extractor/generic] Add generic SMIL tests
Sergey M․ e5e8d20a3a [extractor/generic] Improve generic SMIL detection
Sergey M․ a107193e4b [extractor/common] Extract f4m and m3u8 formats, subtitles and info
Sergey M․ 3f125c8c70 [nbcnews] Extend _VALID_URL
Jaime Marquínez Ferrándiz 525a87f58e [gdcvault] Fix typo: xml_decription_url -> xml_description_url
remitamine 44cae2fb2e [gdcvault] Add support for audio extraction (fixes )
Closes .
remitamine 30a453884e [viewster] use head request to extract api token
Closes .
Sergey M․ 3b58d94f71 [vidme] Make uploader optional and add test
Sergey M. 8abb86fec4 Merge pull request from remitamine/vidme
[vidme] extract the uploader
Sergey M․ 16a089780e [soundcloud] Clean up _VALID_URLs
remitamine 09b6468d30 [vidme] extract the uploader
Sergey M․ 80fb6d4aa4 [soundcloud:user] Rework extractor (Closes )
Jaime Marquínez Ferrándiz 1f04873517 [viewster] Use 'compat_urllib_parse_unquote'
remitamine 799207e838 [viewster] extract the api auth token
Closes .
Jaime Marquínez Ferrándiz 34866b4836 Merge remote-tracking branch 'dstftw/multifeed-videos' (closes )
Sergey M․ d12a1a47d5 [bbc] Improve work with mediaselection URLs
Sergey M․ 8d42e3501e Merge branch 'pr-fix_bbc_mediaselector' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-fix_bbc_mediaselector
Sergey M․ 5e1eddb939 [youtube] Show info message for multifeed videos according to noplaylist option
Sergey M․ 000b6b5ae5 [youtube] Improve tags extraction and add test
Sergey M․ 864f24bd2c [extractor/common] Add _meta_regex and clarify tags field
Purdea Andrei 5316bf7487 Documented tags as a possible dict key
Purdea Andrei a6f774e901 [youtube]: tags key in info jason is now a list
Purdea Andrei f171bc8b59 [youtube] save keywords in info jason when --write-info-json is used
Sergey M․ d247a2c8bf [bbc] Fix regex
Sergey M․ 88ed52aec9 [bbc] Add support for direct bbc.co.uk embeds
fnord cb23bcba29 BBCIE: Fix missing .mp4 formats on news sites
Prior to merge BBCNewsIE from pr  was rewritten into BBCIE in 9afa177. Support was added for non-news
sites (/travel, /sports), however support for the news mediaselector was removed to support these sites.
This removed support for .mp4.

    pr  ( news site, news mediaseletor : http://open.live.bbc.co.uk/mediaselector/4/mtis/stream/ )
    format code                                          extension  resolution note
    journalism_nonuk_stream_h264_flv_200_akamai          flv        400x224    h264@ 176k, 1001.77KiB
    journalism_nonuk_stream_h264_flv_400_akamai          flv        400x224    h264@ 512k, 2.85MiB
    journalism_nonuk_stream_h264_flv_med_akamai          flv        640x360    h264@ 800k, 4.43MiB
    journalism_nonuk_stream_h264_flv_hi_akamai           flv        688x384    h264@1500k, 8.34MiB
    journalism_world_stream_h264_http_200_sis_news_http  mp4        400x224    h264@ 176k, 1001.77KiB
    journalism_world_stream_h264_http_400_sis_news_http  mp4        400x224    h264@ 512k, 2.85MiB
    journalism_world_stream_h264_http_hi_sis_news_http   mp4        688x384    h264@1500k, 8.34MiB (best)

    # 9afa177 ( same url, non-news mediaselector: http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/journalism-pc/vpid/ )
    format code                                  extension  resolution note
    journalism_nonuk_stream_h264_flv_lo_akamai   flv        384x216    h264@ 496k, 2.76MiB
    journalism_nonuk_stream_h264_flv_med_akamai  flv        640x360    h264@ 800k, 4.43MiB
    journalism_nonuk_stream_h264_flv_hi_akamai   flv        688x384    h264@1500k, 8.34MiB (best)

This change corrects the above, by trying /mediaselector/5 if /mediaselector/4 fails.
Jaime Marquínez Ferrándiz 4c6bd5b5b6 [youtube] Use 'vp8' and 'vp9' in lowercase (fixes )
That's how YouTube reports them in their DASH manifest.
tippfeler aeb7b41d44 [spiegel] Accept iframe urls
Closes .
Sergey M․ 5bdec59de1 [comcarcoff] Add support for singleshots (Closes )
remitamine dfaba1ab95 [shahid] fix variable name
remitamine a62fd1af27 [shahid] improve info extraction
Sergey M․ 7a89681722 [bbc] Skip DASH until supported
Sergey M․ 51da40e621 [bbc] PEP8
Sergey M․ d8f0a9ecea [youtube] Respect noplaylist for multifeed videos
Sergey M․ cf7e015f25 [youtube] Add support for multifeed videos
Sergey M․ 1af330f29f Merge branch 'atomicdryad-pr-bbcnews'
Sergey M․ 9afa1770d1 [bbc] Improve playlist extraction, refactor, expand support and document
Yen Chi Hsuan 2c7c721933 [ir90tv] Optional fields should be non-fatal
Yen Chi Hsuan 7523647391 [ir90tv] PEP8
Yen Chi Hsuan 9700cd9097 [ir90tv] Improve title extraction
Yen Chi Hsuan eab7faa0c1 [ir90tv] Test (?:www\.)? part in _VALID_URL
Yen Chi Hsuan a56c1e38c7 Merge branch 'ir90tv' of https://github.com/cyb3r/youtube-dl into cyb3r-ir90tv
Sergey M․ 40a2d17052 [soundcloud:playlist] Defer download link resolve
Sergey M․ b14fa8e687 [soundcloud:set] Defer download link resolve (Closes )
Sergey M․ 678e436f2e [youtube] Handle empty allowed regions (Closes )
Sergey M․ ff81c4c99c Merge branch 'pr-bbcnews' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-bbcnews
Sergey M. 420658e6cb Merge pull request from remitamine/letv
[letv] fix height
remitamine 593ddd851b [letv] fix height
Yen Chi Hsuan 1243402657 [dailymotion:playlist] Detect problematic redirection (fixes )
remitamine 1a117a7728 [clipfish] extract mp4 video link
Sergey M․ 2b2ee140c3 [dailymotion:user] Fix _VALID_URL (Closes )
Sergey M․ d97f5cd795 [bbccouk] Make more robust (Closes )
Sergey M․ f3f0b8e403 [canalplus] Modernize
Sergey M․ 660f9459da [canalplus] Fix m3u8 videos extension
Sergey M․ 10952eb2cf [extractor/common] Consistent URL spelling
Sergey M. cdad742700 Merge pull request from jaimeMF/extract_start_time
[youtube] Extract start_time
Sergey M․ a9e8f60ef6 [rtlnl] Update unencrypted streams comment ()
corone17 a8b7b26068 Undo adaptive -> flash workaround
For a couple of days now rtlXL's non-DRM adaptive (m3u8) streams don't work anymore. By undoing the adaptive -> flash workaround youtube-dl returns the DRM streams again. Too bad for foreigners (geoblock).
The progressive streams still work fine.
Sergey M․ ba911137fa [rts] Add support for articles with videos on rhs (Closes )
Sergey M․ d3f007af18 [daylimotion] Adapt to player v5 and modernize (Closes , closes )
Jaime Marquínez Ferrándiz 2929fa0e79 [youtube] Also look into the 'start' field for start_time
Jaime Marquínez Ferrándiz 297a564bee [youtube] Extract end_time
remitamine 8e92d21ebf [googledrive] raise ExtractorError instead of warning
remitamine 36dbca8784 fix recursive error
remitamine d1cc05e17e remove unnecessary regex group names
remitamine 3b3d531965 fix embed regex
remitamine 653789afc7 add google drive embeds
remitamine 2d651a2d02 import google drive embed class
remitamine 3e5f3df172 move the embed to a separate class
remitamine f120a7ab5e change the _TEST info
remitamine 984e4d4875 [googledrive] Add new extractor
fnord 53b8247cb5 NationalGeographic._VALID_URL: work site-wide
Closes .
Yen Chi Hsuan b73b14f72c [viki] Rewrite dict selection codes
Yen Chi Hsuan 41597d9bed [viki] Fix description extraction (closes )
Jaime Marquínez Ferrándiz b37317d8b0 [generic] Unescape HTML escape sequences in redirect urls (fixes )
Jaime Marquínez Ferrándiz 87dc451108 [youtube] Don't use the DASH manifest from 'get_video_info' if 'use_cipher_signature' is True ()
Currently they give a 403 Forbidden error.
Jaime Marquínez Ferrándiz ca4456eda8 [tagesschau] Remove unused import
Sergey M․ 993df6bc22 [prosiebensat1] Modernize
Sergey M․ 61be92e26a [prosiebensat1] Recognize DRM protected videos ()
Sergey M․ c59b61c0da [viki] Fix height (Closes )
Sergey M․ 3e214851a4 [tagesschau] Improve tests
Sergey M․ a47b602b08 [tagesschau] Add support for audio
Sergey M․ 948199deac [tagesschau] Relax _VALID_URL and simplify
Sergey M․ c356620ec1 Merge branch 'patch/enhance-tagesschau-regex' of https://github.com/rohieb/youtube-dl into rohieb-patch/enhance-tagesschau-regex
Sergey M․ c7620992d2 [pbs] No need to escape colon
Sergey M․ ce1bafdce9 [pbs] Clean up title construction rationale
Sergey M. 9872e588c8 Merge pull request from atomicdryad/pr-fix_pbs_titles
pbs: fix vague 'Full Episode' titles; prepend name of show
Sergey M․ d609edf4f1 [udemy] Handle already-logged-in scenario (Closes )
Yen Chi Hsuan 40101dc311 [lecture2go] Make optional fields non-fatal
Yen Chi Hsuan e9c6deffee [lecture2go] Add more metadata fields
Yen Chi Hsuan 1e12429564 [lecture2go] Update _TEST
Yen Chi Hsuan 795704f0f1 [lecture2go] Support more formats
Yen Chi Hsuan 981b9cdc8c [lecture2go] Improve some regular expressions
Yen Chi Hsuan 3f724339db Merge branch 'lecture2go' of https://github.com/nichdu/youtube-dl into nichdu-lecture2go
fnord 9e7e0dffd5 Actually add the extractor
fnord c3dea3f878 Twittercard: support vmapurl method
fnord f57f84f606 Twitter: get and describe video from status urls
Sergey M․ c84683c88b [viewster] Strip titles
Sergey M․ b68a2613f8 [viewster] Rewrite for new API (Closes )
Jaime Marquínez Ferrándiz 28afa6e77a [snagfilms] Don't use '_' as a variable that is used
Sergey M․ 496ce6b349 [snagfilms] Improve m3u8 extraction (Closes )
Jaime Marquínez Ferrándiz 7c80519cbf [youtube] Extract start_time
From the 't=*' in the url.
Currently youtube-dl doesn't use the value, but it was requested for the mpv plugin.
Jaime Marquínez Ferrándiz 2fe1ff8582 [youtube] Set 'is_live'
Jaime Marquínez Ferrándiz 17ee98e1a5 [youtube] Fix upload_date in test
Jaime Marquínez Ferrándiz 2ee8f5d80f Merge remote-tracking branch 'yan12125/download-dash-segments' ()
Yen Chi Hsuan 3f302bca8c [tumblr] Improve downloading notes
Yen Chi Hsuan c909e5820e [tumblr] Delegate to GenericIE for non-tumblr videos
Fixes 
Yen Chi Hsuan a1b85269a4 [extractor/generic] Support vid.me embeds
Sergey M․ faa1f83ab4 [twitch:stream] Improve _VALID_URL (Closes )
Sergey M․ 308c505c3d [francetv] Improve _VALID_URL
fnord 0eacd2aaae less clunky if statement
Sergey M․ 18ae46ad4b [vice] Modernize
Sergey M․ 65c2b21df1 [vice] Make test only matching
Sergey M․ 772acaf31f [vice] Do not capture unused groups in _VALID_URL
Sergey M. f8d0745e27 Merge pull request from atomicdryad/pr-fixvice
fix/support news.vice.com
Sergey M․ d719c6a5ab [ard:mediathek] Add test for direct mp4
Sergey M․ 769efa16af [ard:mediathek] Remove dead test
Sergey M․ 86b4e98ac6 [ard:mediathek] Add audio test
Sergey M․ 3bf8c316a6 [sportschau] Reimplement in terms of ard extractor
Sergey M․ e37c92ec6d [ard] Extract all formats
fnord a5dd9a0c5d pbs: fix vague 'Full Episode' titles; prepend name of show
Many videos are given the title 'Full Episode' or 'Episode x', etc;
in the info json 'title' is the episode title (for oneshots this is
'Full Episode') while the program name is 'program':{'title'. This
changes the title from '(episode title)' to
 '(program name) - (episode title)'

The following urls demonstrate useless titles

    http://video.pbs.org/video/2365367186/
    http://video.pbs.org/video/2365519307/
    http://video.pbs.org/video/2365527039/
    http://video.pbs.org/video/2365530605/

Before change

    Full Episode
    Episode 5 | Preview
    Season 3 | Episode 4 Preview
    July 17, 2015

After change

    To Catch A Comet - Full Episode
    The Crimson Field - Episode 5 | Preview
    Last Tango in Halifax - Season 3 | Episode 4 Preview
    Charlie Rose The Week - July 17, 2015
fnord 7a4a945f13 fix/support news.vice.com
Sergey M․ 1d18e26eca [francetv] Remove unused import
Sergey M․ ac4b8df5e4 [francetv] Fix embed test
Sergey M․ 3bc9fb5889 [francetv] Update jt test
Sergey M․ 632cbb8efa [francetv] Fix f4m extraction completely
Sergey M․ 789a12aaaf [francetv] Restore support for jt videos
Sergey M․ ecdbe09e10 [francetv] Fix f4m extraction
Zach Bruggeman 1dc31c2786 [appleconnect] Add new extractor (fixes )
Closes .
Jaime Marquínez Ferrándiz 32470bf619 [sportschau] Improve title extraction
The html '<title>' ends with '- sportschau.de', which shouldn't be part of the title.
Jaime Marquínez Ferrándiz 8b61bfd638 [sportschau] skip download in test
slangangular 8a7a208905 [sportschau] Add support for sportschau.de
Closes .
Jaime Marquínez Ferrándiz 0215103e92 [francetv] Remove unused import
Yen Chi Hsuan c2d1be8981 [iqiyi] Add skip_download to reduce network traffic
MD5 checksums are commented out in
36068ae019, and actual downloads are not
necessary anymore.
Roland Hieber 726adc43ec [tagesschau] set description=None for empty descriptions
Roland Hieber 3c6ae8b59e [tagesschau] add support for Bericht aus Berlin videos
Roland Hieber c51bc70e0f [tagesschau] fix test which links to nonexisting video
Roland Hieber e89d7e3029 [tagesschau] add support for more video types
I found that currently only tagesschau videos are played. There are some
more shows hosted on tagesschau.de (see [0] for example) which are
easily playable by adjusting the regex. So this patch adds support for:
* tagesthemen
* tagesschau vor 20 Jahren
* tagesschau (mit Gebärdensprache)
* nachtmagazin

Note that some videos don't provide a description, so in order for the
tests to succeed, an ExtractorError needs to get caught.

[0]: http://www.tagesschau.de/multimedia/video/videoarchiv2~_date-20150714.html
remitamine 3c07a729a6 [shahid] don't fail on missing info
remitamine 84c0ed50a5 [shahid] fix backets closing
remitamine 02c126a7c2 [shahid] raise ExtractorError instead of warning
remitamine 114ed20e64 [shahid] Add new extractor
Yen Chi Hsuan 4b0f45f667 Merge branch 'sceext2-fix-iqiyi-2015-07-17'
Yen Chi Hsuan 36068ae019 [iqiyi] Comment out some MD5 sums
The value is different on Travis CI server
remitamine 9d681c2bb3 remove unnecessary group name
remitamine 3af1fac7b0 [dcn] Add new extractor
Yen Chi Hsuan 761ee0d827 [iqiyi] Remove unused imports
Sergey M․ 826a7da808 [rtlnl] Avoid episodes completely (Closes )
Sergey M․ cbd55ade68 [extractor/generic] Add support for francetv embeds
Sergey M․ 5705ee6ef8 [francetv] Fix duration extraction
Sergey M․ 3f5c6d0c1b [francetv] Add support for embeds and clean up _VALID_URL
linhua55 bfed4813b2 fix extraction
for http://www.tudou.com/albumplay/cJAHGih4yYg.html
Sergey M․ e58066e244 [vk] Add age restricted video test for reference
Sergey M․ ee48b6a88f [vk] Capture error message
Sergey M․ 9ac09ed4de [bliptv] Remove unused import
Sergey M․ fec73daaa3 [vk:uservideos] Revert orderedSet
Sergey M․ c6b68648f4 [bilibili] Show georestriction error
Sergey M․ 1ecb5d1d83 [vk] Clarify extractor names
Sergey M․ dc786d3db5 [vk:uservideos] Improve extraction
Sergey M․ 74fe23ec35 [extractor/common] Style
sceext 1b541d8d6e [iqiyi] fix iqiyi (2015-07-17), update the md5 salt (enc_key) to iqiyi latest (2015-07-17) flash player.
Sergey M․ f29ac588dd [nationalgeographics] Fix extraction (Closes )
Sergey M․ 0696667734 [twitch:stream] Clarify channel_id reassignment rationale ()
Sergey M․ 1793d71db6 [twitch:stream] Fix channel_id in different case (Closes )
Sergey M․ 4211e1941b [videomega] Add shortcut to _VALID_URL
Sergey M․ 4bdfef5a18 [videomega] Add tests
Sergey M․ 8a37f53685 [videomega] Revert iframe URL
Sergey M․ 4e1ad6e9a8 [videomega] Extend _VALID_URL and improve extraction (Closes )
Sergey M․ 3c283a381e [sbs] Simplify
Sergey M․ dac4d5be12 Merge branch 'sbs_website_changes' of https://github.com/seamusphelan/youtube-dl into seamusphelan-sbs_website_changes
Sergey M․ 530857182d [bliptv] Add test with missing duration
Sergey M․ 9441f77faa [bliptv] Use xpath for extraction and fix test
Sergey M․ 6b19647d57 [veehd] Use compat_urllib_parse_unquote
Sergey M․ 7bd42d0d96 [openfilm] Fix compat_urllib_parse_unquote_plus import