Commit Graph

9000 Commits (8e60dc7526596f456c0b5d7dc48daa6cae08ebb6)

Author SHA1 Message Date
Yen Chi Hsuan 0bc4ee60e0 [bbc] Fix test_BBC_6
Yen Chi Hsuan a3ef0e1cdd [bbc.co.uk] Skip removed test video
Yen Chi Hsuan 679bacf0b5 [bbc.co.uk] Fix test_BBCCoUk
This is similar to the one in , So also fixes .
remitamine 02e3952f3b [trilulilu] handle errors
Yen Chi Hsuan 64b7e89c0c [srf] Support audios (closes )
remitamine bee4c5571a [clipfish] improve extraction
remitamine 96929dd1e8 [skynewsarabia] fix extractor name
remitamine 53e06b2507 [ooyala] fix duration scale
remitamine b80d4bebf3 [nba] fix extraction errors
Jaime Marquínez Ferrándiz 55bec9b658 [clipfish] Remove unused import and style fix
Jaime Marquínez Ferrándiz 2a63b0f110 [mixcloud] Fix extraction of the audio url (fixes )
remitamine 07b88cffce Merge pull request from remitamine/acast
[acast] Add new extractor
remitamine 58c8451f36 Merge pull request from remitamine/gameinformer
[gameinformer] Add new extractor(closes )
remitamine 3047121c63 Merge pull request from remitamine/adobetv
[adobetv] improve extraction and add support specific language video,show and channel extraction
remitamine 7079f8ff1f [adobetv] use compat_str
remitamine 2c3b9f3570 [adobetv] use a variable for api base url
remitamine fad2428f47 [gameinformer] split long line
remitamine c3d3110f6a Merge pull request from remitamine/ooyala
[ooyala] extract more formats and metadata
remitamine 79ec00276c Merge pull request from remitamine/clipfish
[clipfish] improve info extraction
remitamine 9c117d345f [nba] improve(fixes )
* extract more formats
* extract videos from team mini sites
* extract more metadata
remitamine 46cc1c65a4 [nba] use xpath utils
remitamine 71d9fe7818 [trilulilu] improve extraction
remitamine 4ccabf93db [trilulilu] fix info extraction
remitamine 6612a34939 [bilibili] flake8
remitamine e5b4225f7c [audimedia] flake8
remitamine 76ab842d9b [bilibili] use xpath_text and catch errors in xml document
remitamine 24dc1ed715 Merge pull request from remitamine/audimedia
[audimedia] Add new extractor(closes )
remitamine 640bb54e73 Merge branch 'master' of https://github.com/rg3/youtube-dl into bilibili
Sergey M․ e0977d7686 [beeg] Decrypt URL (Closes )
remitamine 112ab398db Merge pull request from remitamine/skynewarabia
[skynewsarabia] Add new extractor
Sergey M․ af93fcfa05 [beeg] Update API URL (Closes )
Sergey M․ 62d231c004 [extractor/common] Clarify duration can be float
Sergey M․ 49358274d7 [bbc] Fix _VALID_URL
Jaime Marquínez Ferrándiz 7b1e379ca9 [gametrailers] Fix extraction (fixes )
They have stopped using the MTV system.
Sergey M․ 22d7368dfb [bbc] Extract _ID_REGEX and ad one more video id pattern (Closes )
Sergey M․ 24121bc703 [udemy] Make lecture downloading fatal
Sergey M․ 9fc87fa767 [udemy] Remove unused import
Sergey M․ 328f82d59a [udemy] Semi-switch to api 2.0 (Closes )
* Use api 2.0 to get lectures since it provides more formats
* Fix authorization for api 2.0
* Autotry enrolling in the course for single lectures
* Extract additional metadata rom asset['data']['outputs']
Sergey M․ 78717fc328 [udemy] Allow authentication via cookies
Sergey M․ 3b35c3425e [udemy] Extract formats from data.outputs ()
Sergey M․ 874ae0354e [nrk] Extract f4m formats and impose geo restriction only when not media URL (Closes )
Sergey M․ 4c6b4764f0 [youtube] Clarify itag 272 possible resolutions ()
Sergey M․ 59ee8a8647 [facebook] Make alternative title optional (Closes )
Sergey M․ af284305d5 [vodlocker] Capture file not found error (Closes )
Sergey M․ d53a4af1a4 [pornhub:playlist] Allow alphanumeric viewkeys (Closes )
Sergey M․ 2e1b928540 [youtube:playlist] Extend _VALID_URL
Sergey M․ 040ac68679 [youtube] Extend _VALID_URL (Closes )
Yen Chi Hsuan 049d71d874 [youtube] Simplify and make sure header values are strings
Sergey M․ bf2c8c8f82 [spiegel] Fix extraction (Closes )
Yen Chi Hsuan 992fc9d6e1 [utils] Refactor handle_youtubedl_headers for future extension
Yen Chi Hsuan 0424ec307b [utils] Correct docstring of YoutubeDLHandler
Yen Chi Hsuan ac5a69af45 [youtube] Disable compression for live streams
Yen Chi Hsuan 94e8c80473 [downloader/hls] Respect Youtubedl-* headers
Yen Chi Hsuan 87f0e62d94 [utils] Separate codes for handling Youtubedl-* headers
remitamine 46b4070f3f Merge pull request from remitamine/cspan
[cspan] correct the clip info extraction (fixes )
remitamine 2a776f9788 [cspan] change into a function
remitamine f4c7ef9862 [skynewsarabia] return empty categories array if there is no topic
remitamine 50e12e9df1 [acast] Add new extractor
Sergey M․ b7faebbac8 [bloomberg] Improve formats extraction
Sergey M․ 4191fdf147 [bloomberg] Improve video id regex
Sergey M․ 9a4f12be98 [bloomberg] Modernize
Sergey M․ 7ad4258add [bloomberg] Relax _VALID_URL even more (Closes )
Sergey M․ 5faf9fed7e [youtube] Clarify rationale for yt:stretch validation
Sergey M 13a9b69b09 Merge pull request from lalinsky/yt-stretch-zero-height
[youtube] Ignore yt:stretch with zero width/height
remitamine 4975650e00 [skynewsarabia] fix IE_NAME
remitamine 0cc7178546 [skynewsarabia] Add new extractor
Lukáš Lalinský 41f24c321d [youtube] Use the existing `w` and `h` variables
Yen Chi Hsuan 4b3fbafdd2 [options] Changed wording for --list-formats
As proposed by @dstftw at 9bff48a0e7
Sergey M․ 7ac40086f5 [dbtv] Expand _VALID_URL (Closes )
Lukáš Lalinský 313dfc45f5 [youtube] Ignore yt:stretch with zero width/height
Philipp Hagemeister 78a55d7a28 release 2015.11.27.1
Philipp Hagemeister bb6ac83698 release 2015.11.27
Yen Chi Hsuan 9d0e366880 [downloader/hls] Remove Accept-encoding from headers passed to ffmpeg
Fails for Youtube Gaming live streams ()
Yen Chi Hsuan 9bff48a0e7 [options] Clarify --list-formats needs videos (closes )
remitamine 60121eb514 [gameinformer] Add new extractor
remitamine 527ca1da4f [audimedia] Add new extractor(closes )
Philipp Hagemeister ba7a92b0ce release 2015.11.24
Philipp Hagemeister 4c7d816dd7 [jsinterp] Adapt to updated YouTube code generation (Fixes , fixes , fixes , fixes )
Philipp Hagemeister 20e98bf6c0 release 2015.11.23
Sergey M? 5c2266df4b Switch codebase to use sanitized_Request instead of
compat_urllib_request.Request

[downloader/dash] Use sanitized_Request

[downloader/http] Use sanitized_Request

[atresplayer] Use sanitized_Request

[bambuser] Use sanitized_Request

[bliptv] Use sanitized_Request

[brightcove] Use sanitized_Request

[cbs] Use sanitized_Request

[ceskatelevize] Use sanitized_Request

[collegerama] Use sanitized_Request

[extractor/common] Use sanitized_Request

[crunchyroll] Use sanitized_Request

[dailymotion] Use sanitized_Request

[dcn] Use sanitized_Request

[dramafever] Use sanitized_Request

[dumpert] Use sanitized_Request

[eitb] Use sanitized_Request

[escapist] Use sanitized_Request

[everyonesmixtape] Use sanitized_Request

[extremetube] Use sanitized_Request

[facebook] Use sanitized_Request

[fc2] Use sanitized_Request

[flickr] Use sanitized_Request

[4tube] Use sanitized_Request

[gdcvault] Use sanitized_Request

[extractor/generic] Use sanitized_Request

[hearthisat] Use sanitized_Request

[hotnewhiphop] Use sanitized_Request

[hypem] Use sanitized_Request

[iprima] Use sanitized_Request

[ivi] Use sanitized_Request

[keezmovies] Use sanitized_Request

[letv] Use sanitized_Request

[lynda] Use sanitized_Request

[metacafe] Use sanitized_Request

[minhateca] Use sanitized_Request

[miomio] Use sanitized_Request

[meovideo] Use sanitized_Request

[mofosex] Use sanitized_Request

[moniker] Use sanitized_Request

[mooshare] Use sanitized_Request

[movieclips] Use sanitized_Request

[mtv] Use sanitized_Request

[myvideo] Use sanitized_Request

[neteasemusic] Use sanitized_Request

[nfb] Use sanitized_Request

[niconico] Use sanitized_Request

[noco] Use sanitized_Request

[nosvideo] Use sanitized_Request

[novamov] Use sanitized_Request

[nowness] Use sanitized_Request

[nuvid] Use sanitized_Request

[played] Use sanitized_Request

[pluralsight] Use sanitized_Request

[pornhub] Use sanitized_Request

[pornotube] Use sanitized_Request

[primesharetv] Use sanitized_Request

[promptfile] Use sanitized_Request

[qqmusic] Use sanitized_Request

[rtve] Use sanitized_Request

[safari] Use sanitized_Request

[sandia] Use sanitized_Request

[shared] Use sanitized_Request

[sharesix] Use sanitized_Request

[sina] Use sanitized_Request

[smotri] Use sanitized_Request

[sohu] Use sanitized_Request

[spankwire] Use sanitized_Request

[sportdeutschland] Use sanitized_Request

[streamcloud] Use sanitized_Request

[streamcz] Use sanitized_Request

[tapely] Use sanitized_Request

[tube8] Use sanitized_Request

[tubitv] Use sanitized_Request

[twitch] Use sanitized_Request

[twitter] Use sanitized_Request

[udemy] Use sanitized_Request

[vbox7] Use sanitized_Request

[veoh] Use sanitized_Request

[vessel] Use sanitized_Request

[vevo] Use sanitized_Request

[viddler] Use sanitized_Request

[videomega] Use sanitized_Request

[viewvster] Use sanitized_Request

[viki] Use sanitized_Request

[vk] Use sanitized_Request

[vodlocker] Use sanitized_Request

[voicerepublic] Use sanitized_Request

[wistia] Use sanitized_Request

[xfileshare] Use sanitized_Request

[xtube] Use sanitized_Request

[xvideos] Use sanitized_Request

[yandexmusic] Use sanitized_Request

[youku] Use sanitized_Request

[youporn] Use sanitized_Request

[youtube] Use sanitized_Request

[patreon] Use sanitized_Request

[extractor/common] Remove unused import

[nfb] PEP 8
Sergey M․ 67dda51722 Rename compat_urllib_request_Request to sanitized_Request and move to utils
Sergey M․ e4c4bcf36f [vimeo] Use compat_urllib_request_Request
Sergey M․ 82d8a8b6e2 [YoutubeDL] Wrap plain-text URL requests in compat_urllib_request_Request
Sergey M․ 13a10d5aa3 [compat] Add compat_urllib_request_Request
This is actually not a compatibility routine but rather a workaround for URLs without protocol specified.
The protocol-less URL is treated as HTTP one since it's most probable scenario and it will most likely to
redirect to HTTPS if HTTPS was actually expected. This routine could also be useful for any Request
preprocessing that may be added in future.
Sergey M․ 9022726446 [youtube] Fix test
Sergey M․ 94bfcd23b7 [youtube] Fix test
Sergey M․ 526b3b0716 [youtube] Clarify ytplayer.config extraction rationale
Sergey M․ 61f92af1cf [youtube] Add test with '};' in tags
Sergey M․ a72778d364 [youtube] Improve ytplayer.config extraction
Sergey M 5ae17037a3 Merge pull request from lalinsky/fix-youtube
[youtube] More explicit player config JSON extraction (fixes )
Sergey M․ 02f0da20b0 [pluralsight] Add support for alternative webpage layout (Closes )
Lukáš Lalinský b41631c4e6 [youtube] Send the list of patterns directly to _search_regex
Lukáš Lalinský 0e49d9a6b0 [youtube] Fall back to the original regex for ytplayer.config
Sergey M․ 4a7d108ab3 [rutube] Remove unnecessary print
Lukáš Lalinský 3cfd000849 [youtube] More explicit player config JSON extraction (fixes )
Sergey M․ 1b38185361 [pornhd] Fix title extraction (Closes )
Sergey M․ 9cb9a5df77 [utils] Check ext with trailing slash against the list of known extensions
Sergey M․ 3e12bc583a [utils] Improve determine_ext (Closes )
Sergey M․ e568c2233e [youtube] Add test for multi page list of playlists
Sergey M․ 061a75edd6 [youtube] Extract base for entry list extractors and support multi page lists of playlists
Philipp Hagemeister 82c4d7b0ce release 2015.11.21
Sergey M․ 136dadde95 [youtube:show] Rework in terms of playlists base extractor
Sergey M․ 0c14841585 [youtube:user:playlists] Add extractor (Closes )
Sergey M․ 0eebf34d9d [pluralsight] Rephrase
Sergey M․ cf186b77a7 [pluralsight] Clarify allowed qualities guessing rationale
Sergey M․ a3372437bf [soundcloud] Remove unused variable
Sergey M․ 4c57b4853d [pluralsight] Until listing formats request only single format
Sergey M․ 38eb2968ab [pluralsight] Clarify and randomize ViewClip sleep interval
Andrzej Lichnerowicz bea56c9569 [pluralsight] prevent error 429 when sensing video formats
Sergey M․ 7e508ff2cf [pluralsight] Improve login detection
Sergey M․ 563772eda4 [pluralsight] Extract base class
Sergey M․ 0533915aad [pluralsight] Update some more URLs
Sergey M․ c3a227d1c4 [pluralsight] Update _LOGIN_URL
Sergey M․ f6c903e708 [soundcloud:search] Simplify (Closes )
Sergey M․ 7dc011c063 [soundcloud:search] Remove no track results message
Sergey M․ 4e3b303016 [soundcloud:search] Fix non-ASCII searches
Sergey M․ 7e1f5447e7 [utils] Improve encode_dict
Sergey M․ 7e3472758b [soundcloud:search] PEP 8
reiv 328a22e175 [soundcloud] Remove limit on search results
reiv 417b453699 [soundcloud] Use correct error message conventions
reiv 6ea7190a3e Rewrite as list comprehension.
reiv b54b08c91b Simplify with itertools.islice().
reiv c30943b1c0 Fix some compatibility issues, cleanup.
reiv 2abf7cab80 [soundcloud] Add Soundcloud search extractor
Sergey M․ 4137196899 [rutube] Extract all formats
Sergey M․ 019839faaa [extractor/common] Use baseURL from f4m manifest for recursive manifest extraction
Sergey M․ f52183a878 [rutube:embed] Extend _VALID_URL (Closes )
Yen Chi Hsuan 750b9ff032 [generic] Extract M3U8 formats (closes )
Yen Chi Hsuan 28602e747c [generic] Refactor
Yen Chi Hsuan 6cc37c69e2 [generic] Unescape URLs from JWPlayer ()
Sergey M․ a5cd0eb8a4 [pluralsight:course] Improve _VALID_URL
Sergey M․ c23e266427 [pluralsight] Do not require pluralsight account
Looks like some courses are available without pluralsight account
Sergey M․ 651acffbe5 [pluralsight] Update ViewClip URL
Sergey M․ 71bd93b89c [pluralsight] Do not rely on argument order in query (Closes )
Sergey M․ 6da620de58 [kaltura] Add test for referrer protected video ()
Sergey M․ bdceea7afd [kaltura] Clean description
Sergey M․ d80a39cec8 [kaltura] Improve
Sergey M․ 5b5fae5f20 [generic] Use referrer from source kaltura embed URLs ()
Sergey M․ 01b06aedcf [kaltura] Add support for referrer protected videos ()
ashutosh-mishra 17cc153435 Typo fix, found while going through the code.
Sergey M․ 67446fd49b [instagram] Improve _VALID_URL (Closes )
Sergey M․ 325bb615a7 [theplatform] Style
Sergey M․ ee5cd8418e [theplatform] Handle protocolless feed URLs (Closes )
Sergey M․ 342609a1b4 [bloomberg] Reax _VALID_URL (Closes )
Sergey M f270cf1a26 Merge pull request from barlik/master
Clarify that automatic subtitles are generated.
hedii 371c3b796c [YoutubeDL] Add playlist finished downloading message (Closes )
Conflicts:
	youtube_dl/YoutubeDL.py
Sergey M․ 6b7ceee1b9 [vimeo] Add test for
Sergey M․ fdb20a27a3 [vimeo:group] Improve _VALID_URL (Closes )
Sergey M․ 2c94198eb6 [vimeo] Improve playlists extraction
Philipp Hagemeister e8110b8125 release 2015.11.19
Yen Chi Hsuan c39fd7b1ca [UDNEmbed] Fix generic UDN pages
Closes 
Sergey M․ a9c09a7c62 [pbs] Update API URL (Closes )
Philipp Hagemeister 82beaabb41 release 2015.11.18
Jaime Marquínez Ferrándiz 63b4295d20 [youtube:playlist] fix title extraction (fixes and )
Sergey M․ 312a3f389b [pbs] Extend _VALID_URL
Jaime Marquínez Ferrándiz 609af1ae1c [dplay] Add 'encoding: utf-8' line
Jaime Marquínez Ferrándiz 4cd759f73d [dplay] Add extractor (closes )
Since I haven't figured out how to download the hds stream, we use the hls one instead.
Jaime Marquínez Ferrándiz e156e70281 [rtve] Remove unused import
Sergey M․ 9b464929fe [rtve.es:alacarta] Fix extraction
Sergey M 0c176d7bde Merge pull request from ping/patch-7301
[neteasemusic] Fixes 
Sergey M․ 7a3f0c00ad [utils] Style
Sergey M․ 7aefc49c40 [utils] Skip invalid/non HTML entities (Closes )
Rastislav Barlik 741dd8ea65 Clarify that automatic subtitles are generated.
It wasn't clear what automatic word mean.
ping 76adc82068 [neteasemusic] Fixes
Philipp Hagemeister bd1512d196 release 2015.11.15
Sergey M․ 9a4acbfaf5 [theplatform] Add test for
Sergey M․ ad1f4e7902 [theplatform] Handle explicitly specified SMIL ()
Sergey M b328295910 Merge pull request from davidbz/add_proxy_to_update_procedure
Add proxy support for update_self
David Ben Zakai 828b2a5cd9 Removing an unnecessary import
Sergey M․ 2ff7cbeaaa [nowtv:list] Add extrator (Closes )
Sergey M․ b2f7738830 [dumpert] Use original protocol
Sergey M․ dc0279532a [dumpert] Disable SSL (Closes )
Sergey M․ 0c59d02bdc [periscope] Relax _VALID_URL (Closes )
Jaime Marquínez Ferrándiz 0f72beb515 [periscope] Remove unused imports
Sergey M․ d781e29316 [bbc] Allow selectionunavailable errors (Closes )
Sergey M․ 3b3e8ed332 [quickscope] Remove extractor (2)
Sergey M․ dcdfeb33d2 [quickscope] Remove extractor
Sergey M․ 0d85c3a732 [lynda] Style
Sergey M․ 903d136942 [lynda] Logout only when login info present (Closes )
Yen Chi Hsuan 9d584da7d0 [xfileshare] Correct _VALID_URL
Yen Chi Hsuan 31752f76f7 [twitter:card] Add add_ie for the external test
Yen Chi Hsuan 5f1b2aea80 [twitter:card] Support vine.co embeds (closes )
Sergey M․ 4479600d57 [instagram] Add test for
Sergey M․ a90189c3ad [instagram] Relax _VALID_URL (Closes )
Sergey M․ d8a1caf04f [brightcove:new] Style
Sergey M․ cb33d389ed [brightcove:new] Add test with rtmp streams
Sergey M․ e01b432ad3 [brightcove:new] Fix test
Sergey M․ fd91257c40 [brightcove] Order imports alphabetically
Sergey M․ c7b959ce38 [utils] Remove unused function
Sergey M․ 75eac8961e [brightcove] Remove unused import
Sergey M․ 3b7d9aa487 Rename all references to legacy studio Brightcove extractor
Sergey M․ 1f4b722b00 [generic] Clarify Brightcove Legacy Studio comment
Sergey M․ f6519f89b0 [generic] Extract Brightcove New Studio embeds
Sergey M․ 24af85298e [brightcove] Fix _extract_urls
Sergey M․ e721d857c2 [brightcove] Clarify IE_NAMEs
Sergey M․ 5c17f0a67a [brightcove:embedinpage] Rename extractor to brightcove new
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
Sergey M․ 4fcaa4f4a5 [brightcove] Rename extractor to brightcove legacy
Old embedding approaches are now "Legacy Studio"
Sergey M․ 536f819eda [brightcove] Imrove extraction of new embeds
Sergey M․ a662489877 [brightcove:embedinpage] Make more robust and extract rtmp streams
Sergey M․ a2973eb597 Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed