Commit Graph

6584 Commits (5625bd0617d6c661c66049b420556ae442102ffc)

Author SHA1 Message Date
Yen Chi Hsuan db9bd5267f [keezmovies] Fix extraction
Also fixes 
remitamine ab3b773bbe [acast] change tests into more stable casts and work with channel extractor only if it didn't match cast regex
Yen Chi Hsuan 0bc4ee60e0 [bbc] Fix test_BBC_6
Yen Chi Hsuan a3ef0e1cdd [bbc.co.uk] Skip removed test video
Yen Chi Hsuan 679bacf0b5 [bbc.co.uk] Fix test_BBCCoUk
This is similar to the one in , So also fixes .
remitamine 02e3952f3b [trilulilu] handle errors
Yen Chi Hsuan 64b7e89c0c [srf] Support audios (closes )
remitamine bee4c5571a [clipfish] improve extraction
remitamine 96929dd1e8 [skynewsarabia] fix extractor name
remitamine 53e06b2507 [ooyala] fix duration scale
remitamine b80d4bebf3 [nba] fix extraction errors
Jaime Marquínez Ferrándiz 55bec9b658 [clipfish] Remove unused import and style fix
Jaime Marquínez Ferrándiz 2a63b0f110 [mixcloud] Fix extraction of the audio url (fixes )
remitamine 07b88cffce Merge pull request from remitamine/acast
[acast] Add new extractor
remitamine 58c8451f36 Merge pull request from remitamine/gameinformer
[gameinformer] Add new extractor(closes )
remitamine 3047121c63 Merge pull request from remitamine/adobetv
[adobetv] improve extraction and add support specific language video,show and channel extraction
remitamine 7079f8ff1f [adobetv] use compat_str
remitamine 2c3b9f3570 [adobetv] use a variable for api base url
remitamine fad2428f47 [gameinformer] split long line
remitamine c3d3110f6a Merge pull request from remitamine/ooyala
[ooyala] extract more formats and metadata
remitamine 79ec00276c Merge pull request from remitamine/clipfish
[clipfish] improve info extraction
remitamine 9c117d345f [nba] improve(fixes )
* extract more formats
* extract videos from team mini sites
* extract more metadata
remitamine 46cc1c65a4 [nba] use xpath utils
remitamine 71d9fe7818 [trilulilu] improve extraction
remitamine 4ccabf93db [trilulilu] fix info extraction
remitamine 6612a34939 [bilibili] flake8
remitamine e5b4225f7c [audimedia] flake8
remitamine 76ab842d9b [bilibili] use xpath_text and catch errors in xml document
remitamine 78653a33aa Merge remote-tracking branch 'upstream/master' into bliptv
remitamine 24dc1ed715 Merge pull request from remitamine/audimedia
[audimedia] Add new extractor(closes )
remitamine 640bb54e73 Merge branch 'master' of https://github.com/rg3/youtube-dl into bilibili
Sergey M․ e0977d7686 [beeg] Decrypt URL (Closes )
remitamine 112ab398db Merge pull request from remitamine/skynewarabia
[skynewsarabia] Add new extractor
Sergey M․ af93fcfa05 [beeg] Update API URL (Closes )
Sergey M․ 62d231c004 [extractor/common] Clarify duration can be float
Sergey M․ 49358274d7 [bbc] Fix _VALID_URL
Jaime Marquínez Ferrándiz 7b1e379ca9 [gametrailers] Fix extraction (fixes )
They have stopped using the MTV system.
Sergey M․ 22d7368dfb [bbc] Extract _ID_REGEX and ad one more video id pattern (Closes )
Sergey M․ 24121bc703 [udemy] Make lecture downloading fatal
Sergey M․ 9fc87fa767 [udemy] Remove unused import
Sergey M․ 328f82d59a [udemy] Semi-switch to api 2.0 (Closes )
* Use api 2.0 to get lectures since it provides more formats
* Fix authorization for api 2.0
* Autotry enrolling in the course for single lectures
* Extract additional metadata rom asset['data']['outputs']
Sergey M․ 78717fc328 [udemy] Allow authentication via cookies
Sergey M․ 3b35c3425e [udemy] Extract formats from data.outputs ()
Sergey M․ 874ae0354e [nrk] Extract f4m formats and impose geo restriction only when not media URL (Closes )
Sergey M․ 4c6b4764f0 [youtube] Clarify itag 272 possible resolutions ()
Sergey M․ 59ee8a8647 [facebook] Make alternative title optional (Closes )
Sergey M․ af284305d5 [vodlocker] Capture file not found error (Closes )
Sergey M․ d53a4af1a4 [pornhub:playlist] Allow alphanumeric viewkeys (Closes )
Sergey M․ 2e1b928540 [youtube:playlist] Extend _VALID_URL
Sergey M․ 040ac68679 [youtube] Extend _VALID_URL (Closes )
Yen Chi Hsuan 049d71d874 [youtube] Simplify and make sure header values are strings
Sergey M․ bf2c8c8f82 [spiegel] Fix extraction (Closes )
Yen Chi Hsuan ac5a69af45 [youtube] Disable compression for live streams
remitamine 46b4070f3f Merge pull request from remitamine/cspan
[cspan] correct the clip info extraction (fixes )
remitamine 2a776f9788 [cspan] change into a function
remitamine f4c7ef9862 [skynewsarabia] return empty categories array if there is no topic
remitamine 50e12e9df1 [acast] Add new extractor
Sergey M․ b7faebbac8 [bloomberg] Improve formats extraction
Sergey M․ 4191fdf147 [bloomberg] Improve video id regex
Sergey M․ 9a4f12be98 [bloomberg] Modernize
Sergey M․ 7ad4258add [bloomberg] Relax _VALID_URL even more (Closes )
Sergey M․ 5faf9fed7e [youtube] Clarify rationale for yt:stretch validation
Sergey M 13a9b69b09 Merge pull request from lalinsky/yt-stretch-zero-height
[youtube] Ignore yt:stretch with zero width/height
remitamine 4975650e00 [skynewsarabia] fix IE_NAME
remitamine 0cc7178546 [skynewsarabia] Add new extractor
Lukáš Lalinský 41f24c321d [youtube] Use the existing `w` and `h` variables
Sergey M․ 7ac40086f5 [dbtv] Expand _VALID_URL (Closes )
Lukáš Lalinský 313dfc45f5 [youtube] Ignore yt:stretch with zero width/height
remitamine 60121eb514 [gameinformer] Add new extractor
remitamine 527ca1da4f [audimedia] Add new extractor(closes )
Sergey M? 5c2266df4b Switch codebase to use sanitized_Request instead of
compat_urllib_request.Request

[downloader/dash] Use sanitized_Request

[downloader/http] Use sanitized_Request

[atresplayer] Use sanitized_Request

[bambuser] Use sanitized_Request

[bliptv] Use sanitized_Request

[brightcove] Use sanitized_Request

[cbs] Use sanitized_Request

[ceskatelevize] Use sanitized_Request

[collegerama] Use sanitized_Request

[extractor/common] Use sanitized_Request

[crunchyroll] Use sanitized_Request

[dailymotion] Use sanitized_Request

[dcn] Use sanitized_Request

[dramafever] Use sanitized_Request

[dumpert] Use sanitized_Request

[eitb] Use sanitized_Request

[escapist] Use sanitized_Request

[everyonesmixtape] Use sanitized_Request

[extremetube] Use sanitized_Request

[facebook] Use sanitized_Request

[fc2] Use sanitized_Request

[flickr] Use sanitized_Request

[4tube] Use sanitized_Request

[gdcvault] Use sanitized_Request

[extractor/generic] Use sanitized_Request

[hearthisat] Use sanitized_Request

[hotnewhiphop] Use sanitized_Request

[hypem] Use sanitized_Request

[iprima] Use sanitized_Request

[ivi] Use sanitized_Request

[keezmovies] Use sanitized_Request

[letv] Use sanitized_Request

[lynda] Use sanitized_Request

[metacafe] Use sanitized_Request

[minhateca] Use sanitized_Request

[miomio] Use sanitized_Request

[meovideo] Use sanitized_Request

[mofosex] Use sanitized_Request

[moniker] Use sanitized_Request

[mooshare] Use sanitized_Request

[movieclips] Use sanitized_Request

[mtv] Use sanitized_Request

[myvideo] Use sanitized_Request

[neteasemusic] Use sanitized_Request

[nfb] Use sanitized_Request

[niconico] Use sanitized_Request

[noco] Use sanitized_Request

[nosvideo] Use sanitized_Request

[novamov] Use sanitized_Request

[nowness] Use sanitized_Request

[nuvid] Use sanitized_Request

[played] Use sanitized_Request

[pluralsight] Use sanitized_Request

[pornhub] Use sanitized_Request

[pornotube] Use sanitized_Request

[primesharetv] Use sanitized_Request

[promptfile] Use sanitized_Request

[qqmusic] Use sanitized_Request

[rtve] Use sanitized_Request

[safari] Use sanitized_Request

[sandia] Use sanitized_Request

[shared] Use sanitized_Request

[sharesix] Use sanitized_Request

[sina] Use sanitized_Request

[smotri] Use sanitized_Request

[sohu] Use sanitized_Request

[spankwire] Use sanitized_Request

[sportdeutschland] Use sanitized_Request

[streamcloud] Use sanitized_Request

[streamcz] Use sanitized_Request

[tapely] Use sanitized_Request

[tube8] Use sanitized_Request

[tubitv] Use sanitized_Request

[twitch] Use sanitized_Request

[twitter] Use sanitized_Request

[udemy] Use sanitized_Request

[vbox7] Use sanitized_Request

[veoh] Use sanitized_Request

[vessel] Use sanitized_Request

[vevo] Use sanitized_Request

[viddler] Use sanitized_Request

[videomega] Use sanitized_Request

[viewvster] Use sanitized_Request

[viki] Use sanitized_Request

[vk] Use sanitized_Request

[vodlocker] Use sanitized_Request

[voicerepublic] Use sanitized_Request

[wistia] Use sanitized_Request

[xfileshare] Use sanitized_Request

[xtube] Use sanitized_Request

[xvideos] Use sanitized_Request

[yandexmusic] Use sanitized_Request

[youku] Use sanitized_Request

[youporn] Use sanitized_Request

[youtube] Use sanitized_Request

[patreon] Use sanitized_Request

[extractor/common] Remove unused import

[nfb] PEP 8
Sergey M․ 67dda51722 Rename compat_urllib_request_Request to sanitized_Request and move to utils
Sergey M․ e4c4bcf36f [vimeo] Use compat_urllib_request_Request
Sergey M․ 9022726446 [youtube] Fix test
Sergey M․ 94bfcd23b7 [youtube] Fix test
Sergey M․ 526b3b0716 [youtube] Clarify ytplayer.config extraction rationale
Sergey M․ 61f92af1cf [youtube] Add test with '};' in tags
Sergey M․ a72778d364 [youtube] Improve ytplayer.config extraction
Sergey M 5ae17037a3 Merge pull request from lalinsky/fix-youtube
[youtube] More explicit player config JSON extraction (fixes )
Sergey M․ 02f0da20b0 [pluralsight] Add support for alternative webpage layout (Closes )
Lukáš Lalinský b41631c4e6 [youtube] Send the list of patterns directly to _search_regex
Lukáš Lalinský 0e49d9a6b0 [youtube] Fall back to the original regex for ytplayer.config
Sergey M․ 4a7d108ab3 [rutube] Remove unnecessary print
Lukáš Lalinský 3cfd000849 [youtube] More explicit player config JSON extraction (fixes )
Sergey M․ 1b38185361 [pornhd] Fix title extraction (Closes )
Sergey M․ e568c2233e [youtube] Add test for multi page list of playlists
Sergey M․ 061a75edd6 [youtube] Extract base for entry list extractors and support multi page lists of playlists
Sergey M․ 136dadde95 [youtube:show] Rework in terms of playlists base extractor
Sergey M․ 0c14841585 [youtube:user:playlists] Add extractor (Closes )
Sergey M․ 0eebf34d9d [pluralsight] Rephrase
Sergey M․ cf186b77a7 [pluralsight] Clarify allowed qualities guessing rationale
Sergey M․ a3372437bf [soundcloud] Remove unused variable
Sergey M․ 4c57b4853d [pluralsight] Until listing formats request only single format
Sergey M․ 38eb2968ab [pluralsight] Clarify and randomize ViewClip sleep interval
Andrzej Lichnerowicz bea56c9569 [pluralsight] prevent error 429 when sensing video formats
Sergey M․ 7e508ff2cf [pluralsight] Improve login detection
Sergey M․ 563772eda4 [pluralsight] Extract base class
Sergey M․ 0533915aad [pluralsight] Update some more URLs
Sergey M․ c3a227d1c4 [pluralsight] Update _LOGIN_URL
Sergey M․ f6c903e708 [soundcloud:search] Simplify (Closes )
Sergey M․ 7dc011c063 [soundcloud:search] Remove no track results message
Sergey M․ 4e3b303016 [soundcloud:search] Fix non-ASCII searches
Sergey M․ 7e3472758b [soundcloud:search] PEP 8
reiv 328a22e175 [soundcloud] Remove limit on search results
reiv 417b453699 [soundcloud] Use correct error message conventions
reiv 6ea7190a3e Rewrite as list comprehension.
reiv b54b08c91b Simplify with itertools.islice().
reiv c30943b1c0 Fix some compatibility issues, cleanup.
reiv 2abf7cab80 [soundcloud] Add Soundcloud search extractor
Sergey M․ 4137196899 [rutube] Extract all formats
Sergey M․ 019839faaa [extractor/common] Use baseURL from f4m manifest for recursive manifest extraction
Sergey M․ f52183a878 [rutube:embed] Extend _VALID_URL (Closes )
Yen Chi Hsuan 750b9ff032 [generic] Extract M3U8 formats (closes )
Yen Chi Hsuan 28602e747c [generic] Refactor
Yen Chi Hsuan 6cc37c69e2 [generic] Unescape URLs from JWPlayer ()
Sergey M․ a5cd0eb8a4 [pluralsight:course] Improve _VALID_URL
Sergey M․ c23e266427 [pluralsight] Do not require pluralsight account
Looks like some courses are available without pluralsight account
Sergey M․ 651acffbe5 [pluralsight] Update ViewClip URL
Sergey M․ 71bd93b89c [pluralsight] Do not rely on argument order in query (Closes )
Sergey M․ 6da620de58 [kaltura] Add test for referrer protected video ()
Sergey M․ bdceea7afd [kaltura] Clean description
Sergey M․ d80a39cec8 [kaltura] Improve
Sergey M․ 5b5fae5f20 [generic] Use referrer from source kaltura embed URLs ()
Sergey M․ 01b06aedcf [kaltura] Add support for referrer protected videos ()
Sergey M․ 67446fd49b [instagram] Improve _VALID_URL (Closes )
Sergey M․ 325bb615a7 [theplatform] Style
Sergey M․ ee5cd8418e [theplatform] Handle protocolless feed URLs (Closes )
Sergey M․ 342609a1b4 [bloomberg] Reax _VALID_URL (Closes )
Sergey M․ 6b7ceee1b9 [vimeo] Add test for
Sergey M․ fdb20a27a3 [vimeo:group] Improve _VALID_URL (Closes )
Sergey M․ 2c94198eb6 [vimeo] Improve playlists extraction
Yen Chi Hsuan c39fd7b1ca [UDNEmbed] Fix generic UDN pages
Closes 
Sergey M․ a9c09a7c62 [pbs] Update API URL (Closes )
Jaime Marquínez Ferrándiz 63b4295d20 [youtube:playlist] fix title extraction (fixes and )
Sergey M․ 312a3f389b [pbs] Extend _VALID_URL
Jaime Marquínez Ferrándiz 609af1ae1c [dplay] Add 'encoding: utf-8' line
Jaime Marquínez Ferrándiz 4cd759f73d [dplay] Add extractor (closes )
Since I haven't figured out how to download the hds stream, we use the hls one instead.
Jaime Marquínez Ferrándiz e156e70281 [rtve] Remove unused import
Sergey M․ 9b464929fe [rtve.es:alacarta] Fix extraction
ping 76adc82068 [neteasemusic] Fixes
Sergey M․ 9a4acbfaf5 [theplatform] Add test for
Sergey M․ ad1f4e7902 [theplatform] Handle explicitly specified SMIL ()
Sergey M․ 2ff7cbeaaa [nowtv:list] Add extrator (Closes )
Sergey M․ b2f7738830 [dumpert] Use original protocol
Sergey M․ dc0279532a [dumpert] Disable SSL (Closes )
Sergey M․ 0c59d02bdc [periscope] Relax _VALID_URL (Closes )
Jaime Marquínez Ferrándiz 0f72beb515 [periscope] Remove unused imports
Sergey M․ d781e29316 [bbc] Allow selectionunavailable errors (Closes )
Sergey M․ 3b3e8ed332 [quickscope] Remove extractor (2)
Sergey M․ dcdfeb33d2 [quickscope] Remove extractor
Sergey M․ 0d85c3a732 [lynda] Style
Sergey M․ 903d136942 [lynda] Logout only when login info present (Closes )
Yen Chi Hsuan 9d584da7d0 [xfileshare] Correct _VALID_URL
Yen Chi Hsuan 31752f76f7 [twitter:card] Add add_ie for the external test
Yen Chi Hsuan 5f1b2aea80 [twitter:card] Support vine.co embeds (closes )
Sergey M․ 4479600d57 [instagram] Add test for
Sergey M․ a90189c3ad [instagram] Relax _VALID_URL (Closes )
Sergey M․ d8a1caf04f [brightcove:new] Style
Sergey M․ cb33d389ed [brightcove:new] Add test with rtmp streams
Sergey M․ e01b432ad3 [brightcove:new] Fix test
Sergey M․ fd91257c40 [brightcove] Order imports alphabetically
Sergey M․ 75eac8961e [brightcove] Remove unused import
Sergey M․ 3b7d9aa487 Rename all references to legacy studio Brightcove extractor
Sergey M․ 1f4b722b00 [generic] Clarify Brightcove Legacy Studio comment
Sergey M․ f6519f89b0 [generic] Extract Brightcove New Studio embeds
Sergey M․ 24af85298e [brightcove] Fix _extract_urls
Sergey M․ e721d857c2 [brightcove] Clarify IE_NAMEs
Sergey M․ 5c17f0a67a [brightcove:embedinpage] Rename extractor to brightcove new
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
Sergey M․ 4fcaa4f4a5 [brightcove] Rename extractor to brightcove legacy
Old embedding approaches are now "Legacy Studio"
Sergey M․ 536f819eda [brightcove] Imrove extraction of new embeds
Sergey M․ a662489877 [brightcove:embedinpage] Make more robust and extract rtmp streams
Sergey M․ a2973eb597 Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed
Sergey M․ 4e21b3a94f [cbs] Use android UA for higher quality streams (Closes )
Jaime Marquínez Ferrándiz b703ebeeaf [twitter] Don't fail if the description doesn't contain an URL (fixes )
Jaime Marquínez Ferrándiz b84a5f0337 [twitter] Update tests checksums
Sergey M․ 91d644b5ba [ruutu] Relax formats extraction
Sergey M․ 5d6c3d6a66 [ruutu] Skip NOT-USED URLs(Closes )
Jaime Marquínez Ferrándiz 1ebb4717df [cbsnews] Fix construction of 'play_path' in some videos (fixes )
Yen Chi Hsuan cf5881fc4d Credit @ferama
For providing idea for vidto.me () and extending nowvideo support ()
Sergey M․ fcd817a326 [vimeo] Fix extraction (Closes )
Sergey M․ 031ec536f0 [gorillavid] Rename to xfileshare
Sergey M․ 668db403f9 [gorillavid] Add test for vidto.me and strip title
Sergey M․ b9ad101926 [gorillavid] Add support for vidto.me
Sergey M․ 435911029f [vidto] Remove extractor
Sergey M․ 699ed30cee [novamov] Modernize
Sergey M․ 9eab37dca0 [vimeo] Simplify set cookie
Sergey M․ 9a8a12b7d8 [vimeo] Append cookies instead of overriding
Yen Chi Hsuan a4c2ab35c1 Merge remote-tracking branch 'upstream/master'
Sergey M․ 3d9c4bf09a [vimeo] Fix password protected videos (Closes )
Yen Chi Hsuan 8b8a39e279 [vidto] Several simplifications and improvements
1. Use InfoExtractor._hidden_inputs
2. Fetch title from <title> tag
3. Cookies are preserved automatically
4. Use single quotes everywhere
5. Do not declare variables for one-time use only
Sergey M․ 82393e2bb2 [novamov] Follow continue-to-the-video button if any (Closes )
Sergey M․ 2eb99a4b98 [nowvideo] Replace main host to resolvable one
Yen Chi Hsuan 990e6e8fa3 [vidto] Minor fixes
1. import order
2. fatal is already True in helper functions
Rémy Léone d8b7e80d29 Remove duplicate key
Yen Chi Hsuan 37120974dc [vidto] PEP8
Marco Ferragina 42fc93c709 vidto extractor: code cleanup
Marco Ferragina a625e56543 [vidto] Add extractor
Sergey M․ 9b738b2caa [funnyordie] Fix extraction and extract m3u8 formats
Yen Chi Hsuan 50f84a9ae1 [youtube] Support new base.js html5 player
Sergey M․ b25f753397 [kaltura] Relax _VALID_URL