Commit Graph

8284 Commits (41db73330835d6e8fe29ce18f869247a739467ce)

Author SHA1 Message Date
Sergey M․ 47004d9579 [crunchyroll] Fix uploader and upload date extraction
Sergey M․ 12810c9cd3 [crunchyroll] Force Accept-Language to any for all requests (Closes )
Sergey M․ 7a459170fa [__init__] Remove musicvault
Sergey M. 3cf0df568a Merge pull request from remitamine/musicvault
[musicvault] remove extractor
remitamine b88ebd472e [musicvault] remove extractor
remitamine 64997815c4 [ndr] add support for embeds
remitamine b1b7d1ffba [wimp] fix tests info
Jaime Marquínez Ferrándiz 4003bd82b0 [youtube:shows] Use https
remitamine 8801255d7d [youtube] fix show extraction (fixes )
Closes )
remitamine 3b18f539a7 [ndr] fix info extraction
Yen Chi Hsuan bc973e06d0 Merge pull request from remitamine/yahoo-tests
[yahoo] change test md5 checksum
remitamine cf33a47df0 [ajazzera] skip test
remitamine daeb0f04cd [yahoo] change test md5 checksum
Sergey M․ 97243fe395 [ceskatelevize] Extract playlists (Closes )
Sergey M․ 9dbdb65abe [techtvmit] Update test
Sergey M․ 9af461de35 [techtvmit] Fix extraction
Sergey M. 4d71e200c6 Merge pull request from remitamine/academicearth
[academicearth] fix test info
Sergey M. 8e0bdabed2 Merge pull request from remitamine/airmozilla
[airmozilla] fix test info
Sergey M․ bca553caac [eagleplatform] Fix extraction
remitamine a2f42a3baf [academicearth] fix test info
remitamine 7465222a9c [airmozilla] fix test info
Sergey M․ e28034c5ac [utils] Comment cookie processing until result from travis and some more testing
Sergey M․ 12bbd32ad0 [kuwo:singer] Skip test
Sergey M․ 266e466ee4 [utils] Simplify cookie processor
Sergey M․ cf83f532ae [niconico] Use encode_dict
Sergey M․ cd019668dc [niconico] Use encode_dict
Sergey M․ 515fc8776f [youtube] Use encode_dict
Sergey M․ c7c0996d8c [gorillavid] Add test for filehoot.com (Closes )
Sergey M․ b3e64671cc [gorillavid] Improve title
Sergey M․ 4abe214499 [gorillavid] Encode fields
Sergey M․ e94cb5ae7e [gorillavid] Add support for filehoot.com
Sergey M․ e213c98df1 [gorillavid] Build correct URL
Sergey M․ 1639282434 [utils] Add encode_dict
Sergey M․ be0e5dbd83 [extractor/common] Extract submit inputs
Sergey M․ ad72917274 [utils] Add issue URL in comment for
Sergey M․ 6a3f4c3f82 [YoutubeDL] Use custom cookie processor
Sergey M․ a6420bf50c [utils] Add cookie processor for cookie correction (Closes )
Sergey M․ eb387896e9 [adultswim] Fix extraction on python 2.6
remitamine f43c163158 [nowness] pass cinematique
remitamine 673bf566fc [nowness] more api abstraction
remitamine f95c5e1218 [nowness] change id variable name
remitamine f33f32f159 [nowness] add api abstration function adn extend _VALID_URL regex
Sergey M․ 8df5ae15d1 [compat] Fix python version check for compat_shlex_split
remitamine 75b399f455 [nowness] fix _VALID_URL regex
felix 12439dd5ec [generic] Capture <audio> tags in addition to <video> tags
Sergey M․ cab792abe5 [options] Use compat_shlex_split
Sergey M․ 8870358b1b [__init__] Use compat_shlex_split
Sergey M․ 51f579b635 [compat] Add compat shlex.split
remitamine c23c3d7d7d [nowness] fix video extraction and add support serie and playlist extraction (fixes )
Sergey M․ 4abf617b9c [YoutubeDL] Ensure bool params always present in downloader
Jaime Marquínez Ferrándiz 3026164b16 [postprocessor/common] Use 'self._downloader.params' instead of 'self.params'
'self.params' is not defined
Yen Chi Hsuan 9dd73ef4a4 [dcn] PEP8
Yen Chi Hsuan 08354db47b [vlive] PEP8
Yen Chi Hsuan 027eb5a6b0 Merge branch 'vlive' of https://github.com/ping/youtube-dl into ping-vlive
Sergey M․ 6270239a6d [postprocessor/common] Use generalized cli option converters
Sergey M․ 1195a38f46 [downloader/external] Use generalized cli option converters
Sergey M․ 66e289bab4 [utils] Generalize cli option converters
Sergey M. 52c6f26cab Merge pull request from remitamine/external_downloader_options
[downloader/external] Respect --no-check-certificate for curl and aria2c and --proxy for curl
remitamine dc534b674f [downloader/external] change _argless_option function to _valueless_option
remitamine f30c2e8e98 [downloader/external] add _argless_option for option without arguments
Jaime Marquínez Ferrándiz c482b3c69a [ruutu] Update test url
remitamine 266b0ad676 [downloader/external] add _bool_option to pass value to bool option
Sergey M․ 8e636da499 [utils] Improve xpath_text
Sergey M․ 22889ab175 [ruutu] Fix extraction (Closes )
Sergey M․ 5d2354f177 [utils] Relax attribute key assert
Sergey M․ a41fb80ce1 [utils] Add xpath_element and xpath_attr
Marco Ferragina 26c61e0809 Added ec extension to nowvideo extractor
remitamine e7a8c3032d [downloader/external] Respect --no-check-certificate for curl and aria2c and --proxy for curl
Jaime Marquínez Ferrándiz 725d1c58aa [crunchyroll] Extract width and height (closes )
Philipp Hagemeister bd6742137f release 2015.09.03
Sergey M․ e8dcfa3d69 [ok] Sort formats
Sergey M․ 88720ed09b [ok] Add support for youtube embeds
Sergey M․ 1e804244d0 [ok] Improve player regex
Sergey M․ 198492bbf0 [ok] Extract correct data-options (Closes )
Sergey M. b17ca9c945 Merge pull request from dstftw/strict-http-response
[utils] Strict HTTP responses (Closes )
Sergey M․ e5e78797e6 [utils] Strict HTTP responses (Closes )
Jaime Marquínez Ferrándiz 080997b808 [rtve] Fix extraction (fixes )
Adding the 'Referer' header to the png request is enough.
Sergey M․ 77306e8b97 [francetv] Update tests (2)
Sergey M․ 6917d2a2f0 [francetv] Update tests
Sergey M․ 36c15522c1 [francetv] Use subtitle when present (Closes )
Sergey M․ 804c343a4f [options] Clarify extractors supporting videopassword
Sergey M․ cd5d75427e [youku] Fix videopassword test
Sergey M․ 5ddc127da6 [youku] Simplify (Closes )
PSJay cb3d2eb9e9 Fix coding styple in YouKuIE.
PSJay 33eae08f04 Support video-password on Youku.
Jaime Marquínez Ferrándiz aa3f98677d [dumpert] Support 'embed/' urls (fixes )
Sergey M․ fffccaaf41 [globo] Fix extraction and make more robust (Closes )
Yen Chi Hsuan cdc8d0c373 [odnoklassniki] Fix extraction and extend _VALID_URL (closes )
ping d14f0c45fc [vlive] Add info about www. to m. redirects for mobile
Sergey M․ 39955b0451 [fc2] Fix refer
Sergey M․ 52dfb7ffe2 [fc2] Add test for
Sergey M․ 93462856e1 [fc2] Relax _VALID_URL (Closes )
ping 615f155a3a [vlive] Fixes for review
Sergey M․ fcd9e423ec [hls] Properly encode fragment filename
Sergey M․ db8f2bfd99 [f4m] Add missing imports
Sergey M. 55801fc76e Merge pull request from aajanki/encode_frag_filenames
[f4m] Fix encode error by sanitizing fragment filenames
Sergey M․ d3d89c3256 [YoutubeDL] Encode thumbnail filename (Closes )
Sergey M․ 8875b3d572 [imgut:album] Add extractor (Closes )
Sergey M․ aabc2be693 [youtube] Simplify and extract more metadata from url_encoded_fmt_stream_map (Closes )
Anssi Hannula c9afb51cea [youtube] Fix missing format details for 60fps DASH formats
60fps DASH formats do not appear in the DASH manifest, but the non-DASH
video info page does contain additional parameters for DASH formats that
we can parse.

Use those when they exist.

This fixes "bestvideo" not selecting 60fps formats over similar 30fps
formats just because the file size is unknown.
Yen Chi Hsuan c0a656876c [abc] Use int_or_none
Yen Chi Hsuan 17a647630b [abc] Support YouTube embeds (fixes )
Sergey M․ c88e118b3c [nowtv] Fix display_id (Closes )
Sergey M․ ae6a802106 [kaltura] Fix _VALID_URL formatting
Sergey M․ b184f94413 [kaltura] Clarify html5 player comment
Sergey M․ ee3ec091f4 [kaltura] Strictify _VALID_URL
sourcerect ef49b59053 [kaltura] add html5 player urls
Sergey M․ 1f8125805e [generic] Add test for screenwavemedia embed
Sergey M․ efd712c69b [generic] Use screenwavemedia embed pattern
Sergey M․ 109a4156e1 [cinemassacre] Use screenwavemedia embed pattern
Sergey M․ 678d33295b [screenwavemedia] Improve _VALID_URL
Sergey M․ 5e58956d0a [screenwavemedia] Add EMBED_PATTERN
felix e276fd2cb3 [screenwavemedia] warn when falling back to a hardcoded list of streams
felix 9b22cb10c4 [screenwavemedia] use the true JS value instead of a comment
felix 8ca31a0e05 [generic] Look for ScreenwaveMedia embeds
Sergey M․ 20149a5da1 [mtvservices] Fix title extraction under python 2
Sergey M․ 054d43bb11 [mtvservices] Catch more georestriction errors
Sergey M․ 65488b820c [mtvde] Add support for news
Sergey M․ c3c9f87954 [mtvde] Add test for mediagen URL without query
Sergey M․ 56f447be9f [mtvservices] Fix mediagen URL generation
Sergey M․ 79fa9db0da [mtvde] Simplify (Closes )
Paul Hartmann 071c10137b [MTV] move German mtv site to new class
Philipp Hagemeister a4962b80d6 release 2015.08.28
Sergey M․ 5307c33232 [foxnews] Clarify IE_DESC
Sergey M․ 1b660cce12 [foxnews] Simplify (Closes )
nmrugg 8df8c278b6 Added matching test for FoxBusiness.
nmrugg d7e8264517 Make FoxBusiness work.
Sergey M․ f11c316347 [shared] Add filesize to test
Sergey M․ f62e02c24f [shared] Add test for vivo
Sergey M․ 70113c38c9 [shared] Clarify IE_DESC
Sergey M․ 3d8132f5e2 [shared] Extend _VALID_URL to support vivo.sx (Closes )
Sergey M․ 39affb5aa4 [crunchyroll] Fix typo
Sergey M․ a882c5f474 [udemy] Use raise_login_required
Sergey M․ 61a7ff1622 [tubitv] Use raise_login_required
Sergey M․ 42e7373bd3 [smotri] Use raise_login_required
Sergey M․ e269d3ae7d [safari] Use raise_login_required
Sergey M․ e7ddaef5bd [pluralsight] Use raise_login_required
Sergey M․ 62984e4584 [lynda] Use raise_login_required
Sergey M․ 3c53455d15 [eroprofile] Use raise_login_required
Sergey M․ bbb43a39fd [crunchyroll] Use raise_login_required
Sergey M․ 43e7d3c945 [extractor/common] Add raise_login_required
Sergey M․ 2f72e83bbd [crunchyroll] Detect required login ()
Jaime Marquínez Ferrándiz 4bc8eec4eb [youtube] Adapt player version regex to handle urls ending in '/html5player-new.js'
It was always extracting 'new' as the version, breaking the cache system.
Sergey M․ baf510bf8c [yandexmusic:playlist] Handle playlists with more than 150 tracks (Closes )
Sergey M․ 6d53cdd6ce [yandexmusic] Skip removed tracks ()
Sergey M․ ebbf078c7d [krasview] Skip download for test
Sergey M․ 95e431e9ec [mailru] Skip tests
ping eba470f2f2 [vlive] Remove upload_date extraction & cleanup
Philipp Hagemeister 11addc50ff release 2015.08.23
Sergey M․ e4df2f98cc [yandexmusic:track] Eliminate base class
Sergey M․ e7c14660d3 [yandexmusic] Defer link resolve till actual download time to prevent link expiry (Closes )
Sergey M․ 90076b6172 [spankwire] Preserve old uploader pattern
Sergey M․ 28b83495d8 [spankwire] Simplify
Sergey M․ 551c7837ac [spankwire] Simplify and properly format
clauderains 59e6acc757 [spankwire] Support new cdn video url format
clauderains 9990c960f2 [spankwire] Fixed uploader_id field extraction so that test case passes
Sergey M․ 2006a06eff [kontrtube] Fix extraction (Closes )
Sergey M․ 2b6bda1ed8 [pluralsight] Do not yet rely on userMayViewClip
Sergey M․ 468083d2f5 [pluralsight] Remove unused const
Sergey M․ 483fc223bb [pluralsight] Add extractor (Closes )
Sergey M․ 66ce97024d [soundcloud:user] Update tests
Jaime Marquínez Ferrándiz 8c97f81943 [common] Follow convention of using 'cls' in classmethods
Yen Chi Hsuan d7c1630570 [rtl2] Remove MD5 checksums
Yen Chi Hsuan 5e1a5ac8de [rtl2] Fix extraction for test_RTL2_1
Yen Chi Hsuan 9eb4ab6ad9 [rtl2] Remove an unused line
Yen Chi Hsuan 4932a817a0 [rtl2] Add skip_download for test
Sergey M․ 5d003e29b1 [rtp] Add skip_download for test
Sergey M․ dc95bd503e [folketinget] Add skip_download for test
Yen Chi Hsuan f738dd7b7c [common] Remove debugging codes
Yen Chi Hsuan c687ac745b [theplatform] Use subtitles from SMIL, too
Yen Chi Hsuan 912e0b7e46 [common] Add _merge_subtitles()
Yen Chi Hsuan 03bc7237ad [common] _parse_smil_subtitles: accept `lang` as the subtitle language
ping 061f62da54 [vlive] New extractor for vlive.tv
Yen Chi Hsuan dd565ac1ad [theplatform] Use _download_json
Sergey M․ 5cdefc4625 [extractor/common] Add more subtitle mime types for guess when ext is missing
Sergey M․ ce00af8767 [extractor/common] Add default subtitles lang
Yen Chi Hsuan 51047444aa Merge branch 'master' into HEAD
Yen Chi Hsuan aa6cd05ed8 [theplatform] Fix Python 2: declare coding
Yen Chi Hsuan dac14bf311 [nbc] Add MSNBCIE
Yen Chi Hsuan 05fe2594e4 [theplatform] Support URLs with 'guid='
Yen Chi Hsuan 26e1c3514f [theplatform] Add ThePlatformFeedIE
Sergey M․ 22c83245c5 [mwave] Improve
ping 7900aede14 [mwave] New extractor for mwave.interest.me
Yen Chi Hsuan f877c6ae5a [theplatform] Use InfoExtractor._parse_smil_formats()
Sergey M․ ca681f7041 [videobam] Remove extractor
videobam.com redirects to sendvid.com now
Sergey M․ a01da8bbf8 [crunchyroll] Workaround fplive.net rtmp URLs (Closes )
Sergey M․ 559f4c550f [playtvak] PEP 8
Sergey M․ 03c635a4b5 [twitch] Fix login (Closes )
Sergey M․ 34a4cd0a34 [telecinco] Relax _VALID_URL (Closes )
Philipp Hagemeister 3b9b32f404 [libsyn] Strip options from player URL
Sergey M․ 9c724a9802 [twitch:vod] Add test for
Sergey M․ 7a6e8a1b17 [twitch] Make more robust
Sergey M․ 369c12e038 [twitch] Allow untitled videos (Closes )
Philipp Hagemeister 0fa5795b85 release 2015.08.16.1
Philipp Hagemeister c00c7c0af0 [sportdeutschland] Fix extraction
Sergey M․ cbaed4bb5e [youtube] Expand _VALID_URL to support vid.plus
Sergey M․ f74a7348f6 [youtube:search_url] Fix extraction (Closes )
Sergey M․ 8626b23e4e [screenwavemedia] Make more robust
Sergey M․ 0086874277 [playtvak] Use tuples
Sergey M․ 7fc18d9309 [screenwavemedia] Fix extraction (Closes )
Sergey M․ 974f1a385a [playtvak] Improve description extraction and add test for metro
Philipp Hagemeister 6900b4f6f5 release 2015.08.16
Sergey M․ 276c989772 [playtvak] Improve and simplify
Sergey M․ ea99110d24 Merge branch 'playtvak' of https://github.com/oskar456/youtube-dl into oskar456-playtvak
Ondřej Caletka 221a59fe6f [playtvak] Initial support for videos from Mafra group servers
Support for videos in articles from idnes.cz, lidovky.cz, metro.cz, as
well as video and live streams from playtvak.cz

Signed-off-by: Ondřej Caletka <ondrej@caletka.cz>
Sergey M․ 041bc3adc5 [youtube] Simplify two-factor authentication
Sergey M․ e64b756943 [extractor/common] Interactive TFA code input
Sergey M․ 201ea3ee8e [extractor/common] Improve _hidden_inputs
reddraggone9 9303ce3e69 [youtube] Fix two-factor authentication
Sergey M․ c576ef1e7c [shahid] Improve and simplify
Sergey M․ 11bed5827d Merge branch 'shahid' of https://github.com/remitamine/youtube-dl into remitamine-shahid
Sergey M․ 1d25e9d173 [extractor/__init__] Fix order
Sergey M․ 9c21f22923 [esri:video] Rename extractor
Sergey M․ 3aa697f993 [esri:video] Extract all formats and simplify
Sergey M․ 8b9848ac56 [extractor/common] Expand meta regex
Shaun Walbridge 8b8c1093b6 [EsriVideo] Add new extractor
Add extractor for [videos.esri.com](https://videos.esri.com), a collection
of videos relating to GIS.
Yen Chi Hsuan d0d6c097fc [moniker] Support embed- URLs ()
Sergey M․ 41dbc50f9c [lynda] Capture and output login error (Closes )
Sergey M․ 594f51b859 [indavideo] Remove unused import
Sergey M․ a34e19629c [indavideo] Relax _VALID_URL to match subdomains and add tests
Sergey M․ 3c12a027d4 [indavideo] Split in two extractors, extract all formats and fix timestamp
nyuszika7h cb28e03386 [indavideo] Add new extractor
Closes .
Sergey M․ 7393746da2 [downloader/hls] Add _debug_cmd
Sergey M․ 6828c809e4 [downloader/fragment] Respect --retries for fragment based downloaders (Closes )
Yen Chi Hsuan 28479149cc [theplatform] Fallback to hardcoded releaseUrl if not available
Fixes .

Not adding a test case as test_NBC has the same problem.
Sergey M․ 237c03c8ea [dhm] Remove unused import
Sergey M․ e73c85cb23 [iqiyi] PEP 8
Sergey M․ b6b2711298 [tweakers] Remove unused imports
Sergey M․ 2c919adb74 [rtvnh] Check status code
Sergey M․ 60231c65b9 [rtvnh] Make SMIL not fatal
Sergey M․ f196047832 [rtvnh] Make thumbnail optional
Sergey M․ 240ca32e57 [rtvnh] Carry long lines
Sergey M. fa37c26c4d Merge pull request from ngld/rtvnhnl
[rtvnhnl] Added new extractor
ngld d7dbfc7cc1 Use native HLS implementation by default.
ngld d9ab5262b1 [rtvnh] Renamed rtvnhnl -> rtvnh
ngld fb124e3741 [rtvnhnl] Relax the thumbnail check
Sergey M. 479bf783d2 Merge pull request from ngld/fix-funnyordie
[funnyordie] Handle protocol-relative URLs (fixes )
ngld f0f3a6c99d [rtvnhnl] Added new extractor
Sergey M․ f57b7835e2 [youtube] Update tests
ngld 1df3186e0e [funnyordie] Handle protocol-relative URLs (fixes )
sceext 0a19d4ccd6 [iqiyi] update md5 salt (2015-08-10 Zombie)
Sergey M․ 9f3da13860 [downloader/external] Use generic _option
Sergey M․ bf812ef714 [downloader/external] Forward --proxy to wget and aria2c
Sergey M․ b1ac38fadc [tvplay] Add age limit to tests
Sergey M․ fb0d12c6cb [pbs] Add age limit to tests
Sergey M․ 34952f09e1 [youtube] Add age limit to tests
Sergey M․ 34a7de2970 [youtube] Skip download for multiple v= test
Sergey M. 0ff827419e Merge pull request from puckipedia/master
[youtube] Use the first v= argument in the URL
Sergey M․ b29440aee6 [vimeo:user] Do not match watchlater
Puck Meerburg 11b5605815 [youtube] Use the first v= argument in the URL
This is according to how youtube handles multiple v= values in one URL.
Before this, it was possible to make a single URL show up differently
 on youtube itself, and if you downloaded/viewed it with youtube-dl/mpv