Commit Graph

8268 Commits (2a776f978849e0c66f70133747e7fd244f516f7f)

Author SHA1 Message Date
Philipp Hagemeister 287be8c615 [youtube:truncated_url] Add ?t=
Sometimes found in links - ?t=123&v=ABCD starts the video at position 123.
Philipp Hagemeister 953fed280f [compat] Do not use unicode
If the code ever runs on 3.x, it would fail. Even if it never does, the unicode name confuses Python 3 code analysis tools.
Sergey M․ e2ff3df314 [clubic] Relax _VALID_URL (Closes )
Sergey M․ c246773599 [nowness] Add vimeo test
Sergey M․ 82c18e2a53 [nowness] Simplify
Sergey M․ d5d38d16ae Merge branch 'nowness' of https://github.com/remitamine/youtube-dl into remitamine-nowness
Sergey M․ 2ffe3bc14b [ndr] Rework and cover with tests
Sergey M․ d5867276a9 Merge branch 'master' of github.com:rg3/youtube-dl into remitamine-ndr
Yen Chi Hsuan f665ef8fc5 Merge remote-tracking branch 'upstream/master'
Yen Chi Hsuan b264c21302 [tudou] Use single quotes and compat_str
Yen Chi Hsuan 349b3a2ea0 [tudou] Improve regexs
Yen Chi Hsuan 87813a8570 [tudou] Use _download_xml
Yen Chi Hsuan aab135516b [tudou] Avoid shadowing builtin names
Yen Chi Hsuan 141ba36996 [tudou] Modernize
Yen Chi Hsuan 94e507aea7 [tudou] A more comprehensive _VALID_URL
Sergey M․ 3ebc121293 Merge branch 'ndr' of https://github.com/remitamine/youtube-dl into remitamine-ndr
Yen Chi Hsuan 41ebd6530b [tudou] Add the test case ()
Yen Chi Hsuan 2ec7b7b79b Merge branch 'master' of https://github.com/linhua55/youtube-dl into linhua55-master
Sergey M․ 60ed60353b [openfilm] Remove extractor
OpenFilm has been shut down
Sergey M․ 586f1cc532 [extractor/common] Skip html comment tags (Closes )
Sergey M․ 73eb13dfc7 [extractor/common] Case insensitive inputs extraction
Sergey M․ 1721fef28b [yahoo] Fix test
Sergey M․ 364ca0582e [yahoo] Process query result embedded in webpage
Sergey M․ 133a2b4ac2 [downloader/hls] Properly close stream
Philipp Hagemeister d85187eb74 release 2015.09.09
Sergey M․ cc1ac11017 [vier:videos] Fix extraction with old approach (Closes )
Sergey M․ 482aa3fecc [vidme] Simplify, make more robust, extract more metadata and capture errors (Closes )
Lukáš Lalinský d9c19db340 Extract all vid.me formats
Sergey M. 6c4d243de5 Merge pull request from remitamine/xuite-tests
[xuite] fix test md5
remitamine 7b4137c351 [fktv] fix info extraction
remitamine 1072336249 [washingtonpost] fix test info
remitamine 75bb5c7028 [xuite] fix test md5
remitamine 376e1ad081 [ndr] use utils.qualites
remitamine b58a22b963 [ndr] make NDREmbed and NJoyEmbed _VALID_URL regex unique
Sergey M․ 47004d9579 [crunchyroll] Fix uploader and upload date extraction
Sergey M․ 12810c9cd3 [crunchyroll] Force Accept-Language to any for all requests (Closes )
Sergey M․ 7a459170fa [__init__] Remove musicvault
Sergey M. 3cf0df568a Merge pull request from remitamine/musicvault
[musicvault] remove extractor
remitamine b88ebd472e [musicvault] remove extractor
remitamine 64997815c4 [ndr] add support for embeds
remitamine b1b7d1ffba [wimp] fix tests info
Jaime Marquínez Ferrándiz 4003bd82b0 [youtube:shows] Use https
remitamine 8801255d7d [youtube] fix show extraction (fixes )
Closes )
remitamine 3b18f539a7 [ndr] fix info extraction
Yen Chi Hsuan bc973e06d0 Merge pull request from remitamine/yahoo-tests
[yahoo] change test md5 checksum
remitamine cf33a47df0 [ajazzera] skip test
remitamine daeb0f04cd [yahoo] change test md5 checksum
Sergey M․ 97243fe395 [ceskatelevize] Extract playlists (Closes )
Sergey M․ 9dbdb65abe [techtvmit] Update test
Sergey M․ 9af461de35 [techtvmit] Fix extraction
Sergey M. 4d71e200c6 Merge pull request from remitamine/academicearth
[academicearth] fix test info
Sergey M. 8e0bdabed2 Merge pull request from remitamine/airmozilla
[airmozilla] fix test info
Sergey M․ bca553caac [eagleplatform] Fix extraction
remitamine a2f42a3baf [academicearth] fix test info
remitamine 7465222a9c [airmozilla] fix test info
Sergey M․ e28034c5ac [utils] Comment cookie processing until result from travis and some more testing
Sergey M․ 12bbd32ad0 [kuwo:singer] Skip test
Sergey M․ 266e466ee4 [utils] Simplify cookie processor
Sergey M․ cf83f532ae [niconico] Use encode_dict
Sergey M․ cd019668dc [niconico] Use encode_dict
Sergey M․ 515fc8776f [youtube] Use encode_dict
Sergey M․ c7c0996d8c [gorillavid] Add test for filehoot.com (Closes )
Sergey M․ b3e64671cc [gorillavid] Improve title
Sergey M․ 4abe214499 [gorillavid] Encode fields
Sergey M․ e94cb5ae7e [gorillavid] Add support for filehoot.com
Sergey M․ e213c98df1 [gorillavid] Build correct URL
Sergey M․ 1639282434 [utils] Add encode_dict
Sergey M․ be0e5dbd83 [extractor/common] Extract submit inputs
Sergey M․ ad72917274 [utils] Add issue URL in comment for
Sergey M․ 6a3f4c3f82 [YoutubeDL] Use custom cookie processor
Sergey M․ a6420bf50c [utils] Add cookie processor for cookie correction (Closes )
Sergey M․ eb387896e9 [adultswim] Fix extraction on python 2.6
remitamine f43c163158 [nowness] pass cinematique
remitamine 673bf566fc [nowness] more api abstraction
remitamine f95c5e1218 [nowness] change id variable name
remitamine f33f32f159 [nowness] add api abstration function adn extend _VALID_URL regex
Sergey M․ 8df5ae15d1 [compat] Fix python version check for compat_shlex_split
remitamine 75b399f455 [nowness] fix _VALID_URL regex
felix 12439dd5ec [generic] Capture <audio> tags in addition to <video> tags
Sergey M․ cab792abe5 [options] Use compat_shlex_split
Sergey M․ 8870358b1b [__init__] Use compat_shlex_split
Sergey M․ 51f579b635 [compat] Add compat shlex.split
remitamine c23c3d7d7d [nowness] fix video extraction and add support serie and playlist extraction (fixes )
Sergey M․ 4abf617b9c [YoutubeDL] Ensure bool params always present in downloader
Jaime Marquínez Ferrándiz 3026164b16 [postprocessor/common] Use 'self._downloader.params' instead of 'self.params'
'self.params' is not defined
Yen Chi Hsuan 9dd73ef4a4 [dcn] PEP8
Yen Chi Hsuan 08354db47b [vlive] PEP8
Yen Chi Hsuan 027eb5a6b0 Merge branch 'vlive' of https://github.com/ping/youtube-dl into ping-vlive
Sergey M․ 6270239a6d [postprocessor/common] Use generalized cli option converters
Sergey M․ 1195a38f46 [downloader/external] Use generalized cli option converters
Sergey M․ 66e289bab4 [utils] Generalize cli option converters
Sergey M. 52c6f26cab Merge pull request from remitamine/external_downloader_options
[downloader/external] Respect --no-check-certificate for curl and aria2c and --proxy for curl
remitamine dc534b674f [downloader/external] change _argless_option function to _valueless_option
remitamine f30c2e8e98 [downloader/external] add _argless_option for option without arguments
Jaime Marquínez Ferrándiz c482b3c69a [ruutu] Update test url
remitamine 266b0ad676 [downloader/external] add _bool_option to pass value to bool option
Sergey M․ 8e636da499 [utils] Improve xpath_text
Sergey M․ 22889ab175 [ruutu] Fix extraction (Closes )
Sergey M․ 5d2354f177 [utils] Relax attribute key assert
Sergey M․ a41fb80ce1 [utils] Add xpath_element and xpath_attr
Marco Ferragina 26c61e0809 Added ec extension to nowvideo extractor
remitamine e7a8c3032d [downloader/external] Respect --no-check-certificate for curl and aria2c and --proxy for curl
Jaime Marquínez Ferrándiz 725d1c58aa [crunchyroll] Extract width and height (closes )
Philipp Hagemeister bd6742137f release 2015.09.03
Sergey M․ e8dcfa3d69 [ok] Sort formats
Sergey M․ 88720ed09b [ok] Add support for youtube embeds
Sergey M․ 1e804244d0 [ok] Improve player regex
Sergey M․ 198492bbf0 [ok] Extract correct data-options (Closes )
Sergey M. b17ca9c945 Merge pull request from dstftw/strict-http-response
[utils] Strict HTTP responses (Closes )
Sergey M․ e5e78797e6 [utils] Strict HTTP responses (Closes )
Jaime Marquínez Ferrándiz 080997b808 [rtve] Fix extraction (fixes )
Adding the 'Referer' header to the png request is enough.
Sergey M․ 77306e8b97 [francetv] Update tests (2)
Sergey M․ 6917d2a2f0 [francetv] Update tests
Sergey M․ 36c15522c1 [francetv] Use subtitle when present (Closes )
Sergey M․ 804c343a4f [options] Clarify extractors supporting videopassword
Sergey M․ cd5d75427e [youku] Fix videopassword test
Sergey M․ 5ddc127da6 [youku] Simplify (Closes )
PSJay cb3d2eb9e9 Fix coding styple in YouKuIE.
PSJay 33eae08f04 Support video-password on Youku.
Jaime Marquínez Ferrándiz aa3f98677d [dumpert] Support 'embed/' urls (fixes )
Sergey M․ fffccaaf41 [globo] Fix extraction and make more robust (Closes )
Yen Chi Hsuan cdc8d0c373 [odnoklassniki] Fix extraction and extend _VALID_URL (closes )
ping d14f0c45fc [vlive] Add info about www. to m. redirects for mobile
Sergey M․ 39955b0451 [fc2] Fix refer
Sergey M․ 52dfb7ffe2 [fc2] Add test for
Sergey M․ 93462856e1 [fc2] Relax _VALID_URL (Closes )
ping 615f155a3a [vlive] Fixes for review
Sergey M․ fcd9e423ec [hls] Properly encode fragment filename
Sergey M․ db8f2bfd99 [f4m] Add missing imports
Sergey M. 55801fc76e Merge pull request from aajanki/encode_frag_filenames
[f4m] Fix encode error by sanitizing fragment filenames
Sergey M․ d3d89c3256 [YoutubeDL] Encode thumbnail filename (Closes )
Sergey M․ 8875b3d572 [imgut:album] Add extractor (Closes )
Sergey M․ aabc2be693 [youtube] Simplify and extract more metadata from url_encoded_fmt_stream_map (Closes )
Anssi Hannula c9afb51cea [youtube] Fix missing format details for 60fps DASH formats
60fps DASH formats do not appear in the DASH manifest, but the non-DASH
video info page does contain additional parameters for DASH formats that
we can parse.

Use those when they exist.

This fixes "bestvideo" not selecting 60fps formats over similar 30fps
formats just because the file size is unknown.
Yen Chi Hsuan c0a656876c [abc] Use int_or_none
Yen Chi Hsuan 17a647630b [abc] Support YouTube embeds (fixes )
Sergey M․ c88e118b3c [nowtv] Fix display_id (Closes )
Sergey M․ ae6a802106 [kaltura] Fix _VALID_URL formatting
Sergey M․ b184f94413 [kaltura] Clarify html5 player comment
Sergey M․ ee3ec091f4 [kaltura] Strictify _VALID_URL
sourcerect ef49b59053 [kaltura] add html5 player urls
Sergey M․ 1f8125805e [generic] Add test for screenwavemedia embed
Sergey M․ efd712c69b [generic] Use screenwavemedia embed pattern
Sergey M․ 109a4156e1 [cinemassacre] Use screenwavemedia embed pattern
Sergey M․ 678d33295b [screenwavemedia] Improve _VALID_URL
Sergey M․ 5e58956d0a [screenwavemedia] Add EMBED_PATTERN
felix e276fd2cb3 [screenwavemedia] warn when falling back to a hardcoded list of streams
felix 9b22cb10c4 [screenwavemedia] use the true JS value instead of a comment
felix 8ca31a0e05 [generic] Look for ScreenwaveMedia embeds
Sergey M․ 20149a5da1 [mtvservices] Fix title extraction under python 2
Sergey M․ 054d43bb11 [mtvservices] Catch more georestriction errors
Sergey M․ 65488b820c [mtvde] Add support for news
Sergey M․ c3c9f87954 [mtvde] Add test for mediagen URL without query
Sergey M․ 56f447be9f [mtvservices] Fix mediagen URL generation
Sergey M․ 79fa9db0da [mtvde] Simplify (Closes )
Paul Hartmann 071c10137b [MTV] move German mtv site to new class
Philipp Hagemeister a4962b80d6 release 2015.08.28
Sergey M․ 5307c33232 [foxnews] Clarify IE_DESC
Sergey M․ 1b660cce12 [foxnews] Simplify (Closes )
nmrugg 8df8c278b6 Added matching test for FoxBusiness.
nmrugg d7e8264517 Make FoxBusiness work.
Sergey M․ f11c316347 [shared] Add filesize to test
Sergey M․ f62e02c24f [shared] Add test for vivo
Sergey M․ 70113c38c9 [shared] Clarify IE_DESC
Sergey M․ 3d8132f5e2 [shared] Extend _VALID_URL to support vivo.sx (Closes )
Sergey M․ 39affb5aa4 [crunchyroll] Fix typo
Sergey M․ a882c5f474 [udemy] Use raise_login_required
Sergey M․ 61a7ff1622 [tubitv] Use raise_login_required
Sergey M․ 42e7373bd3 [smotri] Use raise_login_required
Sergey M․ e269d3ae7d [safari] Use raise_login_required
Sergey M․ e7ddaef5bd [pluralsight] Use raise_login_required
Sergey M․ 62984e4584 [lynda] Use raise_login_required
Sergey M․ 3c53455d15 [eroprofile] Use raise_login_required
Sergey M․ bbb43a39fd [crunchyroll] Use raise_login_required
Sergey M․ 43e7d3c945 [extractor/common] Add raise_login_required
Sergey M․ 2f72e83bbd [crunchyroll] Detect required login ()
Jaime Marquínez Ferrándiz 4bc8eec4eb [youtube] Adapt player version regex to handle urls ending in '/html5player-new.js'
It was always extracting 'new' as the version, breaking the cache system.
Sergey M․ baf510bf8c [yandexmusic:playlist] Handle playlists with more than 150 tracks (Closes )
Sergey M․ 6d53cdd6ce [yandexmusic] Skip removed tracks ()
Sergey M․ ebbf078c7d [krasview] Skip download for test
Sergey M․ 95e431e9ec [mailru] Skip tests
ping eba470f2f2 [vlive] Remove upload_date extraction & cleanup
Philipp Hagemeister 11addc50ff release 2015.08.23
Sergey M․ e4df2f98cc [yandexmusic:track] Eliminate base class
Sergey M․ e7c14660d3 [yandexmusic] Defer link resolve till actual download time to prevent link expiry (Closes )
Sergey M․ 90076b6172 [spankwire] Preserve old uploader pattern
Sergey M․ 28b83495d8 [spankwire] Simplify
Sergey M․ 551c7837ac [spankwire] Simplify and properly format
clauderains 59e6acc757 [spankwire] Support new cdn video url format
clauderains 9990c960f2 [spankwire] Fixed uploader_id field extraction so that test case passes
Sergey M․ 2006a06eff [kontrtube] Fix extraction (Closes )
Sergey M․ 2b6bda1ed8 [pluralsight] Do not yet rely on userMayViewClip
Sergey M․ 468083d2f5 [pluralsight] Remove unused const
Sergey M․ 483fc223bb [pluralsight] Add extractor (Closes )
Sergey M․ 66ce97024d [soundcloud:user] Update tests
Jaime Marquínez Ferrándiz 8c97f81943 [common] Follow convention of using 'cls' in classmethods
Yen Chi Hsuan d7c1630570 [rtl2] Remove MD5 checksums
Yen Chi Hsuan 5e1a5ac8de [rtl2] Fix extraction for test_RTL2_1
Yen Chi Hsuan 9eb4ab6ad9 [rtl2] Remove an unused line
Yen Chi Hsuan 4932a817a0 [rtl2] Add skip_download for test