Commit Graph

5535 Commits (594f51b85934878ff20b608f312d7f564e3a3d71)

Author SHA1 Message Date
Yen Chi Hsuan d76dea001b [yinyuetai] Miscellaneous improvements
1. Include all fields in _TEST
2. Use .get() for optional fields
3. Clarify the intention of 'ext' in formats
Yen Chi Hsuan af0f9b0e95 [yinyuetai] Style
Yen Chi Hsuan e2082ea942 [yinyuetai] Add test for h5/ part in _VALID_URL
Yen Chi Hsuan 68923e52a3 Merge branch 'yinyuetai' of https://github.com/ping/youtube-dl into ping-yinyuetai
Sergey M․ 9281f6d253 [vk] Add test for youtube embed
Sergey M․ 4647845679 [vk] Fix youtube extraction
Sergey M․ cf9cf7dd04 [vk] Extend _VALID_URL to handle biqle.ru (Closes )
Yen Chi Hsuan 1316b54956 [clipsyndicate] Use _match_id
Yen Chi Hsuan cbc1fadd6f [clipsyndicate] Support chic subdomain (fixes )
Yen Chi Hsuan 267dc07e6b [gfycat] Catch errors
Yen Chi Hsuan d7b4d5dd50 [gfycat] Extract id correctly (fixes )
Sergey M․ 7f220b2fac [vk] Catch ownership confirmation request
Sergey M․ 275c0423aa [vk] Fix extraction (Closes )
Yen Chi Hsuan 85a064861f [qqmusic] Use regex for thumbnails in test cases
Yen Chi Hsuan d0b436bff2 Merge branch 'qqmusic-format-fix' of https://github.com/ping/youtube-dl into ping-qqmusic-format-fix
Yen Chi Hsuan dfc4eca21f [qqmusic:album] Playlist names are optional
Yen Chi Hsuan fc7ae675e2 [qqmusic:album] Strip description
Yen Chi Hsuan 804ad79985 Merge branch 'qqmusic-album-fix' of https://github.com/ping/youtube-dl into ping-qqmusic-album-fix
Yen Chi Hsuan e9d33454b5 [qqmusic:playlist] Playlist names are optional
Yen Chi Hsuan d80891efc4 Merge branch 'qqmusic-playlist' of https://github.com/ping/youtube-dl into ping-qqmusic-playlist
ping 37c1e4025c [yinyuetai] New extractor for yinyuetai.com
Yen Chi Hsuan 59a83d3e5b [spiegeltv] Skip invalid m3u8 manifests (closes )
Yen Chi Hsuan 13af92fdc4 [common] Add 'fatal' to _extract_m3u8_formats
Sergey M․ 0c20ee7d4b [rtlnl] Clarify current adaptive -> flash workaround rationale
Sergey M․ 89d42c2c75 [rtlnl] Clarify test
Sergey M․ 9dfc4fa1a1 [rtlnl] Add test with encrypted m3u8 streams for reference
Sergey M․ 43232d5c14 [rtlnl] Improve
Sergey M․ f7c272d4fa Merge branch 'patch-1' of https://github.com/corone17/youtube-dl into corone17-patch-1
Sergey M․ ede21449c8 [crunchyroll] Fix extraction (Closes , closes )
Sergey M․ e56a4c9e9b [thisamericanlife] Improve and simplify
Eric Wong 95506e37af [thisamericanlife] Remove unnecessary comment
Eric Wong e41840c522 [thisamericanlife] get info from <meta> tags
Eric Wong 2a46a27e6c [thisamericanlife] Add a new extractor
Sergey M․ 0bcdc27653 [dailymotion:cloud] Extend _VALID_URL (Closes )
Sergey M․ ddf0f74de7 [howcast] Fix extraction and modernize
Yen Chi Hsuan 91b21b2334 [infoq] Fix extraction (closes )
Sergey M․ 66e568de3b [extractor/generic] Improve kaltura embeds support (Closes )
Sergey M․ f5ca97e393 [npo] Clarify token decryption algorithm source
Yen Chi Hsuan 8d06a62485 [npo] Decrypting token (closes )
Yen Chi Hsuan 93f9420993 [pbs] Add coding declaration
Python 2.x does not work without it.
Yen Chi Hsuan 5b61070c70 [pbs] skip_download for m3u8 test cases
Yen Chi Hsuan dbe1a93526 [pbs] Fix player URL (closes )
Sergey M․ 86511ea417 [drtuber] Fix extraction
Sergey M. 33f1f81b8b Merge pull request from alarig/master
Add support of HTTPS for ina.fr
Sergey M․ 9d0b581fea [youtube] Prefer meta for upload date and modernize
alarig c05724cb18 Add support of HTTPS for ina.fr
Sergey M․ f0714c9f86 [youtube] Speed up upload date regex ()
Sergey M․ cf386750c9 [hentaistigma] Modernize
Sergey M. 54f428f645 Merge pull request from nawl/master
[hentaistigma] Fix video extractor
Sergey M. dc2bd20e55 Merge pull request from dstftw/use-codecs-from-dash-manifest
[youtube] Pick up codecs info from DASH manifest when not set explicitly
Sergey M. c608ee491f Merge pull request from dstftw/union-itags-from-multiple-dashmpd
[youtube] Extract formats from multiple DASH manifests (Closes )
nawl 738b926322 [hentaistigma] Fix video extractor
corone17 bea41c7f3f Update rtlnl.py
Better to extract 'http://manifest.us.rtl.nl' from the json, I'd say. And I think it's better to use the default json-url to make it more futureproof.
Succesfully tested with tarball.
Anders Einar Hilden c4bd188da4 NRK now supports / requires HTTPS
Add s? to regexp to support new urls. Update testcases to use HTTPS.
Sergey M․ 5414623791 [extractor/common] Remove superfluous line
Sergey M․ c93d53f5e3 [youtube] Fix likes/dislike extraction
Sergey M․ d16154d163 [tnaflix] Generalize tnaflix extractors
Sergey M․ c342041fba [extractor/common] Use NO_DEFAULT from utils
Sergey M․ c7c040b825 Merge branch 'moviefap' of https://github.com/gebn/youtube-dl into gebn-moviefap
Yen Chi Hsuan ac0474f89d [twitch:vod] Update _TEST
The original test case is gone
Yen Chi Hsuan bb512e57dc [twitch:vod] Fix 'Source' format in m3u8 (closes )
George Brighton db652ea186 [moviefap] Fix `flake8` warnings introduced in 1a5fd4e
George Brighton 5a9cc19972 [moviefap] Move flv videos to formats in the metadata
George Brighton 1a5fd4eebc [moviefap] Wrap long lines
George Brighton 8a1b49ff19 [moviefap] Explicitly sort formats to handle possible site changes
George Brighton b971abe897 [moviefap] Replace call to `str()` with `compat.compat_str()`
George Brighton 43b925ce74 [moviefap] Replace calls to `find()` with `util.xpath_text()`.
George Brighton 62b742ece3 [moviefap] Remove redundant comments
George Brighton d16ef949ca [moviefap] Allow non-critical fields to change without breaking extraction
Sergey M․ 23e7cba87f [twitter:card] Add extractor ()
George Brighton a8e6f30d8e [moviefap] Swap and justify tests
George Brighton 9c49410898 [moviefap] Add categories to tests
George Brighton 802d74aa6b [moviefap] Swap test for an alternative non-copyrighted video
George Brighton 71f9e49e67 [moviefap] Fix dictionary comprehension syntax incompatible with Python 2.6
George Brighton 82ea1051b5 [moviefap] Add new extractor
Sergey M․ 04c27802c0 [smotri] Add tests for password protected videos
Sergey M․ c3b7202f4f [smotri] Remove non relevant test
Sergey M․ 81103ef35d [smotri] Fix password protected video extraction
Sergey M. 0eb5c1c62a Merge pull request from yan12125/skip_problematic_sites
[planetaplay/quickvid/vube] Skip inaccessible sites
Sergey M․ a9de951744 [snagfilms] More tests
Sergey M․ a42a1bb09d [snagfilms] Capture not available error
Sergey M․ 9fbfc9bd4d [snagfilms:embed] Capture geolocation restriction error
Sergey M․ 242a998bdc [snagfilms] Add support for shows
Sergey M․ 9d1bf70234 Merge branch 'remitamine-snagfilms'
Sergey M․ b8c1cc1a51 [extractor/generic] Add test for snagfilms embeds
Sergey M․ eedd20ef96 [extractor/generic] Add support for snagfilms embeds
Sergey M․ 7c197ad96d [snagfilms] Add routine for generic embeds extractions
Sergey M․ 654fd03c73 [snagfilms] Improve and simplify
Jaime Marquínez Ferrándiz cee16e0fa3 [newstube] style: fix alignment
Jaime Marquínez Ferrándiz 73c471e9ef [newstube] Fix GUID extraction (fixes )
Sergey M․ 533b99fbf9 Merge branch 'snagfilms' of https://github.com/remitamine/youtube-dl into remitamine-snagfilms
remitamine f39eb98bab download all pages before start extracting info
Sergey M․ da77d856a1 [youtube] Add test for
Sergey M․ 0a3cf9ad3d [youtube] Skip get_video_info requests when --youtube-skip-dash-manifest is specified
Sergey M․ 226b886ca8 [vk] Fix authentication (Closes )
Sergey M․ bc93bdb5bb [youtube] Fix reference before assignment for video_info
Yen Chi Hsuan af214c3a79 [youtube] More useful messages for georestricted videos ()
remitamine 7d7d469025 add support for embed links
remitamine fd40bdc0be remove unnecessary symbolic name for group
remitamine 7e0480ae0e convert tabs to 4 spaces identation
Sergey M․ d80265ccd6 [youtube] Simplify non-DASH formats exclusion
Sergey M․ 1b5a1ae257 [youtube] Pick up codecs info from DASH manifest when not set explicitly
Sergey M․ d8d24a922a [youtube] Extract formats from multiple DASH manifests (Closes )
DASH manifest pointed by dashmpd from the video webpage and one pointed by get_video_info may
be different (namely different itag set) - some itags are missing from DASH manifest pointed by
webpage's dashmpd, some - from DASH manifest pointed by get_video_info's dashmpd).
The general idea is to take a union of itags of both DASH manifests (for example video with such
'manifest behavior' see https://github.com/rg3/youtube-dl/issues/6093).
remitamine 03339b7b5b [snagfilms] Add new extractor
Shadab Zafar 2028c6e03d Added a Playlist Info Extractor for WebOfStories
Sergey M․ 2988835af5 [lynda] Fix non-ASCII logins/passwords on python 2
Sergey M․ 62cca96b72 [lynda] Fix confirm login request ()
Sergey M․ b4dea075a3 [lynda] Fix login request (Closes )
Sergey M․ 533f67d3fa [infoq] Relax _VALID_URL (Closes )
Yen Chi Hsuan b8091db6b9 [planetaplay/quickvid/vube] Skip inaccessible sites
Yen Chi Hsuan 381c067755 [thesixtyone] Modernize
Yen Chi Hsuan 2182ab5187 [thesixtyone] Fix audio_server
Some of the songs are moved to Amazon AWS
fnord aa5740fb61 Merge remote-tracking branch 'origin/master' into pr-bbcnews
fnord da92eeae42 Fix tests, description formatting
Sergey M․ 8084be78c5 [extractor/generic] Add test for OnionStudios embeds
Sergey M․ 1ac1c4c26e [extractor/generic] Add support for OnionStudios embeds (Closes )
Sergey M․ d4f58034f7 [onionstudios] Add generic embed extraction routine
Sergey M․ f843300fe5 [onionstudios] Add extractor
Sergey M․ 03b9c94437 [soundcloud:user] Add test
Sergey M․ a219d175c6 [soundcloud] Improve _VALID_URL
Do not takeover soundcloud:user URLs
Sergey M. 3c3b4176bd Merge pull request from dstftw/force-generic-extractor
Add --force-generic-extractor
Mitsukarenai 1a1251e877 [noco.tv] Fix issue : title interpreted as integer
Yen Chi Hsuan 18b5e1e534 [drbonanza] Fix extraction of videos
Sergey M․ 2fece970b8 [extractor/generic] Clarify generic extraction warning
Sergey M․ e20d0c1e69 [brightcove] Use `compat_xml_parse_error` (Closes )
fnord a9dcf4a860 Prefer externalId over non-mediaserver-specific hashkey for video id.
Sergey M․ 255f5694aa [faz] Extend _VALID_URL (Closes )
Jaime Marquínez Ferrándiz 25701d5a2c [xhamster] pep8: remove trailing ';'
Yen Chi Hsuan a5158f38a3 [generic/adobetv] Support AdobeTVVideo embeds ()
Sergey M․ c76799c555 [extractor/generic] Add test for xhamster embed
Sergey M․ 2bb5b6d0a1 [generic] Add support for xhamster embeds
Sergey M․ 0bbba43ed0 [xhamster:embed] Add extractor (Closes )
Yen Chi Hsuan 98ca102441 [sohu] Fix extraction again
Yen Chi Hsuan 3f3308cd75 Revert "[sohu] Update extractor"
This reverts commit 32060c6d6b.
Yen Chi Hsuan 6f96e308d0 [francetvinfo.fr] Support dmcloud embeds (fixes )
Yen Chi Hsuan 756f574e4e [dailymotion/generic] Add DailymotionCloudIE
Yen Chi Hsuan 78294e6a9c [bbccouk] Remove TTML to srt conversion codes
It's broken. See 
Yen Chi Hsuan 607841af64 [adobetv] Support embeddable videos (closes )
Yen Chi Hsuan c5895d5dbd [tumblr] Support Vimeo embeds (fixes )
Yen Chi Hsuan b407e173e4 [vimeo/generic] Move detection logic from GenericIE to VimeoIE
Yen Chi Hsuan 6a745c2c0f [pinkbike] PEP8
ping 2da0cad6ae [neteasemusic] Do proper rounding conversion of millisecond timestamps/durations
ping af1fa6234e [neteasemusic] Add new extractor for music.163.com
Sergey M․ c9ac7fa909 [imdb] Fix extraction
Yen Chi Hsuan 964afd0689 [xvideos] Support lower-quality formats found on Android
Closes 
fnord 2a282a3b5f Unbreak breakage that was broken to test breakage
fnord 7bb23aeca4 rename bbccouk.py -> bbc.py
fnord de939d89eb Support BBC news in other languages, non-mediaselector videos
fnord 77c975f536 typofix
fnord 75ab0ebcf5 no .get('..',None)
fnord 10273d6e08 toss new stuff into old file
Sergey M․ 16d6973f8a [viki] Pass session token around ()
Sergey M․ 385c3e5e91 [pinkbike] Improve and simplify
Sergey M․ c8e337450b Merge branch 'pinkbike' of https://github.com/misterhat/youtube-dl into misterhat-pinkbike
Sergey M․ 10464af5d1 [dramafever:series] Fix extraction while authenticated
Sergey M․ cbcd1a5474 [dramafever] Add support for authentication (Closes )
Sergey M․ c9bebed294 [youtube] Add itag 59 and 78 (Closes )
fnord d5552a3477 bbcnews: Switch to parse_duration, revert change to docs/supportedsites.md
fnord a8b081a052 BBCNewsIE: eliminate redundant function.
BBCCoUkIE._download_media_selector: use class variable instead of
hardcoded string for mediaselector_url template.
fnord 9e96dc8b35 Support BBC News (bbc.com/news)
Sergey M․ 360075e28a [pornhub] Extend _VALID_URL (Closes )
Sergey M․ accf79b107 [viki] Add support for authentication (Closes )
ping 4d58b24c15 [qqmusic] Use _check_formats instead
Yen Chi Hsuan 25fa8d66e6 [bbccouk] Fix description (closes )
Yen Chi Hsuan 974a6146fe [bbccouk] Fix error handling
ping 0392ac98d2 [qqmusic] Fix code formatting
ping 5e3915cbe3 [qqmusic] Fix song extraction when certain formats are unavailable
ping 29b809de68 [qqmusic] Fix album extraction
ping 8f73e89ca0 [kuwo] New extractor for kuwo.cn
ping 0d0d5d3717 [qqmusic] Add support for playlists
Sergey M․ a69e8bfdd9 [lifenews] Fix tests
Sergey M․ 062a3fdf36 [lifenews] Modernize
Sergey M․ 028a33d7f2 [lifenews] Fix extraction
Sergey M․ 447053668f [spankwire] Fix extraction
Jaime Marquínez Ferrándiz f3aecb27a4 [youku] Simplify a bit the 'entries' construction
Mainly avoid having to use an index.
Yen Chi Hsuan 79fe954d79 Merge branch 'PeterDing-youku'
Yen Chi Hsuan a155b7e76c [youku] Coding style
Yen Chi Hsuan 5228b756af [youku] Add cn_verification_proxy support and add a georestricted test case
Yen Chi Hsuan 04e7596680 [youku] Better error handling
Yen Chi Hsuan f1e66cb2eb [youku] Change video_id and add a multipart test case
Sergey M․ 4fd35ee072 [safari] Add test for
Yen Chi Hsuan ee69799262 [youku] Add a v.swf test case
Sergey M. 636a9637f4 Merge pull request from zx8/master
[safari] make url regex more lenient
Yen Chi Hsuan 9383e66f94 [youku] Use _match_id
Sergey M․ 99e6833c85 [francetv] Update f4m manifest token URL (Closes , Closes )
Yen Chi Hsuan c203be3fb4 [youku] Better handling for Python 2/3 compatibility
Sergey M․ 02175a7986 [youtube:search] Fix search query (Closes )
Sergey M․ 8117df4cd9 [vk] Extract view count
Sergey M․ 7c7dd9dc7f [vk] Fix upload date extraction
Sergey M․ 054932f403 [vk] Fix extraction (Closes )
Yen Chi Hsuan aed473ccf9 [youku] PEP8
Yen Chi Hsuan 8268e94cd4 Merge branch 'youku' of https://github.com/PeterDing/youtube-dl into PeterDing-youku
Yen Chi Hsuan 4af98ecdfb [vbox7] Fix extraction (fixes )
zx8 2a0fcf6113 [safari] make url regex more lenient
Sergey M․ 67d95f177c [niconico] Simplify format info
Sergey M. 44773ad125 Merge pull request from chaoskagami/niconico_qualitynote
Quality note for niconico
Sergey M․ b95cfa9170 [liveleak] Clarify test
Sergey M․ afa1ded425 [liveleak] Clarify rationale for restoring raw video
Sergey M․ 00ac23e6e0 [liveleak] Improve regex for restoring original video URL
jomo 8f75761f24 LiveLak: add test for URLs with 'h264_270p'
jomo 9fd24e3a22 LiveLeak: support more original videos
some (old?) videos use ...mp4.h264_270p.mp4... instead of ...mp4.h264_base.mp4...
This is an addition to 
Naglis Jonaitis 755a9d3d1a [tvplay] Add support for NovaTv
chaoskagami 976b03c56b Quality note for niconico - at least notify whether you'll get low or src
Sergey M․ 450d89ddc1 [dramafever] Improve _VALID_URL
Sergey M․ 463b2e5542 [dramafever:series] Rollback _PAGE_SIZE to max possible
Sergey M․ 70a2002399 [dramafever:series] Fix _VALID_URL (Closes )
Sergey M․ 0029071adb [dramefever] Improve and simplify
Sergey M․ ad49fe7c8f Merge branch 'dramafever' of https://github.com/ping/youtube-dl into ping-dramafever
Sergey M․ af9cdee9cb [brightcove] Improve and generalize brightcove URL extraction from JS
fnord b4e1576aee Brightcove extractor: support customBC.createVideo(...); method
found in http://www.americanbar.org/groups/family_law.html and
http://america.aljazeera.com/watch/shows/america-tonight/2015/6/exclusive-hunting-isil-with-the-pkk.html
Sergey M․ 78e2b74bb9 [tumblr] Add support for pornhub embeds (Closes )
Sergey M․ 65d161c480 [extractor/generic] Add support for pornhub embeds
Sergey M․ 9fcbd5db2a [pornhub] Add support for embeds
Sergey M․ 4f3bf679f5 [vk] Fix authentication for non-ASCII login/password
Sergey M․ 8b6c896c4b [prosiebensat1] Add title regex
Sergey M․ 185dbc4974 [prosiebensat1] Fix rtmp extraction (Closes )
Sergey M․ 3d535e0471 [tvc] Fix embed regex
Sergey M․ d22dec74ff Add `--force-generic-extractor`
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
Sergey M․ 9872d3110c [extractor/generic] Add support for tvigle embeds
Sergey M․ b859971873 [extractor/generic] Rename tvc embed url variable
Sergey M․ 499a077761 [5tv] Improve
Sergey M․ 5da7177729 Merge branch '5tv' of https://github.com/hlintala/youtube-dl into hlintala-5tv
Sergey M․ f37bdbe537 [extractor/generic] Add test for tvc embed
Sergey M․ 2da09ff8b0 [extractor/generic] Fix tvc ie_key
Sergey M․ 5ccddb7ecf [tvc] Fix ie_key
Sergey M․ 954c1d0529 [tvc] Refactor extractor names
Sergey M․ 494f20cbdc [extractor/generic] Add support for tvc embeds
Sergey M․ 29902c8ec0 [tvc:embed] Add embed extraction routine
Sergey M․ 9f15bdabc8 [tvc] Separate embed extractor
Sergey M․ fff3455f58 Merge branch 'tvc' of https://github.com/hlintala/youtube-dl into hlintala-tvc
Hannu Lintala 87446dc618 [tvc] Add extractor (Closes )
Hannu Lintala 99ac0390f5 [fivetv] Add extractor (Closes )
Sergey M․ ff0f0b9172 [tube8] Fix extraction (Closes )
Sergey M․ 97b570a94c [generic] Improve rtl.nl embeds detection (Closes )
Sergey M․ a9d56c6843 [rtlnl] Improve _VALID_URL ()
Sergey M․ f98470df69 [bilibili] Fix FutureWarning
Jaime Marquínez Ferrándiz eb8be1fe76 [rtbf] Extract all formats (closes )
Yen Chi Hsuan 8a1a26ce4c [youtube] Add a test for the DASH segment downloader
Yen Chi Hsuan 7ebd5376fe [nfl] Relax _VALID_URL (fixes )
Yen Chi Hsuan 0c8662d2b6 [youtube] Fix a TypeError caused by 4da31bd566
Jaime Marquínez Ferrándiz 70219b0f43 [youtube:playlist] Use an iterator for the entries (closes )
So that '--playlist-end' downloads only the required pages.
Sergey M․ bd5bc0cd5a [theplatform] Check for /select/media URLs first ()
Sergey M․ 6e054aacca [theplatform] Take care of /select/media URLs (Closes )
Sergey M․ 9d581f3d52 [cbs] Extract display_id
Sergey M․ 9bf99891d0 [cbs] Add support for colbertlateshow (Closes )
Sergey M․ d9cf48e81e [spiegeltv] Extract all formats and prefer hls (Closes )
Yen Chi Hsuan e1b9322b09 [youtube] Restricter DASH signature pattern
A problematic DASH url is:
https://manifest.googlevideo.com/api/manifest/dash/mm/35/key/yt5/ip/140.112.247.145/ms/pm/mv/s/mt/1433794435/id/o-AD2Od_dsOlAUYPu03ZsVWKSbGEbCJJrMp9vnXGhnyRhd/mn/sn-aigllm7r/sparams/as%2Chfr%2Cid%2Cip%2Cipbits%2Citag%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Cplayback_host%2Crequiressl%2Csource%2Cexpire/fexp/9406009%2C9406821%2C9407575%2C9408142%2C9408420%2C9408710%2C9409121%2C9409208%2C9412514%2C9412780%2C9413208%2C9413426%2C9413476%2C9413503%2C9415304%2C9415753/upn/viDQrs8SnmE/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm_sd_hd_clear%2Cwebm2_sd_hd_clear/playback_host/r4---sn-aigllm7r.googlevideo.com/ipbits/0/requiressl/yes/pl/20/itag/0/source/youtube/expire/1433824806/nh/EAQ/signature/81ABE6391E351BA495F5B041B00FF1257A353318.1A6E48ABB74E8F4AE73CA2CB1F963FC34E33DEE7/sver/3/hfr/1
Yen Chi Hsuan 627b964825 [kickstarted] Extract thumbnails in embedded videos ()
Yen Chi Hsuan 01e21b89ee [noco] Skip invalid timestamps (closes )
Yen Chi Hsuan 788be3313d [cnet] Fix theplatform vid extraction (fixes )
Yen Chi Hsuan e1ec93304d [instagram:user] Truncate title to 80 characters ()
This is a workaround. Currently YoutubeDL.process_info() truncates
info_dict['title'] to 200 characters, but the implementation can't
handle wide characters.
Yen Chi Hsuan edb99d4c18 [instagram] Handling null values (fixes )
I didn't add the test case here because it takes too much time. (7
minutes on my machine)
Yen Chi Hsuan 68477c3dab [tlc] Fix test failure due to DiscoveryIE changes
Yen Chi Hsuan 65ba8b23f4 [discovery] Rewrite DiscoveryIE (fixes )
Discovery.com now uses a completely different approach for serving
videos. At least in both test cases brightcove are involved. However,
AMF support is necessary for these brightcove videos. As a result, I
try to extract videos from the info page ('?flat=1'). The downloaded
file can be different from the one in browsers.
Yen Chi Hsuan 621ed9f5f4 [common] Add note and errnote field for _extract_m3u8_formats
Yen Chi Hsuan b26733ba7f [brightcove] Allow single quotes in Brightcove URLs (fixes )
Sergey M․ 665b6c1236 Merge branch 'hlintala-ruutu'
Sergey M․ 9414338a48 [ruutu] Improve, make more robust and fix python 2.6 support
Sergey M․ 717b0239fd Merge branch 'ruutu' of https://github.com/hlintala/youtube-dl into hlintala-ruutu
Hannu Lintala d00735a0c5 [ruutu] Don't use fallback for DASH and other non-HTTP urls
Yen Chi Hsuan c23d5ce926 Merge branch 'PeterDing-iqiyi'
Yen Chi Hsuan b5a3c7f109 [iqiyi] Cache encryption keys
Yen Chi Hsuan 9c5f685ef1 [iqiyi] Improve regex pattern again
Yen Chi Hsuan 08bb8ef201 [iqiyi] Unify get_format() and get_bid()
Yen Chi Hsuan 865ab62f43 [iqiyi] Make _VALID_URL more accurate
v_* urls are individual videos, while a_* urls are playlists, which are
not supported yet.
Yen Chi Hsuan 9948113590 [iqiyi] Add a multipart test case
Yen Chi Hsuan c4ee87022b [iqiyi] Change id for multipart videos
Yen Chi Hsuan ffba4edb06 [iqiyi] Improve some variable names and add download notes
Yen Chi Hsuan 958d0b659b [iqiyi] Reorder imports
Yen Chi Hsuan aacda28b28 [iqiyi] Give error message for assertion failures
Yen Chi Hsuan 29e7e0781b [iqiyi] Simplify and improve regex patterns
See the comments in 
Yen Chi Hsuan 7012620e2b [iqiyi] Remove format selection codes
Yen Chi Hsuan f1da861018 [iqiyi] PEP8
Yen Chi Hsuan 4da31bd566 [youtube] Fix a FutureWarning from xml.etree.ElementTree
Naglis Jonaitis 05aa9c82d9 [sunporno] Fix view_count extraction
Naglis Jonaitis a9e58ecd3f [turbo] Improve description extraction
`og:description` is empty for some videos.
Hannu Lintala 223544552f [Ruutu] Add new extractor
Sergey M․ 3d8e9573a4 [youtube:channel] Improve channel id extraction ()
Naglis Jonaitis 54eb81a087 [pornovoisines] Improve average_rating extraction and update test case
Naglis Jonaitis c33c547d66 [izlesene] Avoid timestamp differences in tests due to DST
Naglis Jonaitis dfe7dd9bdb [izlesene] Unquote video URLs and simplify
Yen Chi Hsuan e8ac61e840 [qqmusic] Use meaningful variable names
Yen Chi Hsuan f00a650705 [qqmusic] Rearrange codes
Yen Chi Hsuan 4bde5ce992 Merge branch 'qqmusic-more-formats' of https://github.com/ping/youtube-dl into ping-qqmusic-more-formats
Yen Chi Hsuan d31573fa37 [teamcoco] Handle incomplete m3u8 URLs (fixes )
There are 2 TODOs. I don't know how to handle these cases correctly.
ping 8b8cde2140 [qqmusic] Set abr for mp3 formats
Yen Chi Hsuan 9d4f213f90 [qqmusic:toplist] List name and description are optional
Yen Chi Hsuan 168db222c6 Merge pull request from ping/qqmusic-toplist-fix
[qqmusic] Fix toplist extraction
Sergey M․ 3d6388e34e [tnaflix] Fix relative URLs (empflix)
Sergey M․ 3ce9bc712a [empflix] Fix typo
Sergey M․ e52c0bd0eb [tnaflix] Modernize
Sergey M․ 56c837ccb7 [tnaflix] Fix typo
Yen Chi Hsuan 423d2be5f8 [downloader/dash] Rename the protocol
'http_dash_segments' looks more like a protocol name than
'dash_segments'
Yen Chi Hsuan b9258c6178 [YoutubeDL] Change how DashSegmentsFD is selected
ping 55e5841f14 [qqmusic] Extract additional formats (mp3-128, mp3-320)
ping ed15e9ba02 [qqmusic] Remove unused import
ping eedda32e6b [qqmusic] Fix toplist
Sergey M. d073055dcd Merge pull request from slava-sh/nova
[nova] Update
Slava Shklyaev e4ac7bb1e5 [nova] Revert "Fix extension extraction bug"
This reverts commit 9464a194db.
Yen Chi Hsuan 9bac8c57e3 Merge branch 'iqiyi' of https://github.com/PeterDing/youtube-dl into PeterDing-iqiyi
Yen Chi Hsuan 6800d3372f [YoutubeDL] Support DASH manifest downloading
Sergey M․ 3153a2c98d [tvigle] Skip tests
Sergey M․ 15b74b94be [tvigle] Capture error message
Sergey M․ 687cb3ad35 [24video] Fix uploader extraction
Yen Chi Hsuan 8f94784124 [tumblr] Detect vid.me embeds (fixes )
Yen Chi Hsuan 23dd1fc74c [vidme] Always use the non-embedded page
For example, https://vid.me/Wmur contains more information than
https://vid.me/e/Wmur
Slava Shklyaev fa971259e6 [nova] Add a comment about html in description
Slava Shklyaev b0cda32f72 [nova] Fix Python 2.6 compatability issue
Slava Shklyaev 08b7968e28 [nova] Fix display_id extraction bug
Slava Shklyaev 4b5fe1349f [nova] Comply with review
Sergey M․ d23da75b32 [iprima] Fix description extraction
`og:description` does not contain actual description anymore.
Slava Shklyaev b5597738d4 [iprima] Comply with review
Slava Shklyaev bc03e58565 [iprima] Update
Slava Shklyaev a00234f1c5 [nova] Minor style improvement
Slava Shklyaev 34c0f95db2 [nova] Remove html tags from description
Slava Shklyaev fcb04bcaca [nova] Extract upload_date in some cases
Slava Shklyaev 9464a194db [nova] Fix extension extraction bug
Replace the hardcoded flv with determine_ext. Let rtmpdump parse the url.
Slava Shklyaev 9f4b9118cc [nova] Fix display_id extraction bug
Make id group non-greedy so that .html is not included in it.
Sergey M․ 60158217ef [nova] Add tv test
Sergey M․ 923e79e2e4 [nova] Add extractor
Naglis Jonaitis 866b296d0f [aftonbladet] Fix extraction and update _VALID_URL (Fixes )
Sergey M․ 47fd8c2f76 [patreon] Fix embeds extraction (Closes )
Sergey M․ 96b9690985 [imgur] Improve extraction
Sergey M. 002c0fb511 Merge pull request from ivan/make-playlist-url
[youtube] Construct a playlist URL in case the page is missing one
Sergey M․ 7584e38ce4 [tvigle] Modernize
Sergey M․ eb47569f8a [tvigle] Add support for m3u8
Ivan Kozik d2a9de78df [youtube] Construct a playlist URL in case the page is missing one
This fixes jumping from user/channel -> playlist for some users like
https://www.youtube.com/user/BitcoinFoundation

This also removes the superfluous log message
"add --no-playlist to just download video VIDEOID"
when downloading a user/channel.
Sergey M․ c5138a7ce4 [extractor/generic] Clarify test comment
Sergey M․ c5fa81fe81 [extractor/generic] Put all direct link tests near to each other for better navigation
Sergey M․ a074e92296 [extractor/generic] Add test for large compressed media
Sergey M․ 1ddb9456c4 [extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL
Sergey M․ 58bde34a23 [extractor/generic] Force Accept-Encoding to any for extraction pass
Sergey M․ 339516072b [extractor/generic] Unescape video_id and title extracted from URL
Yen Chi Hsuan a2d971309b [porn91] Use single quotes
Yen Chi Hsuan d05a1dbe70 [porn91] Catch daily limit error
Yen Chi Hsuan a80601f8d9 [porn91] Extract more info
Yen Chi Hsuan 1c22238756 [porn91] Simplify
Yen Chi Hsuan 9ff811c5cd [porn91] PEP8
Yen Chi Hsuan 1ebc05df91 Merge branch 'porn91' of https://github.com/PeterDing/youtube-dl into PeterDing-porn91
Sergey M․ 386bdfa698 [youtube:user] Workaround 35 pages limitation (Closes )
Naglis Jonaitis 1ae7ff771b [tubitv] Add error message for videos that require login ()
Naglis Jonaitis 5196b98897 [tubitv] Add new extractor (Closes )
Sergey M․ e6e63e91a7 [tf1] Extend _VALID_URL (Closes )
Sergey M․ b4dd98358f [vgtv] Properly handle lives
Sergey M․ 4d454c5e4b [vgtv] Check for inactive videos
Sergey M․ 5c2191a605 [vgtv] Skip wasLive hds (Closes )
Sergey M․ bba5bfc890 Merge branch 'ping-soompi'
Sergey M․ 1a5b77dc21 [crunchyroll] Fix python 3.2
Sergey M․ b2cf6543b2 [soompi] Improve and simplify
Sergey M․ 0385d64223 [crunchyroll] Extract subtitles extraction routine
pulpe 6ebdfe43e4 [tube8] fix extractor (fixes )
Yen Chi Hsuan fafec39d41 [spiegeltv] Changed RTMP server (fixes and fixes )
Thanks to @brickleroux for finding out the problem
PeterDing 670861bd20 [iqiyi] Do not request for unneeded formats
PeterDing 08f7db20c1 [youku] change format_id
PeterDing 605ec701b7 [iqiyi] Add new extractor for iqiyi.com
Yen Chi Hsuan 84e1e036c2 [senate] Extend _VALID_URL (fixes )
PeterDing 1498940b10 [youku] compare bytes and str for compatible; use compat_urllib_parse for making video_url
PeterDing 806598b94d [porn91] the one that _search_regex returns not needs to be checked
Sergey M․ e26be70bca Merge branch 'soompi' of https://github.com/ping/youtube-dl into ping-soompi
PeterDing ca45246627 [youku] compatible for python > 3.3 or > 2.7
PeterDing f9355dc989 [youku] update youku
Sergey M․ 9e0b579128 [nowtv] Add test for rtlnitro
Sergey M․ ff4a1279f2 [nowtv] Do not request unnecessary metadata
Sergey M․ 9b254aa177 [nowtv] Add non-free video check
PeterDing 703d78bbf5 [porn91] change re to _search_regex
Sergey M․ d9446c7319 Merge branch 'akirk-nowtv'
Sergey M․ b25b645d51 [nowtv] Improve and simplify
PeterDing d90b3854ca [porn91] Add new extractor for 91porn.com
Sergey M․ bf24c3d017 [facebook] Improve title regex (Closes )
Yen Chi Hsuan f9f3e3df9a [teamcoco] Use determine_ext to determine the video type
Some videos does not contain a 'type' field ()
Yen Chi Hsuan f8d5e1cfb5 [naver] Fix video url (fixes )
RTMP urls in test:naver does not work. Need more investigation.
Yen Chi Hsuan c23848b3c5 [naver] Enhanced error detection
Yen Chi Hsuan 6d00a2dcd1 [bilibili] Catch API call failures
JSON are returned in a failed API call
Yen Chi Hsuan b535170b21 [bilibili] Skip assertion if HQ videos not available
Sergey M․ 1434184c57 [spankwire] Do not modify aes key string
Sergey M․ 7a372b64df [pornhub] Do not modify aes key string (Closes )
Sergey M․ 5406af92bc [dailymotion:user] Fix _VALID_URL
Sergey M․ 7d65242dc3 [dailymotion:user] Process user home as user (Closes )
Naglis Jonaitis 544a8693b7 Remove Firedrive and Sockshare imports
Oops
Naglis Jonaitis 35a4f24a37 [firedrive] Remove extractor (Closes )
Haywire since last October.
Naglis Jonaitis ff305edd64 [sockshare] Remove extractor
Haywire since last October.
Yen Chi Hsuan efec4358b9 [cinemassacre] Support an alternative form of screenwavemedia URL
fixes 
Yen Chi Hsuan db3ca36403 [facebook] Move the title extraction warning below (fixes )
Yen Chi Hsuan 42833b44b5 [tf1] Extend _VALID_URL (fixes )
Alexander Kirk 5d0a33eebc rtlnow is now hosted at nowtv.de
Sergey M․ ba2df04b41 [odnoklassniki] Make URL explicit
Sergey M․ c6bbdadd79 [odnoklassniki] Support extraction from metadata URL (Closes )
Mister Hat 680f9744c4 [pinkbike] used proper conversion methods
Mister Hat 2c935c0c72 [pinkbike] converted duration to int
Mister Hat 7198063d96 [pinkbike] new extractor
Sergey M? d41ebe146b [tenplay] Fix formats and modernize (Closes )
Jaime Marquínez Ferrándiz 4b4e1af059 [arte] Remove unused import
Sergey M. 80240b347e Merge pull request from jaimeMF/remove-nondash
[youtube] Remove the nondash formats (fixes )
Jaime Marquínez Ferrándiz 04b3b3df05 [youtube] Remove the nondash formats (fixes )
Since we use fixed values for some fields like width and height they can be wrong, and would get picked by some formats filters.
For example for https://www.youtube.com/watch?v=EQCrhbBxsjA the biggest height is 720 and for nondash formats it's set to 1440, so -f 'bestvideo[height>=1200]+bestaudio' would incorrectly pick the nondash format, instead it should report that the requested format is not available.
Sergey M․ 2ad5708c43 [arte:future] Switch to `search_regex` for now (Closes )
Sergey M․ 63f3cab4ae [rtbf] Fix extraction (Closes )
Sergey M․ d78c834ead [karrierevideos] Improve and simplify
Sergey M․ 05a976cd99 Merge branch 'karrierevideos' of https://github.com/misterhat/youtube-dl into misterhat-karrierevideos
Sergey M․ 34fb7e46ad [empflix] Relax _VALID_URL
Sergey M․ abac15f3c6 [tnaflix] Do not capture `cat_id`
Sergey M. b700055ba4 Merge pull request from frenchy1983/fix_tnaflix_regex
[TNAFlix] Allow dot (and more) in cat_id and display_id
Sergey M? 1335c3aca8 [drtv] Improve extraction (Closes )
Yen Chi Hsuan 30455ce255 [nextmedia] Extend and reorder _VALID_URL
Yen Chi Hsuan 9bf87ae3aa [nextmedia] Merge AppleDailyRealtimeNewsIE and AppleDailyAnimationNewsIE
Yen Chi Hsuan abca34cbc0 [cnn] Relax _VALID_URL again (fixes )
The problem is the same as test:CNN_1, so I didn't add the test case
Sergey M․ d386878af9 [prosiebensat1] Add support for .at domain names (Closes )
Sergey M․ 685c74d315 [rutv] Extend embed URL (Closes )
Jaime Marquínez Ferrándiz ba64547616 [sportbox] Remove unused import
frenchy1983 ed5a637d62 [TNAFlix] Restore test
See dstftw's comment in 
Yen Chi Hsuan 8a278a1d7e [nba] Fix duration extraction (fixes )
Sergey M․ 77d9cb2f04 [sportbox] Fix extraction
Sergey M․ 0459432d96 [shared] Fix for python 3.2
Sergey M․ 43150d7ac3 [shared] Fix for python 3.2
Sergey M․ afe8b594be [rtve.es:alacarta] Fix for python 3.2
Sergey M․ 06947add03 [chilloutzone] Fix for python 3.2
Sergey M․ 5cd47a5e4f [videott] Fix for python 3.2
Sergey M․ 53de95da5e [viki] Extend _VALID_URLs
Jaime Marquínez Ferrándiz 6ad9cb224a [mitele] It now uses m3u8 ()
It should also be possible to use Adobe HDS, but it would require more work.
frenchy1983 e7752cd578 [TNAFlix] Allow dot (and more) in cat_id and display_id
URLs with dots were raising a "UnsupportedError: Unsupported URL" error.
Jaime Marquínez Ferrándiz 4d2f42361e [viki] remove unused import
Sergey M․ 4d8ee01389 [viki] Fix typo
Sergey M․ d01924f488 [viki:channel] Extend matching URLs and extract movies
Sergey M․ bc56355ec6 [viki:channel] Switch to API
Sergey M․ ac20d95f97 [viki] Add support for youtube externals
Sergey M․ 1a83c731bd [viki] Switch extraction to API
Sergey M․ ca57a59883 Merge branch 'ping-viki-shows'
Sergey M․ b0d619fde2 [viki:channel] Extract title from JSON
Sergey M․ cc7051efd7 Merge branch 'viki-shows' of https://github.com/ping/youtube-dl into ping-viki-shows
ping 5137adb94d [soompi] Switch to non-geoblocked test video
ping 2632941f32 [soompi] Add new extractor for tv.soompi.com
ping 137597b0ea [dramafever] Streamline code
Yen Chi Hsuan 051df9ad99 [letv/sohu] Skip tests relying on external proxies
The proxy is currently broken. See  and 
ping f670ef1c8e [dramafever] Add new extractor for dramafever.com
Sergey M․ d9d747a06a [ultimedia] Fix extraction
Yen Chi Hsuan b813d8caf1 [qqmusic] Unescape '\\n' in description ()
Yen Chi Hsuan ecee572411 [yahoo] Add support for closed captions (closes )
Sergey M․ 484c9d2d5b [vier] Fix extraction
Sergey M․ 5d8dcb5342 [vuclip] Fix extraction
Sergey M․ 2328f2fe68 [vulture] Fix extraction
Sergey M․ 4f514c7e88 [wimp] Fix youtube extraction (Closes )
Sergey M․ 5bdc520cf1 [xminus] Fix extraction
Jaime Marquínez Ferrándiz fc6e75dd57 [instagram] Only recognize https urls (fixes )
http urls redirect to them.
Mister Hat ba9d16291b manually specify namespace
Mister Hat 725652e924 [karrierevideos] add support for www.karrierevideos.at (closes )
ping 8da0e0e946 [viki] Change IE name to channel, better message output
Sergey M․ 588b82bbf8 [tv2:article] Add extractor (Closes )
Sergey M․ bc0f937b55 [tv2] Add extractor ()
Sergey M․ baa43cbaf0 [extractor/common] Relax valid url check verbosity
Sergey M․ adb6b1b316 Merge branch 'viki-shows' of https://github.com/ping/youtube-dl into ping-viki-shows
ping 1c18de0019 [viki] Add proper paging and include clips