Commit Graph

7899 Commits (7900aede14d2e2a46c8fd4430e48cde41f354859)

Author SHA1 Message Date
Sergey M․ 5b0c40da24 [extractor/common] Expand meta regex
vijayanand nandam e0ac521438 adding support for axel download manager
remitamine c29458f3ec [shahid] change the tests
Sergey M․ bf94d763ba [extractor/generic] Add test for
Sergey M․ 8a37aa1517 [extractor/generic] Expand ooyala regex (Closes )
Sergey M․ fd5d8270dc [clipfish] Fix extraction, minimize requests, get rid of drm hds, extract m3u8 and more metadata
Sergey M․ be612d9e0c Merge branch 'clipfish' of https://github.com/remitamine/youtube-dl into remitamine-clipfish
Sergey M․ 4a7434d0b0 [dcn] Simplify _VALID_URL
Sergey M․ f94639fadf [dcn] Improve
Sergey M․ 89faae660f Merge branch 'dcn' of https://github.com/remitamine/youtube-dl into remitamine-dcn
Sergey M․ 0f422256d6 [nowtv] Add .at test
Sergey M․ acc1adbe7a [nowtv] Add support for .ch TLD
Sergey M․ 8002ac9e0a [nowtv] Add support for .at TLD
remitamine 6d30cf04db [dcn] fix type and key errors
Philipp Hagemeister 430b092a5f release 2015.08.06.1
Philipp Hagemeister 3eb5fdb581 release 2015.08.06
Sergey M․ 9663bd3abb [southpark:de] Enable non-ASCII redirect URL test
Sergey M․ 5a4d9ddb21 [utils] Percent-encode redirect URL of Location header (Closes )
remitamine 3be3c622dc [shahid] generic errors handling and check with flake8
remitamine cd6b555e19 [dcn] add origin to api request and fix the test and check with flake8
Sergey M․ 671302b5c0 [YoutubeDL] Remove unused imports
Sergey M․ 4f34cdb0a8 [southpark:de] Skip test
Sergey M․ bd690a9f93 [southpark:de] Add test for non-ASCII in URLs
Sergey M․ 51f267d9d4 [YoutubeDL:utils] Move percent encode non-ASCII URLs workaround to http_request and simplify (Closes )
Sergey M. 47f53ad958 Merge pull request from jaimeMF/format_spec_fix_dashes
[YoutubeDL] format spec: correctly handle dashes and other unused operators
Sergey M․ c73cdd800f [xhamster] flake8
Sergey M․ f535ec8278 [xhamster] Remove unused import
Sergey M․ 238755752f [tudou] Extract player URL from the webpage
Delon c71a3195af [tudou] Fix extracion
Sergey M․ 54a9328b20 [generic] Expand jwplayer support
Sergey M․ 3e48522477 [xhamster] Fix uploader extraction
Sergey M․ 251a44b776 [xhamster] Fix thumbnail extraction
Sergey M․ be7a8379b4 [xhamster] Make more robust
Sergey M. defce60385 Merge pull request from vijayanandnandam/master
fixing xhamster file extraction
vijayanand nandam 354b4b8604 fixing xhamster file extraction
Sergey M․ 5b7dab2dd6 [lynda] Make login more robust
Sergey M․ 8a5601e42f [lynda] Fix login (Closes )
Jaime Marquínez Ferrándiz 232541df44 [YoutubeDL] format spec: correctly handle dashes and other unused operators
'mp4-baseline-16x9' must be handled as a single string, but the '-' was treated as an operator.
Sergey M․ a346b1ff57 [bbc] Add support for vxp-playlist-data embeds (Closes )
Jaime Marquínez Ferrándiz d96d604e53 YoutubeDL: format spec: don't accept a bare '/' ()
Niklas Haas e704f87f86 [twitch] Parse start_time from 't' (closes )
Eg. for VOD links like http://www.twitch.tv/gamesdonequick/v/9136645?t=14h29m15s
Sergey M․ 8f5639afcb [pornhub] Improve video quality regex
Jaime Marquínez Ferrándiz 03950c90f7 Merge remote-tracking branch 'jaimemf/format_spec_groups' (closes )
Jaime Marquínez Ferrándiz 47a8b7c14a [mdr] Change XPath to make it work in python 2.6 (fixes )
The 'progressiveDownloadUrl' element is a direct child, so they should be equivalent.
Sergey M. 2a04d2c799 Merge pull request from remitamine/facebook
[facebook] extract uploader
remitamine 67b8a28a2f [facebook] add uploader value to the tests
remitamine 51a575159a [facebook] extract uploader
Sergey M․ 524229a297 [pornhub] Improve
George Brighton 754e70cf3e [pornhub] Fix video url regular expression.
PornHub seems to have subtly changed their JavaScript. Before, video URL strings were embedded directly in the video's `flashvars_*` object, but they are now assigned to variables of the form `player_quality_*`, which are then added to this object later under the relevant quality key.
Sergey M․ 84bc4dcb0f [downloader/http] Clarify rationale for Content-Range check ()
Sergey M․ 10eaa8ef1d [downloader/http] Report unable to resume
Sergey M․ c3124c3085 [downloader/http] Simplify
remitamine 8d5b8b477e [utils] import re
remitamine d7d2a9a3db [utils] restart download if server does not support byte ranges
Jaime Marquínez Ferrándiz 25a4c5a9ed [dailymotion:playlist] Use an iterator for the entries
So that using '--playlist-end' only downloads the required pages (reported in ).
Jaime Marquínez Ferrándiz 5c45bbe57b [nowtv] Remove unused import
Sergey M․ d41d04c0f5 [videolectures] Fix _VALID_URL
Sergey M․ e422d7f4f7 [nowtv] Expand _VALID_URL
Sergey M․ cdc682d5a4 [nowtv] Fix extraction (Closes )
Jaime Marquínez Ferrándiz 9cc93c64aa [screenwavemedia] Use the IP for the videoserver (fixes )
For http://cinemassacre.com/2015/07/28/avgn-seaman-for-dreamcast/ the other server returns a 403 error.
remitamine fa7a1cc5ef [screenwavemedia] fix info extraction (fixes )
Closes .
Sergey M․ 17712eeb19 [extractor/common] Extract namespace parse routine
Sergey M․ 41c3a5a7be [extractor/common] Fix python 3
Sergey M․ 8765222d22 [extractor/generic] Add generic SMIL tests
Sergey M․ e5e8d20a3a [extractor/generic] Improve generic SMIL detection
Sergey M․ a107193e4b [extractor/common] Extract f4m and m3u8 formats, subtitles and info
Sergey M․ 3f125c8c70 [nbcnews] Extend _VALID_URL
Sergey M. 75e8b2ac87 Merge pull request from dstftw/generalized-fragmented-fd
Generalized fragmented media file downloader
Sergey M․ ee114368ad [utils] Make value optional for find_xpath_attr
This allows selecting particular attributes by name but without specifying the value and similar to xpath syntax `[@attrib]`
Jaime Marquínez Ferrándiz 525a87f58e [gdcvault] Fix typo: xml_decription_url -> xml_description_url
remitamine 44cae2fb2e [gdcvault] Add support for audio extraction (fixes )
Closes .
remitamine 30a453884e [viewster] use head request to extract api token
Closes .
Sergey M․ 3b58d94f71 [vidme] Make uploader optional and add test
Sergey M. 8abb86fec4 Merge pull request from remitamine/vidme
[vidme] extract the uploader
Sergey M․ 16a089780e [soundcloud] Clean up _VALID_URLs
remitamine 09b6468d30 [vidme] extract the uploader
Sergey M․ 80fb6d4aa4 [soundcloud:user] Rework extractor (Closes )
Jaime Marquínez Ferrándiz 1f04873517 [viewster] Use 'compat_urllib_parse_unquote'
remitamine 799207e838 [viewster] extract the api auth token
Closes .
Jaime Marquínez Ferrándiz 34866b4836 Merge remote-tracking branch 'dstftw/multifeed-videos' (closes )
Sergey M․ d12a1a47d5 [bbc] Improve work with mediaselection URLs
Sergey M․ 8d42e3501e Merge branch 'pr-fix_bbc_mediaselector' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-fix_bbc_mediaselector
Sergey M․ 5e1eddb939 [youtube] Show info message for multifeed videos according to noplaylist option
Sergey M․ 23e7f53bd3 Merge branch 'purdeaandrei-save_tags_simpler_only_saves_tags_to_info_json'
Sergey M․ 000b6b5ae5 [youtube] Improve tags extraction and add test
Sergey M․ 864f24bd2c [extractor/common] Add _meta_regex and clarify tags field
Sergey M. 5d8df28d27 Merge pull request from raphaelm/patch-1
Remove redundant (and wrong) class parameters
Sergey M․ f9a5affad9 [hls] Implement hlsnative fd in terms of fragment fd
Sergey M․ ab81ef8fa7 [f4m] Implement f4m fd in terms of fragment fd
Sergey M․ 95d8f7ea12 [fragment] Generalize fragmented media file downloader
Purdea Andrei 5316bf7487 Documented tags as a possible dict key
Purdea Andrei a6f774e901 [youtube]: tags key in info jason is now a list
Purdea Andrei f171bc8b59 [youtube] save keywords in info jason when --write-info-json is used
Philipp Hagemeister 289bbb350e release 2015.07.28
Sergey M․ d247a2c8bf [bbc] Fix regex
Sergey M․ 88ed52aec9 [bbc] Add support for direct bbc.co.uk embeds
fnord cb23bcba29 BBCIE: Fix missing .mp4 formats on news sites
Prior to merge BBCNewsIE from pr  was rewritten into BBCIE in 9afa177. Support was added for non-news
sites (/travel, /sports), however support for the news mediaselector was removed to support these sites.
This removed support for .mp4.

    pr  ( news site, news mediaseletor : http://open.live.bbc.co.uk/mediaselector/4/mtis/stream/ )
    format code                                          extension  resolution note
    journalism_nonuk_stream_h264_flv_200_akamai          flv        400x224    h264@ 176k, 1001.77KiB
    journalism_nonuk_stream_h264_flv_400_akamai          flv        400x224    h264@ 512k, 2.85MiB
    journalism_nonuk_stream_h264_flv_med_akamai          flv        640x360    h264@ 800k, 4.43MiB
    journalism_nonuk_stream_h264_flv_hi_akamai           flv        688x384    h264@1500k, 8.34MiB
    journalism_world_stream_h264_http_200_sis_news_http  mp4        400x224    h264@ 176k, 1001.77KiB
    journalism_world_stream_h264_http_400_sis_news_http  mp4        400x224    h264@ 512k, 2.85MiB
    journalism_world_stream_h264_http_hi_sis_news_http   mp4        688x384    h264@1500k, 8.34MiB (best)

    # 9afa177 ( same url, non-news mediaselector: http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/journalism-pc/vpid/ )
    format code                                  extension  resolution note
    journalism_nonuk_stream_h264_flv_lo_akamai   flv        384x216    h264@ 496k, 2.76MiB
    journalism_nonuk_stream_h264_flv_med_akamai  flv        640x360    h264@ 800k, 4.43MiB
    journalism_nonuk_stream_h264_flv_hi_akamai   flv        688x384    h264@1500k, 8.34MiB (best)

This change corrects the above, by trying /mediaselector/5 if /mediaselector/4 fails.
Raphael Michel 2c7ed24796 Remove redundant (and wrong) class parameters
Jaime Marquínez Ferrándiz 4c6bd5b5b6 [youtube] Use 'vp8' and 'vp9' in lowercase (fixes )
That's how YouTube reports them in their DASH manifest.
tippfeler aeb7b41d44 [spiegel] Accept iframe urls
Closes .
Sergey M․ 5bdec59de1 [comcarcoff] Add support for singleshots (Closes )
remitamine dfaba1ab95 [shahid] fix variable name
remitamine a62fd1af27 [shahid] improve info extraction
Sergey M․ 7a89681722 [bbc] Skip DASH until supported
Sergey M․ 51da40e621 [bbc] PEP8
Sergey M․ d8f0a9ecea [youtube] Respect noplaylist for multifeed videos
Sergey M․ cf7e015f25 [youtube] Add support for multifeed videos
Sergey M․ 1af330f29f Merge branch 'atomicdryad-pr-bbcnews'
Sergey M․ 9afa1770d1 [bbc] Improve playlist extraction, refactor, expand support and document
Yen Chi Hsuan 2c7c721933 [ir90tv] Optional fields should be non-fatal
Yen Chi Hsuan 7523647391 [ir90tv] PEP8
Yen Chi Hsuan 9700cd9097 [ir90tv] Improve title extraction
Yen Chi Hsuan eab7faa0c1 [ir90tv] Test (?:www\.)? part in _VALID_URL
Yen Chi Hsuan a56c1e38c7 Merge branch 'ir90tv' of https://github.com/cyb3r/youtube-dl into cyb3r-ir90tv
Sergey M․ 40a2d17052 [soundcloud:playlist] Defer download link resolve
Sergey M․ b14fa8e687 [soundcloud:set] Defer download link resolve (Closes )
Sergey M․ 678e436f2e [youtube] Handle empty allowed regions (Closes )
Sergey M․ ff81c4c99c Merge branch 'pr-bbcnews' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-bbcnews
Sergey M. 420658e6cb Merge pull request from remitamine/letv
[letv] fix height
remitamine 593ddd851b [letv] fix height
Yen Chi Hsuan 1243402657 [dailymotion:playlist] Detect problematic redirection (fixes )
remitamine 1a117a7728 [clipfish] extract mp4 video link
Sergey M․ 2b2ee140c3 [dailymotion:user] Fix _VALID_URL (Closes )
Sergey M․ d97f5cd795 [bbccouk] Make more robust (Closes )
Sergey M․ f3f0b8e403 [canalplus] Modernize
Sergey M․ 660f9459da [canalplus] Fix m3u8 videos extension
Sergey M․ 10952eb2cf [extractor/common] Consistent URL spelling
Sergey M. cdad742700 Merge pull request from jaimeMF/extract_start_time
[youtube] Extract start_time
Sergey M․ a9e8f60ef6 [rtlnl] Update unencrypted streams comment ()
corone17 a8b7b26068 Undo adaptive -> flash workaround
For a couple of days now rtlXL's non-DRM adaptive (m3u8) streams don't work anymore. By undoing the adaptive -> flash workaround youtube-dl returns the DRM streams again. Too bad for foreigners (geoblock).
The progressive streams still work fine.
Sergey M․ ba911137fa [rts] Add support for articles with videos on rhs (Closes )
Sergey M․ d3f007af18 [daylimotion] Adapt to player v5 and modernize (Closes , closes )
Jaime Marquínez Ferrándiz 2929fa0e79 [youtube] Also look into the 'start' field for start_time
Jaime Marquínez Ferrándiz 297a564bee [youtube] Extract end_time
fnord 53b8247cb5 NationalGeographic._VALID_URL: work site-wide
Closes .
Jaime Marquínez Ferrándiz 59db9f8018 [downloader/dash] Improve 'combine_url' (fixes )
In some videos the base_url already ends with '/'.
Yen Chi Hsuan b73b14f72c [viki] Rewrite dict selection codes
Yen Chi Hsuan 41597d9bed [viki] Fix description extraction (closes )
Jaime Marquínez Ferrándiz b37317d8b0 [generic] Unescape HTML escape sequences in redirect urls (fixes )
Jaime Marquínez Ferrándiz 87dc451108 [youtube] Don't use the DASH manifest from 'get_video_info' if 'use_cipher_signature' is True ()
Currently they give a 403 Forbidden error.
Jaime Marquínez Ferrándiz ca4456eda8 [tagesschau] Remove unused import
Sergey M․ 993df6bc22 [prosiebensat1] Modernize
Sergey M․ 61be92e26a [prosiebensat1] Recognize DRM protected videos ()
Sergey M․ c59b61c0da [viki] Fix height (Closes )
Sergey M․ 3e214851a4 [tagesschau] Improve tests
Sergey M․ a47b602b08 [tagesschau] Add support for audio
Sergey M․ 948199deac [tagesschau] Relax _VALID_URL and simplify
Sergey M․ c356620ec1 Merge branch 'patch/enhance-tagesschau-regex' of https://github.com/rohieb/youtube-dl into rohieb-patch/enhance-tagesschau-regex
Sergey M․ c7620992d2 [pbs] No need to escape colon
Sergey M․ ce1bafdce9 [pbs] Clean up title construction rationale