Commit Graph

702 Commits (503b604a316837b9dd6ef32045e4e9bbfb6a1363)

Author SHA1 Message Date
Sergey M․ 73c4ac2c95
[youtube:channel] Improve channel id extraction and detect unavailable channels (Closes #10009) 8 years ago
Yen Chi Hsuan 4080530624
[youtube:shared] Recognize the new 'shared' URLs
Closes #10007
8 years ago
Sergey M․ be49068d65
[youtube] Fix and skip some tests 9 years ago
Sergey M․ 525cedb971
[youtube] Relax URL expansion in description 9 years ago
Sergey M․ de3c7fe0d4
[youtube] Fix 141 format tests 9 years ago
Yen Chi Hsuan daa0df9e8b
[youtube:user] Support another URL form
Such an URL comes from http://www.gametrailers.com/. This is originally
a test case in GenericIE, but now seems all GameTrailers videos are on
YouTube.
9 years ago
Sergey M․ 2c34735267
[youtube] Add itags 256 and 258 9 years ago
Sergey M․ 25cb7a0eeb
[youtube] Allow empty attribute values in description regex 9 years ago
Sergey M․ 175c2e9ec3
[youtube:search_url] Reimplement in terms of youtube:playlistbase 9 years ago
Sergey M․ 494ab6db73
[youtube] Capture and output login error message 9 years ago
Jaime Marquínez Ferrándiz 1b6182d8f7 [youtube:playlist] Fetch all the videos in a mix (fixes #3837)
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
9 years ago
remitamine f3a58d46bf [youtube:user] check if the url didn't match only the other youtube extractors 9 years ago
Sergey M․ 466a614537
[youtube:playlist] Recognize popular uploads playlist as mix (Closes #9170) 9 years ago
Sergey M․ 6d4fc66bfc [youtube] Add support for zwearz (Closes #9062) 9 years ago
Sergey M․ 6dee688e6d [youtube:playlistsbase] Restrict playlist regex (Closes #8986) 9 years ago
Sergey M․ 6e6bc8dae5 Use urlencode_postdata across the codebase 9 years ago
Sergey M․ 15707c7e02 [compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode

Closes #8974
9 years ago
Sergey M․ f07e276a04 [youtube:live] Add extractor (Closes #8959) 9 years ago
Yen Chi Hsuan 11f12195af [youtube] Added itag 91
Seen in https://www.youtube.com/watch?v=jMN4cxyhJjk
9 years ago
Sergey M․ fd050249af [youtube] Extract uploader_url (Closes #8724) 9 years ago
Sergey M․ 7caf9830b0 [youtube] Extract license (Closes #8725) 9 years ago
remitamine 3318832e9d [youtube] improve width and height extraction from fmt_list 9 years ago
remitamine c2d3cb4c63 Revert "[youtube] add tbr to _formats extracted from watch_as3.swf"
This reverts commit 4a5ba28a87.
9 years ago
remitamine c48dd4400f Revert "[youtube] add basic info for some unknown formats extracted from watch_as3.swf"
This reverts commit 85ca019d96.
9 years ago
remitamine 85ca019d96 [youtube] add basic info for some unknown formats extracted from watch_as3.swf 9 years ago
remitamine 4a5ba28a87 [youtube] add tbr to _formats extracted from watch_as3.swf 9 years ago
remitamine 82156fdbf0 [youtube] extract width and height from fmt_list 9 years ago
Sergey M․ d77ab8e255 Add --mark-watched feature (Closes #5054) 9 years ago
Sergey M․ b78b292f0c [youtube] Add alternative automatic captions extraction approach (Closes #8667) 9 years ago
Sergey M․ ebf1b291d0 [youtube:watchlater] Respect --no-playlist 9 years ago
Sergey M․ bc7a9cd8fb [youtube:watchlater] Improve _VALID_URL (Closes #8594) 9 years ago
Sergey M․ d2c1f79f20 [youtube:searchurl] Extend _VALID_URL 9 years ago
Sergey M․ f9f49d87c2 [youtube] Add test for #8536 9 years ago
Sergey M․ 6863631c26 [youtube] Improve multifeed videos extraction (Closes #8536) 9 years ago
Sergey M․ b67d63149d [youtube] Fix typos 9 years ago
Sergey M․ 3834d3e35c [youtube] Clarify itag 36 height and abr (Closes #8457) 9 years ago
remitamine 66159b38aa Merge pull request #8408 from remitamine/dash
Add generic support for mpd manifests(dash formats)
9 years ago
Sergey M․ 23d17e4beb [youtube] Fix automatic captions 9 years ago
remitamine 2fb35d1c28 [youtube] fix subtitle order 9 years ago
remitamine 09be85b8dd [youtube] fix subtitle extraction(fixes #8415) 9 years ago
remitamine 8ff648e4f9 [youtube] use _extract_mpd_formats 9 years ago
Yen Chi Hsuan 08411970d5 Merge pull request #8374 from yan12125/facebook-dash
Facebook DASH formats
9 years ago
Jaime Marquínez Ferrándiz 3ccb0655c1 [youtube] Use 'orderedSet' instead of 'set' to preserve the order 9 years ago
Sergey M․ 9acd33094d [youtube] Filter duplicates in playlists base extractor 9 years ago
Sergey M․ 8e7aad2075 [youtube] Use authentication for entry list base extractor (Closes #8380) 9 years ago
Yen Chi Hsuan 2d2fa82d17 [common] Add _extract_dash_manifest_formats 9 years ago
Yen Chi Hsuan c94678957f [common] Remove unused arguments 9 years ago
Yen Chi Hsuan 16f38a699f [common] Rename to namespace
For consistency with _parse_smil_*
9 years ago
Yen Chi Hsuan a6c2c24479 [youtube] Remove '(v|a)codec': 'none' entries
Not used anymore
9 years ago
Yen Chi Hsuan 5d2c0fd9ba [youtube] Pass self._formats to _parse_dash_manifest 9 years ago
Yen Chi Hsuan 17b598d30c [common] _parse_dash_manifest() from youtube.py 9 years ago
Yen Chi Hsuan 05d0d131a7 [youtube] Move decrypt_sig out of _parse_dash_manifest 9 years ago
Jaime Marquínez Ferrándiz 70029bc348 [youtube:user] Require 'https?://' in the url (fixes #8356)
It was matching www.youtube.com/embed/WpfukLMe1TM.
The generic extractor automatically adds http:// if it's missing.
9 years ago
Yen Chi Hsuan e9bd0f772b Merge pull request #8130 from dyn888/master
[youtube] added vcodec/acodec/abr for multiple itags
9 years ago
Yen Chi Hsuan 94278f7202 [youtube] Prefer info from YouTube than _formats (#8293) 9 years ago
Sergey M․ 51290d8457 [youtube] Simplify automatic captions URL check (Closes #8287) 9 years ago
Dimitre Liotev 582f4f834e Fix issue #8109 (error when downloading automatic captions) 9 years ago
Sergey M․ e323cf3ff3 [youtube] Skip test 9 years ago
Sergey M․ 8ceabd4df3 [youtube] Capture and output unavailable message 9 years ago
Sergey M․ a8776b107b [youtube] Clarify test_Youtube_18 9 years ago
Sergey M․ 096b533982 [youtube] Fix URL expansion in video description
Fixes test_Youtube_18
9 years ago
Yen Chi Hsuan cc28492d31 [youtube] Fix acodec and vcodec order
In RFC6381, there's no rule stating that the first part of codecs should
be video and the second part should be audio, while it seems the case
for data reported by YouTube.
9 years ago
Sergey M․ 23f13e9754 [youtube] Support expanding alternative format of links in description (Closes #8164) 9 years ago
dyn888 e1a0bfdffe [youtube] added vcodec/acodec/abr for multiple itags
Should make downloading with filters more precise and easier, ie. bestvideo[vcodec=h264]. By default a lot of codecs are specified as avc1.xxxxxx and unique for each format, which makes them unusable for bestvideo selection.
9 years ago
Sergey M․ e462474e1d [youtube] Generalize playlists extractor 9 years ago
Sergey M․ 9b9c5355e4 Rename error_to_str to error_to_compat_str 9 years ago
Sergey M․ 7f8b271465 Properly convert errors to strings 9 years ago
Sergey M․ 0cb58b0259 [youtube] Extract alt_title and creator for music videos (Closes #7862) 9 years ago
Sergey M․ 4c6b4764f0 [youtube] Clarify itag 272 possible resolutions (#7699) 9 years ago
Sergey M․ 2e1b928540 [youtube:playlist] Extend _VALID_URL 9 years ago
Sergey M․ 040ac68679 [youtube] Extend _VALID_URL (Closes #7694) 9 years ago
Yen Chi Hsuan 049d71d874 [youtube] Simplify and make sure header values are strings 9 years ago
Yen Chi Hsuan ac5a69af45 [youtube] Disable compression for live streams 9 years ago
Sergey M․ 5faf9fed7e [youtube] Clarify rationale for yt:stretch validation 9 years ago
Lukáš Lalinský 41f24c321d [youtube] Use the existing `w` and `h` variables 9 years ago
Lukáš Lalinský 313dfc45f5 [youtube] Ignore yt:stretch with zero width/height 9 years ago
Sergey M? 5c2266df4b Switch codebase to use sanitized_Request instead of
compat_urllib_request.Request

[downloader/dash] Use sanitized_Request

[downloader/http] Use sanitized_Request

[atresplayer] Use sanitized_Request

[bambuser] Use sanitized_Request

[bliptv] Use sanitized_Request

[brightcove] Use sanitized_Request

[cbs] Use sanitized_Request

[ceskatelevize] Use sanitized_Request

[collegerama] Use sanitized_Request

[extractor/common] Use sanitized_Request

[crunchyroll] Use sanitized_Request

[dailymotion] Use sanitized_Request

[dcn] Use sanitized_Request

[dramafever] Use sanitized_Request

[dumpert] Use sanitized_Request

[eitb] Use sanitized_Request

[escapist] Use sanitized_Request

[everyonesmixtape] Use sanitized_Request

[extremetube] Use sanitized_Request

[facebook] Use sanitized_Request

[fc2] Use sanitized_Request

[flickr] Use sanitized_Request

[4tube] Use sanitized_Request

[gdcvault] Use sanitized_Request

[extractor/generic] Use sanitized_Request

[hearthisat] Use sanitized_Request

[hotnewhiphop] Use sanitized_Request

[hypem] Use sanitized_Request

[iprima] Use sanitized_Request

[ivi] Use sanitized_Request

[keezmovies] Use sanitized_Request

[letv] Use sanitized_Request

[lynda] Use sanitized_Request

[metacafe] Use sanitized_Request

[minhateca] Use sanitized_Request

[miomio] Use sanitized_Request

[meovideo] Use sanitized_Request

[mofosex] Use sanitized_Request

[moniker] Use sanitized_Request

[mooshare] Use sanitized_Request

[movieclips] Use sanitized_Request

[mtv] Use sanitized_Request

[myvideo] Use sanitized_Request

[neteasemusic] Use sanitized_Request

[nfb] Use sanitized_Request

[niconico] Use sanitized_Request

[noco] Use sanitized_Request

[nosvideo] Use sanitized_Request

[novamov] Use sanitized_Request

[nowness] Use sanitized_Request

[nuvid] Use sanitized_Request

[played] Use sanitized_Request

[pluralsight] Use sanitized_Request

[pornhub] Use sanitized_Request

[pornotube] Use sanitized_Request

[primesharetv] Use sanitized_Request

[promptfile] Use sanitized_Request

[qqmusic] Use sanitized_Request

[rtve] Use sanitized_Request

[safari] Use sanitized_Request

[sandia] Use sanitized_Request

[shared] Use sanitized_Request

[sharesix] Use sanitized_Request

[sina] Use sanitized_Request

[smotri] Use sanitized_Request

[sohu] Use sanitized_Request

[spankwire] Use sanitized_Request

[sportdeutschland] Use sanitized_Request

[streamcloud] Use sanitized_Request

[streamcz] Use sanitized_Request

[tapely] Use sanitized_Request

[tube8] Use sanitized_Request

[tubitv] Use sanitized_Request

[twitch] Use sanitized_Request

[twitter] Use sanitized_Request

[udemy] Use sanitized_Request

[vbox7] Use sanitized_Request

[veoh] Use sanitized_Request

[vessel] Use sanitized_Request

[vevo] Use sanitized_Request

[viddler] Use sanitized_Request

[videomega] Use sanitized_Request

[viewvster] Use sanitized_Request

[viki] Use sanitized_Request

[vk] Use sanitized_Request

[vodlocker] Use sanitized_Request

[voicerepublic] Use sanitized_Request

[wistia] Use sanitized_Request

[xfileshare] Use sanitized_Request

[xtube] Use sanitized_Request

[xvideos] Use sanitized_Request

[yandexmusic] Use sanitized_Request

[youku] Use sanitized_Request

[youporn] Use sanitized_Request

[youtube] Use sanitized_Request

[patreon] Use sanitized_Request

[extractor/common] Remove unused import

[nfb] PEP 8
9 years ago
Sergey M․ 9022726446 [youtube] Fix test 9 years ago
Sergey M․ 94bfcd23b7 [youtube] Fix test 9 years ago
Sergey M․ 526b3b0716 [youtube] Clarify ytplayer.config extraction rationale 9 years ago
Sergey M․ 61f92af1cf [youtube] Add test with '};' in tags 9 years ago
Sergey M․ a72778d364 [youtube] Improve ytplayer.config extraction 9 years ago
Sergey M 5ae17037a3 Merge pull request #7599 from lalinsky/fix-youtube
[youtube] More explicit player config JSON extraction (fixes #7468)
9 years ago
Lukáš Lalinský b41631c4e6 [youtube] Send the list of patterns directly to _search_regex 9 years ago
Lukáš Lalinský 0e49d9a6b0 [youtube] Fall back to the original regex for ytplayer.config 9 years ago
Lukáš Lalinský 3cfd000849 [youtube] More explicit player config JSON extraction (fixes #7468) 9 years ago
Sergey M․ e568c2233e [youtube] Add test for multi page list of playlists 9 years ago
Sergey M․ 061a75edd6 [youtube] Extract base for entry list extractors and support multi page lists of playlists 9 years ago
Sergey M․ 136dadde95 [youtube:show] Rework in terms of playlists base extractor 9 years ago
Sergey M․ 0c14841585 [youtube:user:playlists] Add extractor (Closes #3817) 9 years ago
Jaime Marquínez Ferrándiz 63b4295d20 [youtube:playlist] fix title extraction (fixes #7544 and #7545) 9 years ago
Yen Chi Hsuan 50f84a9ae1 [youtube] Support new base.js html5 player 9 years ago
Sergey M․ 89ea063eeb [youtube] Clarify rationale for preferring a video info with token (#7362) 9 years ago
Sergey M․ 44b2264fea [youtube] Prefer video_info with token available 9 years ago
Jaime Marquínez Ferrándiz 5c43afd40f [youtube:channel] Support age restricted channels (fixes #7277) 9 years ago
Jaime Marquínez Ferrándiz 9170ca5b16 [youtube:channel] Fix test 9 years ago
Sergey M․ 648e6a1ffe [youtube] Generalize playlist entries extraction (Closes #6699, closes #6992) 9 years ago
Philipp Hagemeister 2b3c254678 [youtube:channel] Correct 404 handling
Previously, when we encountered a 404 - such as youtube-dl https://www.youtube.com/ohJeiboh8oorehai - we crashed with a regexp error. Instead, make sure to go on and eventually report a 404.
9 years ago
Philipp Hagemeister 287be8c615 [youtube:truncated_url] Add ?t=
Sometimes found in links - ?t=123&v=ABCD starts the video at position 123.
9 years ago
Jaime Marquínez Ferrándiz 4003bd82b0 [youtube:shows] Use https 9 years ago
remitamine 8801255d7d [youtube] fix show extraction (fixes #4841)
Closes #6782)
9 years ago
Sergey M․ 515fc8776f [youtube] Use encode_dict 9 years ago
Sergey M․ aabc2be693 [youtube] Simplify and extract more metadata from url_encoded_fmt_stream_map (Closes #5993) 9 years ago
Anssi Hannula c9afb51cea [youtube] Fix missing format details for 60fps DASH formats
60fps DASH formats do not appear in the DASH manifest, but the non-DASH
video info page does contain additional parameters for DASH formats that
we can parse.

Use those when they exist.

This fixes "bestvideo" not selecting 60fps formats over similar 30fps
formats just because the file size is unknown.
9 years ago
Jaime Marquínez Ferrándiz 4bc8eec4eb [youtube] Adapt player version regex to handle urls ending in '/html5player-new.js'
It was always extracting 'new' as the version, breaking the cache system.
9 years ago
Sergey M․ cbaed4bb5e [youtube] Expand _VALID_URL to support vid.plus 9 years ago
Sergey M․ f74a7348f6 [youtube:search_url] Fix extraction (Closes #6578) 9 years ago
Sergey M․ 041bc3adc5 [youtube] Simplify two-factor authentication 9 years ago
reddraggone9 9303ce3e69 [youtube] Fix two-factor authentication 9 years ago
Sergey M․ f57b7835e2 [youtube] Update tests 9 years ago
Sergey M․ 34952f09e1 [youtube] Add age limit to tests 9 years ago
Sergey M․ 34a7de2970 [youtube] Skip download for multiple v= test 9 years ago
Puck Meerburg 11b5605815 [youtube] Use the first v= argument in the URL
This is according to how youtube handles multiple v= values in one URL.
Before this, it was possible to make a single URL show up differently
 on youtube itself, and if you downloaded/viewed it with youtube-dl/mpv
9 years ago
Jaime Marquínez Ferrándiz 34866b4836 Merge remote-tracking branch 'dstftw/multifeed-videos' (closes #6360) 9 years ago
Sergey M․ 5e1eddb939 [youtube] Show info message for multifeed videos according to noplaylist option 9 years ago
Sergey M․ 000b6b5ae5 [youtube] Improve tags extraction and add test 9 years ago
Purdea Andrei a6f774e901 [youtube]: tags key in info jason is now a list 9 years ago
Purdea Andrei f171bc8b59 [youtube] save keywords in info jason when --write-info-json is used 9 years ago
Jaime Marquínez Ferrándiz 4c6bd5b5b6 [youtube] Use 'vp8' and 'vp9' in lowercase (fixes #6358)
That's how YouTube reports them in their DASH manifest.
9 years ago
Sergey M․ d8f0a9ecea [youtube] Respect noplaylist for multifeed videos 9 years ago
Sergey M․ cf7e015f25 [youtube] Add support for multifeed videos 9 years ago
Sergey M․ 678e436f2e [youtube] Handle empty allowed regions (Closes #6351) 9 years ago
Sergey M. cdad742700 Merge pull request #6306 from jaimeMF/extract_start_time
[youtube] Extract start_time
9 years ago
Jaime Marquínez Ferrándiz 2929fa0e79 [youtube] Also look into the 'start' field for start_time 9 years ago
Jaime Marquínez Ferrándiz 297a564bee [youtube] Extract end_time 9 years ago
Jaime Marquínez Ferrándiz 87dc451108 [youtube] Don't use the DASH manifest from 'get_video_info' if 'use_cipher_signature' is True (#5118)
Currently they give a 403 Forbidden error.
9 years ago
Jaime Marquínez Ferrándiz 7c80519cbf [youtube] Extract start_time
From the 't=*' in the url.
Currently youtube-dl doesn't use the value, but it was requested for the mpv plugin.
9 years ago
Jaime Marquínez Ferrándiz 2fe1ff8582 [youtube] Set 'is_live' 9 years ago
Jaime Marquínez Ferrándiz 17ee98e1a5 [youtube] Fix upload_date in test 9 years ago
Jaime Marquínez Ferrándiz 2ee8f5d80f Merge remote-tracking branch 'yan12125/download-dash-segments' (#5886) 9 years ago
Sergey M․ 7fd002c006 [youtube] Use compat_urllib_parse_unquote and compat_urllib_parse_unquote_plus 9 years ago
Sergey M․ 77c6fb5b24 [youtube] Make further DASH manifests not fatal after succeeded one 9 years ago
Sergey M․ 9d0b581fea [youtube] Prefer meta for upload date and modernize 10 years ago
Sergey M․ f0714c9f86 [youtube] Speed up upload date regex (#6125) 10 years ago
Sergey M. dc2bd20e55 Merge pull request #6098 from dstftw/use-codecs-from-dash-manifest
[youtube] Pick up codecs info from DASH manifest when not set explicitly
10 years ago
Sergey M. c608ee491f Merge pull request #6097 from dstftw/union-itags-from-multiple-dashmpd
[youtube] Extract formats from multiple DASH manifests (Closes #6093)
10 years ago
Sergey M․ c93d53f5e3 [youtube] Fix likes/dislike extraction 10 years ago
Sergey M․ da77d856a1 [youtube] Add test for #6093 10 years ago
Sergey M․ 0a3cf9ad3d [youtube] Skip get_video_info requests when --youtube-skip-dash-manifest is specified 10 years ago
Sergey M․ bc93bdb5bb [youtube] Fix reference before assignment for video_info 10 years ago
Yen Chi Hsuan af214c3a79 [youtube] More useful messages for georestricted videos (#5716) 10 years ago
Sergey M․ d80265ccd6 [youtube] Simplify non-DASH formats exclusion 10 years ago
Sergey M․ 1b5a1ae257 [youtube] Pick up codecs info from DASH manifest when not set explicitly 10 years ago
Sergey M․ d8d24a922a [youtube] Extract formats from multiple DASH manifests (Closes #6093)
DASH manifest pointed by dashmpd from the video webpage and one pointed by get_video_info may
be different (namely different itag set) - some itags are missing from DASH manifest pointed by
webpage's dashmpd, some - from DASH manifest pointed by get_video_info's dashmpd).
The general idea is to take a union of itags of both DASH manifests (for example video with such
'manifest behavior' see https://github.com/rg3/youtube-dl/issues/6093).
10 years ago
Sergey M․ c9bebed294 [youtube] Add itag 59 and 78 (Closes #5979) 10 years ago
Sergey M․ 02175a7986 [youtube:search] Fix search query (Closes #5988) 10 years ago
Yen Chi Hsuan 8a1a26ce4c [youtube] Add a test for the DASH segment downloader 10 years ago
Yen Chi Hsuan 0c8662d2b6 [youtube] Fix a TypeError caused by 4da31bd566 10 years ago
Jaime Marquínez Ferrándiz 70219b0f43 [youtube:playlist] Use an iterator for the entries (closes #5935)
So that '--playlist-end' downloads only the required pages.
10 years ago
Yen Chi Hsuan e1b9322b09 [youtube] Restricter DASH signature pattern
A problematic DASH url is:
https://manifest.googlevideo.com/api/manifest/dash/mm/35/key/yt5/ip/140.112.247.145/ms/pm/mv/s/mt/1433794435/id/o-AD2Od_dsOlAUYPu03ZsVWKSbGEbCJJrMp9vnXGhnyRhd/mn/sn-aigllm7r/sparams/as%2Chfr%2Cid%2Cip%2Cipbits%2Citag%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Cplayback_host%2Crequiressl%2Csource%2Cexpire/fexp/9406009%2C9406821%2C9407575%2C9408142%2C9408420%2C9408710%2C9409121%2C9409208%2C9412514%2C9412780%2C9413208%2C9413426%2C9413476%2C9413503%2C9415304%2C9415753/upn/viDQrs8SnmE/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm_sd_hd_clear%2Cwebm2_sd_hd_clear/playback_host/r4---sn-aigllm7r.googlevideo.com/ipbits/0/requiressl/yes/pl/20/itag/0/source/youtube/expire/1433824806/nh/EAQ/signature/81ABE6391E351BA495F5B041B00FF1257A353318.1A6E48ABB74E8F4AE73CA2CB1F963FC34E33DEE7/sver/3/hfr/1
10 years ago