Commit Graph

7238 Commits (533f67d3fa76eb44799276656207a25ece6d20a3)

Author SHA1 Message Date
Sergey M․ d22dec74ff Add `--force-generic-extractor`
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
10 years ago
Sergey M․ 9872d3110c [extractor/generic] Add support for tvigle embeds 10 years ago
Sergey M․ b859971873 [extractor/generic] Rename tvc embed url variable 10 years ago
Sergey M․ 499a077761 [5tv] Improve 10 years ago
Sergey M․ 5da7177729 Merge branch '5tv' of https://github.com/hlintala/youtube-dl into hlintala-5tv 10 years ago
Sergey M․ f37bdbe537 [extractor/generic] Add test for tvc embed 10 years ago
Sergey M․ 2da09ff8b0 [extractor/generic] Fix tvc ie_key 10 years ago
Sergey M․ 5ccddb7ecf [tvc] Fix ie_key 10 years ago
Sergey M․ 954c1d0529 [tvc] Refactor extractor names 10 years ago
Sergey M․ 494f20cbdc [extractor/generic] Add support for tvc embeds 10 years ago
Sergey M․ 29902c8ec0 [tvc:embed] Add embed extraction routine 10 years ago
Sergey M․ 9f15bdabc8 [tvc] Separate embed extractor 10 years ago
Sergey M․ fff3455f58 Merge branch 'tvc' of https://github.com/hlintala/youtube-dl into hlintala-tvc 10 years ago
Hannu Lintala 87446dc618 [tvc] Add extractor (Closes #5795) 10 years ago
Hannu Lintala 99ac0390f5 [fivetv] Add extractor (Closes #5794) 10 years ago
Sergey M․ ff0f0b9172 [tube8] Fix extraction (Closes #5952) 10 years ago
Sergey M․ 97b570a94c [generic] Improve rtl.nl embeds detection (Closes #5950) 10 years ago
Sergey M․ a9d56c6843 [rtlnl] Improve _VALID_URL (#5950) 10 years ago
Sergey M․ f98470df69 [bilibili] Fix FutureWarning 10 years ago
Jaime Marquínez Ferrándiz eb8be1fe76 [rtbf] Extract all formats (closes #5947) 10 years ago
Yen Chi Hsuan 7ebd5376fe [nfl] Relax _VALID_URL (fixes #5940) 10 years ago
Jaime Marquínez Ferrándiz 70219b0f43 [youtube:playlist] Use an iterator for the entries (closes #5935)
So that '--playlist-end' downloads only the required pages.
10 years ago
Sergey M․ bd5bc0cd5a [theplatform] Check for /select/media URLs first (#5746) 10 years ago
Sergey M․ 6e054aacca [theplatform] Take care of /select/media URLs (Closes #5746) 10 years ago
Sergey M․ 9d581f3d52 [cbs] Extract display_id 10 years ago
Sergey M․ 9bf99891d0 [cbs] Add support for colbertlateshow (Closes #5888) 10 years ago
Sergey M․ d9cf48e81e [spiegeltv] Extract all formats and prefer hls (Closes #5843) 10 years ago
Yen Chi Hsuan e1b9322b09 [youtube] Restricter DASH signature pattern
A problematic DASH url is:
https://manifest.googlevideo.com/api/manifest/dash/mm/35/key/yt5/ip/140.112.247.145/ms/pm/mv/s/mt/1433794435/id/o-AD2Od_dsOlAUYPu03ZsVWKSbGEbCJJrMp9vnXGhnyRhd/mn/sn-aigllm7r/sparams/as%2Chfr%2Cid%2Cip%2Cipbits%2Citag%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Cplayback_host%2Crequiressl%2Csource%2Cexpire/fexp/9406009%2C9406821%2C9407575%2C9408142%2C9408420%2C9408710%2C9409121%2C9409208%2C9412514%2C9412780%2C9413208%2C9413426%2C9413476%2C9413503%2C9415304%2C9415753/upn/viDQrs8SnmE/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm_sd_hd_clear%2Cwebm2_sd_hd_clear/playback_host/r4---sn-aigllm7r.googlevideo.com/ipbits/0/requiressl/yes/pl/20/itag/0/source/youtube/expire/1433824806/nh/EAQ/signature/81ABE6391E351BA495F5B041B00FF1257A353318.1A6E48ABB74E8F4AE73CA2CB1F963FC34E33DEE7/sver/3/hfr/1
10 years ago
Yen Chi Hsuan 627b964825 [kickstarted] Extract thumbnails in embedded videos (#5929) 10 years ago
Sergey M․ a55e36f48d [YoutubeDL] Handle out-of-range timestamps (#5826) 10 years ago
Yen Chi Hsuan 01e21b89ee [noco] Skip invalid timestamps (closes #5826) 10 years ago
Yen Chi Hsuan 788be3313d [cnet] Fix theplatform vid extraction (fixes #5924) 10 years ago
Yen Chi Hsuan e1ec93304d [instagram:user] Truncate title to 80 characters (#5919)
This is a workaround. Currently YoutubeDL.process_info() truncates
info_dict['title'] to 200 characters, but the implementation can't
handle wide characters.
10 years ago
Yen Chi Hsuan edb99d4c18 [instagram] Handling null values (fixes #5919)
I didn't add the test case here because it takes too much time. (7
minutes on my machine)
10 years ago
Yen Chi Hsuan 68477c3dab [tlc] Fix test failure due to DiscoveryIE changes 10 years ago
Yen Chi Hsuan 65ba8b23f4 [discovery] Rewrite DiscoveryIE (fixes #5898)
Discovery.com now uses a completely different approach for serving
videos. At least in both test cases brightcove are involved. However,
AMF support is necessary for these brightcove videos. As a result, I
try to extract videos from the info page ('?flat=1'). The downloaded
file can be different from the one in browsers.
10 years ago
Yen Chi Hsuan 621ed9f5f4 [common] Add note and errnote field for _extract_m3u8_formats 10 years ago
Yen Chi Hsuan b26733ba7f [brightcove] Allow single quotes in Brightcove URLs (fixes #5901) 10 years ago
Sergey M․ 9836cfb8d6 [options] Clarify `--list-extractors` (Closes #5916) 10 years ago
Sergey M․ 665b6c1236 Merge branch 'hlintala-ruutu' 10 years ago
Sergey M․ 9414338a48 [ruutu] Improve, make more robust and fix python 2.6 support 10 years ago
Jaime Marquínez Ferrándiz de390ea077 update: Use https for getting the version info (fixes #5909) 10 years ago
Sergey M․ 717b0239fd Merge branch 'ruutu' of https://github.com/hlintala/youtube-dl into hlintala-ruutu 10 years ago
Hannu Lintala d00735a0c5 [ruutu] Don't use fallback for DASH and other non-HTTP urls 10 years ago
Yen Chi Hsuan c23d5ce926 Merge branch 'PeterDing-iqiyi' 10 years ago
Yen Chi Hsuan b5a3c7f109 [iqiyi] Cache encryption keys 10 years ago
Yen Chi Hsuan 9c5f685ef1 [iqiyi] Improve regex pattern again 10 years ago
Yen Chi Hsuan 08bb8ef201 [iqiyi] Unify get_format() and get_bid() 10 years ago
Yen Chi Hsuan 865ab62f43 [iqiyi] Make _VALID_URL more accurate
v_* urls are individual videos, while a_* urls are playlists, which are
not supported yet.
10 years ago
Yen Chi Hsuan 9948113590 [iqiyi] Add a multipart test case 10 years ago
Yen Chi Hsuan c4ee87022b [iqiyi] Change id for multipart videos 10 years ago
Yen Chi Hsuan ffba4edb06 [iqiyi] Improve some variable names and add download notes 10 years ago
Yen Chi Hsuan 958d0b659b [iqiyi] Reorder imports 10 years ago
Yen Chi Hsuan aacda28b28 [iqiyi] Give error message for assertion failures 10 years ago
Yen Chi Hsuan 29e7e0781b [iqiyi] Simplify and improve regex patterns
See the comments in #5849
10 years ago
Yen Chi Hsuan 7012620e2b [iqiyi] Remove format selection codes 10 years ago
Yen Chi Hsuan f1da861018 [iqiyi] PEP8 10 years ago
Naglis Jonaitis 05aa9c82d9 [sunporno] Fix view_count extraction 10 years ago
Naglis Jonaitis a9e58ecd3f [turbo] Improve description extraction
`og:description` is empty for some videos.
10 years ago
Hannu Lintala 223544552f [Ruutu] Add new extractor 10 years ago
Sergey M․ 3d8e9573a4 [youtube:channel] Improve channel id extraction (#5904) 10 years ago
Naglis Jonaitis 54eb81a087 [pornovoisines] Improve average_rating extraction and update test case 10 years ago
Naglis Jonaitis c33c547d66 [izlesene] Avoid timestamp differences in tests due to DST 10 years ago
Naglis Jonaitis dfe7dd9bdb [izlesene] Unquote video URLs and simplify 10 years ago
Yen Chi Hsuan e8ac61e840 [qqmusic] Use meaningful variable names 10 years ago
Yen Chi Hsuan f00a650705 [qqmusic] Rearrange codes 10 years ago
Yen Chi Hsuan 4bde5ce992 Merge branch 'qqmusic-more-formats' of https://github.com/ping/youtube-dl into ping-qqmusic-more-formats 10 years ago
Yen Chi Hsuan d31573fa37 [teamcoco] Handle incomplete m3u8 URLs (fixes #5798)
There are 2 TODOs. I don't know how to handle these cases correctly.
10 years ago
ping 8b8cde2140 [qqmusic] Set abr for mp3 formats 10 years ago
Philipp Hagemeister 0e805e782b release 2015.06.04.1 10 years ago
Philipp Hagemeister f5c78d118b release 2015.06.04 10 years ago
Yen Chi Hsuan 9d4f213f90 [qqmusic:toplist] List name and description are optional 10 years ago
Yen Chi Hsuan 168db222c6 Merge pull request #5891 from ping/qqmusic-toplist-fix
[qqmusic] Fix toplist extraction
10 years ago
Sergey M․ 3d6388e34e [tnaflix] Fix relative URLs (empflix) 10 years ago
Sergey M․ 3ce9bc712a [empflix] Fix typo 10 years ago
Sergey M․ e52c0bd0eb [tnaflix] Modernize 10 years ago
Sergey M․ 56c837ccb7 [tnaflix] Fix typo 10 years ago
ping 55e5841f14 [qqmusic] Extract additional formats (mp3-128, mp3-320) 10 years ago
ping ed15e9ba02 [qqmusic] Remove unused import 10 years ago
ping eedda32e6b [qqmusic] Fix toplist 10 years ago
Sergey M. d073055dcd Merge pull request #5876 from slava-sh/nova
[nova] Update
10 years ago
Slava Shklyaev e4ac7bb1e5 [nova] Revert "Fix extension extraction bug"
This reverts commit 9464a194db.
10 years ago
Yen Chi Hsuan 9bac8c57e3 Merge branch 'iqiyi' of https://github.com/PeterDing/youtube-dl into PeterDing-iqiyi 10 years ago
Sergey M․ 3153a2c98d [tvigle] Skip tests 10 years ago
Sergey M․ 15b74b94be [tvigle] Capture error message 10 years ago
Sergey M․ 687cb3ad35 [24video] Fix uploader extraction 10 years ago
Yen Chi Hsuan 8f94784124 [tumblr] Detect vid.me embeds (fixes #5883) 10 years ago
Yen Chi Hsuan 23dd1fc74c [vidme] Always use the non-embedded page
For example, https://vid.me/Wmur contains more information than
https://vid.me/e/Wmur
10 years ago
Slava Shklyaev fa971259e6 [nova] Add a comment about html in description 10 years ago
Slava Shklyaev b0cda32f72 [nova] Fix Python 2.6 compatability issue 10 years ago
Slava Shklyaev 08b7968e28 [nova] Fix display_id extraction bug 10 years ago
Slava Shklyaev 4b5fe1349f [nova] Comply with review 10 years ago
Sergey M․ d23da75b32 [iprima] Fix description extraction
`og:description` does not contain actual description anymore.
10 years ago
Slava Shklyaev b5597738d4 [iprima] Comply with review 10 years ago
Slava Shklyaev bc03e58565 [iprima] Update 10 years ago
Slava Shklyaev a00234f1c5 [nova] Minor style improvement 10 years ago
Slava Shklyaev 34c0f95db2 [nova] Remove html tags from description 10 years ago
Slava Shklyaev fcb04bcaca [nova] Extract upload_date in some cases 10 years ago
Slava Shklyaev 9464a194db [nova] Fix extension extraction bug
Replace the hardcoded flv with determine_ext. Let rtmpdump parse the url.
10 years ago
Slava Shklyaev 9f4b9118cc [nova] Fix display_id extraction bug
Make id group non-greedy so that .html is not included in it.
10 years ago
Sergey M․ 60158217ef [nova] Add tv test 10 years ago
Sergey M․ 923e79e2e4 [nova] Add extractor 10 years ago
Naglis Jonaitis 866b296d0f [aftonbladet] Fix extraction and update _VALID_URL (Fixes #5863) 10 years ago
Sergey M․ 47fd8c2f76 [patreon] Fix embeds extraction (Closes #5862) 10 years ago
Sergey M․ 96b9690985 [imgur] Improve extraction 10 years ago
Sergey M․ df15ef8dab [YoutubeDL] Tweak select_format for video only media 10 years ago
Sergey M. 002c0fb511 Merge pull request #5852 from ivan/make-playlist-url
[youtube] Construct a playlist URL in case the page is missing one
10 years ago
Sergey M․ 7584e38ce4 [tvigle] Modernize 10 years ago
Sergey M․ eb47569f8a [tvigle] Add support for m3u8 10 years ago
Ivan Kozik d2a9de78df [youtube] Construct a playlist URL in case the page is missing one
This fixes jumping from user/channel -> playlist for some users like
https://www.youtube.com/user/BitcoinFoundation

This also removes the superfluous log message
"add --no-playlist to just download video VIDEOID"
when downloading a user/channel.
10 years ago
Sergey M․ c5138a7ce4 [extractor/generic] Clarify test comment 10 years ago
Sergey M․ c5fa81fe81 [extractor/generic] Put all direct link tests near to each other for better navigation 10 years ago
Sergey M․ a074e92296 [extractor/generic] Add test for large compressed media 10 years ago
Sergey M․ 1ddb9456c4 [extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL 10 years ago
Sergey M․ 58bde34a23 [extractor/generic] Force Accept-Encoding to any for extraction pass 10 years ago
Sergey M․ 339516072b [extractor/generic] Unescape video_id and title extracted from URL 10 years ago
Sergey M․ 931bc3c3a7 [YoutubeDL] Do not loose request method information 10 years ago
Yen Chi Hsuan a2d971309b [porn91] Use single quotes 10 years ago
Yen Chi Hsuan d05a1dbe70 [porn91] Catch daily limit error 10 years ago
Yen Chi Hsuan a80601f8d9 [porn91] Extract more info 10 years ago
Yen Chi Hsuan 1c22238756 [porn91] Simplify 10 years ago
Yen Chi Hsuan 9ff811c5cd [porn91] PEP8 10 years ago
Yen Chi Hsuan 1ebc05df91 Merge branch 'porn91' of https://github.com/PeterDing/youtube-dl into PeterDing-porn91 10 years ago
Sergey M․ 386bdfa698 [youtube:user] Workaround 35 pages limitation (Closes #5778) 10 years ago
Naglis Jonaitis 1ae7ff771b [tubitv] Add error message for videos that require login (#5524) 10 years ago
Naglis Jonaitis 5196b98897 [tubitv] Add new extractor (Closes #5524) 10 years ago
Sergey M․ e6e63e91a7 [tf1] Extend _VALID_URL (Closes #5848) 10 years ago
Sergey M․ b4dd98358f [vgtv] Properly handle lives 10 years ago
Sergey M․ 181c7053e3 [YoutubeDL] Make sure all formats have unique format_id 10 years ago
Sergey M․ 4d454c5e4b [vgtv] Check for inactive videos 10 years ago
Sergey M․ 5c2191a605 [vgtv] Skip wasLive hds (Closes #5835) 10 years ago
Sergey M․ bba5bfc890 Merge branch 'ping-soompi' 10 years ago
Sergey M․ 1a5b77dc21 [crunchyroll] Fix python 3.2 10 years ago
Sergey M․ b2cf6543b2 [soompi] Improve and simplify 10 years ago
Sergey M․ 0385d64223 [crunchyroll] Extract subtitles extraction routine 10 years ago
pulpe 6ebdfe43e4 [tube8] fix extractor (fixes #5846) 10 years ago
Yen Chi Hsuan fafec39d41 [spiegeltv] Changed RTMP server (fixes #5788 and fixes #5843)
Thanks to @brickleroux for finding out the problem
10 years ago
PeterDing 670861bd20 [iqiyi] Do not request for unneeded formats 10 years ago
PeterDing 08f7db20c1 [youku] change format_id 10 years ago
PeterDing 605ec701b7 [iqiyi] Add new extractor for iqiyi.com 10 years ago
pulpe d6aa68ce75 [postprocessor/embedthumbnail] embed mp4 too (fixes #5840) 10 years ago
Philipp Hagemeister eb6cb9fbe9 release 2015.05.29 10 years ago
Yen Chi Hsuan 84e1e036c2 [senate] Extend _VALID_URL (fixes #5836) 10 years ago
PeterDing 1498940b10 [youku] compare bytes and str for compatible; use compat_urllib_parse for making video_url 10 years ago
PeterDing 806598b94d [porn91] the one that _search_regex returns not needs to be checked 10 years ago
Sergey M․ e26be70bca Merge branch 'soompi' of https://github.com/ping/youtube-dl into ping-soompi 10 years ago
PeterDing ca45246627 [youku] compatible for python > 3.3 or > 2.7 10 years ago
PeterDing f9355dc989 [youku] update youku 10 years ago
Sergey M․ 9e0b579128 [nowtv] Add test for rtlnitro 10 years ago
Sergey M․ ff4a1279f2 [nowtv] Do not request unnecessary metadata 10 years ago