Commit Graph

489 Commits (16afce174ea71690844d37776d518ae374b896ea)

Author SHA1 Message Date
Sergey M․ 0de168f7ed
[extractor/generic] Detect schema.org/VideoObject embeds 9 years ago
Yen Chi Hsuan ad213a1d74
[francetv] Recognize more Dailymotion embedded videos
Closes #9955
9 years ago
Remita Amine 81953d1ae5 [kaltura] add support videos stored on custom kaltura servers(closes #5557) 9 years ago
Yen Chi Hsuan dbf0157a26 [generic] Add MD5 checksums 9 years ago
Yen Chi Hsuan 7deef1ba67 [generic] Support Wordpress "YouTube Video Importer" plugin
Closes #9938
9 years ago
Yen Chi Hsuan fd6ca38262 [facebook] Improve Facebook embedded detection
Related to #9938.

Another example comes from 9834872bf6.
9 years ago
Remita Amine 7dbeee7e22 [generic] make twitter:player extraction non fatal 9 years ago
Remita Amine 329179073b [generic] add generic support for twitter:player embeds 9 years ago
Sergey M․ 06a96da15b
[eagleplatform] Improve embed detection and extract in separate routine (Closes #9926) 9 years ago
Sergey M․ c287f2bc60
[extractor/generic] Use _extract_url for kaltura embeds (Closes #9922) 9 years ago
Sergey M․ 427cd050a3
[extractor/generic] Improve kaltura embed detection (Closes #9911) 9 years ago
Yen Chi Hsuan 7d52c052ef
[generic] Fix test_Generic_76
Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658
9 years ago
Yen Chi Hsuan c5edd147d1
[generic] Remove an invalid test
Now handled by telewebion.py
9 years ago
Yen Chi Hsuan 1fa309da40
[generic] Update test_Generic_40
The original link now redirects to an YouTube user channel.
9 years ago
Yen Chi Hsuan cc4444662c [generic] Remove Vulture embed detection
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
9 years ago
Yen Chi Hsuan de3eb07ed6
[generic] Detect NBC News embeds 9 years ago
Sergey M․ 48a5eabc48
[extractor/generic] Add support vessel embeds (Closes #7083) 9 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 9 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 9 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
9 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 9 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 9 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 9 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 9 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 9 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
remitamine 67167920db [viewlift] replace SnagFilms extractors
- add support for other sites that use the same logic
- improve format extraction and sorting
9 years ago
Yen Chi Hsuan 4645432d7a
[eagleplatform] Checking direct HTTP links
Sometimes they fail with 404
9 years ago
Yen Chi Hsuan 0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc 9 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
9 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 9 years ago
Yen Chi Hsuan ef0e4e7bc0
[generic] Fix test_Generic_2
Now a HEAD request returns 400 Bad Request
9 years ago
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds 9 years ago
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support (#2620) 9 years ago
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE) 9 years ago
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes #8051
9 years ago
Yen Chi Hsuan d10fe8358c [generic] Add a test case for brightcove embed
Closes #8862
9 years ago
Yen Chi Hsuan 5a51775a58 [generic] Extract Instagram embeds (#8817) 9 years ago
Yen Chi Hsuan 088e1aac59 [generic] Support Vine embeds (#8817) 9 years ago
Sergey M․ 0d769bcb78 [extractor/generic] Fix missing byte literal prefix 9 years ago
Sergey M․ edd9b71c2c [extractor/generic] Add a test for m3u playlist served without proper Content-Type 9 years ago
Sergey M․ 5940862d5a [extractor/generic] Detect m3u playlists served without proper Content-Type 9 years ago
Sergey M․ de6c51e88e [extractor/generic] Fix direct link semantics 9 years ago
Sergey M․ 303dcdb995 [extractor/generic] Simplify upload_date extraction 9 years ago
Sergey M․ 20938f768b [extractor/generic] Add another test for generic m3u8 9 years ago
Sergey M․ 955737b2d4 [extractor/generic] Force Content-Type to lowecase 9 years ago
Sergey M․ 263eff9537 [extractor/generic] Properly extract format id from Content-Type
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
9 years ago
Sergey M․ 3f2f4a94aa [extractor/generic] Extract f4m formats from final URLs 9 years ago
Sergey M․ f930e0c76e [extractor/generic] Extract f4m formats and refactor common info 9 years ago
Sergey M․ 2c9ca78281 [extractor/generic] Add support for tnaflix network embeds (Closes #7505) 9 years ago
Sergey M․ 33d4fdabfa [extractor/generic] Add support for ok embeds (#8619) 9 years ago
Sergey M․ 9d939cec48 [extractor/generic] Add direct mpd url test 9 years ago
Sergey M․ 7be747b921 [extractor/generic] Pass mpd base url to _parse_mpd_formats 9 years ago
Sergey M․ 5a4905924d [extractor/generic] Improve dailymotion embed detection (Closes #8521, closes #8325) 9 years ago
remitamine 28ad7df65d [generic] detect MPD manfiest only from the content 9 years ago
Sergey M․ 79a3508579 [extractor/generic] Detect DASH manifests in found URLs and extract mpd formats 9 years ago
Sergey M․ 1b840245bd [extractor/generic] Detect DASH manifests and extract mpd formats 9 years ago
remitamine bcbbb98bfe [generic] extract dash formats detected using content type 9 years ago
remitamine eadc3ccd50 [generic] extract m3u8 formats when mpegurl content type detected 9 years ago
remitamine 1bf996fa5c [generic] Add support for Limelight API 9 years ago
Sergey M․ aecfcd4e59 [ultimedia] Rename to digiteka 9 years ago
Sergey M․ 1fa2b9841d [extractor/generic] Extend dailymotion embed regex 9 years ago
Jakub Wilk dfb1b1468c Fix typos
Closes #8200.
9 years ago
Sergey M․ ff18735cb2 [extractor/generic] Add support for videomore embeds 9 years ago
remitamine 06e4874c99 Merge branch 'jukebox' of https://github.com/remitamine/youtube-dl into remitamine-jukebox 9 years ago
remitamine 7ba71e30fb Merge branch 'bliptv' of github.com:remitamine/youtube-dl into remitamine-bliptv 9 years ago
remitamine 7cb0952474 [makertv] improve extraction 9 years ago
remitamine a8ae232fa9 Merge branch 'googledrive' of github.com:remitamine/youtube-dl into remitamine-googledrive 9 years ago
remitamine 5b251628e9 [googledrive] Modernize 9 years ago
Sergey M․ 45dad7ba1b [extractor/generic] Use _extract_url for pladform 9 years ago
remitamine 53e06b2507 [ooyala] fix duration scale 9 years ago
remitamine c3d3110f6a Merge pull request #7185 from remitamine/ooyala
[ooyala] extract more formats and metadata
9 years ago
remitamine 78653a33aa Merge remote-tracking branch 'upstream/master' into bliptv 9 years ago
Sergey M? 5c2266df4b Switch codebase to use sanitized_Request instead of
compat_urllib_request.Request

[downloader/dash] Use sanitized_Request

[downloader/http] Use sanitized_Request

[atresplayer] Use sanitized_Request

[bambuser] Use sanitized_Request

[bliptv] Use sanitized_Request

[brightcove] Use sanitized_Request

[cbs] Use sanitized_Request

[ceskatelevize] Use sanitized_Request

[collegerama] Use sanitized_Request

[extractor/common] Use sanitized_Request

[crunchyroll] Use sanitized_Request

[dailymotion] Use sanitized_Request

[dcn] Use sanitized_Request

[dramafever] Use sanitized_Request

[dumpert] Use sanitized_Request

[eitb] Use sanitized_Request

[escapist] Use sanitized_Request

[everyonesmixtape] Use sanitized_Request

[extremetube] Use sanitized_Request

[facebook] Use sanitized_Request

[fc2] Use sanitized_Request

[flickr] Use sanitized_Request

[4tube] Use sanitized_Request

[gdcvault] Use sanitized_Request

[extractor/generic] Use sanitized_Request

[hearthisat] Use sanitized_Request

[hotnewhiphop] Use sanitized_Request

[hypem] Use sanitized_Request

[iprima] Use sanitized_Request

[ivi] Use sanitized_Request

[keezmovies] Use sanitized_Request

[letv] Use sanitized_Request

[lynda] Use sanitized_Request

[metacafe] Use sanitized_Request

[minhateca] Use sanitized_Request

[miomio] Use sanitized_Request

[meovideo] Use sanitized_Request

[mofosex] Use sanitized_Request

[moniker] Use sanitized_Request

[mooshare] Use sanitized_Request

[movieclips] Use sanitized_Request

[mtv] Use sanitized_Request

[myvideo] Use sanitized_Request

[neteasemusic] Use sanitized_Request

[nfb] Use sanitized_Request

[niconico] Use sanitized_Request

[noco] Use sanitized_Request

[nosvideo] Use sanitized_Request

[novamov] Use sanitized_Request

[nowness] Use sanitized_Request

[nuvid] Use sanitized_Request

[played] Use sanitized_Request

[pluralsight] Use sanitized_Request

[pornhub] Use sanitized_Request

[pornotube] Use sanitized_Request

[primesharetv] Use sanitized_Request

[promptfile] Use sanitized_Request

[qqmusic] Use sanitized_Request

[rtve] Use sanitized_Request

[safari] Use sanitized_Request

[sandia] Use sanitized_Request

[shared] Use sanitized_Request

[sharesix] Use sanitized_Request

[sina] Use sanitized_Request

[smotri] Use sanitized_Request

[sohu] Use sanitized_Request

[spankwire] Use sanitized_Request

[sportdeutschland] Use sanitized_Request

[streamcloud] Use sanitized_Request

[streamcz] Use sanitized_Request

[tapely] Use sanitized_Request

[tube8] Use sanitized_Request

[tubitv] Use sanitized_Request

[twitch] Use sanitized_Request

[twitter] Use sanitized_Request

[udemy] Use sanitized_Request

[vbox7] Use sanitized_Request

[veoh] Use sanitized_Request

[vessel] Use sanitized_Request

[vevo] Use sanitized_Request

[viddler] Use sanitized_Request

[videomega] Use sanitized_Request

[viewvster] Use sanitized_Request

[viki] Use sanitized_Request

[vk] Use sanitized_Request

[vodlocker] Use sanitized_Request

[voicerepublic] Use sanitized_Request

[wistia] Use sanitized_Request

[xfileshare] Use sanitized_Request

[xtube] Use sanitized_Request

[xvideos] Use sanitized_Request

[yandexmusic] Use sanitized_Request

[youku] Use sanitized_Request

[youporn] Use sanitized_Request

[youtube] Use sanitized_Request

[patreon] Use sanitized_Request

[extractor/common] Remove unused import

[nfb] PEP 8
9 years ago
Yen Chi Hsuan 750b9ff032 [generic] Extract M3U8 formats (closes #7582) 9 years ago
Yen Chi Hsuan 28602e747c [generic] Refactor 9 years ago
Yen Chi Hsuan 6cc37c69e2 [generic] Unescape URLs from JWPlayer (#7582) 9 years ago
Sergey M․ 6da620de58 [kaltura] Add test for referrer protected video (#7409) 9 years ago
Sergey M․ 5b5fae5f20 [generic] Use referrer from source kaltura embed URLs (#7409) 9 years ago
Yen Chi Hsuan c39fd7b1ca [UDNEmbed] Fix generic UDN pages
Closes #7547
9 years ago
Sergey M․ 3b7d9aa487 Rename all references to legacy studio Brightcove extractor 9 years ago
Sergey M․ 1f4b722b00 [generic] Clarify Brightcove Legacy Studio comment 9 years ago
Sergey M․ f6519f89b0 [generic] Extract Brightcove New Studio embeds 9 years ago
Sergey M․ 5c17f0a67a [brightcove:embedinpage] Rename extractor to brightcove new
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
9 years ago
Sergey M․ 4fcaa4f4a5 [brightcove] Rename extractor to brightcove legacy
Old embedding approaches are now "Legacy Studio"
9 years ago
Sergey M․ a2973eb597 Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed 9 years ago
Sergey M․ 6a5d6de1e3 [generic] Improve kaltura embed detection (2) 9 years ago
Sergey M․ 1c31a5b0e0 [generic] Improve kaltura embed detection (Closes #7409) 9 years ago
Sergey M 30eecc6a04 Merge pull request #7296 from jaimeMF/xml_attrib_unicode
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
9 years ago
Sergey M․ e327b736ca [generic] Update test 9 years ago
Jaime Marquínez Ferrándiz f78546272c [compat] compat_etree_fromstring: also decode the text attribute
Deletes parse_xml from utils, because it also does it.
9 years ago
remitamine cce9d15d01 [ooyala] extract domain,handle errors and change related tests 9 years ago
remitamine 77302fe5c9 [bliptv] remove extractor and add support for site replacement(makertv) 9 years ago
Sergey M․ dd467d33d0 [extractor/generic] Add support for condenast script embeds (Closes #6885, closes #6991) 9 years ago
Sergey M․ 46fde8a1a2 [extractor/generic] Use _extract_url for mtvservices 9 years ago
remitamine 6aeba407db [jukebox] remove extractor and handle it using generic extractor 9 years ago
Sergey M․ 6c91a5a7f5 [extractor/generic] Fix following redirect in Refresh HTTP header on python 2 9 years ago
remitamine ed1269000f [brightcove] add support for brightcove in page embed(fixes #6824) 9 years ago
felix 12439dd5ec [generic] Capture <audio> tags in addition to <video> tags 9 years ago
Sergey M․ 1f8125805e [generic] Add test for screenwavemedia embed 9 years ago
Sergey M․ efd712c69b [generic] Use screenwavemedia embed pattern 9 years ago
felix 8ca31a0e05 [generic] Look for ScreenwaveMedia embeds 9 years ago
Sergey M․ 0791ac1b44 [extractor/generic] Clarify comment 10 years ago
Sergey M․ 1de5cd3ba5 [extractor/generic] Add test for xspf playlist 10 years ago
Sergey M․ 729accb482 [extractor/generic] Add support for xspf playlists 10 years ago
Sergey M. d5d7bdaeb5 Merge pull request #6428 from dstftw/improve-generic-smil-support
Improve generic SMIL support
10 years ago
Sergey M․ bf94d763ba [extractor/generic] Add test for #6485 10 years ago
Sergey M․ 8a37aa1517 [extractor/generic] Expand ooyala regex (Closes #6485) 10 years ago
Sergey M․ 54a9328b20 [generic] Expand jwplayer support 10 years ago
Sergey M․ 8765222d22 [extractor/generic] Add generic SMIL tests 10 years ago
Sergey M․ e5e8d20a3a [extractor/generic] Improve generic SMIL detection 10 years ago
Sergey M․ 88ed52aec9 [bbc] Add support for direct bbc.co.uk embeds 10 years ago
remitamine 653789afc7 add google drive embeds 10 years ago
Jaime Marquínez Ferrándiz b37317d8b0 [generic] Unescape HTML escape sequences in redirect urls (fixes #6311) 10 years ago
Yen Chi Hsuan a1b85269a4 [extractor/generic] Support vid.me embeds 10 years ago
Sergey M․ cbd55ade68 [extractor/generic] Add support for francetv embeds 10 years ago
Sergey M․ f7e6f7fa23 [extractor/generic] Use compat_urllib_parse_unquote 10 years ago
fnord 45eedbe58c Generic: use compat_urllib_parse_unquote to prevent utf8 mangling
of the entire page in python 2.

-requires- fixed compat_urllib_parse_unquote

example - the following will save with a mangled playlist title,
 instead of the kanji for 'tsunami'. This affects all utf8encoded
 urls as well

youtube-dl -f18 -o '%(playlist_title)s-%(title)s.%(ext)s' \
  61c14c1e3a/tsunami.html
10 years ago
Sergey M․ bf20b9c540 [extractor/generic] Add test for myvi embed 10 years ago
Sergey M․ 6dd94d3a79 [myvi:embed] Rename to myvi 10 years ago
Sergey M․ e6c2d9ad29 [extractor/generic:myvi] Add support for myvi embeds 10 years ago
Sergey M․ 66e568de3b [extractor/generic] Improve kaltura embeds support (Closes #6137) 10 years ago
Sergey M․ b8c1cc1a51 [extractor/generic] Add test for snagfilms embeds 10 years ago
Sergey M․ eedd20ef96 [extractor/generic] Add support for snagfilms embeds 10 years ago
Sergey M․ 8084be78c5 [extractor/generic] Add test for OnionStudios embeds 10 years ago
Sergey M․ 1ac1c4c26e [extractor/generic] Add support for OnionStudios embeds (Closes #5841) 10 years ago
Sergey M. 3c3b4176bd Merge pull request #5961 from dstftw/force-generic-extractor
Add --force-generic-extractor
10 years ago
Sergey M․ 2fece970b8 [extractor/generic] Clarify generic extraction warning 10 years ago
Yen Chi Hsuan a5158f38a3 [generic/adobetv] Support AdobeTVVideo embeds (#6039) 10 years ago
Sergey M․ c76799c555 [extractor/generic] Add test for xhamster embed 10 years ago
Sergey M․ 2bb5b6d0a1 [generic] Add support for xhamster embeds 10 years ago
Yen Chi Hsuan 756f574e4e [dailymotion/generic] Add DailymotionCloudIE 10 years ago
Yen Chi Hsuan b407e173e4 [vimeo/generic] Move detection logic from GenericIE to VimeoIE 10 years ago
Sergey M․ 78e2b74bb9 [tumblr] Add support for pornhub embeds (Closes #5963) 10 years ago
Sergey M․ 65d161c480 [extractor/generic] Add support for pornhub embeds 10 years ago
Sergey M․ d22dec74ff Add `--force-generic-extractor`
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
10 years ago
Sergey M․ 9872d3110c [extractor/generic] Add support for tvigle embeds 10 years ago
Sergey M․ b859971873 [extractor/generic] Rename tvc embed url variable 10 years ago
Sergey M․ f37bdbe537 [extractor/generic] Add test for tvc embed 10 years ago
Sergey M․ 2da09ff8b0 [extractor/generic] Fix tvc ie_key 10 years ago
Sergey M․ 954c1d0529 [tvc] Refactor extractor names 10 years ago
Sergey M․ 494f20cbdc [extractor/generic] Add support for tvc embeds 10 years ago
Sergey M․ 97b570a94c [generic] Improve rtl.nl embeds detection (Closes #5950) 10 years ago
Yen Chi Hsuan b26733ba7f [brightcove] Allow single quotes in Brightcove URLs (fixes #5901) 10 years ago
Sergey M․ c5138a7ce4 [extractor/generic] Clarify test comment 10 years ago
Sergey M․ c5fa81fe81 [extractor/generic] Put all direct link tests near to each other for better navigation 10 years ago
Sergey M․ a074e92296 [extractor/generic] Add test for large compressed media 10 years ago
Sergey M․ 1ddb9456c4 [extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL 10 years ago