Commit Graph

514 Commits (3c3a07ee0bbd1305af155ae028afba36c74d4b0d)

Author SHA1 Message Date
Yen Chi Hsuan 3d83a1ae92
[generic] Support direct MMS links (closes #10838) 8 years ago
Sergey M․ 09b9c45e24
[generic] Add support for multiple vimeo embeds (Closes #10862) 8 years ago
Déstin Reed dcdb292fdd
Unify coding cookie 8 years ago
Yen Chi Hsuan bd26441205
[utils] Fix xattr error handling 8 years ago
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
8 years ago
Remita Amine d05ef09d9d [mangomolo] fix domain regex 8 years ago
Remita Amine 7d273a387a [mangomolo] add support for Mangomolo embeds 8 years ago
Sergey M․ a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed 8 years ago
Remita Amine 93b8404599 [generic,vodplatform] improve embed regex 8 years ago
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 8 years ago
Sergey M․ fd3ec986a4
[generic] Fix dbtv test (Closes #10364) 8 years ago
Déstin Reed b0c8f2e9c8
[DBTV:generic] Add support for embeds 8 years ago
Sergey M․ 2a1321a272
[vbox7:generic] Add support for vbox7 embeds 8 years ago
Sergey M․ 082395d0a0
[extractor/generic] Add proper default to _search_json_ld call 9 years ago
Sergey M․ 395c74615c
Revert "[extractor/generic] Make _search_json_ld non fatal"
This reverts commit 958849275f.
9 years ago
Sergey M․ 958849275f
[extractor/generic] Make _search_json_ld non fatal 9 years ago
Remita Amine 217d5ae013 [vodplatform] Add new extractor 9 years ago
Sergey M․ db19df6ca0
[extractor/generic] Add test for #10179 9 years ago
Sergey M․ 94aae01548
[extractor/generic] Extract all soundcloud embeds (Closes #10179) 9 years ago
Yen Chi Hsuan 326fa4e6e5
[generic] Skip an invalid test 9 years ago
Yen Chi Hsuan 05d1e7aaa9
[generic] Fix an MTV test and another test that breaks nosetests 9 years ago
Sergey M․ 1979969f91
[extractor/generic] Add support for arkena embeds 9 years ago
Sergey M․ 371ddb14fe
[extractor/generic] Change twitter:player embeds priority to lowest (Closes #10090) 9 years ago
Yen Chi Hsuan c03adf90bd
[generic] Add the test. Closes #1638 9 years ago
Sergey M․ 6e6b70d65f
[extractor/generic] Properly comment out a test 9 years ago
Sergey M․ 0de168f7ed
[extractor/generic] Detect schema.org/VideoObject embeds 9 years ago
Yen Chi Hsuan ad213a1d74
[francetv] Recognize more Dailymotion embedded videos
Closes #9955
9 years ago
Remita Amine 81953d1ae5 [kaltura] add support videos stored on custom kaltura servers(closes #5557) 9 years ago
Yen Chi Hsuan dbf0157a26 [generic] Add MD5 checksums 9 years ago
Yen Chi Hsuan 7deef1ba67 [generic] Support Wordpress "YouTube Video Importer" plugin
Closes #9938
9 years ago
Yen Chi Hsuan fd6ca38262 [facebook] Improve Facebook embedded detection
Related to #9938.

Another example comes from 9834872bf6.
9 years ago
Remita Amine 7dbeee7e22 [generic] make twitter:player extraction non fatal 9 years ago
Remita Amine 329179073b [generic] add generic support for twitter:player embeds 9 years ago
Sergey M․ 06a96da15b
[eagleplatform] Improve embed detection and extract in separate routine (Closes #9926) 9 years ago
Sergey M․ c287f2bc60
[extractor/generic] Use _extract_url for kaltura embeds (Closes #9922) 9 years ago
Sergey M․ 427cd050a3
[extractor/generic] Improve kaltura embed detection (Closes #9911) 9 years ago
Yen Chi Hsuan 7d52c052ef
[generic] Fix test_Generic_76
Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658
9 years ago
Yen Chi Hsuan c5edd147d1
[generic] Remove an invalid test
Now handled by telewebion.py
9 years ago
Yen Chi Hsuan 1fa309da40
[generic] Update test_Generic_40
The original link now redirects to an YouTube user channel.
9 years ago
Yen Chi Hsuan cc4444662c [generic] Remove Vulture embed detection
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
9 years ago
Yen Chi Hsuan de3eb07ed6
[generic] Detect NBC News embeds 9 years ago
Sergey M․ 48a5eabc48
[extractor/generic] Add support vessel embeds (Closes #7083) 9 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 9 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 9 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
9 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 9 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 9 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 9 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 9 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 9 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
remitamine 67167920db [viewlift] replace SnagFilms extractors
- add support for other sites that use the same logic
- improve format extraction and sorting
9 years ago
Yen Chi Hsuan 4645432d7a
[eagleplatform] Checking direct HTTP links
Sometimes they fail with 404
9 years ago
Yen Chi Hsuan 0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc 9 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
9 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 9 years ago
Yen Chi Hsuan ef0e4e7bc0
[generic] Fix test_Generic_2
Now a HEAD request returns 400 Bad Request
9 years ago
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds 9 years ago
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support (#2620) 9 years ago
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE) 9 years ago
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes #8051
9 years ago
Yen Chi Hsuan d10fe8358c [generic] Add a test case for brightcove embed
Closes #8862
9 years ago
Yen Chi Hsuan 5a51775a58 [generic] Extract Instagram embeds (#8817) 9 years ago
Yen Chi Hsuan 088e1aac59 [generic] Support Vine embeds (#8817) 9 years ago
Sergey M․ 0d769bcb78 [extractor/generic] Fix missing byte literal prefix 9 years ago
Sergey M․ edd9b71c2c [extractor/generic] Add a test for m3u playlist served without proper Content-Type 9 years ago
Sergey M․ 5940862d5a [extractor/generic] Detect m3u playlists served without proper Content-Type 9 years ago
Sergey M․ de6c51e88e [extractor/generic] Fix direct link semantics 9 years ago
Sergey M․ 303dcdb995 [extractor/generic] Simplify upload_date extraction 9 years ago
Sergey M․ 20938f768b [extractor/generic] Add another test for generic m3u8 9 years ago
Sergey M․ 955737b2d4 [extractor/generic] Force Content-Type to lowecase 9 years ago
Sergey M․ 263eff9537 [extractor/generic] Properly extract format id from Content-Type
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
9 years ago
Sergey M․ 3f2f4a94aa [extractor/generic] Extract f4m formats from final URLs 9 years ago
Sergey M․ f930e0c76e [extractor/generic] Extract f4m formats and refactor common info 9 years ago
Sergey M․ 2c9ca78281 [extractor/generic] Add support for tnaflix network embeds (Closes #7505) 9 years ago
Sergey M․ 33d4fdabfa [extractor/generic] Add support for ok embeds (#8619) 9 years ago
Sergey M․ 9d939cec48 [extractor/generic] Add direct mpd url test 9 years ago
Sergey M․ 7be747b921 [extractor/generic] Pass mpd base url to _parse_mpd_formats 9 years ago
Sergey M․ 5a4905924d [extractor/generic] Improve dailymotion embed detection (Closes #8521, closes #8325) 9 years ago
remitamine 28ad7df65d [generic] detect MPD manfiest only from the content 9 years ago
Sergey M․ 79a3508579 [extractor/generic] Detect DASH manifests in found URLs and extract mpd formats 9 years ago
Sergey M․ 1b840245bd [extractor/generic] Detect DASH manifests and extract mpd formats 9 years ago
remitamine bcbbb98bfe [generic] extract dash formats detected using content type 9 years ago
remitamine eadc3ccd50 [generic] extract m3u8 formats when mpegurl content type detected 9 years ago
remitamine 1bf996fa5c [generic] Add support for Limelight API 9 years ago
Sergey M․ aecfcd4e59 [ultimedia] Rename to digiteka 9 years ago
Sergey M․ 1fa2b9841d [extractor/generic] Extend dailymotion embed regex 9 years ago
Jakub Wilk dfb1b1468c Fix typos
Closes #8200.
9 years ago
Sergey M․ ff18735cb2 [extractor/generic] Add support for videomore embeds 9 years ago
remitamine 06e4874c99 Merge branch 'jukebox' of https://github.com/remitamine/youtube-dl into remitamine-jukebox 9 years ago
remitamine 7ba71e30fb Merge branch 'bliptv' of github.com:remitamine/youtube-dl into remitamine-bliptv 9 years ago
remitamine 7cb0952474 [makertv] improve extraction 9 years ago
remitamine a8ae232fa9 Merge branch 'googledrive' of github.com:remitamine/youtube-dl into remitamine-googledrive 9 years ago
remitamine 5b251628e9 [googledrive] Modernize 9 years ago
Sergey M․ 45dad7ba1b [extractor/generic] Use _extract_url for pladform 9 years ago
remitamine 53e06b2507 [ooyala] fix duration scale 9 years ago
remitamine c3d3110f6a Merge pull request #7185 from remitamine/ooyala
[ooyala] extract more formats and metadata
9 years ago
remitamine 78653a33aa Merge remote-tracking branch 'upstream/master' into bliptv 9 years ago
Sergey M? 5c2266df4b Switch codebase to use sanitized_Request instead of
compat_urllib_request.Request

[downloader/dash] Use sanitized_Request

[downloader/http] Use sanitized_Request

[atresplayer] Use sanitized_Request

[bambuser] Use sanitized_Request

[bliptv] Use sanitized_Request

[brightcove] Use sanitized_Request

[cbs] Use sanitized_Request

[ceskatelevize] Use sanitized_Request

[collegerama] Use sanitized_Request

[extractor/common] Use sanitized_Request

[crunchyroll] Use sanitized_Request

[dailymotion] Use sanitized_Request

[dcn] Use sanitized_Request

[dramafever] Use sanitized_Request

[dumpert] Use sanitized_Request

[eitb] Use sanitized_Request

[escapist] Use sanitized_Request

[everyonesmixtape] Use sanitized_Request

[extremetube] Use sanitized_Request

[facebook] Use sanitized_Request

[fc2] Use sanitized_Request

[flickr] Use sanitized_Request

[4tube] Use sanitized_Request

[gdcvault] Use sanitized_Request

[extractor/generic] Use sanitized_Request

[hearthisat] Use sanitized_Request

[hotnewhiphop] Use sanitized_Request

[hypem] Use sanitized_Request

[iprima] Use sanitized_Request

[ivi] Use sanitized_Request

[keezmovies] Use sanitized_Request

[letv] Use sanitized_Request

[lynda] Use sanitized_Request

[metacafe] Use sanitized_Request

[minhateca] Use sanitized_Request

[miomio] Use sanitized_Request

[meovideo] Use sanitized_Request

[mofosex] Use sanitized_Request

[moniker] Use sanitized_Request

[mooshare] Use sanitized_Request

[movieclips] Use sanitized_Request

[mtv] Use sanitized_Request

[myvideo] Use sanitized_Request

[neteasemusic] Use sanitized_Request

[nfb] Use sanitized_Request

[niconico] Use sanitized_Request

[noco] Use sanitized_Request

[nosvideo] Use sanitized_Request

[novamov] Use sanitized_Request

[nowness] Use sanitized_Request

[nuvid] Use sanitized_Request

[played] Use sanitized_Request

[pluralsight] Use sanitized_Request

[pornhub] Use sanitized_Request

[pornotube] Use sanitized_Request

[primesharetv] Use sanitized_Request

[promptfile] Use sanitized_Request

[qqmusic] Use sanitized_Request

[rtve] Use sanitized_Request

[safari] Use sanitized_Request

[sandia] Use sanitized_Request

[shared] Use sanitized_Request

[sharesix] Use sanitized_Request

[sina] Use sanitized_Request

[smotri] Use sanitized_Request

[sohu] Use sanitized_Request

[spankwire] Use sanitized_Request

[sportdeutschland] Use sanitized_Request

[streamcloud] Use sanitized_Request

[streamcz] Use sanitized_Request

[tapely] Use sanitized_Request

[tube8] Use sanitized_Request

[tubitv] Use sanitized_Request

[twitch] Use sanitized_Request

[twitter] Use sanitized_Request

[udemy] Use sanitized_Request

[vbox7] Use sanitized_Request

[veoh] Use sanitized_Request

[vessel] Use sanitized_Request

[vevo] Use sanitized_Request

[viddler] Use sanitized_Request

[videomega] Use sanitized_Request

[viewvster] Use sanitized_Request

[viki] Use sanitized_Request

[vk] Use sanitized_Request

[vodlocker] Use sanitized_Request

[voicerepublic] Use sanitized_Request

[wistia] Use sanitized_Request

[xfileshare] Use sanitized_Request

[xtube] Use sanitized_Request

[xvideos] Use sanitized_Request

[yandexmusic] Use sanitized_Request

[youku] Use sanitized_Request

[youporn] Use sanitized_Request

[youtube] Use sanitized_Request

[patreon] Use sanitized_Request

[extractor/common] Remove unused import

[nfb] PEP 8
9 years ago
Yen Chi Hsuan 750b9ff032 [generic] Extract M3U8 formats (closes #7582) 9 years ago
Yen Chi Hsuan 28602e747c [generic] Refactor 9 years ago
Yen Chi Hsuan 6cc37c69e2 [generic] Unescape URLs from JWPlayer (#7582) 9 years ago
Sergey M․ 6da620de58 [kaltura] Add test for referrer protected video (#7409) 9 years ago
Sergey M․ 5b5fae5f20 [generic] Use referrer from source kaltura embed URLs (#7409) 9 years ago
Yen Chi Hsuan c39fd7b1ca [UDNEmbed] Fix generic UDN pages
Closes #7547
9 years ago
Sergey M․ 3b7d9aa487 Rename all references to legacy studio Brightcove extractor 9 years ago
Sergey M․ 1f4b722b00 [generic] Clarify Brightcove Legacy Studio comment 9 years ago
Sergey M․ f6519f89b0 [generic] Extract Brightcove New Studio embeds 9 years ago
Sergey M․ 5c17f0a67a [brightcove:embedinpage] Rename extractor to brightcove new
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
9 years ago
Sergey M․ 4fcaa4f4a5 [brightcove] Rename extractor to brightcove legacy
Old embedding approaches are now "Legacy Studio"
9 years ago
Sergey M․ a2973eb597 Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed 9 years ago
Sergey M․ 6a5d6de1e3 [generic] Improve kaltura embed detection (2) 9 years ago
Sergey M․ 1c31a5b0e0 [generic] Improve kaltura embed detection (Closes #7409) 9 years ago
Sergey M 30eecc6a04 Merge pull request #7296 from jaimeMF/xml_attrib_unicode
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
9 years ago
Sergey M․ e327b736ca [generic] Update test 9 years ago
Jaime Marquínez Ferrándiz f78546272c [compat] compat_etree_fromstring: also decode the text attribute
Deletes parse_xml from utils, because it also does it.
9 years ago
remitamine cce9d15d01 [ooyala] extract domain,handle errors and change related tests 9 years ago
remitamine 77302fe5c9 [bliptv] remove extractor and add support for site replacement(makertv) 9 years ago
Sergey M․ dd467d33d0 [extractor/generic] Add support for condenast script embeds (Closes #6885, closes #6991) 9 years ago
Sergey M․ 46fde8a1a2 [extractor/generic] Use _extract_url for mtvservices 9 years ago
remitamine 6aeba407db [jukebox] remove extractor and handle it using generic extractor 9 years ago
Sergey M․ 6c91a5a7f5 [extractor/generic] Fix following redirect in Refresh HTTP header on python 2 9 years ago
remitamine ed1269000f [brightcove] add support for brightcove in page embed(fixes #6824) 9 years ago
felix 12439dd5ec [generic] Capture <audio> tags in addition to <video> tags 9 years ago
Sergey M․ 1f8125805e [generic] Add test for screenwavemedia embed 9 years ago
Sergey M․ efd712c69b [generic] Use screenwavemedia embed pattern 9 years ago
felix 8ca31a0e05 [generic] Look for ScreenwaveMedia embeds 9 years ago
Sergey M․ 0791ac1b44 [extractor/generic] Clarify comment 10 years ago
Sergey M․ 1de5cd3ba5 [extractor/generic] Add test for xspf playlist 10 years ago
Sergey M․ 729accb482 [extractor/generic] Add support for xspf playlists 10 years ago
Sergey M. d5d7bdaeb5 Merge pull request #6428 from dstftw/improve-generic-smil-support
Improve generic SMIL support
10 years ago
Sergey M․ bf94d763ba [extractor/generic] Add test for #6485 10 years ago
Sergey M․ 8a37aa1517 [extractor/generic] Expand ooyala regex (Closes #6485) 10 years ago
Sergey M․ 54a9328b20 [generic] Expand jwplayer support 10 years ago
Sergey M․ 8765222d22 [extractor/generic] Add generic SMIL tests 10 years ago
Sergey M․ e5e8d20a3a [extractor/generic] Improve generic SMIL detection 10 years ago
Sergey M․ 88ed52aec9 [bbc] Add support for direct bbc.co.uk embeds 10 years ago
remitamine 653789afc7 add google drive embeds 10 years ago
Jaime Marquínez Ferrándiz b37317d8b0 [generic] Unescape HTML escape sequences in redirect urls (fixes #6311) 10 years ago
Yen Chi Hsuan a1b85269a4 [extractor/generic] Support vid.me embeds 10 years ago
Sergey M․ cbd55ade68 [extractor/generic] Add support for francetv embeds 10 years ago
Sergey M․ f7e6f7fa23 [extractor/generic] Use compat_urllib_parse_unquote 10 years ago
fnord 45eedbe58c Generic: use compat_urllib_parse_unquote to prevent utf8 mangling
of the entire page in python 2.

-requires- fixed compat_urllib_parse_unquote

example - the following will save with a mangled playlist title,
 instead of the kanji for 'tsunami'. This affects all utf8encoded
 urls as well

youtube-dl -f18 -o '%(playlist_title)s-%(title)s.%(ext)s' \
  61c14c1e3a/tsunami.html
10 years ago
Sergey M․ bf20b9c540 [extractor/generic] Add test for myvi embed 10 years ago
Sergey M․ 6dd94d3a79 [myvi:embed] Rename to myvi 10 years ago
Sergey M․ e6c2d9ad29 [extractor/generic:myvi] Add support for myvi embeds 10 years ago
Sergey M․ 66e568de3b [extractor/generic] Improve kaltura embeds support (Closes #6137) 10 years ago
Sergey M․ b8c1cc1a51 [extractor/generic] Add test for snagfilms embeds 10 years ago