Commit Graph

324 Commits (1a6d92847f4e5fe1d94f2f159f903a414d5ff62c)

Author SHA1 Message Date
Sergey M․ 2dcc114f84 [generic] Add support for playwire embeds (Closes )
Yen Chi Hsuan 01c58f8473 [generic] Fix test generic_51
The website replaced the original video with a new one
Yen Chi Hsuan edfcf7abe2 [generic] Support another type of Ooyala embedded video
Sergey M․ a4257017ef [generic] Add tests for Crooks and Liars embeds
Sergey M․ 18153f1b32 [generic] Add support for Crooks and Liars embeds
Yen Chi Hsuan 0a1603634b [utils] Remove url_infer_protocol
Yen Chi Hsuan 418c5cc3fc [udn] Add new extractor
Sergey M․ facecb84a1 [generic] Add working NBC Sports vplayer test
Yen Chi Hsuan a2edf2e7ff [NBC/ThePlatform/Generic] Add a generic detector for NBCSportsVPlayer and enhance error detection in ThePlatformIE
Naglis Jonaitis ad320e9b83 [generic] Add support for 5min embeds ()
Sergey M․ 2051acdeb2 [extractor/generic] Add test for Libsyn embed
Sergey M․ cefdf970cc [extractor/generic] Support Libsyn embeds
Sergey M․ 3378d67a18 [generic] Add support for nytimes embeds (Closes )
Sergey M․ ed9a25dd61 [generic] Generalize redirect regex
Sergey M․ 84f8101606 [generic] Follow redirects specified by `Refresh` HTTP header
Sergey M․ f838875726 [pladform] Add support for embeds
Sergey M․ d47ae7f620 [eagleplatform] Add support for ClipYou embeds
Sergey M․ 135c9c42bf [eagleplatform] Add support for embeds
Philipp Hagemeister 76c73715fb [generic] Parse RSS enclosure URLs (Fixes )
Naglis Jonaitis e3216b82bf [generic] Support dynamic Kaltura embeds () ()
Jaime Marquínez Ferrándiz 13d8fbef30 [generic] Don't set the 'title' if it's not defined in the entry (closes )
Some of them may be an 'url' result, which in general don't have the 'title' field.
Sergey M․ 255fca5eea [generic] Add support for Zapiks embeds ()
Philipp Hagemeister f37e3f99f0 [generic] Correct test case
Video has been reuploaded / edited
Philipp Hagemeister 11e611a7fa Extend various playlist tests
Philipp Hagemeister 59b8ab5834 [rtlnl|generic] Add support for rtl.nl embeds (Fixes )
Philipp Hagemeister e98b8e79ea [generic] Improve SBS detection (Fixes )
Philipp Hagemeister a0f7198544 [generic] Add support for jwPlayer YouTube videos
This makes nationalarchives.gov.uk work (Fixes , fixes )
naglis f076b63821 [generic/ooyala] Add support for Ooyala embeds on SBN network websites (Fixes )
codesparkle 52585fd6dc The opening curly brace `{` is a regex reserved [control character](http://stackoverflow.com/a/400316/1106367), so it needs to be escaped.
Sergey M․ cb454b333d [generic] Improve some regexes
Shaya G 796df3c631 fixed viddler support - needed a Referer header; also added a viddler
generic extractor
Philipp Hagemeister b1b0b1ca30 [generic] Improve description testcase in rss test
Philipp Hagemeister 501f13fbf3 [generic] Add support for Cinerama player (Fixes )
Philipp Hagemeister 61ca9a80b3 [generic] Add support for BOMs (Fixes )
Philipp Hagemeister d7cc31b63e [generic] PEP8
Jaime Marquínez Ferrándiz cd791a5ea0 [ted] Add support for embed-ssl.ted.com embedded videos
Jaime Marquínez Ferrándiz 87830900a9 [generic] Update some tests
Sergey M․ faa4ea68c0 [generic] Add BBC iPlayer playlist test
Sergey M․ 476eae0c2a [generic] Generalize BBC iPlayer playlist extraction
Sergey M․ 8399267671 [generic] Make getter None by default
Sergey M․ db546cf87f [generic] Add support for BBC iPlayer embeds (Closes )
Philipp Hagemeister 416c7fcbce Add documentation about supported sites (Fixes )
Philipp Hagemeister 42bdd9d051 [cinchcast] Add new extractor (Fixes )
Philipp Hagemeister 4e262a8838 [generic] Detect direct video links (Fixes , )
Philipp Hagemeister 65f3a228b1 [generic] Add support for LazyYT embeds (Fixes )
Philipp Hagemeister b74e86f48a Fix all PEP8 issues except E501
Jouke Waleson 9e1a5b8455 PEP8: applied even more rules
Jouke Waleson 2514d2635e PEP8: E225,E227
Jouke Waleson 8bcc875676 PEP8: more applied
Jouke Waleson 5f6a1245ff PEP8 applied
Philipp Hagemeister 9b32eca3ce [generic] Add support for single quotes in HTML5 videos (Fixes )
Philipp Hagemeister af63fed7d8 [generic] Add support for livestream embeds (Fixes )
Jaime Marquínez Ferrándiz 9908e03528 Merge pull request from ghedo/direct_type
[generic] indicate when a direct video has been extracted
Naglis Jonaitis 37aab27808 [brightcove] Extract m3u8 formats ()
Naglis Jonaitis bdf9701729 [generic/brightcove] Add a new test case for kijk.nl ()
Philipp Hagemeister 8c25f81bee [util] Move compatibility functions out of util
utils is large enough without these compatibility functions.

Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
Alessandro Ghedini ccdd0ffb80 [generic] indicate when a direct video has been extracted
Fixes .
Sergey M․ 5263cdfcf9 [generic] Improve MLB iframe regex
Philipp Hagemeister ac645ac7d0 [generic] Allow soundcloud embeds with additional attributes
Philipp Hagemeister 48a24ab746 [generic] Fix HTML5 video regexp
Philipp Hagemeister d6d9186f0d [generic] Fix test title
Philipp Hagemeister 37d66e7f1e [generic] Correct call to _webpage_read_full_content
Philipp Hagemeister 70b7e3fbb6 [generic] Add a test case for direct links with broken HEAD ()
Philipp Hagemeister 23be51d8ce [generic] Handle audio streams that do not implement HEAD (Fixes )
Philipp Hagemeister a7e97f6db1 [generic] Allow new SWFObject()-style imports
This embed style is used on http://www.bitburger-open.de/ , but that is not included as a test case since the format is likely to be temporary.
Philipp Hagemeister f2f2c0c2c6 [generic] Allow --default-search without colon
Sergey M․ 281d3f1d68 [generic/wistia] Improve regex
dinesh 85d7b76586 [thoughtworks] wistia regex modified
dinesh 52cffcb186 [thoughtworks] wistia support added
Naglis Jonaitis 9471c44405 [generic] Make sure Wistia embed URLs contain the protocol (Closes )
Also, improve detection (Addresses )
Philipp Hagemeister 09a42738fc [generic] Correct handling of embedded vimeo players ()
Sergey M․ 1419fafd36 [condenast] Add support for embedded videos (Closes )
Sergey M․ ced659bb4d [generic] Ignore some non-video file extensions during generic extraction (Closes )
Naglis Jonaitis 8489578df4 [generic] Support embedded Dailymotion playlists (fixes )
Philipp Hagemeister 07e764439a [generic] Delete test case
The page is not available any more.
Philipp Hagemeister 761e1645e0 [generic] Remove unstable test checksum
Philipp Hagemeister a8eb5a8e61 [generic] Fix testcases
Philipp Hagemeister d6e6a42256 [vimeo:likes] Add new extractor (Fixes )
Philipp Hagemeister c6e90caaa6 Merge remote-tracking branch 'naglis/wistia'
Philipp Hagemeister 6b08cdf626 [youtube] Support for embedded /p players (Fixes )
Philipp Hagemeister 3b2f933b01 [generic] Allow embedded YoutubePlaylists (Fixes )
Naglis Jonaitis 746c67d72f [wistia] Use API and make more generic
Jaime Marquínez Ferrándiz a04aa7a9e6 [generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes (fixes )
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/.
Sergey M․ 1bf5423e82 [generic/youtube] Recognize youtube nocookie embeds (Closes )
Sergey M․ 1a94ff6865 [mlb] Add support for embedded videos (Closes )
Philipp Hagemeister b759a0d4d2 fix up imports
Philipp Hagemeister 22a6f15061 Move playlist tests to extractors.
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
Philipp Hagemeister aff216edf4 [generic] Prevent <video> search from skipping over empty sources ()
Philipp Hagemeister 1cb6dcdbbe [generic] Do not download images as videos by accident
Philipp Hagemeister f971dcbba0 Merge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister 0990305d2a [generic] Fix rss under Python 2.x and move test to extractor
Jaime Marquínez Ferrándiz bcc069a937 [generic] Remove debug statement
Philipp Hagemeister 5f90042bd6 [generic] remove unused imports
Philipp Hagemeister ebab4520ff [generic] Use default opener for HEAD request (Fixes )
Philipp Hagemeister 4d805e063c [generic] Automatic detection of flow player and age_limit (Fixes )
Philipp Hagemeister 4d54ef20a2 [ministrygrid] Add extractor (Fixes )
Philipp Hagemeister 1f8b6af773 [bip.tv] Allow underscore in lookup ids (Fixes )
Philipp Hagemeister 10eaeb20c5 [generic] Require og:video URLs to contain a dot
Philipp Hagemeister fa8deaf38b [generic] Prevent from downloading a .swf as a video
We're seeing quite a number of people who do not put a video file in the og:video field, but the player URL. Try to detect some of these and filter them out.
Philipp Hagemeister c8e9a235d9 [generic] Add support for camtasia videos (Fixes )
Philipp Hagemeister 2ef6fcb5d8 [sbs] Add new extractor (Fixes )
Philipp Hagemeister ed2d6a1960 [generic] Simplify playlist support ()
Philipp Hagemeister c71dfccc98 Merge remote-tracking branch 'anovicecodemonkey/generic-data-video-url'
Conflicts:
	youtube_dl/extractor/generic.py
Sergey M․ 49807b4ac6 [yahoo] Add support for embedded videos (Closes )
Philipp Hagemeister 1f7ccb9014 [generic] Add --default-search fixup_error
This restores the ability to enter URLs without a scheme (and default to http), but still fail if the input is a search term.
Anthony J. Bentley eef4a7a304 Fix typo: “ytseach” → “ytsearch”
Philipp Hagemeister 7571c02c8a [generic] Set default-search to error
This prevents users from submitting bug reports where they mistyped a URL, and prevents me from getting a weird video when holding shift and thus searching for :Tds
Sergey M․ 0364fa8b65 [generic] Add support for ivi.ru embedded player
Jaime Marquínez Ferrándiz c5cd249e41 [generic] Extract mtvservices embedded videos
Philipp Hagemeister 826ec77fb2 [Vulture] Add support for vulture.com
Philipp Hagemeister 2b88feedf7 [generic] Add support for <embed YouTube
anovicecodemonkey 37e3cbe22e Move duplicate check to generic.py
anovicecodemonkey 610134730a Add a _TEST_
Philipp Hagemeister 0e67ab0d8e [generic] Abort if user passes in URL "url" ()
anovicecodemonkey 3442b30ab2 [generic] Support data-video-url for YouTube embeds (Fixes )
Sergey M․ 8dfa187b8a [generic] Support pagespeed_iframe for NovaMov embeds
Sergey M․ a5a45015ba [generic] Fix redirect
Philipp Hagemeister 2099125333 [soundcloud/generic] Add support for playlists
Sergey M․ 669f0e7cda [generic] Fix wrong entries index
Philipp Hagemeister b30b8698ea [generic] Allow multiple matches for generic hits (Fixes )
Philipp Hagemeister ebd3c7b370 [generic] Add support for protocol-independent URLs (Fixes )
Philipp Hagemeister c0292e8ab7 [generic] Improve jwplayer detection (Fixes )
Philipp Hagemeister 48099643cc [generic] Be more relaxed when looking for aparat embeds (Fixes )
Philipp Hagemeister fa35cdad02 [condenast|generic] Add support for condenast embeds (Fixes )
Sergey M․ fd50bf623c [generic] Modernize tests
Sergey M․ d360a14678 [generic] Update test
Sergey M․ 15c0e8e7b2 [generic] Generalize novamov based embeds
Sergey M․ 7cd3bc5f99 [nowvideo] Support more domains
Sergey M․ 50f566076f [generic] Add support for videoweed embeds
anovicecodemonkey ca6aada48e Fix _TEST for Ustream embed URLs
anovicecodemonkey 5c38625259 [UstreamIE] [generic] Added support for Ustream embed URLs (Fixes )
Philipp Hagemeister 9ad400f75e [generic] Remove test case that has become a 404
Sergey M․ 0479c625a4 [brightcove] Encode object_str with utf-8
Philipp Hagemeister 9c1fc022ae [generic] Warn before fallback to automatic search
Sergey M․ cb3ac1c610 [smotri] Modernize and add support for emdebbed videos (Closes )
Philipp Hagemeister 893f8832b5 [arte] Add support for embedded videos (Fixes )
Jaime Marquínez Ferrándiz 7e2ede9891 [generic] Run TED detection before JW Player detection
Otherwise it overwrittes the `mobj` variable.
Jaime Marquínez Ferrándiz 0f2a2ba14b Merge remote-tracking branch 'dstftw/generic-webpage-unescape'
Conflicts:
	youtube_dl/extractor/generic.py
Jaime Marquínez Ferrándiz 750f9020ae [generic] Recognize more Ooyala embedded videos ()
Philipp Hagemeister aab74fa106 [ted] Simplify embed code ()
anovicecodemonkey 8d7c0cca13 [generic] Add support for embeded TED videos
Jaime Marquínez Ferrándiz ecbe1ad207 [generic] Fix access to removed function in python 3.4
The `Request.get_origin_req_host` method was deprecated in 3.3, use the
 `origin_req_host` property if it's not available, see http://docs.python.org/3.3/library/urllib.request.html#urllib.request.Request.get_origin_req_host.
Sergey M․ 93d020dd65 [generic] Add support for embedded rutv player
Sergey M․ 15fd51b37c [generic] More generic support for embedded vimeo player ()
Sergey M․ d95e35d659 [generic] Add nowvideo test hidden behind percent encoding
Sergey M․ 1439073049 [generic] Add comment for unescaping webpage contents
Sergey M 1f7659dbe9 [generic] Unescape webpage contents
Philipp Hagemeister 60cc4dc4b4 [generic/funnyordie] Add support for funnyordie embeds (Fixes )
Philipp Hagemeister bcf89ce62c [generic] Suppress warning about doctypes in RSS parser
Philipp Hagemeister 0a5bce566f [generic] Add all test attributes for embedly ()
In the future, we may want to not only print something, but throw an error for untested properties.