Commit Graph

6003 Commits (1e9a9e167d5e518f44402394bb4cc23712ff32fc)

Author SHA1 Message Date
naglis f076b63821 [generic/ooyala] Add support for Ooyala embeds on SBN network websites (Fixes )
Philipp Hagemeister cd7342755f release 2015.02.03.1
Philipp Hagemeister 9bb8e0a3f9 [wsj] Add new extractor (Fixes )
Philipp Hagemeister 1a6373ef39 [sort_formats] Prefer bitrate over video size
720p @ 1000KB/s looks way better than 1080p @ 500KB/s
Philipp Hagemeister f6c24009be [YoutubeDL] Calculate thumbnail IDs automatically
Philipp Hagemeister d862042301 [aftonbladet] Modernize
Philipp Hagemeister 23d9ded655 [franceculture] Rewrite for new HTML scheme (Fixes )
Philipp Hagemeister 4c1a017e69 release 2015.02.03
Philipp Hagemeister 2cf0ecac7b [ffmpeg] --add-metadata: Set comment and purl fields (Fixes )
Philipp Hagemeister d0eca21021 release 2015.02.02.5
Philipp Hagemeister c1147c05e1 [brightcove] Fix up more generically invalid XML (Fixes )
Philipp Hagemeister 55898ad2cf release 2015.02.02.4
Philipp Hagemeister a465808592 Merge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister 5c4862bad4 [normalboots] Remove unused import
Philipp Hagemeister 995029a142 [nerdist] Add new extractor (Fixes )
Jaime Marquínez Ferrándiz a57b562cff [nfl] Add support for articles pages (fixes )
Philipp Hagemeister 531572578e [normalboots] Modernize
Philipp Hagemeister 3a4cca687f release 2015.02.02.3
Philipp Hagemeister 7d3d06a16c [vevo] Restore SMIL support ()
Philipp Hagemeister c21b1fbeeb release 2015.02.02.2
Philipp Hagemeister f920ce295e [ntvru] Remove unused import
Philipp Hagemeister 7a7bd19c45 [n-tv.de] Use native m3u8 as best format
Philipp Hagemeister 8f4b58d70e [ntvde] Add new extractor (Fixes )
Philipp Hagemeister 3fd45e03bf [ntvru] Rename from NTV to clarify the difference between n-tv.de and ntv.ru
Philipp Hagemeister 869b4aeff4 release 2015.02.02.1
Philipp Hagemeister cc9ca3ba6e [downloader/external] Simplify source_address
'' might actually be passed in, so check for None.
Philipp Hagemeister ea71034bd3 Merge remote-tracking branch 'origin/master'
Conflicts:
	youtube_dl/downloader/external.py
Philipp Hagemeister 9fffd0469f [options] Mark --fixup as non-experimental and correct its help
Sergey M․ ae7773942e [downloader/external] Simplify
Sergey M․ 469a64cebf [downloader/external] Simplify
Sergey M. aae3fdcfae Merge pull request from vijayanandnandam/master
Passing source address option to external downloaders
vijayanand nandam 6a66904f8e passing source address option to external downloaders
Sergey M․ 78271e3319 [drtv] Extract material id (Closes )
Sergey M․ 92bf0bcdf8 [historicfilms] Add extractor (Closes )
Philipp Hagemeister 1283204917 [http] PEP8 ()
Philipp Hagemeister 6789defea9 Merge pull request from light94/master
Handling Connection Reset by Peer Error
Philipp Hagemeister acf2a6e97b release 2015.02.02
Philipp Hagemeister 8cfb6efe6f [jsinterp] Correct div command
Philipp Hagemeister 0a7055c90d release 2015.02.01
Philipp Hagemeister 9e3f19919a [jsinterp] Beef up and add tests
In preparation for , extend jsinterp by a lot. (We may even have to/want to write a proper interpreter with actual parsing)
Sergey M․ 4a3da4ebdb [hls] Simplify
Sergey M․ 027008b14e [hls] Fix encode issues on python2 @ Windows
Sergey M․ c6df692466 [rutv] Extract all m3u8 formats
Philipp Hagemeister acf757f42e [youtube] Complete test definition
Philipp Hagemeister dd8982f19c [wdr] Complete test definition
Philipp Hagemeister 654bd52f58 [teletask] Fix test definition
Philipp Hagemeister a9551e9020 [soundcloud:set] Fix test definition
Philipp Hagemeister c172440ac5 [ringtv] Modernize test definition
Philipp Hagemeister e332772531 [servingsys] Modernize
Philipp Hagemeister 437cac8cc1 [sina] Modernize and simplify
Philipp Hagemeister 9f281cacd2 [keezmovies] Fix extraction and modernize test
Philipp Hagemeister 748a0fab8a Remove unused imports
Philipp Hagemeister c1f06d6307 [macgamestore] Modernize
Philipp Hagemeister c4e817ce4a [france2.fr:generation-quoi] Modernize
Philipp Hagemeister 9a3e5e6955 [kankan] Modernize
Philipp Hagemeister 228d30ed06 [la7] Modernize
Philipp Hagemeister 057c0609fc [toutv] Modernize test definition
Philipp Hagemeister 17d2712d9c [teamcoco] Modernize and fix extraction
Philipp Hagemeister fc09240e24 [vimeo] Modernize test definition
Philipp Hagemeister 146303136f [nerdcubed] Modernize test definition
Philipp Hagemeister 96aded8d3d [rottentomatoes] Modernize test definition
Philipp Hagemeister 2886be15aa [defense] Modernize
Philipp Hagemeister ca0f500ecf [mtv] Modernize and clean up test
Philipp Hagemeister 29aef5a33c [ard] Remove deleted video test case
Philipp Hagemeister 9158b2b301 [mpora] Modernize
Philipp Hagemeister 0196149c5b [compat] Correct compat_basestring definition
Philipp Hagemeister 8f9312c387 Appease pyflakes8-3
Sergey M․ 8c72beb25e [globo] Properly extract m3u8 formats ( )
kinetoskombi 1ee94db2d0 [globo] Fix error on some globo videos
light94 e77d2975af Handling Connection Reset by Peer Error
Jaime Marquínez Ferrándiz e41b1f7385 Fix flake8 errors
Jaime Marquínez Ferrándiz cd596028d6 [rtve] Recognize mobile urls (fixes )
Jaime Marquínez Ferrándiz cc57bd33a8 [rtve] Fix extraction
Skip live stream test, we can't use the f4m manifest yet
Sergey M․ 6d593c3276 [YoutubeDL] Fix video+audio format_id (Closes )
Philipp Hagemeister 91755ee384 [comedycentral:shows] Generate better IDs and add a test for that
Sergey M․ 0692ef86ef [bbccouk] Improve _VALID_URL
Sergey M․ 439d9be27d [mixcloud] Remove unused import
Sergey M․ b80505a409 [mixcloud] Fix extraction (Closes )
Sergey M․ e4c17d7274 [nhl:news] Add extractor (Closes )
Sergey M․ 2c58674e0e [nhl] Improve _VALID_URL ()
Sergey M․ ef1269fb07 [drtv] Improve _VALID_URL ()
Sergey M․ e525d9a3df [mtv] Extract subtitles (Closes )
Sergey M․ 20b4492c71 [spike] Improve _VALID_URL
Sergey M․ dee3f73787 [spike] Modernize
Philipp Hagemeister d543bdc351 [downloader/f4m] Clarify that we should eventually just implement the DRM scheme ()
Philipp Hagemeister c7ff0c6422 Merge remote-tracking branch 'rzhxeo/f4m-drm'
Philipp Hagemeister 01c46659c4 [washingtonpost] Catch more UUIDs
Philipp Hagemeister b04b885271 [extractor/common] Document all protocol values
Philipp Hagemeister 70fca8d694 [youtube] Remove unused import
Philipp Hagemeister a52c633536 [cinchcast] Wrap overly long lines ()
codesparkle 749f2ca044 Smotri info extractor: removed unreachable code and updated old md5 for test video
codesparkle 5468ff4d91 Remove duplicate dictionary keys
codesparkle 1d2daaea63 Simplify list creation
codesparkle 52585fd6dc The opening curly brace `{` is a regex reserved [control character](http://stackoverflow.com/a/400316/1106367), so it needs to be escaped.
Philipp Hagemeister c03844a4ec release 2015.01.30.2
Philipp Hagemeister 6449cd807e [youtube] Fall back to embed webpage when content is blocked on main (Fixes )
Philipp Hagemeister 5d6677ca28 release 2015.01.30.1
Philipp Hagemeister 5a8a29cfea release 2015.01.30
Philipp Hagemeister c1708b89c0 [youtube:truncated_url] Add hl= forms ()
Philipp Hagemeister 83fddfd493 [dctp] PEP8
Philipp Hagemeister 6ebb0dca9f [dctp] Improve output ()
Philipp Hagemeister cf8d6ec865 Merge remote-tracking branch 'bastik/dev-dctp'
Philipp Hagemeister 3198291f26 [ctsnews] Remove unused import
Philipp Hagemeister 02c1d5e285 Merge remote-tracking branch 'yan12125/IE_NextMedia'
Philipp Hagemeister ec4161a57d [ctsnews] Remove news count check ()
That's the number of articles (or at least some constant value); view count is the number of views of the video!
Also add a better description so that we can distinguish the two downloads.
Philipp Hagemeister 03d2d6d51b Merge remote-tracking branch 'yan12125/IE_CtsNews'
Philipp Hagemeister 83fda3c000 Add a test for --no-check-certificate
Philipp Hagemeister 4fe8495a23 [viddler] PEP8
Philipp Hagemeister a16f6643f0 Merge pull request from jaimeMF/https_handler
[utils] YoutubeDLHTTPSHandler.https_open: pass all required arguments to to do_open
Philipp Hagemeister adc0ae3ceb [__init__] Provide a better error messages if URLs are missing (Closes )
Paul Hartmann 7bb3ceb4c7 [dctp] prefix real_time parameter with rtmp_
Paul Hartmann 75a4fc5b72 [dctp] fix test
Paul Hartmann 87673cd438 [dctp] follow id conventions
Paul Hartmann f345fe9db7 [dctp] fix python 2.6 compatibility
Yen Chi Hsuan e683a48d0e [ctsnews] Detect youtube embedde videos
Jaime Marquínez Ferrándiz a7a14d9586 [YoutubeDL] set the 'thumbnails' field if the info_dict has the 'thumbnails' field
Since the '--write-thumbnail' uses the 'thumbnails' field and we didn't updated the info_dict, it wouldn't detect the thumbnail. (fixes )
Sergey M․ 219337990b [xuite] Fix _VALID_URL
Sergey M. 376a770cc4 Merge pull request from bastik/fix-sr
fix srmediathek description
Sergey M․ affd04a45d [xuite] Simplify and improve
Sergey M․ c84130e865 Merge branch 'IE_Xuite' of https://github.com/yan12125/youtube-dl into yan12125-IE_Xuite
Jaime Marquínez Ferrándiz 4f264c02c7 [utils] YoutubeDLHTTPSHandler.https_open: pass all required arguments to do_open
With this change the '--no-check-certificate' works again ().
Paul Hartmann d205476103 fix srmediathek description
Yen Chi Hsuan 367cc95aa7 [CtsNews] Add new extractor
Yen Chi Hsuan 206dba27a4 [NextMedia] Add new extractor
Sergey M․ dcf53d4408 [YoutubeDL] Set format_id for video+audio (Closes )
Sergey M․ 63be3b8989 [ivi] Modernize
Sergey M․ 18b4e9e79d [viddler] Extract comment count
Sergey M․ cb454b333d [generic] Improve some regexes
Sergey M․ b04fbd789c [viddler] Modernize
Paul Hartmann 48a1e5141a added test for dctp
Paul Hartmann 0865f397ae added extractor for dctp.tv
Shaya G 796df3c631 fixed viddler support - needed a Referer header; also added a viddler
generic extractor
Yen Chi Hsuan a28383834b [xuite] Update tests
Sergey M․ 3a0d2f520a [YoutubeDL] Temporary fix for subprocess encoding issues on python2 @ Windows (Closes )
For now filenames will be encoded with preferrefencoding before written to disk
Yen Chi Hsuan 6348ad12a0 [xuite] Add height information for the two formats
Yen Chi Hsuan fe7710cbcc [xuite] Add new extractor
Naglis Jonaitis 2103d038b3 [lnkgo] Adapt to website changes
rzhxeo 6ca85be6f8 Filter DRM protected media in f4m downloader
Philipp Hagemeister 9f0df77ab1 [YoutubeDL] Allow format filtering by fps
Jaime Marquínez Ferrándiz e72c7e4123 [YoutubeDL] Always set the '_filename' field in the info_dict (reported in )
It's also useful when you use the '--write-info-json' option.
Philipp Hagemeister 2b1bd292ae release 2015.01.25
Philipp Hagemeister 71e7da6533 Merge branch 'master' of github.com:rg3/youtube-dl
Sergey M․ d862a4f94f [spiegel] Use generalized formats pre-testing
Sergey M․ a57e8ce658 [lynda] Pre-test video URLs for HTTP errors (Closes , closes )
Sergey M․ 96a53167fa [common] Generalize URLs' HTTP errors pre-testing
Jaime Marquínez Ferrándiz 6d2749aac4 [drtv] Prefer the version without spoken subtitles (fixes )
For example for http://www.dr.dk/tv/se/moderne-klassikere/moderne-klassikere-one-republic-apologize#!/, there's a version where everytime someone speaks in English a computer voice translates it.
Philipp Hagemeister b1b0b1ca30 [generic] Improve description testcase in rss test
Philipp Hagemeister 3dee7826e7 [rtl2] PEP8, simplify, make rtmp tests run ()
Philipp Hagemeister d4f64cabf4 Merge remote-tracking branch 'David-Development/rtl2.py'
David Development fe41ddbb28 refactoring - bug fixes
Philipp Hagemeister ee69b99af6 [YoutubeDL] clarify hook documentation
Philipp Hagemeister 767ff0a2d1 Merge branch 'travis-rtmp'
Philipp Hagemeister 8604e882a8 [ubu] Fix test and modernize
Philipp Hagemeister cc1237f484 [__init__] Work around flake8 false positive
Philipp Hagemeister 37f4ce538a [smotri] Fix test case
Philipp Hagemeister 7d346331b5 [audiomack:album] Update testcase
Philipp Hagemeister e1ccc04e9f Test rtmpdump on travis (Fixes )
Philipp Hagemeister 881e6a1f5c Add --xattr-set-filesize option (Fixes )
Philipp Hagemeister baeaeffce5 [options] Add support for infinite retries (Fixes )
Philipp Hagemeister c14e88f0f5 [YoutubeDL] Add --playlist-items option (Fixes )
Philipp Hagemeister 8940b8608e Merge remote-tracking branch 'h-collector/master'
Conflicts:
	youtube_dl/extractor/fc2.py
Philipp Hagemeister ec82d85acd [YoutubeDL] Implement --write-all-thumbnails (Closes )
Philipp Hagemeister cfb56d1af3 Add --list-thumbnails
Sergey M․ 1e10802990 [krasview] Fix extraction
David-Development 7906d199a1 [rtl2] Add new extractor
Jaime Marquínez Ferrándiz 1070711d60 [YoutubeDL._calc_cookies] Restore the 'is_unverifiable'
I should have check everything was copied before commiting 4b405cfc6e.
Jaime Marquínez Ferrándiz 4b405cfc6e [YoutubeDL._calc_cookies] Restore the 'has_header' method
I didn't copied it from downloader/external
Jaime Marquínez Ferrándiz e5660ee6ae [YoutubeDL] Fill the info dict 'http_headers' field with all the headers available
Useful for external tools using the json output.

The methods '_calc_headers' and '_calc_cookies' have been copied from the downloader/external, now they just use "info_dict['http_headers']".
Jaime Marquínez Ferrándiz 587a9c2749 [downloader/external] Use the 'http_headers' field
Jaime Marquínez Ferrándiz e1554a407d [extractors] Use http_headers for setting the User-Agent and the Referer
Jaime Marquínez Ferrándiz 3fcfb8e9fa [utils] YoutubeDLHandler: don't use 'Youtubedl-user-agent' for overriding the default user agent
Setting the 'User-Agent' header is enough
Philipp Hagemeister 384b62028a [downloader/external] Add curl and aria2c (Closes )
Philipp Hagemeister b95aab8482 [youtube:truncated_url] Add x-yt-cl URLs ()
Sergey M․ fc2d6abfe7 [videott] Improve _VALID_URL and add test
Irfan Charania 6aa4f54d66 [videott] improve extraction
Philipp Hagemeister 222516d97d [downloader] Lay groundwork for external downloaders.
This comes with a very simply implementation for wget; the real work is in setting up the infrastructure.
Philipp Hagemeister a055469faf [downloader] Improve downloader selection
Jaime Marquínez Ferrándiz 12d1fb5aa9 [twitch] PEP8
Jaime Marquínez Ferrándiz 48f00d15b1 [auengine] Remove extractor
The test is probably infringing copyright and nobody has provided a new test (see ).
Naglis Jonaitis 3e055aa5c3 [cliphunter] Fix extraction and update test (Fixes )
Philipp Hagemeister 6896a52721 release 2015.01.23.4
Philipp Hagemeister 5779b3e1fe Merge remote-tracking branch 'origin/master'
Philipp Hagemeister 62cd676c74 [youtube] Fixup DASH m4a headers
This fixes , , , , , .
Sergey M․ 0c17278843 [atresplayer] Extract subtitles
Philipp Hagemeister d229ee70da Merge remote-tracking branch 'origin/master'
Philipp Hagemeister 26e274666d [liveleak] Add original videos (Fixes )
Sergey M․ ebd46aed51 [atresplayer] Filter URLs and clarify android format ids
Philipp Hagemeister e793f7671c [liveleak] Modernize
Sergey M․ c2e64f71d0 [twitch] Add support for bookmarks
Jaime Marquínez Ferrándiz 0920e5830f [atresplayer] Don't include f4m formats if they are protected by DRM (fixes )
Jaime Marquínez Ferrándiz bf7fa94ec7 [downloader/f4m] build_fragments_list: Support videos with more than 1 segment
Philipp Hagemeister 6f58db8982 release 2015.01.23.3
Philipp Hagemeister aa42e87340 [utils] Catch strange Windows errors (Closes )
Philipp Hagemeister 649f7966f7 Fix --sleep-interval ()
Philipp Hagemeister 5f0d813d93 Merge remote-tracking branch 'rupertbaxter2/master'
Conflicts:
	youtube_dl/__init__.py
	youtube_dl/downloader/common.py
Philipp Hagemeister 501f13fbf3 [generic] Add support for Cinerama player (Fixes )
Philipp Hagemeister ba55168157 release 2015.01.23.2
Philipp Hagemeister d79323136f [utils] Simplify HTTPS socket creation
We were duplicating (bad) code and doing crazy things with SSL.
Just use TLSv1 across the board, and do with one implementation of HTTPSConnection.connect.
Fixes .
Philipp Hagemeister 08ff6ab07e [gamestar] Modernize slightly
Philipp Hagemeister ba655a0e4c Merge remote-tracking branch 'derrotebaron/master'
Philipp Hagemeister b59c17e543 Merge pull request from BitLooter/master
Embed description and URL as MP4 tags
Philipp Hagemeister 61ca9a80b3 [generic] Add support for BOMs (Fixes )
Philipp Hagemeister 317239b097 release 2015.01.23.1
Philipp Hagemeister c2a30b250c [testtube] Add new extractor (Fixes )
Philipp Hagemeister c994e6bd63 release 2015.01.23
Philipp Hagemeister 3ee2aa7a16 Merge remote-tracking branch 'origin/master'
Philipp Hagemeister 083c9df93b [YoutubeDL] Allow filtering by properties (Fixes )
Philipp Hagemeister 50789175ed [pornhub] Detect private videos and emit an error message (Closes )
Philipp Hagemeister dc1b027cd4 [twitch] PEP8
Sergey M․ f353cbdb2f [twitch:stream] Randomize query
Philipp Hagemeister 73e449b226 Merge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister 78111136db [twitch] Move URL matching tests into extractor
Philipp Hagemeister 650ab5beeb [comedycentral:shows] Remove references to colbert report
Philipp Hagemeister 7932de6352 [hearthisat] Correct error message
Sergey M․ 240b9b7a5c [twitch] Add support for streams (Closes , closes , closes )
Naglis Jonaitis bb6e38787d [videomega] Fix extraction (Closes )
Philipp Hagemeister 898c23c03f release 2015.01.22
Philipp Hagemeister b55ee18ff3 [hearthisat] Add support for more high-quality download links
Naglis Jonaitis e5763a7a7e [hearthisat] Add new extractor (Closes )
Sergey M․ 8bb1bdfae9 [twitch:past_broadcasts] Fix IE_NAME
Sergey M․ bb0aa4cb3c [streetvoice] Improve
Sergey M. d63528c8c7 Merge pull request from yan12125/IE_streetvoice
[StreetVoice] Add new extractor
Sergey M․ c5db6bb32b [twitch] Refactor and add support for past broadcasts
Yen Chi Hsuan c8dc41a6e7 [StreetVoice] Add new extractor
Jaime Marquínez Ferrándiz 47e0e1e0e2 [nbc] Fix pep8 issue
Jaime Marquínez Ferrándiz efcddaebe9 [cnn] Use edition.cnn.com for getting the information (fixes )
Some videos (like http://edition.cnn.com/videos/us/2015/01/20/orig-yellowstone-oil-spill.cnn) will fail if we use cnn.com.
Jaime Marquínez Ferrándiz 5fe5112589 [CNNArticle] Update test
Sergey M․ 564bb5e964 [tinypic] Tweak VALID_URL regex (Closes )
Sergey M․ 2df54b4ba8 [nbcnews] Ignore HTTP errors while coping with playlists (Closes )
Sergey M․ 030aa5d9e7 [tvp] Fix extraction
Philipp Hagemeister c511f13f22 [ndtv] Modernize
David Powell bd3cbe0716 Embed description and URL as MP4 tags
Sergey M․ fdb2ed7455 [abc7news] Add extractor (Closes )
Philipp Hagemeister ba319696a9 [options] Clarify that --password can be left out ()
Philipp Hagemeister 910c552052 release 2015.01.16
Philipp Hagemeister cce81f192c [bandcamp:album] Fix title extraction (Fixes )
Philipp Hagemeister 9d22a7dfb0 [fourtube] Fix extraction
Philipp Hagemeister 4f4f642822 [npo] Remove unused import
Jaime Marquínez Ferrándiz 2875cf01bb FFmpegEmbedSubtitlePP: simplify command
Jaime Marquínez Ferrándiz e205db3bcd FFmpegEmbedSubtitlePP: don't fail if the video doesn't have an audio stream (fixes )
Instead of specifying which streams ffmpeg must copy, we tell it to copy all.
Philipp Hagemeister 31d4a6e212 release 2015.01.15.1
Sergey M․ aaeb86f682 [youtube] Add test for
Phil Kulak a9b6b5cd15 Looks like Google switched to a new JS compiler that includes dollar signs in function names.
Naglis Jonaitis a45c0a5d67 [videomega] Fix extraction (Closes )
Sergey M․ c8dfe360eb [atresplayer] Add authentication support (Closes )
Philipp Hagemeister 4cfaf85c65 release 2015.01.15
Philipp Hagemeister be5f2c192c [ssl] Correct connect creation
We want to authenticate the server, see https://docs.python.org/dev/library/ssl.html#ssl.Purpose.SERVER_AUTH .
Sergey M․ c9ef44ce29 [smotri] Improve extraction (Closes )
Sergey M․ e92d4a11f5 [spiegel] Test format video URLs for 404 (Closes )
Naglis Jonaitis f2cbc96c3e [lnkgo] Make more robust