Commit Graph

444 Commits (9c286cfa004d18da196a6961ffda30bb9bf57515)

Author SHA1 Message Date
Philipp Hagemeister 95506f1235 Merge remote-tracking branch 'jaimeMF/color_error_messages'
Philipp Hagemeister 1447f728b5 Merge branch 'master' of github.com:rg3/youtube-dl
Jaime Marquínez Ferrándiz d2c690828a Add title and id to playlist results
Not all IE give both. They are not used yet.
Jaime Marquínez Ferrándiz cfa90f4adc Merge branch 'master' into extract_info_rewrite
dodo 5011cded16 SoundcloudSetIE
info extractor for soundcloud sets
Filippo Valsorda f10b2a9c14 fix KeekIE
Filippo Valsorda 5cb3c0b319 Merge pull request by @iemejia
Removed innecesary function to convert subtitles, improved use of the youtube api
Ismael Mejia c0ba104674 Fixed typo in error message when no subtitles were available.
Ismael Mejia 2a4093eaf3 Added new option '--list-subs' to show the available subtitle languages
Ismael Mejia 9e62bc4439 Added new option '--sub-format' to choose the format of the subtitles to downloade (defaut=srt)
Ismael Mejia 553d097442 Refactor subtitle options from srt to the more generic 'sub'.
In order to be more consistent with different subtitle formats.
From:
* --write-srt to --write-sub
* --only-srt to --only-sub
* --all-srt to --all-subs
* --srt-lang to --sub-lang'

Refactored also all the mentions of srt for sub in all the source code.
Ismael Mejia ae608b8076 Added new option '--all-srt' to download all the subtitles of a video.
Only works in youtube for the moment.
Philipp Hagemeister c397187061 Spiegel: Support hash at end of URL
Philipp Hagemeister e32b06e977 Spiegel IE
Johny Mo Swag 08ec0af7c6 catch fatal error
Johny Mo Swag 3b221c5406 removed str used for other project.
Philipp Hagemeister 3d3423574d Fix Unicode handling GenericIE (Fixes )
Johny Mo Swag 64c78d50cc working - worldstarhiphop IE
Support for WorldStarHipHop
Johny Mo Swag b3bcca0844 clean up
Johny Mo Swag 61e40c88a9 fixed typo
Johny Mo Swag 40634747f7 Support for WorldStarHipHop.com
Tim Douglas 47dcd621c0 Escapist videos are acutally .mp4, not .flv
Jaime Marquínez Ferrándiz a0d6fe7b92 When a redirect is found return the new url using the new style
Jaime Marquínez Ferrándiz c9fa1cbab6 More trouble calls changed in InfoExtractors.py
The calls with the message starting with 'WARNING' have been changed to report_warning instead of report_error
Jaime Marquínez Ferrándiz 8a38a194fb Add auxiliary methods to InfoExtractor to set the '_type' key and use them for some playlist IEs
Jaime Marquínez Ferrándiz f6e6da9525 Use extract_info in BlipTV User and Youtube Channel
Jaime Marquínez Ferrándiz 597cc8a455 Use extract_info in YoutubePlaylist and YoutubeSearch
Jaime Marquínez Ferrándiz e5f30ade10 Use report_error in InfoExtractors.py
Some calls haven't been changed
Philipp Hagemeister 7ae153ee9c Remove tweetreel - it has shut down
Philipp Hagemeister f7b567ff84 Use proper urlparse functions and simplify a bit
Philipp Hagemeister f2e237adc8 Merge remote-tracking branch 'jcarlosgarciasegovia/master'
Jaime Marquínez Ferrándiz 2e5457be1d Use report_warning in InfoExtractors
Juan Carlos Garcia Segovia 7f9d41a55e Allow downloading http://blip.tv/play/ embeded URLs
Philipp Hagemeister 691db5ba02 Don't be too clever (Fixes Python 3)
Philipp Hagemeister 6bf48bd866 Merge remote-tracking branch 'origin/API_YT_playlists'
Filippo Valsorda 89de9eb125 Modified Youtube video/playlist matching; fixes ; fixes
Filippo Valsorda 6324fd1d74 Switch YTPlaylistIE to API (relevant: ); fixes ; fixes ; fixes
Juan M 9e07cf2955 [YT Search] No results if items is not in response
When a query results of 0 items, the key items is not present in the
api_response dictionary, raising a KeyError.

Intead, look for the key and call trouble if it's not present.
Philipp Hagemeister 450e709972 Formalize URL creation (prepare for some cleanup in blip.tv:users)
Philipp Hagemeister 9befce2b8c Merge remote-tracking branch 'joksnet/ytsearch_decode_request'
Philipp Hagemeister f82b28146a Merge remote-tracking branch 'jaimeMF/TED'
Juan M d1b7a24354 Decode the data requested to the api in utf-8.
Jaime Marquínez Ferrándiz c85538dba1 TED: get thumbnails
Jaime Marquínez Ferrándiz 60bd48b175 Steam: get thumbnails
Ismael Mejia cdb130b09a Added new option '--only-srt' to download only the subtitles of a video
Improved option '--srt-lang'
 - it shows the argument in case of missing subtitles
 - added language suffix for non-english languages (e.g. video.it.srt)
Ismael Mejia 2e5d60b7db Removed conversion from youtube closed caption format to srt since youtube api supports the 'srt' format
Philipp Hagemeister 1013186a17 Also check for JSLoader of JWSPlayer (thanks to @maximeg, Closes )
Philipp Hagemeister 7c038b3c32 Import HTTPErrorProcessor from the correct module (Closes )
Philipp Hagemeister e711babbd1 Fix YP IE
Philipp Hagemeister 197080b10b Merge remote-tracking branch 'jaimeMF/TED'
Philipp Hagemeister 7796e8c2cb facebook: also download lq videos
Philipp Hagemeister 6d4363368a Fix MyVideo IE
Jaime Marquínez Ferrándiz 414638cd50 TED: Add support for playlists
Philipp Hagemeister 2a9983b78f Fix 8tracks
Philipp Hagemeister b17c974a88 Mark DailyMotion as broken for now ()
Philipp Hagemeister 58994225bc Add tests to MySpass
Jaime Marquínez Ferrándiz 59d4c2fe1b fix some titles in TED
Jaime Marquínez Ferrándiz 3a468f2d8b Basic support for TED
bastik 1ad5d872b9 added new InfoExtractor for myspass.de
Philipp Hagemeister f0877a445e Add tests for keek
Osama Khalid da06e2daf8 Add KeekIE()
Philipp Hagemeister d3f5f9f6b9 Fix login (Closes )
Philipp Hagemeister 8edc2cf8ca Support direct vimeo links (Closes )
Philipp Hagemeister fb778e66df Fix encoding in youtube subtitle download (Closes )
Philipp Hagemeister edba5137b8 Fix Facebook IE
Philipp Hagemeister f0bad2b026 Fix Stanford (Closes )
Philipp Hagemeister 25580f3251 8tracks: Ignore hashes
Philipp Hagemeister da4de959df 8tracks: Better default titles
Philipp Hagemeister d0d51a8afa 8tracks: Include performer as uploader
Philipp Hagemeister ccf65f9dee 8tracks IE (Closes )
Philipp Hagemeister b954070d70 Fix Facebook (Closes )
Philipp Hagemeister 97f194c1fb twitch.tv: Use id as title if no title is present (Closes )
Philipp Hagemeister 187f491ad2 [RBMA] Do not fail if thumbnail is empty
Philipp Hagemeister ca0a0bbeec RBMA IE (Closes )
Philipp Hagemeister 6119f78cb9 Add location field
Philipp Hagemeister 539679c7f9 Make uploader and upload_date fields optional
Philipp Hagemeister 3446dfb7cb Proper support for changing User-Agents from IEs
Philipp Hagemeister db16276b7c Improve YouJizz
Philipp Hagemeister 629fcdd135 Add agecheck and various improvements to YouPorn IE
Philipp Hagemeister 64ce2aada8 _request_webpage helper methods for queries that need the final URL
Philipp Hagemeister 565f751967 Clean up porno IEs
Philipp Hagemeister 6017964580 Merge remote-tracking branch 'jefftimesten/master'
Philipp Hagemeister ef0c8d5f9f Make ustream IE more robust
atomizer fa1bf9c653 justin.tv tweaks
- download all parts of a broadcast, fixes 
- set "uploader" variable to channel_name if available
- catch api errors even if http status is 200
Jeff Crouse 18be482a6f oops - didn't remove some reminders
Jeff Crouse ca6710ee41 made changes recommended in pull request
Philipp Hagemeister 9314810243 fix ComedyCentral IE in Python3
Philipp Hagemeister 7717ae19fa Add tests for ComedyCentral IE
Philipp Hagemeister 32635ec685 Switch comedycentral IE to http downloads
Jeff Crouse caec7618a1 re-fixed XNXX regex problem
Jeff Crouse 991ba7fae3 Added extractors for 3 porn sites
Jaime Marquínez Ferrándiz 26714799c9 steamIE remove the HTMLparser object
Jaime Marquínez Ferrándiz 5e9d042d8f steamIE follow @phihag suggestions
Jaime Marquínez Ferrándiz 9cf98a2bcc Allow downloading videos with other characters in their titles
Especially html entities
Philipp Hagemeister 01951dda7a Make ExtractorError usable for other causes
Philipp Hagemeister 26cf040827 Support youtube videos of google+ users
Philipp Hagemeister 8e241d1a1a Simplify DailyMotion IE
Philipp Hagemeister c80f0a417a Better name for InfoQ IE
Philipp Hagemeister 4fcca4bb18 Fix infoQ in Python3
Philipp Hagemeister 5f9551719c Simplify some IEs
Philipp Hagemeister d830b7c297 _download_webpage helper function
Philipp Hagemeister 1c256f7047 ExtractorError for errors during extraction
Philipp Hagemeister a34dd63beb Remove superfluous IE names
Philipp Hagemeister 4aeae91f86 Move gen_extractors to InfoExtractors
Jaime Marquínez Ferrándiz 278986ea0f ustreamIE
Jaime Marquínez Ferrándiz e314ba675b SteamIE
Filippo Valsorda 8cad53e84c Removed a spurious increment_downloads, this time cleanly
Philipp Hagemeister 0deac3a2d8 Revert "Removed a spurious increment_downloads"
This reverts commit 92e3e18a1d.
Filippo Valsorda 92e3e18a1d Removed a spurious increment_downloads
Philipp Hagemeister 3bb6165927 Allow ampersand right after ? in youtube URLs (Closes )
Philipp Hagemeister d0d4f277da TweetReel IE
Filippo Valsorda 99b0a1292b add --no-post-overwrites to README.md; + minor style fixes
Philipp Hagemeister a7c0f8602e Merge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister 21a9c6aaac FunnyOrDie IE (Fixes )
Filippo Valsorda 6b3aef80ce better Vimeo tests; fixed a couple of VimeoIE fields
Filippo Valsorda 77c4beab8a new info_dict field: uploader_id
Filippo Valsorda 1a2c3c0f3e some py3 fixes, both needed and recommended; we should pass 2to3 as cleanly as possible now
Filippo Valsorda 056d857571 refactor YouTube subtitles code, it was ugly (my bad)
Nick Daniels 0dcfb234ed Update Vimeo Info Extractor to get pull in the description properly
Nick Daniels cdb3076445 Sublime space formatting
Filippo Valsorda 937021133f a number of new tests and fixes; all tests green on 3.3
Filippo Valsorda f7b111b7d1 Google Video has been shutdown as of 11/15/2012. All videos on Google Video will be migrated to YouTube by the end of 2012.
Filippo Valsorda 80d3177e5c various py3 fixes; all tests green on 3.3
Dave Vasilevsky 4096b60948 Misc justin.tv fixes
Dave Vasilevsky 2ab1c5ed1a Support more than 100 videos for justin.tv
Dave Vasilevsky 0b40544f29 Preliminary support for twitch.tv and justin.tv
Philipp Hagemeister f1171f7c2d Fix VimeoIE in Python 3
Philipp Hagemeister 28ca6b5afa Fix Dailymotion in Python 3
Philipp Hagemeister bec102a843 Fix XNXX in Python 3
Philipp Hagemeister 8f6f40d991 More Youku Python 3 fixing
Philipp Hagemeister e2a8ff24a9 Fix YoukuIE in Python3 (and in general)
Philipp Hagemeister 8588a86f9e Fix xvideo IE in Python 3
Philipp Hagemeister 4cc3d07426 NBA IE (Closes )
nto ca6849e65d Add support for comedycentral clips (closes )
Support individual clips, not just full episodes.
break up now monstrous _VALID_URL regex over multiple lines to improve readability,
pass re.VERBOSE flag when using regex to ignore the whitespace
Philipp Hagemeister 4c21c56bfe Merge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister 55c0539872 Fix blip.tv in python3
Filippo Valsorda 9789a05c20 fix playlist pagination and add YT playlist tests (closes )
Filippo Valsorda 1ca63e3ae3 the test didn't load our Gzip opener
this was blocking the Vimeo test

+ some more gentest fixes
Philipp Hagemeister c7214f9a6f Use Soundcloud API (Closes )
Philipp Hagemeister 8fd3afd56c More work on soundcloud IE
Philipp Hagemeister f9b2f2b955 Correct accidental rename
Philipp Hagemeister 633b4a5ff6 Mark SoundCloud IE as nonfunctional for now ()
Philipp Hagemeister b4cd069d5e Better error reporting for SoundCloud IE
Philipp Hagemeister e387eb5aba Let youtube IE handle IDs starting with PL (Closes )
Philipp Hagemeister 15c8d83358 Fix Soundcloud IE (+ Python3 support)
Filippo Valsorda 0eb0faa26f Mark CollegeHumorIE not working until phihag finishes
Filippo Valsorda 32761d863c fix YouTubeIE on 2.6, sorry
Philipp Hagemeister 799c076384 collegehumor: able to download a single f4f file (not yet playable)
Philipp Hagemeister 9e8056d5a7 Use relative imports
Philipp Hagemeister 59ae15a507 Convert all tabs to 4 spaces (PEP8)
Philipp Hagemeister 8cd10ac4ef Fix printing title etc.
Philipp Hagemeister 72f976701a youtube IE: Correct bytes vs str
Philipp Hagemeister 9f37a95941 Py2/3 parse_qs compatibility
Philipp Hagemeister a130bc6d02 One more except..as
Philipp Hagemeister 348d0a7a18 Py2/3 compatibility for http.client
Philipp Hagemeister 03f9daab34 Use io.BytesIO instead of StringIO
Philipp Hagemeister 01ba00ca42 Prepare urllib references for 2/3 compatibility
Philipp Hagemeister e08bee320e Use except .. as everywhere ()
Philipp Hagemeister 96731798db Rename util.u to util.compat_str
Filippo Valsorda c63cc10ffa Merge remote-tracking branch 'origin/master' into IE_cleanup
Conflicts:
	youtube_dl/FileDownloader.py
Filippo Valsorda f462df021a Use None on missing required info_dict fields
Philipp Hagemeister 1a84d8675b Use u instead of str in Python 2
Filippo Valsorda 03c5b0fbd4 IE._WORKING attribute in order to warn the users and skip the tests on broken IEs
Philipp Hagemeister 95649b3936 Replace long with int (see PEP 237)
Philipp Hagemeister dd109dee8e Remove mentions of unicode
Filippo Valsorda 7e4674830e document info_dict['subtitles'] and info_dict['urlhandle']
Filippo Valsorda 9ce5d9ee75 make all IEs return 'upload_date' and 'uploader', even if only u'NA'
Filippo Valsorda b49e75ff9a info_dict['upload_date'] is documented in --output, IEs MUST specify it
Filippo Valsorda abe7a3ac2a info_dict['player_url'] is used only for rtmpdump, indicate it as optional in the info_dict
Filippo Valsorda 717b1f72ed default info_dict['format'] to info_dict['ext'] and make the YT one more verbose
Philipp Hagemeister 33d94a6c99 Merge remote-tracking branch 'alab1001101/master'
Philipp Hagemeister fa59f4b6a9 Merge remote-tracking branch 'chrisjrn/master'
Christopher Neugebauer 4a702f3819 Fixes the InfoExtractor for the Colbert Report.
Philipp Hagemeister 6bac102a4d Fix spacing in comedycentral IE
Christopher Neugebauer feb22fe5fe Fixed indentation error
Christopher Neugebauer d8dddb7c02 Removes extranous debugging info :)
Christopher Neugebauer 4408d996fb Adds format listing/selection support to the Comedy Central extractor.
Christopher Neugebauer 89af8e9d32 Removes extraneous debug message.
Christopher Neugebauer 36a9c0b5ff Points the ComedyCentral extractor at a CDN which works with more RTMPDump versions.
Philipp Hagemeister 92b91c1878 Use character instead of byte strings
Philipp Hagemeister 51937c0869 Add some parentheses around print for
zejn 297d7fd9c0 Also enable album URLs on Vimeo.
Filippo Valsorda 74033a662d Reworked Vimeo file selection logic (quality, codec) - closes
Filippo Valsorda 4cc391461a fix DailyMotion official users videos - closes - by @yvestan
Filippo Valsorda bf95333e5e fixed MetacafeIE (uploader nickname regex) - closes
Filippo Valsorda fe4d68e196 slight change to Dailymotion uploader regex (fix)
Tailszefox 2262a32dd7 Added duration for YouTube videos
Philipp Hagemeister c6c0e23a32 Support raw playlist parameters (Closes )
Filippo Valsorda b8005afc20 handle YT urls with #/ redirects (closes )
Filippo Valsorda 902b2a0a45 New IE: YouTube channels (closes )
Filippo Valsorda 10daa766a1 support EDU YouTube playlists (closes )
Filippo Valsorda 0bfd0b598a Re-engineered Dailymotion qualities selection (thanks @knagano, sort of merges )
Filippo Valsorda fd873c69a4 Merge PR from 'kevinamadeus/master'
Add InfoExtractor for Google Plus video
(with fixes)
Tailszefox 413575f7a5 Added uploaded date for Dailymotion
Filippo Valsorda 13e69f546c Merged, modified and compiled Dailymotion pull request by @Steap
Cyril Roelandt 63ec7b7479 DailymotionIE: There is not necessarily an underscore in a Dailymotion URL.
Cyril Roelandt 7b6d7001d8 DailymotionIE: some videos do not use the "hqURL", "sdURL", "ldURL" keywords. In this case, the "video_url" keyword should be looked for.
Filippo Valsorda 5c961d89df Merge pull request from FiloSottile/re_VERBOSE
Filippo Valsorda 3c4d6c9eba Not all Dailymotion videos have an hqURL, now downloads highest quality available
Filippo Valsorda 349e2e3e21 Fixed DailymotionIE, now downloads high-def mp4s, which might be too much (?)
cryzed 3af2f7656c Fixed YouTube playlist parsing
Philipp Hagemeister 7f36e39676 Merge remote-tracking branch 'FiloSottille/supports'
Conflicts:
	youtube-dl
Philipp Hagemeister ebe3f89ea4 Merge xnxx.com Support (NSFW). Test URL (SFW): http://video.xnxx.com/video1443330/youtube-dl_testvid_a_and_9829_._and_amp_and_38_
Danko Alexeyev 9ca667065e Add 'signature' to YouTube URLs, fixes
Kevin Kwan d443aca863 Add InfoExtractor for Google Plus video
Christian Albrecht f2ad10a97d Add arte.tv Info Extractor
Filippo Valsorda 202e76cfb0 Made the YouTubeIE regex verbose/commented
Filippo Valsorda 795cc5059a Re-engineered XNXXIE to actually exit on ERRORs even with -i
Filippo Valsorda 5dc846fad0 Merge pull request from tempname/master
Filippo Valsorda d5c4c4c10e bugfix and standarize the youku.com support
Filippo Valsorda 1ac3e3315e Merge pull request from thesues/master
Filippo Valsorda 0e4dc2fc74 Merge 'rbrito/support-tube.majestyc.net' (PR ) with small fix
tempname 6de7ef9b8d added InfoExtractor for XNXX
dongmao zhang 392105265c Merge branch 'master' of github.com:thesues/youtube-dl
Conflicts:
	youtube-dl
	youtube_dl/InfoExtractors.py
dongmao zhang 51661d8600 add www.youku.com support
dongmao zhang b5809a68bf merge
dongmao zhang 7733d455c8 fix 0a->0A bug
dongmao zhang 0a98b09bc2 youku default to download hd2 video
dongmao zhang 302efc19ea add youku support
Rogério Brito 55a1fa8a56 Support downloading Youtube videos via tube.majestyc.net
A user requested (in Debian's bug tracking system) that support for
tube.majestyc.net, a frontend for Youtube with accessibility functions
(and other support for other assistive technologies), be added.

This patch adds support for this.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
Philipp Hagemeister a171dbfc27 Merge pull request from FiloSottile/blip
Blip.tv
Filippo Valsorda 11a141dec9 BlipTVUserIE fix
Filippo Valsorda 818282710b moved the User-Agent workaround to the BlipTV IE
Filippo Valsorda dee5d76923 changed YouTube closed captions URL; closes
Filippo Valsorda 363a4e1114 xvideos patch by @pocoimporta - closes
Philipp Hagemeister 3210735c49 Fix EscapistMagazine IE
Filippo Valsorda d4e16d3e97 YouTube playlist fix; closes and
Witchakorn Kamolpornwijit 5404179338 Change a number of subtitle sequence to begin with one (instead of zero) for ffmpeg,avcodec, and Matroska compatibility
Filippo Valsorda 7df97fb59f display a meaningful error message on rental videos ()
Filippo Valsorda 3187e42a23 Merge pull requests by jcarlosgarciasegovia
Juan Carlos Garcia Segovia f1927d71e4 Some blip.tv URLs use Unicode characters. urllib2 breaks when passing a Unicode string. it needs a UTF-8 byte buffer
Juan Carlos Garcia Segovia eeeb4daabc Information Extractor for blip.tv users
chocolateboy 6ab92c8b62 don't corrupt stdout (-o -) in verbose mode
Philipp Hagemeister 9ab3406ddb Fix Escapist IE
Filippo Valsorda 2c288bda42 reorganized the titles sanitizing: now title is the untouched title
and stitle is created in process_info() and is cross-filesystem sanitized by sanitize_filename();
closes 
Filippo Valsorda 0b8c922da9 Introduced Trouble(Exception) for more elegant non-fatal errors handling
Filippo Valsorda 3fe294e4ef merge upstream
Filippo Valsorda 921a145592 dropped the support for Python 2.5
let's elaborate the decision: Python 2.5 is a 6 years old release
and "under the current release policy, no security issues in Python
2.5 will be fixed anymore" (!!); also, it doesn't support the new
zipfile distribution format.
Filippo Valsorda 9beb5af82e some HTMLParser bugfixes
Filippo Valsorda 9e6dd23876 merged unescapeHTML branch; removed lxml dependency
Filippo Valsorda - Campagna d11d05d07a better naming for the sub-modules
Filippo Valsorda 303692b5ed 's/ /\t/'
Filippo Valsorda 58ca755f40 moved increment_downloads and process_info calls from IEs to FD.download () (follows current doclines); a small step towards importability
Filippo Valsorda d77c3dfd02 Split code as a package, compiled into an executable zip