Commit Graph

1800 Commits (eb0a83986642cf660820b168bd83c8770e3e5ce6)

Author SHA1 Message Date
Philipp Hagemeister 8abeeb9449 Nicer --list-formats output 11 years ago
Philipp Hagemeister c1002e96e9 Let extractors omit ext in formats 11 years ago
Philipp Hagemeister 77d0a82fef [addanime] Use new formats system 11 years ago
Philipp Hagemeister ebc14f251c Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister d41e6efc85 New debug option --write-pages 11 years ago
Filippo Valsorda 8ffa13e03e [Instagram] get the non-https link, as they are serving Akamai cert from a instagram.com domain 11 years ago
Filippo Valsorda 750e9833b8 Add the missing age_limit tags; added a devscript to do a superficial check for porn sites without the age_limit tag in the test 11 years ago
Filippo Valsorda 82f0ac657c Merge pull request #1657 by @rzhxeo
[YouPornIE] Extract all encrypted links and remove doubles at the end
11 years ago
Filippo Valsorda eb6a2277a2 Merge pull request #1659 by @rzhxeo
Add support for http://www.tube8.com
11 years ago
Filippo Valsorda f8778fb0fa Merge pull request #1663 by @rzhxeo
Add support for http://www.spankwire.com
11 years ago
Filippo Valsorda e2f9de207c Merge pull request #1664 by @rzhxeo
Add support for http://www.keezmovies.com
11 years ago
Filippo Valsorda a93cc0d943 Merge pull request #1661 by @rzhxeo
Add support for http://www.pornhub.com
11 years ago
Filippo Valsorda 7d8c2e07f2 [Exfm] replace the failing Soundcloud test vector (broken also in browser) 11 years ago
Filippo Valsorda efb4c36b18 Merge pull request #1660 from pyed/master
[addanime] try to download HQ before normal
11 years ago
Jaime Marquínez Ferrándiz 29526d0d2b Merge pull request #1656 from rzhxeo/xhamster
[XHamsterIE] Extract SD and HD video
11 years ago
Abdulelah Alfntokh 198e370f23 [addanime] better regex. 11 years ago
Jaime Marquínez Ferrándiz c19f7764a5 [generic] Detect bandcamp pages that use custom domains (closes #1662)
They embed the original url in the 'og:url' property.
11 years ago
Jaime Marquínez Ferrándiz bc63d9d329 [rtlnow] Change the test for rtlnitronow 11 years ago
Jaime Marquínez Ferrándiz aa929c37d5 [generic] Fix test video's checksum 11 years ago
Jaime Marquínez Ferrándiz af4d506eb3 [faz] Use a regex for getting the description
The page cannot be parsed in python2.6 with the html parser.
11 years ago
rzhxeo 5da0549581 [KeezMoviesIE] Correct return value for embedded videos 11 years ago
Jaime Marquínez Ferrándiz 749a4fd2fd [facebook] Don't recommend to report the issue if the video is private. 11 years ago
Jaime Marquínez Ferrándiz 6f71ef580c [facebook] Report a more meaningful message if the video cannot be accessed (closes #1658) 11 years ago
Jaime Marquínez Ferrándiz 67874aeffa [facebook] Fix the login process (fixes #1244) 11 years ago
Abdulelah Alfntokh 3e6a330d38 [addanime] fix md5sum 11 years ago
Abdulelah Alfntokh aee5e18c8f [addanime] catch 'RegexNotFoundError' 11 years ago
rzhxeo 5b11143d05 Add support for http://www.keezmovies.com 11 years ago
rzhxeo 7b2212e954 Add support for http://www.spankwire.com 11 years ago
rzhxeo 71865091ab [Tube8IE] Fix regex for uploader extraction 11 years ago
rzhxeo 125cfd78e8 Add support for http://www.pornhub.com 11 years ago
rzhxeo 8cb57d9b91 [Tube8IE] Escape dot in regex 11 years ago
pyed 14e10b2b6e [addanime] try to download HQ before normal 11 years ago
rzhxeo 6e76104d66 [YouPornIE] Make webpage download more robust 11 years ago
rzhxeo 1d45a23b74 Add support for http://www.tube8.com 11 years ago
rzhxeo 7df286540f [YouPornIE] Extract all encrypted links and remove doubles at the end 11 years ago
rzhxeo 5d0c97541a [XHamsterIE] Extract SD and HD video 11 years ago
Philipp Hagemeister 49a25557b0 [8tracks] Use track count instead of looking at at_last_track property
This fixes the error:

$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
    youtube_dl.main()
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
    _real_main(argv)
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
    videos = self.extract_info(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
    ie_result = ie.extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
    return self._real_extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
    'id': track_data['id'],
KeyError: 'id'
11 years ago
Jaime Marquínez Ferrándiz b5936c0059 Document the %(format_id)s field for the output template 11 years ago
Jaime Marquínez Ferrándiz 600cc1a4f0 [youtube] Set the format_id field to the itag of the format (closes #1624) 11 years ago
Jaime Marquínez Ferrándiz ea32fbacc8 Fix the extensions of two tests with youtube videos
The best quality is now a mp4 video.
11 years ago
Jaime Marquínez Ferrándiz 00fe14fc75 [youtube] Also use the 'adaptative_fmts' field from the /get_video_info page (fixes #1649)
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
11 years ago
Jaime Marquínez Ferrándiz fcc28edb2f [cinemassacre] Simplify
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
11 years ago
Jaime Marquínez Ferrándiz fac6be2dd5 Merge pull request #1632 from rzhxeo/cinemassacre
[Cinemassacre] Download video that is shown in flash player
11 years ago
Philipp Hagemeister 1cf64ee468 release 2013.10.23.2 11 years ago
Jaime Marquínez Ferrándiz cdec0190c4 [dailymotion] Extract all the available formats (closes #1028) 11 years ago
Jaime Marquínez Ferrándiz 2450bcb28b [nowvideo] Fix key extraction
Extract it from the embed page
11 years ago
Jaime Marquínez Ferrándiz 3126050c0f Hide the video password on verbose mode 11 years ago
Jaime Marquínez Ferrándiz 93b22c7828 [vimeo] fix the extraction for videos protected with password
Added a test video.
11 years ago
Philipp Hagemeister 0a89b2852e release 2013.10.23.1 11 years ago
Jaime Marquínez Ferrándiz 55b3e45bba [vimeo] Fix pro videos and player.vimeo.com urls
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
11 years ago
Philipp Hagemeister 365bcf6d97 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 71907db3ba [vimeo] Fix normal videos (Fixes #1642)
Vimeo Pro Videos are still broken
11 years ago
Philipp Hagemeister 6803655ced Merge pull request #1622 from rbrito/fix-extension
extractor: youtube: Set extension of AAC audio formats to m4a.
11 years ago
Philipp Hagemeister df1c39ec5c release 2013.10.23 11 years ago
Philipp Hagemeister 80f55a9511 release 2013.10.22 11 years ago
Philipp Hagemeister 7853cc5ae1 Merge remote-tracking branch 'origin/master'
Conflicts:
	youtube_dl/YoutubeDL.py
11 years ago
Philipp Hagemeister 586a91b67f Expand tilde in template (Fixes #1639) 11 years ago
Jaime Marquínez Ferrándiz b028e96144 [arte.tv:creative] Update the title of the test 11 years ago
Jaime Marquínez Ferrándiz ce68b5907c [nhl:videocenter] Fix playlist title extraction 11 years ago
Jaime Marquínez Ferrándiz fe7e0c9825 Style fixes in YoutubeDL.py
Fixed some of the problems reported by pep8
11 years ago
Jaime Marquínez Ferrándiz 12893efe01 Respect the download parameter in YoutubeDL.process_video_result if the extractor handle the format selection 11 years ago
Joshua Elsasser a6387bfd3c [vimeo] Implement the new format selection system (closes PR #996)
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
11 years ago
Jaime Marquínez Ferrándiz f6a54188c2 [youtube] Use 'node is None' when checking if the video has automatic captions
It had stopped working and it reports a FutureWarning
11 years ago
Jaime Marquínez Ferrándiz cbbd9a9c69 Fix the duration field for the VideoDetective and InternetVideoArchive tests
Also remove the use of the old format system and the comment
11 years ago
Jaime Marquínez Ferrándiz 685a9cd2f1 [googleplus] Fix upload_date extraction 11 years ago
Jaime Marquínez Ferrándiz 182a107877 [arte] Set the format_note and the format_id fields (closes #1628) 11 years ago
Jaime Marquínez Ferrándiz 8c51aa6506 The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
11 years ago
Jaime Marquínez Ferrándiz 3fd39e37f2 YoutubeDL: remove method that came from FileDownloader 11 years ago
Jaime Marquínez Ferrándiz 49e86983e7 Allow to use the extension for the format selection
The best format with the extension is downloaded.
11 years ago
Jaime Marquínez Ferrándiz a9c58ad945 Accept requested formats to be in the format 35/best (closes #1552)
The format selection code is now an independent function.
11 years ago
Philipp Hagemeister f8b45beacc Merge remote-tracking branch 'rbrito/set-age'
Conflicts:
	youtube_dl/extractor/xhamster.py
11 years ago
Philipp Hagemeister 9d92015d43 [xhamster] Add support for age_limit (Instead of #1627) 11 years ago
Rogério Brito 50a6150ed9 extractor: Set age limit on some adult-related extractors.
More age limit of videos for adult-related sites.

Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.

That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
rzhxeo b0505eb611 [CinemassacreIE] Fix information extraction 11 years ago
Rogério Brito 8ed6b34477 extractor: Set age limit on some adult-related extractors.
This is similar in spirit to what was done in commit 8e590a117f.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Rogério Brito f6f1fc9286 extractor: youtube: Fix extension of dash formats.
While we are at it, separate the audio formats from the video formats.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Philipp Hagemeister 8e590a117f [xnxx] Add age_limit 11 years ago
Philipp Hagemeister b186d949cf release 2013.10.18.2 11 years ago
Philipp Hagemeister 41fd7c7e60 Add new option --abort-on-error 11 years ago
Philipp Hagemeister fdefe96bf2 Document %(format)s (#1612) 11 years ago
Rogério Brito 16f36a6fc9 extractor: youtube: Set extension of AAC audio formats to m4a.
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue

Furthermore, one may argue that this is, indeed, the case for correctness's
sake.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Philipp Hagemeister cce722b79c Add metavar to --cache-dir 11 years ago
Philipp Hagemeister 82697fb2ab release 2013.10.18.1 11 years ago
Philipp Hagemeister 53c1d3ef49 Check for embedded YouTube player (Fixes #1616) 11 years ago
Philipp Hagemeister 8e55e9abfc release 2013.10.18 11 years ago
Philipp Hagemeister 7c58ef3275 [tudou] Fix title regex (Fixes #1614) 11 years ago
Philipp Hagemeister 416a5efce7 fix typos 11 years ago
Philipp Hagemeister f4d96df0f1 Extend #980 with --max-quality support 11 years ago
Philipp Hagemeister 1c1218fefc Merge remote-tracking branch 'jaimeMF/format_selection' 11 years ago
Jaime Marquínez Ferrándiz d21ab29200 Add an extractor for techtalks.tv (closes #1606) 11 years ago
Philipp Hagemeister 54ed626cf8 release 2013.10.17 11 years ago
Philipp Hagemeister a733eb6c53 [youtube] Do not crash if caption info is missing altogether (Fixes #1610) 11 years ago
Philipp Hagemeister 591454798d [brightcove] Raise error if playlist is empty (#1608) 11 years ago
Philipp Hagemeister 38604f1a4f Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 2d0efe70a6 [brightcove] Fix more broken XML (#1608) 11 years ago
Jaime Marquínez Ferrándiz bfd14b1b2f Add an extractor for rutube.ru (closes #1136)
It downloads with a m3u8 manifest, requires ffmpeg.
11 years ago
Philipp Hagemeister 8abbf43f21 release 2013.10.15 11 years ago
Philipp Hagemeister 10eaae48ff Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Philipp Hagemeister 9d4660cab1 [generic] Support embedded vimeo videos (#1602) 11 years ago
Jaime Marquínez Ferrándiz 9d74e308f7 [sztvhu] Fix the title extraction 11 years ago
Jaime Marquínez Ferrándiz 8381a92120 [websurg] Skipt the test
It needs login information.
11 years ago
Philipp Hagemeister cd054fc491 Use upper-case for prefixes in help to signify bytes (#1043) 11 years ago
Philipp Hagemeister f219743e33 Merge remote-tracking branch 'alphapapa/master' 11 years ago
Philipp Hagemeister 4f41664de8 Merge remote-tracking branch 'Rudloff/websurg' 11 years ago
Philipp Hagemeister a4fd04158e Do not import * 11 years ago
Philipp Hagemeister a623df4c7b Credit @Elbandi for sztvhu 11 years ago
Philipp Hagemeister 7cf67fbe29 [sztvhu] Simplify 11 years ago
Philipp Hagemeister 3ddf1a6d01 Merge remote-tracking branch 'Elbandi/master' 11 years ago
Philipp Hagemeister 850555c484 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 9ed3bdc64d [tudou] Add support for youku links (Closes #1571) 11 years ago
Jaime Marquínez Ferrándiz c45aa56080 [gamespot] Fix video extraction (fixes #1587) 11 years ago
Philipp Hagemeister 7394b8db3b Merge remote-tracking branch 'origin/master' 11 years ago
Andras Elso f9b3d7af47 Add an extractor for Szombathelyi TV 11 years ago
Filippo Valsorda ea62a2da46 add VideoPremium.tv RTMP support 11 years ago
Jai Grimshaw 1fb07d10a3 [youtube] Adds #1312 Download annotations
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
11 years ago
Philipp Hagemeister 9378ae6e1d [youku] Allow shortcut youku:ID and make non-matching groups non-matching (#1571) 11 years ago
Philipp Hagemeister 06723d47c4 Merge remote-tracking branch 'jaimeMF/opus-fix' 11 years ago
Jaime Marquínez Ferrándiz 69a0c470b5 [arte] Add an extractor for future.arte.tv (closes #1593) 11 years ago
Jaime Marquínez Ferrándiz c40f5cf45c [arte] add an extractor for creative.arte.tv (#1593)
The +7 videos now use an independent extractor that is also used for the creative videos
11 years ago
Jaime Marquínez Ferrándiz 4b7b839f24 Add an extractor for rottentomatoes.com and improve InternetVideoArchiveIE to get the best quality 11 years ago
Jaime Marquínez Ferrándiz 3d60d33773 Add an extractor for videodetective.com (closes #262)
It uses the internetvideoarchive.com platform.
11 years ago
Jaime Marquínez Ferrándiz d7e66d39a0 Add an extractor for internetvideoarchive.com videos
It's used by videodetective.com
11 years ago
Filippo Valsorda f5e54a1fda add support for NowVideo.ch 11 years ago
Jaime Marquínez Ferrándiz 4eb7f1d12e FFmpegPostProcessor: print the command line used if the --verbose option is given 11 years ago
Jaime Marquínez Ferrándiz 0f6d12e43c Don't set the '-aq' option with the opus format (fixes #1263) 11 years ago
Joey Adams 3283533149 Fix Brightcove detection when another Flash object is on the page
The regex used non-greedy match, but alas it failed on input like this:

    <object class="...> ... class="BrightcoveExperience"

It captured two objects and the intervening HTML.  This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.

Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
11 years ago
Jaime Marquínez Ferrándiz 8032e31f2d Merge pull request #1558 from rzhxeo/cinemassacre
Add support for http://cinemassacre.com
11 years ago
Jaime Marquínez Ferrándiz d2f9cdb205 Merge branch 'cinemassacre' of github.com:rzhxeo/youtube-dl into rzhxeo-cinemassacre 11 years ago
Jaime Marquínez Ferrándiz 8016c92297 Fix the default values of format_id and format 11 years ago
Jaime Marquínez Ferrándiz e028d0d1e3 Implement the prefer_free_formats in YoutubeDL 11 years ago
Jaime Marquínez Ferrándiz 79819f58f2 Default 'format' field to {width}x{height}
If width is None, use {height}p and if height is None, '???'
11 years ago
Jaime Marquínez Ferrándiz 6ff000b888 Do not handle format selection for IEs that already handle it 11 years ago
Jaime Marquínez Ferrándiz 99e206d508 Implement the max quality option in YoutubeDL 11 years ago
Jaime Marquínez Ferrándiz dd82ffea0c Implement format selection in YoutubeDL
Now the IEs can set a formats field in the info_dict, with the formats ordered from worst to best quality. It's a list of dicts with the following fields:
* Mandatory: url and ext
* Optional: format and format_id

The format_id is used for choosing which formats have to be downloaded.

Now a video result is processed by the method process_video_result.
11 years ago
Jaime Marquínez Ferrándiz 3823342d9d [arte] Prepare for generic format support (#980) 11 years ago
Jaime Marquínez Ferrándiz 91dbaef406 [nhl] Add an extractor for videocenter's categories (#1586)
It downloads the last 12 videos.
11 years ago
Jaime Marquínez Ferrándiz 9026dd3858 Make sure it only runs rtmpdump one time in test mode and return True if the download can be resumed 11 years ago
Jaime Marquínez Ferrándiz 81d7f1928c Merge pull request #1565 from rzhxeo/rtmpdump_test
Only download 1 sec. with rtmpdump in test mode
11 years ago
Jaime Marquínez Ferrándiz bc4f29170f Add a PostProcessor for adding metadata to the file (closes #1570)
It currently sets the title, the date and the author values.
11 years ago
Jaime Marquínez Ferrándiz cb354c8f62 [yahoo] Download the info from another page
The 'meta' field is not always in the video webpage
11 years ago
Jaime Marquínez Ferrándiz 1cbb27b151 [gamespot] Mark as broken (#1587) 11 years ago
Jaime Marquínez Ferrándiz 0ab4ff6378 [mtv] Strip the description
There were some tabs and newlines added around the string.
11 years ago
Jaime Marquínez Ferrándiz 63da13e829 Add an extractor for faz.net (closes #1582) 11 years ago
Jaime Marquínez Ferrándiz 2e1fa03bf5 Add an extractor for video.nhl.com (closes #1586) 11 years ago
Philipp Hagemeister 8f1ae18a18 release 2013.10.09 11 years ago
Philipp Hagemeister 57da92b7df [youtube] Do not recognize attribution link as user (Fixes #1573) 11 years ago
Jaime Marquínez Ferrándiz df4f632dbc Merge pull request #1584 from wingsuit/master
Tiny tpo
11 years ago
Jaime Marquínez Ferrándiz a34c2faae4 [youtube] set the 'name' parameter in the subtitles url (fixes #1577) 11 years ago
Tom 1d368c7589 Tiny tpo 11 years ago
Jaime Marquínez Ferrándiz 88bd97e34c [vevo] Some improvements (fixes #1580)
Extract the info from http://videoplayer.vevo.com/VideoService/AuthenticateVideo?isrc={id}
Some videos don't have an smil manifest, extract the video urls directly from the json and use the last version of the video.
Extract all the available formats and set the 'formats' field of the result
11 years ago