Commit Graph

9740 Commits (8ddf48d59f2d04b7411202eb6bf02c6eaa387035)
 

Author SHA1 Message Date
rzhxeo 4894fe8c5b Report download progress of rtmpdump
Jaime Marquínez Ferrándiz dd5bcdc4c9 [brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter (fixes )
Philipp Hagemeister 6161d17579 release 2013.11.07
Jaime Marquínez Ferrándiz 4ac5306ae7 Fix the report progress when file_size is unknown ()
The report_progress function will accept eta and percent with None value and will set the message to 'Unknow ETA' or 'Unknown %'.
Otherwise the values must be numbers.
Jaime Marquínez Ferrándiz b1a80ec1a9 [xnxx] Accept urls that start with 'www' (fixes )
Philipp Hagemeister 672fe94dcb release 2013.11.06.1
Jaime Marquínez Ferrándiz 51040b72ed [brightcove] Support redirected urls from bcove.me (fixes )
'bctid' needs to be changed to '@videoPlayer', and 'bckey' to 'playerKey'.
Jaime Marquínez Ferrándiz 4f045eef8f [youtube:channel] Fix the extraction
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
Jaime Marquínez Ferrándiz 5d7b253ea0 Add an extractor for eitb.tv (fixes )
The BrighcoveExperience object doesn't contain the video id, the extractor adds it and passes the url to BrightcoveIE.
Jaime Marquínez Ferrándiz b0759f0c19 [brightcove] Extract all the available formats
Jaime Marquínez Ferrándiz 065472936a Add an extractor for space.com (fixes )
It uses Brightcove, but requires some special process for getting a url with the playerKey field in some videos
Jaime Marquínez Ferrándiz fc4a0c2aec [brightcove] Change the 'videoId' or 'videoID' field to '@videoPlayer' (fixes )
It seems to be needed when using the htmlFederated page
Jaime Marquínez Ferrándiz eeb165e674 [brightcove] Add the extraction of the url from generic
Jaime Marquínez Ferrándiz 9ee2b5f6f2 tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
Philipp Hagemeister da54be877a release 2013.11.06
Philipp Hagemeister 50a886b7ab Fix reporting when file size is unkown (Fixes )
Philipp Hagemeister 76e67c2cb6 Clean up imports
Marcin Cieślak 5137ebac0b [tvp] Telewizja Polska: new extractor for tvp.pl, fixes
Thanks-To: mplonski

https://github.com/mplonski/linux/blob/master/tvp-dl.py
Marcin Cieślak a8eeb0597b Fix AssertionError when og property not found
On tvp.pl some webpages contain OpenGraph
metadata and some don't.

If og property is not found, _og_search_description
fails with

WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug
Traceback (most recent call last):
  File "/usr/home/saper/bin/youtube-dl", line 18, in <module>
    youtube_dl.main()
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main
    _real_main(argv)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main
    retcode = ydl.download(all_urls)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download
    videos = self.extract_info(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info
    ie_result = ie.extract(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract
    return self._real_extract(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract
    info['description'] = self._og_search_description(webpage)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description
    return self._og_search_property('description', html, fatal=False, **kargs)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property
    return unescapeHTML(escaped)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML
    assert type(s) == type(u'')
AssertionError

The patch allows me to use:

  try:
    info['description'] = self._og_search_description(webpage)
    info['thumbnail'] = self._og_search_thumbnail(webpage)
  except RegexNotFoundError:
    pass
Ismaël Mejía 4ed3e51080 [ted] fixed error in case of no subtitles present
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
Jaime Marquínez Ferrándiz 7f34001d57 Merge pull request from rzhxeo/generic_youtube
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instead of "
rzhxeo 2dcf7d8f99 [GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
Jaime Marquínez Ferrándiz 19b0668251 [canal2c] Accept more urls (fixes )
The url only needs to have the 'idVideo' field in the query, in any position.
We have to set the 'void=oui' in the webpage url, so that we get the file name.
Jaime Marquínez Ferrándiz e7e6b54d8a [teamcoco] Parse the xml file and extract all the formats
Jaime Marquínez Ferrándiz 2a1a8ffe41 Merge pull request from alexvh/teamcoco_fix
[teamcoco] Fix video url extraction for some videos
Philipp Hagemeister 08fb86c49b [youtube] Add description for YoutubeSearchDateIE ()
Philipp Hagemeister 3633d77c0f Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
Philipp Hagemeister 165e179764 release 2013.11.03
Philipp Hagemeister 12ebdd1506 [viddler] Support non-digit IDs (Fixes )
Jaime Marquínez Ferrándiz 1baf9a5938 Merge pull request from rzhxeo/cinemassacre
[CinemassacreIE] Support more embed urls
Jaime Marquínez Ferrándiz a56f9de156 Style fixes for extractors: remove spaces around (,),{ and }
Jaime Marquínez Ferrándiz fa5d47af4b Merge pull request from rzhxeo/mofosex
Add support for http://www.mofosex.com
Jaime Marquínez Ferrándiz d607038753 Merge pull request from rzhxeo/xtube
Add support for http://www.xtube.com
Jaime Marquínez Ferrándiz 9ac6a01aaf Merge pull request from rzhxeo/extremetube
Add support for http://www.extremetube.com
Jaime Marquínez Ferrándiz be97abc247 Set the 'extractor_key' field in the info_dict
It's the string returned by the class method 'ie_key', which allows to retrieve the extractor with 'get_info_extractor'
Jaime Marquínez Ferrándiz 9103bbc5cd Add the 'webpage_url' field to info_dict
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
Jaime Marquínez Ferrándiz b6c45014ae Set the extra_info inside YoutubeDL.process_ie_result and set only if the keys are missing
Craig Markwardt a3dd924871 Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
rzhxeo 137bbb3e37 [XTubeIE] Add description to TEST
rzhxeo 86ad94bb2e [ExtremeTubeIE] Set age_limit to 18 and fix uploader extraction
Jaime Marquínez Ferrándiz 3e56add7c9 Merge pull request from rzhxeo/keezmovies
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
Jaime Marquínez Ferrándiz f52f01b5d2 [brightcove] Don't set the extension
If the video only has the 'FLVFullLengthURL' key, it can still be an mp4 file.
Jaime Marquínez Ferrándiz 98d7efb537 [exfm] skip tests
The site is down too often.
Jaime Marquínez Ferrándiz cf51923545 [youtube] Remove vevo test
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
Ismaël Mejía 38fcd4597a Merge remote-tracking branch 'iemejia/master'
Jaime Marquínez Ferrándiz 165e3bb67a [bambuser] Add an extractor for channels (closes )
Ismaël Mejía 38db46794f Merge branch 'ted_subtitles'
Ismaël Mejía a9a3876d55 [ted] Added support for subtitle download
Ismaël Mejía 1f343eaabb [subtitles] refactor to support websites with subtitle information the
webpage.

I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
Jaime Marquínez Ferrándiz 72a5b4f702 Add an extractor for bambuser.com ()