Commit Graph

10333 Commits (749b0046a8664d023ff622dd38844f5c8632f3f2)

Author SHA1 Message Date
Yen Chi Hsuan 260c7036ba
[sportbox] Fix SportBoxEmbedIE
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753)
remitamine f74197a074 [cbs] extract rtmp formats
remitamine f3a58d46bf [youtube:user] check if the url didn't match only the other youtube extractors
Sergey M․ b6612c9b11
[karaoketv] Fix extraction
Yen Chi Hsuan 7e176effb2
[iqiyi] Also suuport pps.tv URLs
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.

[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
Yen Chi Hsuan 4a252cc2d2
[karaoketv] Update and mark as not _WORKING
Yen Chi Hsuan f0ec61b525
[huffpost] Fix extraction
Yen Chi Hsuan 66d40ae3a5 Merge pull request from kasper93/master
[generic] Add support for LiveLeak embeds
Yen Chi Hsuan e6da9240d4
[mixcloud:stream] Add new extractor
Closes 
Yen Chi Hsuan dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
Fixes 
Yen Chi Hsuan c773082692
Merge branch 'Phaeilo-mixcloud'
Yen Chi Hsuan 9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist
Yen Chi Hsuan 56f1750049
[tdslifeway] Use the new Brightcove API
Thanks for @remitamine's suggestion.
Yen Chi Hsuan f2159c9815
[wayofthemaster] Remove extractor
Now it's using YouTube embeds.
Yen Chi Hsuan b0cf2e7c1b
[ubu] Remove extractor
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
   (For example http://ubu.com/film/hammons_king.html)
Yen Chi Hsuan 74b47d00c3
[xboxclips] Use http:// URL
xboxclips has misconfigured certificates
Yen Chi Hsuan 8cb57bab8e
[ministrygrid] Fix extraction and modernize
Yen Chi Hsuan e1bf277e19
[tdslifeway] Add TDSLifewayIE
Used by MinistryGridIE
remitamine ce599d5a7e [downloader/external] enable piping for FFmpegFD(closes )
Sergey M․ 9e28538726
[arte:creative] Improve _VALID_URL
Sergey M․ 404284132c
[arte:info] Add extractor (Closes )
remitamine 5565be9dd9 [aol] relex _VALID_URL regex
Yen Chi Hsuan b3a9474ad1 Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud
Yen Chi Hsuan 86475d59b1
[metacritic] Add a new valid test case
Yen Chi Hsuan 73d93f948e
[lecture2go] Fix extraction
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:

$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
Yen Chi Hsuan f5d8743e0a
[downloader/rtsp] Print the command
Yen Chi Hsuan d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test
Yen Chi Hsuan f141fefab7
[karrierevideos] Fix extraction
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
aystroganov@gmail.com 8334637f4a Make tbr field 'int' rather than 'tuple'
Closes .
Philipp Hagemeister b0ba11cc64 release 2016.04.13
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds
Yen Chi Hsuan 75af5d59ae
[netease] Skip all tests: completely georestricted
Philip Huppert 6d67169509 [mixcloud] improved extraction of user description
Philip Huppert dcaf00fb3e [mixcloud] support older urllib versions
Philip Huppert f896e1ccef [mixcloud] fixed some tests
Philip Huppert c96eca426b [mixcloud] Added support for user uploads, playlists, favorites and listens.
Fixes  and 
Sergey M․ 466a614537
[youtube:playlist] Recognize popular uploads playlist as mix (Closes )
Sergey M․ ffa2cecf72
[ard] Change subtitles extension to ttml (Closes )
ttml is now served instead of srt
Yen Chi Hsuan a837416025
[jadorecettepub] Remove extractor: website gone
Yen Chi Hsuan c9d448876f
[izlesene] Fix extraction
description may be absent
Yen Chi Hsuan 8865b8abfd
[howstuffworks] Skip a broken test case
Yen Chi Hsuan c77a0c01cb
[groupon] Fix extraction
Yen Chi Hsuan 12355ac473
[goshgay] Fix extraction
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
Sergey M․ 49f523ca50
[mixcloud] Capture error message ()
remitamine 4a903b93a9 Revert "[openclassroom] Add new extractor(closes )"
This reverts commit 13267a2be3.
remitamine 13267a2be3 [openclassroom] Add new extractor(closes )
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support ()
Yen Chi Hsuan 0f56bd2178
Merge branch 'Phaeilo-presstv'
Yen Chi Hsuan dfbc7f7f3f
[presstv] Improve and simplify
Yen Chi Hsuan 7d58ea7c5b Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv
Sergey M․ 452908b257
[telebruxelles] Fix extraction (Closes )
Sergey M․ 5899e988d5
[glide] Improve extraction and extract upload info
Sergey M․ 4a121d29bb
[glide] Fix extraction (Closes )
Sergey M․ 7ebc36900d
[jwplatform:base] Improve subtitles extraction
Sergey M․ d7eb052fa2
[screencastomatic] Add duration to test
Sergey M․ a6d6722c8f
[jwplatform:base] Extract duration
Sergey M․ 66fa495868
[screencastomatic] Fix extraction (Closes )
Sergey M․ 443285aabe
[ebaumsworlds] Update _VALID_URL (Closes )
Philip Huppert de728757ad [presstv] Refactored extractor.
Sergey M․ f44c276842
[extractor/extractors] Remove non-existant imports
Sergey M․ a1fa60a934
[cliprs] Add extractor (Closes )
Sergey M․ 49caf3307f
[extractor/common] Remove irrelevant comment
Sergey M․ 61dd350a04
[1tv] Fix extraction (Closes )
Philip Huppert 95153a960d [presstv] updated extractor and tests to work with current PressTV website
Yen Chi Hsuan c991106706 [videodetective] Adapt to InternetVideoArchiveIE
Yen Chi Hsuan dae2a058de [rottentomatoes] Adapt to InternetVideoArchiveIE
Yen Chi Hsuan c05025fdd7 [internetvideoarchive] Fix extraction and support json URLs
Philip Huppert bfe96d7bea [presstv] Added extractor PressTV.
Fixes 
Yen Chi Hsuan ab481b48e5 [funnyordie] Relax M3U8 URL matching
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.

This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
Sergey M․ 92c7f3157a [aol] Add coding cookie
Yen Chi Hsuan cacd996662 [utils] Don't touch URLs if not necessary
Fix test_Generic_15 (Google redirect)
remitamine bffb245a48 [aol] add support for videos with vidible IDs(closes )
Jaime Marquínez Ferrándiz e0986e31cf lazy extractors: Output if it's enabled in the verbose log
Jaime Marquínez Ferrándiz 779822d945 Add experimental support for lazy loading the info extractors
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
Jaime Marquínez Ferrándiz 1b3d5e05a8 Move the extreactors import to youtube_dl/extractor/extractors.py
Jaime Marquínez Ferrándiz e52d7f85f2 Delay initialization of InfoExtractors until they are needed
Sergey M․ 568d2f78d6 [tnaflix] Fix metadata extraction
Sergey M․ 2f2fcf1a33 [tnaflix] Fix extraction (Closes )
Sergey M․ bacec0397f [extractor/common] Relax _hidden_inputs
Sergey M․ 3c6c7e7d7e [gdcvault] Fix extraction (Closes , closes )
Sergey M․ fb38aa8b53 [extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests (Closes , closes )
Sergey M․ 18da24634c [democracynow] Improve extraction
Sergey M․ a134426d61 [democracynow] Fix tests
Sergey M․ a64c0c9b06 [democracynow] Make description optional (Closes )
Sergey M․ 56019444cb [novamov] Improve _VALID_URL template (Closes )
remitamine a1ff3cd5f9 [acast] fix channel extraction(closes )
remitamine 9a32e80477 [acast] fix extraction()
Sergey M․ 536a55dabd [YoutubeDL] Sanitize single thumbnail URL
Sergey M․ ed6fb8b804 [vrt] Add support for direct hls playlists and YouTube (Closes )
Sergey M․ 3afef2e3fc [beeg] Improve extraction
Sergey M․ e90d175436 [yandexmusic] Extract music album metafields (Closes )
Sergey M․ 7a93ab5f3f [extractor/common] Introduce music album metafields
Philipp Hagemeister c41cf65d4a release 2016.04.06
Yen Chi Hsuan 92d5477d84 [compat] Handle tuples properly in urlencode()
Fixes 
Yen Chi Hsuan 8790249c68 [iqiyi] Improve error detection for VIP-only videos
Closes 
Philipp Hagemeister 416930d450 release 2016.04.05
Sergey M․ 65150b41bb [deezer] Fix extraction (Closes )
Sergey M․ e42f413716 [rte] Improve thumbnail extraction (Closes )
Sergey M․ 40a056d85d [extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically
Sergey M․ e7d77efb9d [auroravid] Add extractor (Closes )
Sergey M․ 995cf05c96 [novamov] Make title fatal
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace
Used by the ZDF subtitles ().
Jaime Marquínez Ferrándiz 8c7d6e8e22 [zdf] Extract subtitles (closes )
Sergey M․ 6d4fc66bfc [youtube] Add support for zwearz (Closes )
remitamine 23576edbfc [brightcove:legacy] skip None value for uploader_id
remitamine 4d4cd35f48 [brightcove:legacy] extract uploader_id as a string
remitamine 3aac9b2fb1 [nowness] update tests
remitamine e47d19e991 [brightcove:new] extract subtitles and strip video title
remitamine 41f5492fbc [brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp
Jaime Marquínez Ferrándiz 2defa7d75a [instagram:user] Fix extraction (fixes )
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
Sergey M․ bbc26c8a01 [bbc] Set vcodec to none for audio formats
Sergey M․ b507cc925b [extractor/common] Carry long line
Sergey M․ db8ee7ec05 [extractor/common] Fix numeric identifiers conversion in DASH URL templates
remitamine 08136dc138 [brightcove] fix format sorting
remitamine fe7ef95e91 [cbsinteractive] Add support for ZDNet videos
remitamine 5f705baf5e [cnet] extract more formats
remitamine 0750b2491f [ffmpeg] try to convert tt subtitles usng dfxp2srt
remitamine df634be2ed [common] prefer using mime type over ext for smil subtitle extraction
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
Jaime Marquínez Ferrándiz 6d628fafca [camwithher] Remove extra blank line
Jaime Marquínez Ferrándiz 0f28777f58 [cbsnews] Remove unused import
Jaime Marquínez Ferrándiz 329c1eae54 [aenetworks] Make pep8 happy
Sergey M․ 9aaaf8e8e8 [camwithher] Improve extraction (Closes )
theGeekPirate 04819db58e [camwithher] Add extractor
Corrected unnecessary test

Sane variable naming

RTMP all .flv & url_id for _download_webpage()

Corrected all outstanding issues, next up is a squash!
remitamine 79ba9140dc [theplatform] extract timestamp and uploader
Sergey M․ 75d572e9fb [screencast] Improve title regexes (Closes )
Martin Trigaux 791d6aaecc screencast.com: fallback on page title
When determining the title of the page, use the <title> tag of the page
Sergey M․ 81de73e5b4 [screencast] Add test
Martin Trigaux 83cedc1cf2 screencast.com: support missing www
The "www." part of the URL is not mandatory
Sergey M․ 244cd04237 [pluralsight] Remove unnecessary login/password encode
Sergey M․ fbdaced256 [lynda] Remove unnecessary login/password encode
Sergey M․ a3373823e1 [udemy] Remove unnecessary login/password encode
This is now covered by compat_urllib_parse_urlencode
Sergey M․ 03caa463e7 [udemy:course] Skip non-video lectures
remitamine 3f64379eda [movieclips] fix extraction
remitamine 3e0c3d14d9 [cbs] add base extractor
remitamine d8873d4def [aenetworks] improve format extraction
remitamine db1c969da5 [theplatform] sign https urls
Philipp Hagemeister 1e02bc7ba2 release 2016.04.01
remitamine 63c55e9f22 [cbs] improve extraction(closes )
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE)
remitamine 961fc024d2 [voxmedia] improve sbnation support
Sergey M․ b53a06e3b9 [udemy:course] Use new URL format
remitamine 4ecc1fc638 [howstuffworks] improve extraction
Yen Chi Hsuan 5b012dfce8 [tudou] Improve error handling (closes )
remitamine 8369942773 [voxmedia] Add new extractor(closes )
Sergey M․ 86f3b66cec [udemy] Remove unused import
Sergey M․ 6bb4600717 [udemy:course] Simplify course curriculum downloading
Sergey M․ 41d06b0424 [extractor/common] Improve _request_webpage
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
Sergey M․ 15d260ebaa [utils] Use update_Request in http_request
Sergey M․ ed0291d153 [utils] Add update_Request
Sergey M․ 81da8cbc45 [udemy] Switch to api 2.0 (Closes )