Commit Graph

10799 Commits (e154c65128305fcaf6c6b2d5fd41ecd83e4ec154)

Author SHA1 Message Date
Peter Rowlands 22e35adefd use url instead of single formats entry 9 years ago
Yen Chi Hsuan 6f59aa934b
[periscope:user] Add new extractor for user pages
Closes #9388
9 years ago
Yen Chi Hsuan 109db8ea64 Merge pull request #9367 from codesparkle/master
Feature: --restrict-filenames: replace accented characters by their unaccented counterpart instead of "_"
9 years ago
Peter Rowlands 833b644fff use xpath_text 9 years ago
Sergey M․ 915620fd68
[redtube] PEP 8 9 years ago
Sergey M․ ac12e888f9
[redtube] Extract all formats, duration, upload date and view count (Closes #9397) 9 years ago
Yen Chi Hsuan 7d08f6073d
[kuwo:category] Update test 9 years ago
remitamine 758a059241 [dailymail] Add new extractor(closes #2667) 9 years ago
Yen Chi Hsuan 4f8c56eb4e
[fczenit] Fix extraction and update test
Closes #9359
9 years ago
Peter Rowlands 57cf9b7f06 [afreecatv] Add new extractor for afreecatv.com VODs 9 years ago
Sergey M․ 9da526aae7
[yandexmusic:playlist] Update test 9 years ago
Sergey M․ 75b81df3af
[udemy] Modernize 9 years ago
Sergey M․ aabdc83d6e
[udemy] Fix course enroll (Closes #9393) 9 years ago
Sergey M․ 2a48e6f01a
[yandexmusic:playlist] Respect track order for long (>150) playlists 9 years ago
Sergey M․ 203a3c0e6a
[yandexmusic:playlist] Make title optional 9 years ago
Sergey M․ d36724cca4
[yandexmusic:playlist] Remove unused imports 9 years ago
Sergey M․ 15fc0658f7
[yandexmusic:playlist] Modernize 9 years ago
Sergey M․ e960c3c223
[yandexmusic:playlist] Improve extraction (Closes #6801) 9 years ago
Sergey M․ bc7e77a04b
[vevo] Use raise_geo_restricted 9 years ago
Sergey M․ 964f49336f
[aol] Improve _VALID_URL (Closes #9381) 9 years ago
Sergey M․ 57d8e32a3e
[xfileshare] Add support for streamin.to 9 years ago
Sergey M․ 4174552391
[xfileshare] Refactor _VALID_URL and remove ded sites 9 years ago
Sergey M․ 80bc4106af
[xfileshare] Add support for thevideobee.to (Closes #9374) 9 years ago
Yen Chi Hsuan 7759be38da
[xiami] Detect georestriction and skip tests 9 years ago
Yen Chi Hsuan a0a309b973
[kuwo:category] Fix description and update test 9 years ago
Adam Thalhammer c587cbb793 improved performance by extracting accented chars to top level 9 years ago
Sergey M․ 8a92e51c60
[extractor/common] Relax wording for creator metafield 9 years ago
Sergey M․ f0e14fdd43
[YoutubeDL] Skip non-relevant field types when building output template 9 years ago
Sergey M․ df5f4e8888
[vevo] Remove superfluous code 9 years ago
Sergey M․ 7960b0563b
[YoutubeDL] Properly process unable-to-download-error on python2 9 years ago
Sergey M․ 5c9ced9504
[vevo] Improve genre extraction 9 years ago
Adam Thalhammer 79a2e94e79 Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347 9 years ago
Sergey M․ 686cc89634
[discovery] Fix typo 9 years ago
Sergey M․ 9508738f9a
[vevo] Extract featured artist 9 years ago
Sergey M․ 78a3ff33ab
[vevo:playlist] Add fallback for playlist id 9 years ago
Sergey M․ 881dbc86c4
[vevo] Extract track related metafields and add artists to title (Closes #1684) 9 years ago
Sergey M․ 8e7d004888
[vevo] Add test for video only available via webpage 9 years ago
Sergey M․ 9618c44824
[vevo] Extract video versions from webpage as a last resort (Closes #8426, closes #9366) 9 years ago
Sergey M․ 516ea41a7d
[vevo] Fix _call_api 9 years ago
Sergey M․ e2bd301ce7
[vevo:playlist] Fix genre playlists 9 years ago
Sergey M․ 0c9d288ba0
[vevo:playlist] Remove debug params 9 years ago
Sergey M․ e0da32df6e
[vevo:playlist] Add extractor (Closes #9334, closes #9364) 9 years ago
Philipp Hagemeister 174aba3223 release 2016.05.01 9 years ago
Sergey M․ 0d66bd0eab
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected 9 years ago
Sergey M․ 4bd143a3a0
[postprocessor/ffmpeg] Simplify metadata preparation and add track related metafields (Closes #9357) 9 years ago
Sergey M․ 68bb2fef95
[tagesschau] Restrict playlist entry regex 9 years ago
Sergey M․ 854cc54bc1
[tagesschau] Expand video id 9 years ago
Sergey M․ 651ad35ce0
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 6a0f9a24d0
[tagesschau] Separate player extractor 9 years ago
remitamine 9cf79e8f4b [ccc] improve extraction 9 years ago
Sergey M․ 2844b09336
[tagesschau] Fix article media ids 9 years ago
Sergey M․ 1a2b377cc2
[tagesschau] Fix audio support 9 years ago
Sergey M․ 4c1b2e5c0e
[tagesschau] Add support for playlists 9 years ago
Sergey M․ 9e1b96ae40
[rtlnl] Match formats only by height 9 years ago
Sergey M․ fc35cd9e0c
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 339fe7228a
[tagesschau] Update _FORMATS map 9 years ago
remitamine ea7e7fecbd [discovery] remove unused imports 9 years ago
remitamine d00b93d58c [discovery] extract more info using BrightcoveNewIE 9 years ago
remitamine 93f7a31bf3 [discovery] extract subtitle 9 years ago
remitamine 33a1ec950c [discovery] extract http formats 9 years ago
Sergey M․ 4e0c0c1508
[xiami] Improve extraction (Closes #9079)
* Switch to JSON source
* Add abstract IE for playlists
* Extract more track related metadata
9 years ago
BlahGeek 89c0dc9a5f
[xiami] Add xiami extractor 9 years ago
remitamine f628d800fb [ted] add support for youtube embeds and update tests 9 years ago
remitamine 11fa3d7f99 [ted] extract all http formats 9 years ago
Sergey M․ d41ee7b774
[vlive] Pass Referer as bytestring (Closes #9352) 9 years ago
remitamine e0e9bbb0e9 [pbs] extract srt and vtt subtitles 9 years ago
remitamine 7691184a31 [pbs] remove duplicate format 9 years ago
remitamine 35cd2f4c25 [pbs] extract only the formats that we know that they will be available as http format
https://projects.pbs.org/confluence/display/coveapi/COVE+Video+Specifications
9 years ago
remitamine 350d7963db [pbs] fix the least bitrate http url construction 9 years ago
remitamine cbc032c8b7 [pbs] extract all http formats 9 years ago
remitamine 69c4cde4ba [wsj] improve extraction 9 years ago
Sergey M․ ca278a182b
[rtlnl] Replace test 9 years ago
Sergey M․ 373e1230e4
[rtlnl] Clarify tests 9 years ago
Sergey M․ cd63d091ce
[rtlnl] Fix tests 9 years ago
Sergey M․ 0571ffda7d
[rtlnl] Improve extraction (Closes #9329)
* Make hls extraction non fatal and revert ext
* Extract progressive formats' metadata from corresponding hls formats
9 years ago
Reino17 5556047465
[rtlnl] Update 720p PG_URL_TEMPLATE
- Fixed the format_id for the 720p progressive videostream and added the video's resolution.
- The adaptive videostreams have the m3u8-extension, so I removed the confusing mp4-extension in order to make a better distinction between the these and the progressive videostreams.
9 years ago
remitamine 65a3bfb379 [dfb] extract m3u8 formats 9 years ago
Yen Chi Hsuan cef3f3011f
[funimation] Detect blocking and support CloudFlare cookies 9 years ago
Yen Chi Hsuan e9c6cdf4a1
[common] Fix format_id construction for HLS 9 years ago
Sergey M․ 00a17a9e12
[crunchyroll] Sort formats 9 years ago
Sergey M․ 8312b1a3d1
[crunchyroll] Add even more relaxed fmt fallback 9 years ago
Sergey M․ 6ff4469528
[crunchyroll] Relax fmt regex 9 years ago
Yen Chi Hsuan 68835d687a
Merge branch 'Kagami-vlive-hls' 9 years ago
Yen Chi Hsuan 9d186afac8
[vlive] Coding style and PEP8 9 years ago
Yen Chi Hsuan 151d98130b Merge branch 'vlive-hls' of https://github.com/Kagami/youtube-dl into Kagami-vlive-hls 9 years ago
Kagami Hiiragi b24d6336a7 [vlive] Add support for live videos 9 years ago
remitamine 065216d94f [crunchyroll] reduce requests for formats extraction 9 years ago
remitamine 67167920db [viewlift] replace SnagFilms extractors
- add support for other sites that use the same logic
- improve format extraction and sorting
9 years ago
Yen Chi Hsuan 14638e2915
[sexykarma] Rename to WatchIndianPornIE and fix extraction 9 years ago
Yen Chi Hsuan 1910077ed7
Revert "[sexykarma] Remove the extractor"
This reverts commit 31ff3c074e.
9 years ago
Yen Chi Hsuan 5819edef03
[ooyala] Skip an invalid test
Ooyala is used by lots of extractors and its correctness can be verified
by these websites.
9 years ago
Yen Chi Hsuan f5535ed0e3
[orf] Skip the expired test 9 years ago
Yen Chi Hsuan 31ff3c074e
[sexykarma] Remove the extractor
Its domain name is on sale.

Closes #9317
9 years ago
Sergey M․ 72670c39de
[arte:+7] Fix typo in _VALID_URL 9 years ago
Sergey M․ 683d892bf9
[viewster] Remove unused import 9 years ago
Sergey M․ 497971cd4a
[yandexmusic] Clarify blockage even more 9 years ago
remitamine e757fb3d05 [crunchyroll] improve extraction
- extract more metadata(series, episode, episode_number)
- reduce duplicate requests for extracting formats
- remove duplicate formats
9 years ago
remitamine 0ba9e3ca22 [viewster] extract formats for videos with multiple audios/subtitles 9 years ago
Sergey M․ 4b53762914
[yandexmusic] Clarify blockage 9 years ago
Sergey M․ eebe6b382e
[yandexmusic] Improve error handling 9 years ago
Yen Chi Hsuan 0cbcbdd89d
[nuvid] Fix extraction
Closes #7620
9 years ago
Yen Chi Hsuan 7f776fa4b5
[yandexmusic] Skip tests as Travis CI blocked 9 years ago
Yen Chi Hsuan a5941305b6
[mwave] Coding style 9 years ago
Yen Chi Hsuan f8dddaf456 Merge branch 'mwave-meetgreet' of https://github.com/pmrowla/youtube-dl into pmrowla-mwave-meetgreet 9 years ago
Yen Chi Hsuan 618c71dc64
[cloudy] New domain name for the test_cloudy_1
I'm sure whether videoraj.ch still works or not, so keep it.
9 years ago
Sergey M․ 52af8f222b
[cwtv] Relax _VALID_URL (Closes #9327) 9 years ago
Yen Chi Hsuan 3cc8649c9d
[20min] Detect embedded YouTube videos
Fixes #9331
9 years ago
Yen Chi Hsuan dcf094d626
[theplatform] Fix for Python 3.2
test_AENetworks{,_1} fails as in Python < 3.3, binascii.a2b_* functions
accepts only bytes-like objects
9 years ago
Peter Rowlands 5b5d7cc11e [mwave] Add Mwave Meet & Greet extractor 9 years ago
Yen Chi Hsuan 2ac2cbc0a3
[malemotion] Remove the extractor
Announcement from their homepage:

```
MaleMotion is closed

After another system crash, I'm forced to close the site

This week all content will be erased

Don't forget to cancel your subscription if any !
```

Closes #9311.
9 years ago
Yen Chi Hsuan a7e03861e8
[scivee] Skip the test
Not accessible from either Travis CI or my machine.

Closes #9315
9 years ago
Sergey M․ 175c2e9ec3
[youtube:search_url] Reimplement in terms of youtube:playlistbase 9 years ago
remitamine f1f879098a [viewster] extract more metadata for http formats 9 years ago
Sergey M․ c9fd530670
[ok] Extract start time 9 years ago
Sergey M․ 749b0046a8
[ok] Allow embeds without title (Closes #9303) 9 years ago
Yen Chi Hsuan e3de3d6f2f
[normalboots] Fix extraction
Now it's using ScreenwaveMedia
9 years ago
Yen Chi Hsuan ad58942d57
[muzu] Remove extractor
MUZU is shutting down in October 2015. [1]

[1] http://www.musicbusinessworldwide.com/youtube-rival-muzu-is-heading-into-liquidation/
9 years ago
Yen Chi Hsuan 4645432d7a
[eagleplatform] Checking direct HTTP links
Sometimes they fail with 404
9 years ago
Yen Chi Hsuan 6bdc2d5358
[mitele] Comment out unstable MD5
Also Akamai f4f fragments
9 years ago
Yen Chi Hsuan 2beff95da5
[nrk] Comment out unstable MD5 checksums
Both are Akamai f4f fragments.
9 years ago
Yen Chi Hsuan abc1723edd
[unistra] Sort formats
Originally URLs are passed to set() and not sorted, so the result is not
deterministic, causing occasional FAILs on Travis CI.
9 years ago
Yen Chi Hsuan d6712378e7
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv 9 years ago
remitamine fb72ec58ae [extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge 9 years ago
Sergey M․ c83a352227
[openload] Make thumbnail optional 9 years ago
Sergey M․ e9063b5de9
[openload] Add test 9 years ago
Sergey M․ 594b0c4c69
[openload] Fix ext extraction 9 years ago
Sergey M․ eb9ee19422
[utils] Allow None mimetypes in mimetype2ext 9 years ago
Sergey M․ a1394b820d
[openload] Fix title extraction (Closes #9298) 9 years ago
Yen Chi Hsuan aa9dc24f5a
[douyutv] Improve extraction and update tests
The JSON API sometimes return HTML pages with errors
9 years ago
Yen Chi Hsuan 51762e1a31
[xminus] Fix extraction (closes #9228) 9 years ago
Philipp Hagemeister 8b38f2ac40 release 2016.04.24 9 years ago
Yen Chi Hsuan a82398bd72
[kwuo:song] Fix extraction and update the test 9 years ago
remitamine c14dc00df3 [viewster] improve http formats extraction 9 years ago
Yen Chi Hsuan 03dd60ca41
[kuwo:category] Fix the test
Sometimes there are 24 songs and sometimes 30 lol
9 years ago
Yen Chi Hsuan 0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc 9 years ago
Yen Chi Hsuan a956cb6306
[onionstudios] Fix description extraction
\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537)
9 years ago
Yen Chi Hsuan a8062eabcd
[mwave] Skip checking unstable MD5
On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc
9 years ago
Yen Chi Hsuan 2a7dee8cc5
[yahoo] Improve error detection and update tests 9 years ago
Yen Chi Hsuan d9ed362116
[yahoo] Extract all <iframe>s
Fixes test_yahoo_6

(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html)
9 years ago
Yen Chi Hsuan 4f54958097
[yahoo] Update some tests
One has new fields as ThePlatformIE changed, and others have changed
files.
9 years ago
Yen Chi Hsuan 2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
Closes #9271
9 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
9 years ago
remitamine fda9a1ca9e [viewster] simplify qualities_basename regex 9 years ago
remitamine 864d5e7231 [viewster] extract all http formats 9 years ago
Sergey M․ 5448b781f6
[dplay] Sign unsigned final download hls URLs 9 years ago
Sergey M․ e239413fbc
[dplay] Extract subtitles (Closes #9284) 9 years ago
Sergey M․ fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests 9 years ago
Sergey M․ 397ec446f3
[dplay] Try secure api for no tld (Closes #9282) 9 years ago
Boris Wachtmeister 14f7a2b8af [WDRMaus] switch current show to new WDR extractor (fixes #8562)
It seems that the "current show" already uses the new WDR video-player,
while all the others videos still use the old player.

I just added the current show URL to the normal WDR-extractor, which
works fine. This commit needs my changes from PR #8842 that fix the
support for WDR.
9 years ago
Boris Wachtmeister c0837a12c8 [WDR] complete overhaul after relaunch of the site
The WDR relaunched their site on 2016-02-23 which not only changed the
URL-schema completely but also the layout of their pages.

Apparently the whole "mediathek" now runs on the wdr-domain, so no
separate URL for funkhauseuropa anymore.
There seems to be no explicit handling of video-sizes on the page or in
the URLs anymore. There seems to be only one size for HTML5, but still
several sizes for flash. The extractor adds all to the list of formats.

There is no metadata for the HTML5-stream, so that the best flash-stream
will always be considered as the "best" format. At least in my tests
this seemed to be true anyway.
9 years ago
remitamine 29a7e8f6f8 [nhl] Add new extractor(closes #8419)(closes #8798) 9 years ago
Yen Chi Hsuan eb01e97e10
[youku] Skip streams with channel_type=tail
Fixes #9275

These video segments look like ads and they don't appear in the web
player.
9 years ago
remitamine cb7d4d0efd [nbc] add support for today.com(closes #2909) 9 years ago
Yen Chi Hsuan c80037918b
[iqiyi] Improve error detection (#9276) 9 years ago
remitamine 237a41108a [eagleplatform] extract all http formats 9 years ago
remitamine e962ae15d3 [newstube] extract http formats(closes #9253) 9 years ago
remitamine 7c36ea7d54 [rtbf] improve extraction(fixes #9267) 9 years ago
remitamine 9260cf1d97 [tubitv] fix extraction(closes #8741) 9 years ago
Sergey M․ bdbb8530c7
[vimeo] Pass Referer for check-password request 9 years ago
Sergey M․ 09a9fadb84
[dump] Remove extractor 9 years ago
Sergey M․ bf09af3acb
Add --hls-prefer-ffmpeg 9 years ago
Sergey M․ 88296ac326
[planetaplay] Remove remainings of extractor 9 years ago
Sergey M․ 870d525848
[options] Remove experimental mark for --hls-prefer-native 9 years ago
Sergey M․ 6577112890
[planetaplay] Remove extractor (Closes #9256) 9 years ago
Sergey M․ 1988647dda
[tvigle] Skip hls completely (#9259) 9 years ago
Yen Chi Hsuan a292cba256
[mgtv] Fix _VALID_URL and add localized name 9 years ago
Yen Chi Hsuan 982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking 9 years ago
Yen Chi Hsuan 748e730099
[dispeak] Several fixes 9 years ago
Sergey M b6c0d4f431 Merge pull request #9110 from remitamine/parse_duration
[utils] imporove parse_duration to handle more formats
9 years ago
remitamine acaff49575 [utils] imporove parse_duration to handle more formats 9 years ago
Yen Chi Hsuan 1da19488f9
[mgtv] Add new extractor (closes #9212) 9 years ago
Yen Chi Hsuan 442c4d361f
[dispeak/gdcvault] Add the test case from #5784 9 years ago
Yen Chi Hsuan ec59d657e7
[dispeak] Add new extractor
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
9 years ago
Yen Chi Hsuan 99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
Fixes #9248
9 years ago
Yen Chi Hsuan 4dccea8ad0
[streetvoice] Fix extraction
The old API results in URLs with HTTP 403 from time to time.

Hopefully fixes #9219.
9 years ago
Yen Chi Hsuan 2c0d9c6217
[extractor/common] Allow empty post data 9 years ago
Sergey M․ 12a5134596
[tvigle] Fix extraction (Closes #9259) 9 years ago
Sergey M․ 16e633a5d7
[quickvid] Remove extractor (Closes #9258) 9 years ago
Sergey M․ 494ab6db73
[youtube] Capture and output login error message 9 years ago
Sergey M․ 107701fcfc
[people] Remove bogus comment 9 years ago
Sergey M․ f77970765a
[people] Add extractor 9 years ago
Philipp Hagemeister 81215d5652 release 2016.04.19 9 years ago
Sergey M․ 241a318f27
[vimeo] Improve _VALID_URL (Closes #9229) 9 years ago
Sergey M․ 4fdf082375
[theonion] Remove extractor (Closes #9220)
It now uses generic onionstudios embed
9 years ago
Jaime Marquínez Ferrándiz 1b6182d8f7 [youtube:playlist] Fetch all the videos in a mix (fixes #3837)
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
9 years ago
remitamine 7bab22a402 [vice] remove unused import and variable 9 years ago
Yen Chi Hsuan 0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
In r'pl=\d+&play=\d+' pages, several metadata items are missing

Closes #9222.
9 years ago
Yen Chi Hsuan b1cf58f48f
[musicplayon] Fix extraction (closes #9222) 9 years ago
remitamine 3014b0ae83 Merge pull request #9195 from remitamine/ffmpeg-pipe
[downloader/external] enable piping for FFmpegFD(closes #2124)
9 years ago
remitamine b9f2fdd37f [ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument 9 years ago
remitamine bbb3f730bb [onionstudios] extract m3u8 formats 9 years ago
remitamine d868f43c58 [ffmpeg] check for - file name in _ffmpeg_filename_argument 9 years ago
Yen Chi Hsuan 21525bb8ca
[kuwo:category] Update the test
Now the webpage says there are 24 songs.
9 years ago
Sergey M․ d8f103159f
[nerdist] Remove extractor
It now uses brightcove
9 years ago
remitamine 663ee5f0a9 [vice] extract youtube embed 9 years ago
Sergey M․ b6b950bf58
[cbs] Remove unused import 9 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 9 years ago
Sergey M․ c23533a100
[instagram] Add support for iframe embeds 9 years ago
Sergey M․ 0dafea02e6
[instagram] Add support for embed URLs 9 years ago
Sergey M․ 5d6360c3b7
[mooshare] Remove extractor 9 years ago
Yen Chi Hsuan 5e5c30c3fd
[mdr] Fix extraction and update tests
It's strange that the date is changed. Anyway, new data matches what the
webpage says.
9 years ago
Yen Chi Hsuan 9154c87fc4
[huffpost] Fix a typo 9 years ago
Yen Chi Hsuan ef0e4e7bc0
[generic] Fix test_Generic_2
Now a HEAD request returns 400 Bad Request
9 years ago
Yen Chi Hsuan 67d46a3f90
[ustream] Fix /embed/ URLs and add a test 9 years ago
Yen Chi Hsuan bec47a0748
[tudou] Improve error detection (closes #9175) 9 years ago
Yen Chi Hsuan 36b7d9dbfa
[twitter] Don't check /cards/ URLs
Fixes #9181

In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
   This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
   This is the real video and can be handled by TwitterCardIE

In all current test_Twitter* tests, /videos/tweet/ approach works fine.
9 years ago
Yen Chi Hsuan 8c65e4a527
[bbc] Fix a test 9 years ago
Yen Chi Hsuan 6ad2ef8b7c
[audiomack] Update the test
The original test raises 404
9 years ago
Yen Chi Hsuan 00b426d66d
[varzesh3] Add md5 to the test 9 years ago
Yen Chi Hsuan 0de968b584
[newgrounds] Support videos (closes #9138) 9 years ago
remitamine 0841d5013c [cbs] do not catch Exceptions raised by by _extract_theplatform_smil 9 years ago
remitamine a71fca8577 [theplatform] remove _sort_formats from _extract_theplatform_smil 9 years ago
Yen Chi Hsuan ee94e7e66d
[varzesh3] Fix metadata extraction (closes #9197) 9 years ago
Yen Chi Hsuan 759e37c9e6
[gazeta] Relax _VALID_URL and update tests
Closes #9196
9 years ago
Yen Chi Hsuan ae65567102
[eagleplatform] Fix error handling 9 years ago
Yen Chi Hsuan c394b4f4cb
[puls4] Fix error detection (#9194) 9 years ago
Yen Chi Hsuan 260c7036ba
[sportbox] Fix SportBoxEmbedIE
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753)
9 years ago
remitamine f74197a074 [cbs] extract rtmp formats 9 years ago
remitamine f3a58d46bf [youtube:user] check if the url didn't match only the other youtube extractors 9 years ago
Sergey M․ b6612c9b11
[karaoketv] Fix extraction 9 years ago
Yen Chi Hsuan 7e176effb2
[iqiyi] Also suuport pps.tv URLs
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.

[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
9 years ago
Yen Chi Hsuan 4a252cc2d2
[karaoketv] Update and mark as not _WORKING 9 years ago
Yen Chi Hsuan f0ec61b525
[huffpost] Fix extraction 9 years ago
Yen Chi Hsuan 66d40ae3a5 Merge pull request #9041 from kasper93/master
[generic] Add support for LiveLeak embeds
9 years ago
Yen Chi Hsuan e6da9240d4
[mixcloud:stream] Add new extractor
Closes #7633
9 years ago
Yen Chi Hsuan dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
Fixes #7521
9 years ago
Yen Chi Hsuan c773082692
Merge branch 'Phaeilo-mixcloud' 9 years ago
Yen Chi Hsuan 9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist 9 years ago
Yen Chi Hsuan 56f1750049
[tdslifeway] Use the new Brightcove API
Thanks for @remitamine's suggestion.
9 years ago
Yen Chi Hsuan f2159c9815
[wayofthemaster] Remove extractor
Now it's using YouTube embeds.
9 years ago
Yen Chi Hsuan b0cf2e7c1b
[ubu] Remove extractor
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
   (For example http://ubu.com/film/hammons_king.html)
9 years ago
Yen Chi Hsuan 74b47d00c3
[xboxclips] Use http:// URL
xboxclips has misconfigured certificates
9 years ago
Yen Chi Hsuan 8cb57bab8e
[ministrygrid] Fix extraction and modernize 9 years ago
Yen Chi Hsuan e1bf277e19
[tdslifeway] Add TDSLifewayIE
Used by MinistryGridIE
9 years ago
remitamine ce599d5a7e [downloader/external] enable piping for FFmpegFD(closes #2124) 9 years ago
Sergey M․ 9e28538726
[arte:creative] Improve _VALID_URL 9 years ago
Sergey M․ 404284132c
[arte:info] Add extractor (Closes #9182) 9 years ago
remitamine 5565be9dd9 [aol] relex _VALID_URL regex 9 years ago
Yen Chi Hsuan b3a9474ad1 Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud 9 years ago
Yen Chi Hsuan 86475d59b1
[metacritic] Add a new valid test case 9 years ago
Yen Chi Hsuan 73d93f948e
[lecture2go] Fix extraction
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:

$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
9 years ago
Yen Chi Hsuan f5d8743e0a
[downloader/rtsp] Print the command 9 years ago
Yen Chi Hsuan d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test 9 years ago
Yen Chi Hsuan f141fefab7
[karrierevideos] Fix extraction
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
9 years ago
aystroganov@gmail.com 8334637f4a Make tbr field 'int' rather than 'tuple'
Closes #9180.
9 years ago
Philipp Hagemeister b0ba11cc64 release 2016.04.13 9 years ago
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds 9 years ago
Yen Chi Hsuan 75af5d59ae
[netease] Skip all tests: completely georestricted 9 years ago
Philip Huppert 6d67169509 [mixcloud] improved extraction of user description 9 years ago
Philip Huppert dcaf00fb3e [mixcloud] support older urllib versions 9 years ago
Philip Huppert f896e1ccef [mixcloud] fixed some tests 9 years ago
Philip Huppert c96eca426b [mixcloud] Added support for user uploads, playlists, favorites and listens.
Fixes #3750 and #5272
9 years ago
Sergey M․ 466a614537
[youtube:playlist] Recognize popular uploads playlist as mix (Closes #9170) 9 years ago
Sergey M․ ffa2cecf72
[ard] Change subtitles extension to ttml (Closes #9169)
ttml is now served instead of srt
9 years ago
Yen Chi Hsuan a837416025
[jadorecettepub] Remove extractor: website gone 9 years ago
Yen Chi Hsuan c9d448876f
[izlesene] Fix extraction
description may be absent
9 years ago
Yen Chi Hsuan 8865b8abfd
[howstuffworks] Skip a broken test case 9 years ago
Yen Chi Hsuan c77a0c01cb
[groupon] Fix extraction 9 years ago
Yen Chi Hsuan 12355ac473
[goshgay] Fix extraction
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
9 years ago
Sergey M․ 49f523ca50
[mixcloud] Capture error message (#9156) 9 years ago
remitamine 4a903b93a9 Revert "[openclassroom] Add new extractor(closes #9147)"
This reverts commit 13267a2be3.
9 years ago
remitamine 13267a2be3 [openclassroom] Add new extractor(closes #9147) 9 years ago
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support (#2620) 9 years ago
Yen Chi Hsuan 0f56bd2178
Merge branch 'Phaeilo-presstv' 9 years ago
Yen Chi Hsuan dfbc7f7f3f
[presstv] Improve and simplify 9 years ago
Yen Chi Hsuan 7d58ea7c5b Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv 9 years ago
Sergey M․ 452908b257
[telebruxelles] Fix extraction (Closes #9142) 9 years ago
Sergey M․ 5899e988d5
[glide] Improve extraction and extract upload info 9 years ago
Sergey M․ 4a121d29bb
[glide] Fix extraction (Closes #9141) 9 years ago
Sergey M․ 7ebc36900d
[jwplatform:base] Improve subtitles extraction 9 years ago
Sergey M․ d7eb052fa2
[screencastomatic] Add duration to test 9 years ago
Sergey M․ a6d6722c8f
[jwplatform:base] Extract duration 9 years ago
Sergey M․ 66fa495868
[screencastomatic] Fix extraction (Closes #9136) 9 years ago
Sergey M․ 443285aabe
[ebaumsworlds] Update _VALID_URL (Closes #9135) 9 years ago
Philip Huppert de728757ad [presstv] Refactored extractor. 9 years ago
Sergey M․ f44c276842
[extractor/extractors] Remove non-existant imports 9 years ago
Sergey M․ a1fa60a934
[cliprs] Add extractor (Closes #9099) 9 years ago
Sergey M․ 49caf3307f
[extractor/common] Remove irrelevant comment 9 years ago
Sergey M․ 61dd350a04
[1tv] Fix extraction (Closes #9103) 9 years ago
Philip Huppert 95153a960d [presstv] updated extractor and tests to work with current PressTV website 9 years ago
Yen Chi Hsuan c991106706 [videodetective] Adapt to InternetVideoArchiveIE 9 years ago
Yen Chi Hsuan dae2a058de [rottentomatoes] Adapt to InternetVideoArchiveIE 9 years ago
Yen Chi Hsuan c05025fdd7 [internetvideoarchive] Fix extraction and support json URLs 9 years ago
Philip Huppert bfe96d7bea [presstv] Added extractor PressTV.
Fixes #7060
9 years ago
Yen Chi Hsuan ab481b48e5 [funnyordie] Relax M3U8 URL matching
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.

This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
9 years ago
Sergey M․ 92c7f3157a [aol] Add coding cookie 9 years ago
Yen Chi Hsuan cacd996662 [utils] Don't touch URLs if not necessary
Fix test_Generic_15 (Google redirect)
9 years ago
remitamine bffb245a48 [aol] add support for videos with vidible IDs(closes #9124) 9 years ago
Jaime Marquínez Ferrándiz e0986e31cf lazy extractors: Output if it's enabled in the verbose log 9 years ago
Jaime Marquínez Ferrándiz 779822d945 Add experimental support for lazy loading the info extractors
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
9 years ago
Jaime Marquínez Ferrándiz 1b3d5e05a8 Move the extreactors import to youtube_dl/extractor/extractors.py 9 years ago
Jaime Marquínez Ferrándiz e52d7f85f2 Delay initialization of InfoExtractors until they are needed 9 years ago
Sergey M․ 568d2f78d6 [tnaflix] Fix metadata extraction 9 years ago
Sergey M․ 2f2fcf1a33 [tnaflix] Fix extraction (Closes #9074) 9 years ago
Sergey M․ bacec0397f [extractor/common] Relax _hidden_inputs 9 years ago
Sergey M․ 3c6c7e7d7e [gdcvault] Fix extraction (Closes #9107, closes #9114) 9 years ago
Sergey M․ fb38aa8b53 [extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests (Closes #9119, closes #9120) 9 years ago
Sergey M․ 18da24634c [democracynow] Improve extraction 9 years ago
Sergey M․ a134426d61 [democracynow] Fix tests 9 years ago
Sergey M․ a64c0c9b06 [democracynow] Make description optional (Closes #9115) 9 years ago
Sergey M․ 56019444cb [novamov] Improve _VALID_URL template (Closes #9116) 9 years ago
remitamine a1ff3cd5f9 [acast] fix channel extraction(closes #9117) 9 years ago
remitamine 9a32e80477 [acast] fix extraction(#9117) 9 years ago
Sergey M․ 536a55dabd [YoutubeDL] Sanitize single thumbnail URL 9 years ago
Sergey M․ ed6fb8b804 [vrt] Add support for direct hls playlists and YouTube (Closes #9108) 9 years ago
Sergey M․ 3afef2e3fc [beeg] Improve extraction 9 years ago
Sergey M․ e90d175436 [yandexmusic] Extract music album metafields (Closes #7354) 9 years ago
Sergey M․ 7a93ab5f3f [extractor/common] Introduce music album metafields 9 years ago
Philipp Hagemeister c41cf65d4a release 2016.04.06 9 years ago
Yen Chi Hsuan 92d5477d84 [compat] Handle tuples properly in urlencode()
Fixes #9055
9 years ago
Yen Chi Hsuan 8790249c68 [iqiyi] Improve error detection for VIP-only videos
Closes #9071
9 years ago
Philipp Hagemeister 416930d450 release 2016.04.05 9 years ago
Sergey M․ 65150b41bb [deezer] Fix extraction (Closes #9086) 9 years ago
Sergey M․ e42f413716 [rte] Improve thumbnail extraction (Closes #9085) 9 years ago
Sergey M․ 40a056d85d [extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically 9 years ago
Sergey M․ e7d77efb9d [auroravid] Add extractor (Closes #9070) 9 years ago
Sergey M․ 995cf05c96 [novamov] Make title fatal 9 years ago
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace
Used by the ZDF subtitles (#9081).
9 years ago
Jaime Marquínez Ferrándiz 8c7d6e8e22 [zdf] Extract subtitles (closes #9081) 9 years ago
Sergey M․ 6d4fc66bfc [youtube] Add support for zwearz (Closes #9062) 9 years ago
remitamine 23576edbfc [brightcove:legacy] skip None value for uploader_id 9 years ago
remitamine 4d4cd35f48 [brightcove:legacy] extract uploader_id as a string 9 years ago
remitamine 3aac9b2fb1 [nowness] update tests 9 years ago
remitamine e47d19e991 [brightcove:new] extract subtitles and strip video title 9 years ago
remitamine 41f5492fbc [brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp 9 years ago
Jaime Marquínez Ferrándiz 2defa7d75a [instagram:user] Fix extraction (fixes #9059)
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
9 years ago
Sergey M․ bbc26c8a01 [bbc] Set vcodec to none for audio formats 9 years ago
Sergey M․ b507cc925b [extractor/common] Carry long line 9 years ago
Sergey M․ db8ee7ec05 [extractor/common] Fix numeric identifiers conversion in DASH URL templates 9 years ago
remitamine 08136dc138 [brightcove] fix format sorting 9 years ago
remitamine fe7ef95e91 [cbsinteractive] Add support for ZDNet videos 9 years ago
remitamine 5f705baf5e [cnet] extract more formats 9 years ago
remitamine 0750b2491f [ffmpeg] try to convert tt subtitles usng dfxp2srt 9 years ago
remitamine df634be2ed [common] prefer using mime type over ext for smil subtitle extraction
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
9 years ago
Jaime Marquínez Ferrándiz 6d628fafca [camwithher] Remove extra blank line 9 years ago
Jaime Marquínez Ferrándiz 0f28777f58 [cbsnews] Remove unused import 9 years ago
Jaime Marquínez Ferrándiz 329c1eae54 [aenetworks] Make pep8 happy 9 years ago
Sergey M․ 9aaaf8e8e8 [camwithher] Improve extraction (Closes #8989) 9 years ago
theGeekPirate 04819db58e [camwithher] Add extractor
Corrected unnecessary test

Sane variable naming

RTMP all .flv & url_id for _download_webpage()

Corrected all outstanding issues, next up is a squash!
9 years ago
remitamine 79ba9140dc [theplatform] extract timestamp and uploader 9 years ago
Sergey M․ 75d572e9fb [screencast] Improve title regexes (Closes #9025) 9 years ago
Martin Trigaux 791d6aaecc screencast.com: fallback on page title
When determining the title of the page, use the <title> tag of the page
9 years ago
Sergey M․ 81de73e5b4 [screencast] Add test 9 years ago
Martin Trigaux 83cedc1cf2 screencast.com: support missing www
The "www." part of the URL is not mandatory
9 years ago
Sergey M․ 244cd04237 [pluralsight] Remove unnecessary login/password encode 9 years ago
Sergey M․ fbdaced256 [lynda] Remove unnecessary login/password encode 9 years ago
Sergey M․ a3373823e1 [udemy] Remove unnecessary login/password encode
This is now covered by compat_urllib_parse_urlencode
9 years ago
Sergey M․ 03caa463e7 [udemy:course] Skip non-video lectures 9 years ago
remitamine 3f64379eda [movieclips] fix extraction 9 years ago
remitamine 3e0c3d14d9 [cbs] add base extractor 9 years ago
remitamine d8873d4def [aenetworks] improve format extraction 9 years ago
remitamine db1c969da5 [theplatform] sign https urls 9 years ago
Philipp Hagemeister 1e02bc7ba2 release 2016.04.01 9 years ago
remitamine 63c55e9f22 [cbs] improve extraction(closes #6321) 9 years ago
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE) 9 years ago
remitamine 961fc024d2 [voxmedia] improve sbnation support 9 years ago
Sergey M․ b53a06e3b9 [udemy:course] Use new URL format 9 years ago
remitamine 4ecc1fc638 [howstuffworks] improve extraction 9 years ago
Yen Chi Hsuan 5b012dfce8 [tudou] Improve error handling (closes #8988) 9 years ago
remitamine 8369942773 [voxmedia] Add new extractor(closes #3182) 9 years ago
Sergey M․ 86f3b66cec [udemy] Remove unused import 9 years ago
Sergey M․ 6bb4600717 [udemy:course] Simplify course curriculum downloading 9 years ago
Sergey M․ 41d06b0424 [extractor/common] Improve _request_webpage
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
9 years ago
Sergey M․ 15d260ebaa [utils] Use update_Request in http_request 9 years ago
Sergey M․ ed0291d153 [utils] Add update_Request 9 years ago
Sergey M․ 81da8cbc45 [udemy] Switch to api 2.0 (Closes #9035) 9 years ago
Sergey M․ 5299bc3f91 [beeg] Switch to api v6 (Closes #9036) 9 years ago
remitamine c9c39c22c5 [nationalgeographic] add support for channel.nationalgeographic.com urls 9 years ago
remitamine d84b48e3f1 [nationalgeographic] improve extraction 9 years ago
remitamine dd17041c82 [tenplay] remove extractor(fixes #6927) 9 years ago
remitamine fea7295b14 [brightcove] relax embed_in_page regex 9 years ago
remitamine 9cf01f7f30 [nbc] add new extractor for csnne.com(#5432) 9 years ago
remitamine ce548296fe [cnbc] fix test 9 years ago
remitamine c02ec7d430 [cnbc] Add new extractor(closes #8012) 9 years ago
remitamine 6b820a2376 [myspace] improve extraction 9 years ago
Yen Chi Hsuan e621a344e6 [kwuo] Port to new API and enable --cn-verification-proxy 9 years ago
Yen Chi Hsuan 3ae6f8fec1 [kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
Following the idea proposed in 19dbaeece3
9 years ago
Yen Chi Hsuan 597d52fadb [kuwo:song] Correct song ID extraction (fixes #9033)
Bug introduced in daef04a4e7.
9 years ago
Sergey M․ afca767d19 [tumblr] Improve _VALID_URL (Closes #9027) 9 years ago
remitamine 6e359a1534 [comcarcoff] don not depend on crackle extractor(closes #8995)
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995.
9 years ago
Sergey M․ 33f3040a3e [YoutubeDL] Fix sanitizing subtitles' url 9 years ago
Sergey M․ 03442072c0 [pornhub] Fix typo (Closes #9008) 9 years ago
Sergey M․ c8b13fec02 [foxnews] Restore upload time fields in test 9 years ago
Sergey M․ 87d105ac6c [amp] Fix upload timestamp extraction (Closes #9007) 9 years ago
Sergey M․ 3454139576 [pornhub:uservideos] Add support for multipage videos (Closes #9006) 9 years ago
Sergey M․ 3a23bae9cc [pornhub:playlistbase] Do not include videos not from playlist 9 years ago
Sergey M․ 8f9a477e7f [pornhub:playlistbase] Use orderedSet 9 years ago
Sergey M․ a1cf3e38a3 [bbc] Extend vpid regex (Closes #9003) 9 years ago
Philipp Hagemeister a122e7080b release 2016.03.27 9 years ago
Sergey M․ b22ca76204 [extractor/common] Filter out unsupported encrypted media for f4m formats (Closes #8573) 9 years ago
Sergey M․ f7df343b4a [downloader/f4m] Extract routine for removing unsupported encrypted media 9 years ago
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes #8051
9 years ago
Yen Chi Hsuan 395fd4b08a [twitter] Handle another form of embedded Vine
Fixes #8996
9 years ago
Sergey M․ 8018028d0f [pluralsight] Extract chapter metadata (Closes #8993) 9 years ago
Sergey M․ 00322ad4fd [lynda] Extract chapter metadata (#8993) 9 years ago
Sergey M․ 4cf3489c6e [vevo] Update videoservice API URL (Closes #8900) 9 years ago
Sergey M․ b24ab3e341 [udemy] Improve paid course detection 9 years ago
Sergey M․ af4116f4f0 [udemy] Improve format_id 9 years ago
Sergey M․ f973e5d54e [udemy] Drop outputs' formats
Always results in 403
9 years ago
Sergey M․ 62f55aa68a [udemy] Add outputs metadata to view_html formats 9 years ago