Commit Graph

10861 Commits (88d9f6c0c4c3d1d2179ee4fe0af560f500e62579)

Author SHA1 Message Date
Yen Chi Hsuan d9ed362116
[yahoo] Extract all <iframe>s
Fixes test_yahoo_6

(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html)
9 years ago
Yen Chi Hsuan 4f54958097
[yahoo] Update some tests
One has new fields as ThePlatformIE changed, and others have changed
files.
9 years ago
Yen Chi Hsuan 2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
Closes #9271
9 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
9 years ago
remitamine fda9a1ca9e [viewster] simplify qualities_basename regex 9 years ago
remitamine 864d5e7231 [viewster] extract all http formats 9 years ago
Sergey M․ 5448b781f6
[dplay] Sign unsigned final download hls URLs 9 years ago
Sergey M․ e239413fbc
[dplay] Extract subtitles (Closes #9284) 9 years ago
Sergey M․ fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests 9 years ago
Sergey M․ 397ec446f3
[dplay] Try secure api for no tld (Closes #9282) 9 years ago
Boris Wachtmeister 14f7a2b8af [WDRMaus] switch current show to new WDR extractor (fixes #8562)
It seems that the "current show" already uses the new WDR video-player,
while all the others videos still use the old player.

I just added the current show URL to the normal WDR-extractor, which
works fine. This commit needs my changes from PR #8842 that fix the
support for WDR.
9 years ago
Boris Wachtmeister c0837a12c8 [WDR] complete overhaul after relaunch of the site
The WDR relaunched their site on 2016-02-23 which not only changed the
URL-schema completely but also the layout of their pages.

Apparently the whole "mediathek" now runs on the wdr-domain, so no
separate URL for funkhauseuropa anymore.
There seems to be no explicit handling of video-sizes on the page or in
the URLs anymore. There seems to be only one size for HTML5, but still
several sizes for flash. The extractor adds all to the list of formats.

There is no metadata for the HTML5-stream, so that the best flash-stream
will always be considered as the "best" format. At least in my tests
this seemed to be true anyway.
9 years ago
remitamine 29a7e8f6f8 [nhl] Add new extractor(closes #8419)(closes #8798) 9 years ago
Yen Chi Hsuan eb01e97e10
[youku] Skip streams with channel_type=tail
Fixes #9275

These video segments look like ads and they don't appear in the web
player.
9 years ago
remitamine cb7d4d0efd [nbc] add support for today.com(closes #2909) 9 years ago
Yen Chi Hsuan c80037918b
[iqiyi] Improve error detection (#9276) 9 years ago
remitamine 237a41108a [eagleplatform] extract all http formats 9 years ago
remitamine e962ae15d3 [newstube] extract http formats(closes #9253) 9 years ago
remitamine 7c36ea7d54 [rtbf] improve extraction(fixes #9267) 9 years ago
remitamine 9260cf1d97 [tubitv] fix extraction(closes #8741) 9 years ago
Sergey M․ bdbb8530c7
[vimeo] Pass Referer for check-password request 9 years ago
Sergey M․ 09a9fadb84
[dump] Remove extractor 9 years ago
Sergey M․ bf09af3acb
Add --hls-prefer-ffmpeg 9 years ago
Sergey M․ 88296ac326
[planetaplay] Remove remainings of extractor 9 years ago
Sergey M․ 870d525848
[options] Remove experimental mark for --hls-prefer-native 9 years ago
Sergey M․ 6577112890
[planetaplay] Remove extractor (Closes #9256) 9 years ago
Sergey M․ 1988647dda
[tvigle] Skip hls completely (#9259) 9 years ago
Yen Chi Hsuan a292cba256
[mgtv] Fix _VALID_URL and add localized name 9 years ago
Yen Chi Hsuan 982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking 9 years ago
Yen Chi Hsuan 748e730099
[dispeak] Several fixes 9 years ago
Sergey M b6c0d4f431 Merge pull request #9110 from remitamine/parse_duration
[utils] imporove parse_duration to handle more formats
9 years ago
remitamine acaff49575 [utils] imporove parse_duration to handle more formats 9 years ago
Yen Chi Hsuan 1da19488f9
[mgtv] Add new extractor (closes #9212) 9 years ago
Yen Chi Hsuan 442c4d361f
[dispeak/gdcvault] Add the test case from #5784 9 years ago
Yen Chi Hsuan ec59d657e7
[dispeak] Add new extractor
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
9 years ago
Yen Chi Hsuan 99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
Fixes #9248
9 years ago
Yen Chi Hsuan 4dccea8ad0
[streetvoice] Fix extraction
The old API results in URLs with HTTP 403 from time to time.

Hopefully fixes #9219.
9 years ago
Yen Chi Hsuan 2c0d9c6217
[extractor/common] Allow empty post data 9 years ago
Sergey M․ 12a5134596
[tvigle] Fix extraction (Closes #9259) 9 years ago
Sergey M․ 16e633a5d7
[quickvid] Remove extractor (Closes #9258) 9 years ago
Sergey M․ 494ab6db73
[youtube] Capture and output login error message 9 years ago
Sergey M․ 107701fcfc
[people] Remove bogus comment 9 years ago
Sergey M․ f77970765a
[people] Add extractor 9 years ago
Philipp Hagemeister 81215d5652 release 2016.04.19 9 years ago
Sergey M․ 241a318f27
[vimeo] Improve _VALID_URL (Closes #9229) 9 years ago
Sergey M․ 4fdf082375
[theonion] Remove extractor (Closes #9220)
It now uses generic onionstudios embed
9 years ago
Jaime Marquínez Ferrándiz 1b6182d8f7 [youtube:playlist] Fetch all the videos in a mix (fixes #3837)
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
9 years ago
remitamine 7bab22a402 [vice] remove unused import and variable 9 years ago
Yen Chi Hsuan 0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
In r'pl=\d+&play=\d+' pages, several metadata items are missing

Closes #9222.
9 years ago
Yen Chi Hsuan b1cf58f48f
[musicplayon] Fix extraction (closes #9222) 9 years ago
remitamine 3014b0ae83 Merge pull request #9195 from remitamine/ffmpeg-pipe
[downloader/external] enable piping for FFmpegFD(closes #2124)
9 years ago
remitamine b9f2fdd37f [ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument 9 years ago
remitamine bbb3f730bb [onionstudios] extract m3u8 formats 9 years ago
remitamine d868f43c58 [ffmpeg] check for - file name in _ffmpeg_filename_argument 9 years ago
Yen Chi Hsuan 21525bb8ca
[kuwo:category] Update the test
Now the webpage says there are 24 songs.
9 years ago
Sergey M․ d8f103159f
[nerdist] Remove extractor
It now uses brightcove
9 years ago
remitamine 663ee5f0a9 [vice] extract youtube embed 9 years ago
Sergey M․ b6b950bf58
[cbs] Remove unused import 9 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 9 years ago
Sergey M․ c23533a100
[instagram] Add support for iframe embeds 9 years ago
Sergey M․ 0dafea02e6
[instagram] Add support for embed URLs 9 years ago
Sergey M․ 5d6360c3b7
[mooshare] Remove extractor 9 years ago
Yen Chi Hsuan 5e5c30c3fd
[mdr] Fix extraction and update tests
It's strange that the date is changed. Anyway, new data matches what the
webpage says.
9 years ago
Yen Chi Hsuan 9154c87fc4
[huffpost] Fix a typo 9 years ago
Yen Chi Hsuan ef0e4e7bc0
[generic] Fix test_Generic_2
Now a HEAD request returns 400 Bad Request
9 years ago
Yen Chi Hsuan 67d46a3f90
[ustream] Fix /embed/ URLs and add a test 9 years ago
Yen Chi Hsuan bec47a0748
[tudou] Improve error detection (closes #9175) 9 years ago
Yen Chi Hsuan 36b7d9dbfa
[twitter] Don't check /cards/ URLs
Fixes #9181

In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
   This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
   This is the real video and can be handled by TwitterCardIE

In all current test_Twitter* tests, /videos/tweet/ approach works fine.
9 years ago
Yen Chi Hsuan 8c65e4a527
[bbc] Fix a test 9 years ago
Yen Chi Hsuan 6ad2ef8b7c
[audiomack] Update the test
The original test raises 404
9 years ago
Yen Chi Hsuan 00b426d66d
[varzesh3] Add md5 to the test 9 years ago
Yen Chi Hsuan 0de968b584
[newgrounds] Support videos (closes #9138) 9 years ago
remitamine 0841d5013c [cbs] do not catch Exceptions raised by by _extract_theplatform_smil 9 years ago
remitamine a71fca8577 [theplatform] remove _sort_formats from _extract_theplatform_smil 9 years ago
Yen Chi Hsuan ee94e7e66d
[varzesh3] Fix metadata extraction (closes #9197) 9 years ago
Yen Chi Hsuan 759e37c9e6
[gazeta] Relax _VALID_URL and update tests
Closes #9196
9 years ago
Yen Chi Hsuan ae65567102
[eagleplatform] Fix error handling 9 years ago
Yen Chi Hsuan c394b4f4cb
[puls4] Fix error detection (#9194) 9 years ago
Yen Chi Hsuan 260c7036ba
[sportbox] Fix SportBoxEmbedIE
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753)
9 years ago
remitamine f74197a074 [cbs] extract rtmp formats 9 years ago
remitamine f3a58d46bf [youtube:user] check if the url didn't match only the other youtube extractors 9 years ago
Sergey M․ b6612c9b11
[karaoketv] Fix extraction 9 years ago
Yen Chi Hsuan 7e176effb2
[iqiyi] Also suuport pps.tv URLs
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.

[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
9 years ago
Yen Chi Hsuan 4a252cc2d2
[karaoketv] Update and mark as not _WORKING 9 years ago
Yen Chi Hsuan f0ec61b525
[huffpost] Fix extraction 9 years ago
Yen Chi Hsuan 66d40ae3a5 Merge pull request #9041 from kasper93/master
[generic] Add support for LiveLeak embeds
9 years ago
Yen Chi Hsuan e6da9240d4
[mixcloud:stream] Add new extractor
Closes #7633
9 years ago
Yen Chi Hsuan dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
Fixes #7521
9 years ago
Yen Chi Hsuan c773082692
Merge branch 'Phaeilo-mixcloud' 9 years ago
Yen Chi Hsuan 9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist 9 years ago
Yen Chi Hsuan 56f1750049
[tdslifeway] Use the new Brightcove API
Thanks for @remitamine's suggestion.
9 years ago
Yen Chi Hsuan f2159c9815
[wayofthemaster] Remove extractor
Now it's using YouTube embeds.
9 years ago
Yen Chi Hsuan b0cf2e7c1b
[ubu] Remove extractor
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
   (For example http://ubu.com/film/hammons_king.html)
9 years ago
Yen Chi Hsuan 74b47d00c3
[xboxclips] Use http:// URL
xboxclips has misconfigured certificates
9 years ago
Yen Chi Hsuan 8cb57bab8e
[ministrygrid] Fix extraction and modernize 9 years ago
Yen Chi Hsuan e1bf277e19
[tdslifeway] Add TDSLifewayIE
Used by MinistryGridIE
9 years ago
remitamine ce599d5a7e [downloader/external] enable piping for FFmpegFD(closes #2124) 9 years ago
Sergey M․ 9e28538726
[arte:creative] Improve _VALID_URL 9 years ago
Sergey M․ 404284132c
[arte:info] Add extractor (Closes #9182) 9 years ago
remitamine 5565be9dd9 [aol] relex _VALID_URL regex 9 years ago
Yen Chi Hsuan b3a9474ad1 Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud 9 years ago
Yen Chi Hsuan 86475d59b1
[metacritic] Add a new valid test case 9 years ago
Yen Chi Hsuan 73d93f948e
[lecture2go] Fix extraction
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:

$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
9 years ago
Yen Chi Hsuan f5d8743e0a
[downloader/rtsp] Print the command 9 years ago
Yen Chi Hsuan d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test 9 years ago
Yen Chi Hsuan f141fefab7
[karrierevideos] Fix extraction
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
9 years ago
aystroganov@gmail.com 8334637f4a Make tbr field 'int' rather than 'tuple'
Closes #9180.
9 years ago
Philipp Hagemeister b0ba11cc64 release 2016.04.13 9 years ago
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds 9 years ago
Yen Chi Hsuan 75af5d59ae
[netease] Skip all tests: completely georestricted 9 years ago
Philip Huppert 6d67169509 [mixcloud] improved extraction of user description 9 years ago
Philip Huppert dcaf00fb3e [mixcloud] support older urllib versions 9 years ago
Philip Huppert f896e1ccef [mixcloud] fixed some tests 9 years ago
Philip Huppert c96eca426b [mixcloud] Added support for user uploads, playlists, favorites and listens.
Fixes #3750 and #5272
9 years ago
Sergey M․ 466a614537
[youtube:playlist] Recognize popular uploads playlist as mix (Closes #9170) 9 years ago
Sergey M․ ffa2cecf72
[ard] Change subtitles extension to ttml (Closes #9169)
ttml is now served instead of srt
9 years ago
Yen Chi Hsuan a837416025
[jadorecettepub] Remove extractor: website gone 9 years ago
Yen Chi Hsuan c9d448876f
[izlesene] Fix extraction
description may be absent
9 years ago
Yen Chi Hsuan 8865b8abfd
[howstuffworks] Skip a broken test case 9 years ago
Yen Chi Hsuan c77a0c01cb
[groupon] Fix extraction 9 years ago
Yen Chi Hsuan 12355ac473
[goshgay] Fix extraction
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
9 years ago
Sergey M․ 49f523ca50
[mixcloud] Capture error message (#9156) 9 years ago
remitamine 4a903b93a9 Revert "[openclassroom] Add new extractor(closes #9147)"
This reverts commit 13267a2be3.
9 years ago
remitamine 13267a2be3 [openclassroom] Add new extractor(closes #9147) 9 years ago
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support (#2620) 9 years ago
Yen Chi Hsuan 0f56bd2178
Merge branch 'Phaeilo-presstv' 9 years ago
Yen Chi Hsuan dfbc7f7f3f
[presstv] Improve and simplify 9 years ago
Yen Chi Hsuan 7d58ea7c5b Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv 9 years ago
Sergey M․ 452908b257
[telebruxelles] Fix extraction (Closes #9142) 9 years ago
Sergey M․ 5899e988d5
[glide] Improve extraction and extract upload info 9 years ago
Sergey M․ 4a121d29bb
[glide] Fix extraction (Closes #9141) 9 years ago
Sergey M․ 7ebc36900d
[jwplatform:base] Improve subtitles extraction 9 years ago
Sergey M․ d7eb052fa2
[screencastomatic] Add duration to test 9 years ago
Sergey M․ a6d6722c8f
[jwplatform:base] Extract duration 9 years ago
Sergey M․ 66fa495868
[screencastomatic] Fix extraction (Closes #9136) 9 years ago
Sergey M․ 443285aabe
[ebaumsworlds] Update _VALID_URL (Closes #9135) 9 years ago
Philip Huppert de728757ad [presstv] Refactored extractor. 9 years ago
Sergey M․ f44c276842
[extractor/extractors] Remove non-existant imports 9 years ago
Sergey M․ a1fa60a934
[cliprs] Add extractor (Closes #9099) 9 years ago
Sergey M․ 49caf3307f
[extractor/common] Remove irrelevant comment 9 years ago
Sergey M․ 61dd350a04
[1tv] Fix extraction (Closes #9103) 9 years ago
Philip Huppert 95153a960d [presstv] updated extractor and tests to work with current PressTV website 9 years ago
Yen Chi Hsuan c991106706 [videodetective] Adapt to InternetVideoArchiveIE 9 years ago
Yen Chi Hsuan dae2a058de [rottentomatoes] Adapt to InternetVideoArchiveIE 9 years ago
Yen Chi Hsuan c05025fdd7 [internetvideoarchive] Fix extraction and support json URLs 9 years ago
Philip Huppert bfe96d7bea [presstv] Added extractor PressTV.
Fixes #7060
9 years ago
Yen Chi Hsuan ab481b48e5 [funnyordie] Relax M3U8 URL matching
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.

This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
9 years ago
Sergey M․ 92c7f3157a [aol] Add coding cookie 9 years ago
Yen Chi Hsuan cacd996662 [utils] Don't touch URLs if not necessary
Fix test_Generic_15 (Google redirect)
9 years ago
remitamine bffb245a48 [aol] add support for videos with vidible IDs(closes #9124) 9 years ago
Jaime Marquínez Ferrándiz e0986e31cf lazy extractors: Output if it's enabled in the verbose log 9 years ago
Jaime Marquínez Ferrándiz 779822d945 Add experimental support for lazy loading the info extractors
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
9 years ago
Jaime Marquínez Ferrándiz 1b3d5e05a8 Move the extreactors import to youtube_dl/extractor/extractors.py 9 years ago
Jaime Marquínez Ferrándiz e52d7f85f2 Delay initialization of InfoExtractors until they are needed 9 years ago
Sergey M․ 568d2f78d6 [tnaflix] Fix metadata extraction 9 years ago
Sergey M․ 2f2fcf1a33 [tnaflix] Fix extraction (Closes #9074) 9 years ago
Sergey M․ bacec0397f [extractor/common] Relax _hidden_inputs 9 years ago
Sergey M․ 3c6c7e7d7e [gdcvault] Fix extraction (Closes #9107, closes #9114) 9 years ago
Sergey M․ fb38aa8b53 [extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests (Closes #9119, closes #9120) 9 years ago
Sergey M․ 18da24634c [democracynow] Improve extraction 9 years ago
Sergey M․ a134426d61 [democracynow] Fix tests 9 years ago
Sergey M․ a64c0c9b06 [democracynow] Make description optional (Closes #9115) 9 years ago
Sergey M․ 56019444cb [novamov] Improve _VALID_URL template (Closes #9116) 9 years ago
remitamine a1ff3cd5f9 [acast] fix channel extraction(closes #9117) 9 years ago
remitamine 9a32e80477 [acast] fix extraction(#9117) 9 years ago
Sergey M․ 536a55dabd [YoutubeDL] Sanitize single thumbnail URL 9 years ago
Sergey M․ ed6fb8b804 [vrt] Add support for direct hls playlists and YouTube (Closes #9108) 9 years ago
Sergey M․ 3afef2e3fc [beeg] Improve extraction 9 years ago
Sergey M․ e90d175436 [yandexmusic] Extract music album metafields (Closes #7354) 9 years ago
Sergey M․ 7a93ab5f3f [extractor/common] Introduce music album metafields 9 years ago
Philipp Hagemeister c41cf65d4a release 2016.04.06 9 years ago
Yen Chi Hsuan 92d5477d84 [compat] Handle tuples properly in urlencode()
Fixes #9055
9 years ago
Yen Chi Hsuan 8790249c68 [iqiyi] Improve error detection for VIP-only videos
Closes #9071
9 years ago
Philipp Hagemeister 416930d450 release 2016.04.05 9 years ago
Sergey M․ 65150b41bb [deezer] Fix extraction (Closes #9086) 9 years ago
Sergey M․ e42f413716 [rte] Improve thumbnail extraction (Closes #9085) 9 years ago
Sergey M․ 40a056d85d [extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically 9 years ago
Sergey M․ e7d77efb9d [auroravid] Add extractor (Closes #9070) 9 years ago
Sergey M․ 995cf05c96 [novamov] Make title fatal 9 years ago
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace
Used by the ZDF subtitles (#9081).
9 years ago
Jaime Marquínez Ferrándiz 8c7d6e8e22 [zdf] Extract subtitles (closes #9081) 9 years ago
Sergey M․ 6d4fc66bfc [youtube] Add support for zwearz (Closes #9062) 9 years ago
remitamine 23576edbfc [brightcove:legacy] skip None value for uploader_id 9 years ago
remitamine 4d4cd35f48 [brightcove:legacy] extract uploader_id as a string 9 years ago
remitamine 3aac9b2fb1 [nowness] update tests 9 years ago
remitamine e47d19e991 [brightcove:new] extract subtitles and strip video title 9 years ago
remitamine 41f5492fbc [brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp 9 years ago
Jaime Marquínez Ferrándiz 2defa7d75a [instagram:user] Fix extraction (fixes #9059)
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
9 years ago
Sergey M․ bbc26c8a01 [bbc] Set vcodec to none for audio formats 9 years ago
Sergey M․ b507cc925b [extractor/common] Carry long line 9 years ago
Sergey M․ db8ee7ec05 [extractor/common] Fix numeric identifiers conversion in DASH URL templates 9 years ago
remitamine 08136dc138 [brightcove] fix format sorting 9 years ago
remitamine fe7ef95e91 [cbsinteractive] Add support for ZDNet videos 9 years ago
remitamine 5f705baf5e [cnet] extract more formats 9 years ago
remitamine 0750b2491f [ffmpeg] try to convert tt subtitles usng dfxp2srt 9 years ago
remitamine df634be2ed [common] prefer using mime type over ext for smil subtitle extraction
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
9 years ago
Jaime Marquínez Ferrándiz 6d628fafca [camwithher] Remove extra blank line 9 years ago
Jaime Marquínez Ferrándiz 0f28777f58 [cbsnews] Remove unused import 9 years ago
Jaime Marquínez Ferrándiz 329c1eae54 [aenetworks] Make pep8 happy 9 years ago
Sergey M․ 9aaaf8e8e8 [camwithher] Improve extraction (Closes #8989) 9 years ago
theGeekPirate 04819db58e [camwithher] Add extractor
Corrected unnecessary test

Sane variable naming

RTMP all .flv & url_id for _download_webpage()

Corrected all outstanding issues, next up is a squash!
9 years ago
remitamine 79ba9140dc [theplatform] extract timestamp and uploader 9 years ago
Sergey M․ 75d572e9fb [screencast] Improve title regexes (Closes #9025) 9 years ago
Martin Trigaux 791d6aaecc screencast.com: fallback on page title
When determining the title of the page, use the <title> tag of the page
9 years ago
Sergey M․ 81de73e5b4 [screencast] Add test 9 years ago
Martin Trigaux 83cedc1cf2 screencast.com: support missing www
The "www." part of the URL is not mandatory
9 years ago
Sergey M․ 244cd04237 [pluralsight] Remove unnecessary login/password encode 9 years ago
Sergey M․ fbdaced256 [lynda] Remove unnecessary login/password encode 9 years ago
Sergey M․ a3373823e1 [udemy] Remove unnecessary login/password encode
This is now covered by compat_urllib_parse_urlencode
9 years ago
Sergey M․ 03caa463e7 [udemy:course] Skip non-video lectures 9 years ago
remitamine 3f64379eda [movieclips] fix extraction 9 years ago
remitamine 3e0c3d14d9 [cbs] add base extractor 9 years ago
remitamine d8873d4def [aenetworks] improve format extraction 9 years ago
remitamine db1c969da5 [theplatform] sign https urls 9 years ago
Philipp Hagemeister 1e02bc7ba2 release 2016.04.01 9 years ago
remitamine 63c55e9f22 [cbs] improve extraction(closes #6321) 9 years ago
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE) 9 years ago
remitamine 961fc024d2 [voxmedia] improve sbnation support 9 years ago
Sergey M․ b53a06e3b9 [udemy:course] Use new URL format 9 years ago
remitamine 4ecc1fc638 [howstuffworks] improve extraction 9 years ago
Yen Chi Hsuan 5b012dfce8 [tudou] Improve error handling (closes #8988) 9 years ago
remitamine 8369942773 [voxmedia] Add new extractor(closes #3182) 9 years ago
Sergey M․ 86f3b66cec [udemy] Remove unused import 9 years ago
Sergey M․ 6bb4600717 [udemy:course] Simplify course curriculum downloading 9 years ago
Sergey M․ 41d06b0424 [extractor/common] Improve _request_webpage
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
9 years ago
Sergey M․ 15d260ebaa [utils] Use update_Request in http_request 9 years ago
Sergey M․ ed0291d153 [utils] Add update_Request 9 years ago
Sergey M․ 81da8cbc45 [udemy] Switch to api 2.0 (Closes #9035) 9 years ago
Sergey M․ 5299bc3f91 [beeg] Switch to api v6 (Closes #9036) 9 years ago
remitamine c9c39c22c5 [nationalgeographic] add support for channel.nationalgeographic.com urls 9 years ago
remitamine d84b48e3f1 [nationalgeographic] improve extraction 9 years ago
remitamine dd17041c82 [tenplay] remove extractor(fixes #6927) 9 years ago
remitamine fea7295b14 [brightcove] relax embed_in_page regex 9 years ago
remitamine 9cf01f7f30 [nbc] add new extractor for csnne.com(#5432) 9 years ago
remitamine ce548296fe [cnbc] fix test 9 years ago
remitamine c02ec7d430 [cnbc] Add new extractor(closes #8012) 9 years ago
remitamine 6b820a2376 [myspace] improve extraction 9 years ago
Yen Chi Hsuan e621a344e6 [kwuo] Port to new API and enable --cn-verification-proxy 9 years ago
Yen Chi Hsuan 3ae6f8fec1 [kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
Following the idea proposed in 19dbaeece3
9 years ago
Yen Chi Hsuan 597d52fadb [kuwo:song] Correct song ID extraction (fixes #9033)
Bug introduced in daef04a4e7.
9 years ago
Sergey M․ afca767d19 [tumblr] Improve _VALID_URL (Closes #9027) 9 years ago
remitamine 6e359a1534 [comcarcoff] don not depend on crackle extractor(closes #8995)
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995.
9 years ago
Sergey M․ 33f3040a3e [YoutubeDL] Fix sanitizing subtitles' url 9 years ago
Sergey M․ 03442072c0 [pornhub] Fix typo (Closes #9008) 9 years ago
Sergey M․ c8b13fec02 [foxnews] Restore upload time fields in test 9 years ago
Sergey M․ 87d105ac6c [amp] Fix upload timestamp extraction (Closes #9007) 9 years ago
Sergey M․ 3454139576 [pornhub:uservideos] Add support for multipage videos (Closes #9006) 9 years ago
Sergey M․ 3a23bae9cc [pornhub:playlistbase] Do not include videos not from playlist 9 years ago
Sergey M․ 8f9a477e7f [pornhub:playlistbase] Use orderedSet 9 years ago
Sergey M․ a1cf3e38a3 [bbc] Extend vpid regex (Closes #9003) 9 years ago
Philipp Hagemeister a122e7080b release 2016.03.27 9 years ago
Sergey M․ b22ca76204 [extractor/common] Filter out unsupported encrypted media for f4m formats (Closes #8573) 9 years ago
Sergey M․ f7df343b4a [downloader/f4m] Extract routine for removing unsupported encrypted media 9 years ago
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes #8051
9 years ago
Yen Chi Hsuan 395fd4b08a [twitter] Handle another form of embedded Vine
Fixes #8996
9 years ago
Sergey M․ 8018028d0f [pluralsight] Extract chapter metadata (Closes #8993) 9 years ago
Sergey M․ 00322ad4fd [lynda] Extract chapter metadata (#8993) 9 years ago
Sergey M․ 4cf3489c6e [vevo] Update videoservice API URL (Closes #8900) 9 years ago
Sergey M․ b24ab3e341 [udemy] Improve paid course detection 9 years ago
Sergey M․ af4116f4f0 [udemy] Improve format_id 9 years ago
Sergey M․ f973e5d54e [udemy] Drop outputs' formats
Always results in 403
9 years ago
Sergey M․ 62f55aa68a [udemy] Add outputs metadata to view_html formats 9 years ago
Sergey M․ 02d7634d24 [udemy] Fix outputs' formats format_id 9 years ago
Sergey M․ 48dce58ca9 [udemy] Use custom sorting 9 years ago
Sergey M․ efcba804f6 [udemy] Extract formats from view_html (Closes #8979) 9 years ago
Sergey M․ 6dee688e6d [youtube:playlistsbase] Restrict playlist regex (Closes #8986) 9 years ago
Sergey M․ eedb7ba536 [YoutubeDL] Sort imports 9 years ago
Sergey M․ dcf77cf1a7 [YoutubeDL] Sanitize final URLs (Closes #8991) 9 years ago
Sergey M․ 17bcc626bf [utils] Extract sanitize_url routine 9 years ago
Sergey M․ b5a5bbf376 [mailru] Extend _VALID_URL (Closes #8990) 9 years ago
Yen Chi Hsuan e68d3a010f [twitter] Fix extraction (closes #8966)
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
9 years ago
Yen Chi Hsuan d10fe8358c [generic] Add a test case for brightcove embed
Closes #8862
9 years ago
Yen Chi Hsuan d6c340cae5 [brightcove] Extract more formats (#8862) 9 years ago
Yen Chi Hsuan 5964b598ff [brightcove] Support alternative BrightcoveExperience layout
The full URL lays in the `data` attribute of <object> (#8862)
9 years ago
Philipp Hagemeister 62cdb96f51 release 2016.03.26 9 years ago
Sergey M․ 6e6bc8dae5 Use urlencode_postdata across the codebase 9 years ago
Sergey M․ 15707c7e02 [compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode

Closes #8974
9 years ago
Sergey M․ 2156f16ca7 [thescene] Fix extraction and improve style (Closes #8978) 9 years ago
Sergey M․ 4db441de72 [once] Relax _VALID_URL (Closes #8976) 9 years ago
Philipp Hagemeister 0be8314dc8 release 2016.03.25 9 years ago
Yen Chi Hsuan d7f62b049a [iqiyi] Update enc_key 9 years ago
Yen Chi Hsuan 3bb3356812 [douyutv] Extend _VALID_URL 9 years ago
Sergey M․ 98e68806fb [mnet] Improve (Closes #8958) 9 years ago
Kagami Hiiragi e031768666 [mnet] Add new extractor 9 years ago
Sergey M․ 5eb7db4ee9 [udemy] Add support for new URL schema 9 years ago
Sergey M․ f0e83681d9 [udemy] Extract formats from outputs 9 years ago
Sergey M․ ff9d5d0938 [udemy] Improve course enrolling 9 years ago
Sergey M․ d041a73674 [extractor/__init__] Add youtube:live and sort youtube extractors alphabetically 9 years ago
Sergey M․ f07e276a04 [youtube:live] Add extractor (Closes #8959) 9 years ago
Sergey M․ 993271da0a [nytimes] Tolerate missing metadata (Closes #8952) 9 years ago
Sergey M․ 369e7e3ff0 [iprima] Fix extraction (Closes #8953) 9 years ago
Sergey M․ 5767b4eeae [mtv] Fix description extraction (Closes #8962) 9 years ago
Yen Chi Hsuan 622d19160b [utils] Clarify Python versions affected by buggy struct module 9 years ago
Yen Chi Hsuan 32d88410eb [tumblr] Add a test with Instagram embed
Closes #8817
9 years ago
Yen Chi Hsuan 5a51775a58 [generic] Extract Instagram embeds (#8817) 9 years ago
Yen Chi Hsuan 87696e78d7 [instagram] Unescape description (#8817) 9 years ago
Yen Chi Hsuan c4096e8aea [instagram] Extract embed videos (#8817) 9 years ago
Yen Chi Hsuan fc27ea9464 [tumblr] Support Vine embeds (#8817) 9 years ago
Yen Chi Hsuan 088e1aac59 [generic] Support Vine embeds (#8817) 9 years ago
Sergey M 4333d56494 Merge pull request #8898 from dstftw/fragment-retries
Add --fragment-retries option (Fixes #8466)
9 years ago
Sergey M․ 882c699296 [tunein] Fix stream data extraction (Closes #8899, closes #8924) 9 years ago
Yen Chi Hsuan efbed08dc2 [utils] Encode hostnames before passing to urllib
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError

Fixes #8890
9 years ago
Jaime Marquínez Ferrándiz 7da2c87119 Add extractor for thescene.com (closes #8929) 9 years ago
Sergey M․ c6ca11f1b3 [once] Prevent ads from embedding into m3u8 playlists (Closes #8893) 9 years ago
Sergey M․ 2beeb286e1 [laola1tv] Add support for livestreams (Closes #8934) 9 years ago
Sergey M․ cc7397b04d [ceskatelevize] Make m3u8 formats extraction non fatal (Closes #8933) 9 years ago
Sergey M․ bc5d16b302 [animeondemand] Skip dash for now 9 years ago
Sergey M․ 85c637b737 [animeondemand] Extract teaser when no full episode available (#8923) 9 years ago
Sergey M․ 5c69f7a479 [animeondemand] Respect startvideo (Closes #8923) 9 years ago
Sergey M․ ff5873b72d [motherless] Detect friends only videos 9 years ago
Sergey M․ 065c4b27bf [xhamster:embed] Extract vars (Closes #8912) 9 years ago
Sergey M․ 1600ed1ff9 [rutv] Improve flash version pattern (Closes #8911) 9 years ago
Sergey M․ 5886b38d73 Add support for https for all extractors as preventive and future-proof measure 9 years ago
Sergey M․ 0cef27ad25 Add missing r prefix for _VALID_URLs 9 years ago
Sergey M․ 12af4beb3e [mailru] Add support for https (Closes #8920) 9 years ago
Sergey M․ 9016d76f71 [YoutubeDL] Improve _format_note 9 years ago
Sergey M․ 3c5d183c19 [animeondemand] Extract all formats (Closes #8906) 9 years ago
Sergey M․ 3e8bb9a972 [animeondemand] Detect geo restriction 9 years ago
Yen Chi Hsuan daef04a4e7 [kwuo] Fix KuwoChartIE and KuwoSingerIE and accept new URL forms 9 years ago
Yen Chi Hsuan 2648918c81 [vlive] Fix creator extraction (closes #8814) 9 years ago
Yen Chi Hsuan 9e3c2f1d74 [openload] Misc improvements
* Add thumbnail
* Detect errors (#6469)
* Match more (#6469, #8489)
9 years ago
Yen Chi Hsuan 2bfeee69b9 [openload] Add new extractor (closes #8489) 9 years ago
Yen Chi Hsuan 664bcd80b9 [tudou] Use InAdvancePagedList (closes #8884) 9 years ago
Sergey M․ 3c20208eff [francetv] Improve formats extraction 9 years ago
Sergey M․ db264e3cc3 [francetvinfo] Add support for france3-regions and strip title (Closes #7673) 9 years ago
Sergey M․ 96a9f22d98 [discovery] Relax _VALID_URL (Closes #8903) 9 years ago
Sergey M․ 40025ee2a3 [postprocessort/ffmpeg] Allow embedding webvtt into webm (Closes #8874) 9 years ago
Sergey M․ 298c04b464 [91porn] Use common messages' wording 9 years ago
Sergey M․ d95114dd83 [91porn] Unquote final URL (Closes #8881) 9 years ago
Sergey M․ fa023ccb2c [biobiochiletv] Fix extraction, extract m3u8 formats and overall improve (Closes #7314) 9 years ago
jjatria e36f4aa72b [biobiotv] Add extractor 9 years ago
Sergey M․ f1ced6df51 [cda] Improve and simplify (Closes #8805) 9 years ago
Kacper Michajłow 8b0d7a66ef [cda] Add new extractor for cda.pl
Fixes #8760
9 years ago
Sergey M․ 3aec71766d [safari:api] Separate extractor (Closes #8871) 9 years ago
Sergey M․ 16a8b7986b [downloader/fragment] Document fragment_retries 9 years ago
Sergey M․ 617e58d850 [downloader/{common,fragment}] Fix total retries reporting on python 2.6 9 years ago
Sergey M․ e33baba0dd [downloader/dash] Add fragment retry capability
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
9 years ago
Sergey M․ 721f26b821 [downloader/fragment] Add report_retry_fragment 9 years ago
Sergey M․ 52bb437e41 [options] Add --fragment-retries option 9 years ago
Jaime Marquínez Ferrándiz 782b1b5bd1 [utils] lookup_unit_table: Match word boundary instead of end of string 9 years ago
Sergey M․ 0d769bcb78 [extractor/generic] Fix missing byte literal prefix 9 years ago
remitamine 4cd70099ea [hbo] Add new extractor 9 years ago
Jaime Marquínez Ferrándiz 09fc33198a utils: lookup_unit_table: Use a stricter regex
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
9 years ago
John Peel d5aacf9a90 Added format_id to the filers on -f. 9 years ago
Sergey M․ 19e2617a6f [commonprotocols] Add generic support for rtmp URLs (Closes #8488) 9 years ago
Sergey M․ edd9b71c2c [extractor/generic] Add a test for m3u playlist served without proper Content-Type 9 years ago
Sergey M․ 5940862d5a [extractor/generic] Detect m3u playlists served without proper Content-Type 9 years ago
Sergey M․ de6c51e88e [extractor/generic] Fix direct link semantics 9 years ago
Sergey M․ 303dcdb995 [extractor/generic] Simplify upload_date extraction 9 years ago
Sergey M․ 20938f768b [extractor/generic] Add another test for generic m3u8 9 years ago
Sergey M․ 955737b2d4 [extractor/generic] Force Content-Type to lowecase 9 years ago
Sergey M․ 263eff9537 [extractor/generic] Properly extract format id from Content-Type
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
9 years ago
Sergey M․ cae21032ab [theplatform] Improve geo restriction detection 9 years ago
remitamine 6187091532 [once] check http formats availability 9 years ago
Philipp Hagemeister 0d33166ec5 release 2016.03.18 9 years ago
remitamine 87c03c6bd2 [theplatform] remove unnecessary import 9 years ago
remitamine 4c92fd2e83 [theplatform] always force theplatform to return a smil for _extract_theplatform_smil 9 years ago
Sergey M․ e3d17b3c07 [noz] Fix extraction on python 2.6 by means of using compat_xpath 9 years ago
Sergey M․ 810c10baa1 [utils] Use compat_xpath 9 years ago
Sergey M․ 57f7e3c62d [compat] Add compat_xpath 9 years ago
Sergey M․ 0d0e282912 [animeondemand] Fix typo and improve 9 years ago
Sergey M․ 85e8f26b82 [animeondemand] Improve extraction 9 years ago
Sergey M․ b57fecfddd [animeondemand] Add test 9 years ago
Sergey M․ 8c97e7efb6 [animeondemand] Expand episode title regex (Closes #8875) 9 years ago
Sergey M․ cc162f6a0a [crunchyroll] Fix custom _download_webpage (Closes #8883) 9 years ago
remitamine cf45ed786e [wistia] extract more metadata 9 years ago
remitamine 574b2a7393 [nbc:nbcnews] improve extraction(fixes #6922)
- extract more metadata and formats
- relax regex
9 years ago
remitamine 9f02ff537c [theplatform] extract brightcove once formats 9 years ago
remitamine 0436ec0e7a [once] Add new format extractor 9 years ago
Yen Chi Hsuan 11f12195af [youtube] Added itag 91
Seen in https://www.youtube.com/watch?v=jMN4cxyhJjk
9 years ago
remitamine a646a8cf98 [sbs] improve extraction(fixes #3811)
- extract error messages
- force the platform smil url(previously the manifest param
in the query is not respected which make theplatform return non working
mp4 files for some videos)
9 years ago
remitamine 63f41d3821 [bravotv] Add new extractor(#4657) 9 years ago
Sergey M․ c5229f3926 [utils] PEP 8 9 years ago
Sergey M․ 96f4f796fb [brightcover] Remove unused import 9 years ago
Sergey M․ 70cab344c4 [udemy] Improve course id v4 regex 9 years ago
Quan Hua a7ba57dc17 [udemy] Update course id regex to cover v4 layout (Closes #8753, closes #8868, closes #8870) 9 years ago
remitamine 83548824c2 Merge pull request #8092 from bpfoley/twitter-thumbnail
[utils] Add extract_attributes for extracting html tag attributes
9 years ago
remitamine 354dbbd880 [brightcove:new] extract protocol-less embed URLs(closes #2914) 9 years ago
remitamine 23edc49509 [tv3] Add new extractor(closes #8059) 9 years ago
remitamine 48254c3f2c [brightcove] some improvements and fixes
- use FFmpeg downloader to download m3u8 formats extracted
from BrightcoveNew(some of the m3u8 media playlists use AES-128)
- update comment and update_url_query to handle url query
9 years ago
remitamine 2cab48704c [thestar] Add new extractor(closes #5955) 9 years ago
remitamine 64d4f31d78 [brightcove:new] update embed_in_page embeds regex to match non numeric ref id 9 years ago
remitamine 0c9ff24041 [noz] fix extraction in python 2.6 9 years ago
Yen Chi Hsuan 3ff8279e80 [kuwo:mv] Fix the test and extraction of georestricted MVs 9 years ago
remitamine cb6e477dfe [aljazeera] update the extractor to use BrightcoveNewIE 9 years ago
remitamine edfd93518e [svt] extract dashhbbtv formats(#8867) 9 years ago
remitamine 89807d6a82 [brightcove] extract dash formats and detect audio formats 9 years ago
remitamine 49dea4913b Merge pull request #8513 from remitamine/dash-sort
[extractor/common] fix dash formats sorting
9 years ago
Sergey M․ dec2cae0a7 [twitch:playlistbase] Clarify pagination bug
Pagination bug has been fixed by twitch on 15.03.2016.
9 years ago
remitamine cf6cd07396 [noz] extract f4m and m3u8 formats 9 years ago
remitamine 975b9c9ab0 [brightcove:new] detect m3u8 manifests by M2TS container 9 years ago
remitamine 8ac73bdbe4 [brightcove:new] Add support for non numeric ref: preffixed video ids 9 years ago
remitamine 877f440f7b [rice] Add new extractor(closes #1736) 9 years ago
remitamine d13bdc3824 [brightcove] raise ExtractorError on 403 errors and fix regex to work with tenplay 9 years ago
remitamine 744daf9418 [gameinformer] remove unused imports 9 years ago
remitamine bf475e1990 [tlc] fix extraction and update extractor to use BrightcoveNewIE 9 years ago
remitamine 203f3d779a [gameinformer] update the extractor to use BrightcoveNewIE 9 years ago
remitamine 4230c4894d [external/downloader] fix rtmp downloading using FFmpegFD 9 years ago
Philipp Hagemeister 6bb266693f release 2016.03.14 9 years ago
remitamine 5d53c32701 [usatoday] Add new extractor(closes #8655) 9 years ago
remitamine 2e7e561c1d Merge pull request #8611 from remitamine/ffmpegfd
[downloader/external] Add FFmpegFD
9 years ago
remitamine d8515fd41c [downloader/external] pass configuration args to ffmpeg 9 years ago
remitamine 694c47b261 [external/downloader] don't pass -t and -ss to ffmpeg 9 years ago
remitamine 77dea16ac8 [downloader/external] check for ffmpeg availablity when it used for m3u8 download 9 years ago
remitamine 6ae27bed01 [download/external] move the check for multiple selected formats to get_suitable_downloader 9 years ago
remitamine da1973a038 [extractor/__init__] disable time range downloading 9 years ago
remitamine be24916a7f [downloader/rtsp] Add rtsp and mms downloader 9 years ago
remitamine 2cb99ebbd0 [downloader/external] add can_download mathod for checking downloader availibilty and support 9 years ago
remitamine 91ee320bfa [downloader/external] wrap available_opt in a list 9 years ago
remitamine 8fb754bcd0 Merge pull request #8821 from remitamine/list-thumbnails-order
[YoutubeDL] check for --list-thumbnails immediately after processing them
9 years ago
remitamine b7b72db9ad [YoutubeDL] check for --list-thumbnails immediately after processing them 9 years ago
remitamine 634415ca17 [downloader/external] skip FFmpegFD when requesting multiple formats 9 years ago
Sergey M․ 2f7ae819ac [utils] PEP 8 9 years ago
Sergey M․ 0a477f8731 [vice:show] Add extractor (Closes #8847) 9 years ago
remitamine a755f82549 [ffmpeg] convert format ext to ffmpeg output formats codes 9 years ago
Sergey M․ 7f4173ae7c [mixcloud] Fix view count extraction (Closes #8831, closes #8845) 9 years ago
Sergey M․ fb47597b09 [bbc] Generalize unit table lookup and add parse_count 9 years ago
Sergey M․ 450b233cc2 [bbc] Update test 9 years ago
Sergey M․ b7d7674f1e [bbc] Update test 9 years ago
Sergey M․ 0e832c2c97 [bbc] Improve title and description extraction (Closes #8826, closes #8822) 9 years ago
Benjamin Congdon 8e4aa7bf18 [bbc] Fix BBC Extractor to work with 'School Report' 9 years ago
remitamine a42dfa629e [makerschannel] Add new extractor(closes #8839) 9 years ago
remitamine b970dfddaf [minoto] Add new extractor 9 years ago
Sergey M․ 46a4ea8276 [safari] Remove unused imports 9 years ago
Sergey M․ 3f2f4a94aa [extractor/generic] Extract f4m formats from final URLs 9 years ago
Sergey M․ f930e0c76e [extractor/generic] Extract f4m formats and refactor common info 9 years ago
Sergey M․ 0fdbb3322b [extractor/common] Add _parse_f4m_formats routine 9 years ago
Sergey M․ e9c8999ede [safari] Fix authentication 9 years ago
Sergey M․ 73cbd709f9 [safari] Respect kaltura session (Closes #7491) 9 years ago
Sergey M․ 9dce3c095b [kaltura] Respect kaltura session 9 years ago
remitamine e5a2e17a9c [kaltura] optimize url info extraction 9 years ago
remitamine 0ec589fac3 Merge pull request #8827 from remitamine/safari
[safari] extract free and preview videos(#7491)
9 years ago
remitamine 36bb63e084 [dw] add support for article pages(closes #8790) 9 years ago
remitamine 91d6aafb48 [dw] add support for audio pages 9 years ago
remitamine c8868a9d83 [dw] Add new extractor 9 years ago
remitamine 09f572fbc0 [extractor/common] add transform_source to _download_smil and _extract_smil_formats 9 years ago
Sergey M․ 58e6d097d8 [googledrive] Relax _VALID_URL (Closes #8829) 9 years ago
remitamine 15bf934de5 Merge pull request #8819 from remitamine/simple-webpage-requests
[extractor/common] simplify using data, headers and query params with _download_* methods
9 years ago
remitamine cdfee16818 [extractor/common] add data, headers and query params to _request_webpage 9 years ago
remitamine bcb668de18 [safari] extract free and preview videos(#7491) 9 years ago
remitamine fac7e79277 [kaltura] add support for videos with reference id 9 years ago
Yen Chi Hsuan a6c8b75904 [common] Use mimeType to determine file extensions (#8766) 9 years ago
Yen Chi Hsuan 25cb05bda9 [utils] Remove codec2ext
This function is orignally used for determining file extensions of DASH
formats. Now in DASH, ext is determined by mime_type. See #8766 for more
information.
9 years ago
Sergey M․ 883c052378 [audioboom] Improve robustness and extract uploader (Closes #8812) 9 years ago
Benjamin Congdon 61f317c24c Added extractor for AudioBoom.com 9 years ago
Yen Chi Hsuan 64f08d4ff2 Merge pull request #8766 from yan12125/dash-detect-ext
Detect file extensions of DASH formats from their codecs
9 years ago
Yen Chi Hsuan e738e43358 [facebook] Support videos in groups
Viewing/Downloading videos in groups requires logging in, even for
those in public groups.

Fixes #6951.
9 years ago
Jaime Marquínez Ferrándiz f6f6217a98 [facebook] Don't override variable in list comprehension 9 years ago
Yen Chi Hsuan 31db8709bf [iqiyi] Update enc_key 9 years ago
Yen Chi Hsuan 5080cbf9fd [facebook] Handle escaped swf params
Fixes #8713
9 years ago
Yen Chi Hsuan 9880124196 [facebook] Fix for m.facebook.com URLs 9 years ago
Yen Chi Hsuan 9c7b509b2a [facebook] Merge FacebookPostIE into FacebookIE
Fixes #8713
9 years ago
Sergey M․ 5d583bdf6c [YoutubeDL] Improve _format_note 9 years ago
Sergey M․ 1e501364d5 [vimeo:ondemand] Clarify IE_NAME 9 years ago
Sergey M․ 74278def2e [vimeo:ondemand] Separate ondemand extractor (Closes #8330, closes #8801) 9 years ago
Sergey M․ e375a149e1 [livestream] Properly build smil URLs (#8794) 9 years ago
Benjamin Congdon ac45505528 Added flag for 'allow_audio_only' format in Twitch queries 9 years ago
Sergey M․ 46c329d6f6 [arte] Improve extraction (Closes #8768) 9 years ago
Sergey M․ 1818e4c2b4 [arte] Fix typo 9 years ago
Sergey M․ e7bd17373d [sexu] Improve extraction (Closes #8782) 9 years ago
aystroganov@gmail.com c58e74062f [Sexu] fix extractor 9 years ago
Yen Chi Hsuan 6d210f2090 [utils] Add more codecs to codec2ext
BBC uses avc3. Here's an example (thanks to @remitamine for this example)

http://rdmedia.bbc.co.uk/dash/ondemand/bbb/2/client_manifest-common_init.mpd

See also https://trac.ffmpeg.org/ticket/5217
9 years ago
Yen Chi Hsuan af7d5a63b2 [common] Document protocol http_dash_segments 9 years ago
Yen Chi Hsuan e41acb6364 [safari] Don't pollute std_headers (#8778) 9 years ago
Philipp Hagemeister bdf7f13954 release 2016.03.06 9 years ago
Yen Chi Hsuan 0f56a4b443 [vimeo] Don't pollute std_headers
Fixes #8778
9 years ago
Sergey M․ 1b5284b13f [downloader/fragment] Make speed more smooth
At the beginning of every segment there was a drop to Unknown speed due to timeslice being too small to calculate speed.
Now last speed from the previous fragment is used.
9 years ago
Sergey M․ d1e4a464cd [YoutubeDL] Carry long lines and improve readability 9 years ago
Sergey M․ ff059017c0 [YoutubeDL] Fix typo in m3u8_native fixup 9 years ago
remitamine f22ba4bd60 update tests related to the change in youtube http format sorting
the change was done in 82156fdbf0
9 years ago
remitamine 1db772673e [cinemassacre] update tests 9 years ago
remitamine 75313f2baa [cnet] fix info extraction 9 years ago
remitamine 090eb8e25f Merge pull request #8718 from remitamine/m3u8-fixup
Add fixup for media files produced by HlsNative downloader(fixes #4776)
9 years ago
remitamine a9793f58a1 Merge pull request #8754 from remitamine/5min
update 5min related web sites info extraction and add support for Aol features.
9 years ago
remitamine 7177fd24f8 [vgtv] support ap.vgtv.no and fix old videos extraction(fixes #8719) 9 years ago
Sergey M․ 1e501f6c40 [jeuxvideo] Fix config URL extraction (Closes #8774) 9 years ago
remitamine 2629a3802c [revison3] fix video_id for --download-archive 9 years ago
Sergey M․ 51ce91174b [YoutubeDL] Fix resolution with missing height in output template dict 9 years ago
remitamine 107d0c421a [revision3] add support for pages of type tag 9 years ago
remitamine 18b0b23992 [revision3] add support pages of type embed 9 years ago
Sergey M․ d1b29d1342 [elpais] Add support for alternative layout (Closes #8744) 9 years ago
Yen Chi Hsuan 2def60c5f3 [common] Use codec2ext for DASH formats (#8764) 9 years ago
Yen Chi Hsuan 19a17d4623 [utils] Add codec2ext 9 years ago
Yen Chi Hsuan 845817aadf [twitter] Provide more metadata 9 years ago
Jaime Marquínez Ferrándiz 3233a68fbb [utils] update_url_query: Encode the strings in the query dict
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
9 years ago
remitamine cf074e5ddd [foxnews] update test 9 years ago
Sergey M․ 002c755248 [youporn] Fix sources regex 9 years ago
Sergey M․ d627cec608 [youporn] Fix quality extraction (Closes #8758) 9 years ago
remitamine 1315224cbb [bleacherreport] update tests 9 years ago
remitamine 7760b9ff4d [audimedia] update _VALID_URL and video_id regex and improve http format_id 9 years ago
Yen Chi Hsuan 28559564b2 [kusi] Correct test_KUSI 9 years ago
Yen Chi Hsuan fa880d20ad [kusi] Two fixes
Thanks @dstftw for pointing out those
9 years ago
Sergey M․ ae7d31af1c [yandexmusic] Capture and output API errors 9 years ago
Yen Chi Hsuan 5f1688f271 [kusi] Simplify and improve 9 years ago
remitamine 1d4c9ed90c [aol] imporve extraction
- add support for aol features
- remove support for legacy urls
9 years ago
remitamine d48352fb5d [engadget] remove support for legacy urls 9 years ago
remitamine 6d6536acb2 [fivemin] improve extraction
- skip m3u8 formats(404 error)
- skip unavailable test
- download embed page only when it's needed
- update _VALID_URL regex(joystiq.com redirect to engadget.com)
9 years ago
Yen Chi Hsuan b6f94d81ea [kusi] Add a test for the alternative form of URL 9 years ago
Yen Chi Hsuan 8477a69283 Merge branch 'kusi' of https://github.com/mutantmonkey/youtube-dl into mutantmonkey-kusi 9 years ago
Yen Chi Hsuan d58cb3ec7e [leeco] Skip an invalid test. test_LePlaylist_1 is sufficient 9 years ago
Yen Chi Hsuan 8a370aedac [leeco] format_id should be strings 9 years ago
Yen Chi Hsuan 24ca0e9c0b [douyutv] Fix tests 9 years ago
Sergey M․ e1dd521e49 [livestream] Fix FutureWarning (Closes #8742) 9 years ago
remitamine 1255733945 Merge pull request #8739 from remitamine/update_url_params
[utils] add update_url_query function to create or update query string params
9 years ago
Sergey M․ d0ff690d68 [indavideo:embed] Fix tags extraction (Closes #8738) 9 years ago
remitamine 38f9ef31dc [utils] add update_url_query function 9 years ago
Sergey M․ a8276b2680 [twitch:playlistbase] Fix all at once fetch 9 years ago
Sergey M․ ececca6cde [twitch:playlistbase] Restore original _PAGE_LIMIT 9 years ago
Sergey M․ 8bbb4b56ee [twitch:playlistsbase] Use orderedSet 9 years ago
Sergey M․ 539a1641c6 [twitch] Workaround broken paging (Closes #8740) 9 years ago
Yen Chi Hsuan e9c0cdd389 [jython] Introduce compat_os_name
os.name is always 'java' on Jython
9 years ago
Yen Chi Hsuan 0cae023b24 Merge branch 'jython-support'
Closes #8302
9 years ago
Yen Chi Hsuan 8ee239e921 [utils] Jython support - handle filenames correctly
Now test:youtube downloads
9 years ago
Brian Foley 8bb56eeeea [utils] Add extract_attributes for extracting html tag attributes
This is much more robust than just using regexps, and handles all
the common scenarios, such as empty/no values, repeated attributes,
entity decoding, mixed case names, and the different possible value
quoting schemes.
9 years ago
remitamine fa9e259fd9 [extractor/common] use compat_parse_qs in update_url_params 9 years ago
remitamine f3bdae76de [extractor/common] add update_url_params helper method to add or update query string params 9 years ago
Yen Chi Hsuan 03879ff054 [twitter] Media info is not always in the first entity
Fixes #8704
9 years ago
Yen Chi Hsuan c8398a9b87 [twitter] Now Twitter serves the same file for Firefox and Chrome 9 years ago
Yen Chi Hsuan b8972bd69d [twitter] Fix extraction of test_Twitter and test_Twitter_1 9 years ago
Yen Chi Hsuan 0ae937a798 [twitter] Support twitter.com/i/videos/tweet/ URLS
Closes #8737
9 years ago
remitamine 4459bef203 [thepltform] detect other types of errors 9 years ago
remitamine e07237f640 [utils] remove check for val from find_xpath_attr 9 years ago
Yen Chi Hsuan 8c5a994424 [leeco] Letv renamed to LeEco
LeEco is the company name and Le is the domain name.

For more information see the Chinese news post
http://www.techorz.com/company-news/letv-renamed-to-leeco-and-new-logo/
9 years ago
Yen Chi Hsuan 2eb25b256b [letv] Merge LetvTvIE into LetvPlaylistIE
And
1. Add more URL examples
2. Improve the matching pattern
9 years ago
Yen Chi Hsuan f3bc19a989 [letv] Correct regular expressions and fix a typo 9 years ago
Yen Chi Hsuan 7a8fef3173 [letv] Order imports alphabetically 9 years ago
Yen Chi Hsuan 7465e7e42d [letv] Keep videos' order in playlists 9 years ago
Yen Chi Hsuan 5e73a67d44 [letv] Domain name changed 9 years ago
Sergey M․ 2316dc2b9a [twitch:playlistbase] Mark broken
Twitch paging mechanism is completely broken on twitch side serving all videos all the time and making our travis builds stall.
9 years ago
Sergey M․ a2d7797cee [vimeo] Extract uploader_url (Closes #8727) 9 years ago
Sergey M․ fd050249af [youtube] Extract uploader_url (Closes #8724) 9 years ago
Sergey M․ 7bcd2830dd [extractor/common] Document uploader_url 9 years ago
Sergey M․ 7caf9830b0 [youtube] Extract license (Closes #8725) 9 years ago
Sergey M․ 2bc0c46f98 [extractor/common] Document license metafield 9 years ago
remitamine 3318832e9d [youtube] improve width and height extraction from fmt_list 9 years ago
remitamine e7d2084568 Merge branch 'master' of github.com:rg3/youtube-dl 9 years ago
remitamine c2d3cb4c63 Revert "[youtube] add tbr to _formats extracted from watch_as3.swf"
This reverts commit 4a5ba28a87.
9 years ago
remitamine c48dd4400f Revert "[youtube] add basic info for some unknown formats extracted from watch_as3.swf"
This reverts commit 85ca019d96.
9 years ago
Sergey M․ e38cafe986 [YoutubeDL] Skip postprocessing and archive report when outputting to stdout (Closes #8729) 9 years ago
remitamine 85ca019d96 [youtube] add basic info for some unknown formats extracted from watch_as3.swf 9 years ago
remitamine 4a5ba28a87 [youtube] add tbr to _formats extracted from watch_as3.swf 9 years ago
remitamine 82156fdbf0 [youtube] extract width and height from fmt_list 9 years ago
Sergey M․ 6114090418 [nrk:skole] Relax _VALID_URL 9 years ago
Sergey M․ 3099b31276 [nrk:skole] Add extractor (Closes #8728) 9 years ago
remitamine f17f86513e Add fixup for media files produced by HlsNative downloader(fixes #4776) 9 years ago
Sergey M․ 90f794c6c3 [options] Add --no-mark-watched (#5054) 9 years ago
Sergey M․ 66ca2cfddd [wistia] Fix extraction (Closes #8707) 9 years ago
Sergey M 269dd2c6a7 Merge pull request #8703 from dstftw/mark-watched
Add --mark-watched feature (Closes #5054)
9 years ago
Sergey M․ e7998f59aa [lifenews] Fix extraction and improve (Closes #2482, closes #8714) 9 years ago
Yen Chi Hsuan 9fb556eef0 [iqiyi] SWF URLs are not used anymore
Since automatic detection of enc_key failed

Closes #8705
9 years ago
Philipp Hagemeister e781ab63db release 2016.03.01 9 years ago
Jaime Marquínez Ferrándiz 3e76968220 [rtve.es:live] Fix extraction
* Update _VALID_URL to match the current URLs
* Use the m3u8 manifest since I haven't figured out how to use the rtmp stream
9 years ago
Sergey M․ 2812c24c16 [mdr] Fix extraction (Closes #8702) 9 years ago
Sergey M․ d77ab8e255 Add --mark-watched feature (Closes #5054) 9 years ago
Sergey M․ 4b3cd7316c [tf1] Improve wat id regex (Closes #8691) 9 years ago
Sergey M․ 6dae56384a [screenwavemedia] Check formats' URLs 9 years ago
Sergey M․ 2b2dfae83e [screenwavemedia] Improve formats sorting 9 years ago
Sergey M․ 6c10dbeae9 [screenwavemedia] Improve formats extraction 9 years ago
Jaime Marquínez Ferrándiz 9173202b84 [zdf] Ignore hls manifests that use https (closes #8665)
The certificates are misconfigured, you get the following error mesage:

    ssl.CertificateError: hostname u'zdf-hdios-none-i.zdf.de' doesn't match either of 'a248.e.akamai.net', '*.akamaihd.net', '*.akamaihd-staging.net', '*.akamaized.net', '*.akamaized-staging.net'
9 years ago
Sergey M․ 8870bb4653 [webofstories] Tolerate malforder og:title (Closes #8417) 9 years ago
Philipp Hagemeister da665ddc25 release 2016.02.27 9 years ago
Sergey M․ 5add979d91 [dplay] Add support for dplay.no 9 years ago
Sergey M․ 940b606a07 [dplay] Improve, extract all formats and metadata (Closes #8463) 9 years ago
Aidan Rowe 9505053704 [dplay] add support for it.dplay.com and dplay.dk 9 years ago
Sergey M․ 2c9ca78281 [extractor/generic] Add support for tnaflix network embeds (Closes #7505) 9 years ago
Sergey M․ 63719a8ac3 [tnaflixnetwork:embed] Add _extract_urls 9 years ago
Sergey M․ 8fab62482a [tnaflixnetwork] Fallback age limit to 18 9 years ago
Sergey M․ d6e9c2706f [tnaflixnetwork:embed] Add extractor 9 years ago
Sergey M․ f7f2e53a0a [imdb] Recognize 1080p formats (Closes #8677) 9 years ago
Sergey M․ 9cdffeeb3f [extractor/common] Clarify rationale on media playlist detection 9 years ago
Sergey M․ fbb6edd298 [extractor/common] Properly extract audio only formats in master m3u8 playlists 9 years ago
Yen Chi Hsuan 5eb6bdced4 [utils] Multiple changes to base_n()
1. Renamed to encode_base_n()
2. Allow tables longer than 62 characters
3. Raise ValueError instead of AssertionError for invalid input data
4. Return the first character in the table instead of '0' for number 0
5. Add tests
9 years ago
Yen Chi Hsuan 5633b4d39d [infoq] Use BokeCC extractor function 9 years ago
Yen Chi Hsuan 4435c6e98e [bokecc] Add new extractor (#2336) 9 years ago
Yen Chi Hsuan 2ebd2eac88 [letv] Speedup M3U8 decryption 9 years ago
Sergey M․ b78b292f0c [youtube] Add alternative automatic captions extraction approach (Closes #8667) 9 years ago
Yen Chi Hsuan efbd6fb8bb [vidzi] Use decode_packed_codes
Javascript codes found on Vidzi are slightly different from those found
in VideoMega and iQiyi. Nevertheless, the difference has no effects on
the final result.
9 years ago
Yen Chi Hsuan 680079be39 [utils] Relaxing regex in decode_packed_codes for vidzi 9 years ago
Yen Chi Hsuan e4fc8d2ebe [videomega] Fix extraction (closes #7606) 9 years ago
Yen Chi Hsuan f52354a889 [utils] Move codes for handling eval() from iqiyi.py 9 years ago
Yen Chi Hsuan 59f898b7a7 [utils] Merge base_n functions 9 years ago
Yen Chi Hsuan 8f4a2124a9 [vidzi] Fix extraction 9 years ago
Yen Chi Hsuan 481888294d [utils] Add base36 for use in Vidzi 9 years ago
Yen Chi Hsuan d1e440a4a1 [jwplatform] Separate codes for for parsing jwplayer data 9 years ago
Yen Chi Hsuan 81bdc8fdf6 [utils] Move base62 to utils 9 years ago
Yen Chi Hsuan e048d87fc9 [kuwo] Fix a test 9 years ago
Sergey M․ e26cde0927 [space] Remove extractor (Closes #8662)
Now uses ooyala embed
9 years ago
Sergey M․ 20108c6b90 [ustudio] Improve (Closes #8574) 9 years ago
mutantmonkey 9195ef745a [uStudio] Add new extractor 9 years ago
Sergey M․ d0459c530d [motherless] Update tests 9 years ago
Sergey M․ f160785c5c [utils] Remove AM/PM from unified_strdate patterns 9 years ago
Sergey M․ 5c0a57185c [motherless] Detect non-existing videos 9 years ago
Sergey M․ 43479d9e9d [motherless] Make categories optional (Closes #8654) 9 years ago
Yen Chi Hsuan c24883a1c0 [facebook] Fix format sorting
'hd' formats should have higher priorities
9 years ago
Yen Chi Hsuan 1b77ee6248 [c56] Support videos hosted on Sohu (closes #8073) 9 years ago
Sergey M․ bf4b3b6bd9 [vk] Extract video URL from extra_data (Closes #8646) 9 years ago
Yen Chi Hsuan efbeddead3 [facebook] Support mobile URLs (closes #8638) 9 years ago
Yen Chi Hsuan 3cfeb1624a [nba] Support channels (#5362, #4167) 9 years ago
Yen Chi Hsuan b95dc034ca [utils] Implement cache for OnDemandPagedList 9 years ago
Yen Chi Hsuan 86a7dbe66e [nba] Support non-video/ pages
Fixes #8589
9 years ago