Commit Graph

13906 Commits (0ce76801e8f6e4d69182c20d9cef4de772555ad7)

Author SHA1 Message Date
Sergey M․ 9dc7ea320d
[nexx] Don't capture domain id and add support for domainless shortcuts
Remita Amine e231afb14f [nexx] switch to ark api(closes )
Wandang 12acb9a6fb [zdf] Update tests
Wandang 18ebd1a843 [redtube] Fix duration extraction and update test
Wandang 8315ee6c4c [reddit] Update test
Wandang b9d1a79426 [9gag] Update test
Wandang 09f934b009 [vk] Update test
Wandang 73af6e22fd [vimeo] Update test
Wandang 77e499f95e [xhamster] Update test
Sergey M․ befa4708fd
[utils] Fixup some common URL's typos in sanitize_url (closes )
Sergey M․ 90830004c8
[sonyliv] Respect referrer (closes )
Sergey M․ 18d7aa6efa
[brightcove:new] Use referrer for formats' HTTP headers
Remita Amine b12cf31bb1 [cbc] add new extractor for olympics.cbc.ca(closes )
Sergey M․ 7d2b4aa047
Respect --prefer-insecure while updating (closes )
VietTPham 38662dfec7 [fusion] Add support for fusion.tv
Sergey M․ ee706f1009
[npo] Improve quality metadata extraction
Sergey M․ c4e7496421
[npo] Relax _VALID_URL (closes , closes )
Sergey M․ b8adcec4ea
[npo] Capture and output error message
Sergey M․ 073cca3df8
[downloader/common] Add whitespace
Parmjit Virk f66df20ccd [pornhub] Add support for channels (closes )
Sergey M․ ea69624992
[youtube] Handle shared URLs with generic extractor (closes )
Sergey M․ 49702e3669
[francetv] Fix typo
Sergey M․ 59b5e7b280
release 2018.02.11
Sergey M․ 760f81212f
[francetv] Add support for live streams (closes )
Sergey M․ 79080573b5
[francetv] Add support for zouzous.fr and ludo.fr (closes , closes , closes , closes )
Sergey M․ 99892e9908
[francetv] Separate main extractor and rework others to delegate to it
Sergey M․ 8faa338ff3
[francetv] Improve manifest URL signing (closes )
François Revol 818df33fda
[francetv] Sign m3u8 manifest URLs (closes )
they seem to be required now, else we get 403 errors.
Jan Schär a072a12e24 [veoh] Add support for embed URLs
Petr Novák e67734dda9 [dvtv] Skip download on failing test
Sergey M․ 9e36fedd00
[afreecatv] Fix extraction (closes )
Sergey M․ d2b200eef9
[periscope] Use accessVideoPublic endpoint (closes )
Sergey M․ a03a3c80fe
[YoutubeDL] Add support for filesize_approx in format selector (closes )
Sergey M․ 9d5871fdff
[discovery] Fix auth request (closes )
Sergey M․ ff873b5777
[6play] Extract subtitles (closes )
Sergey M․ 9e167e1ee3
[newgrounds] Fix metadata extraction (closes )
Remita Amine 5828489072 [nbc] add support for NBC Olympics Streams(closes )
Sergey M․ 8c5fafe29f
[dvtv] Simplify (closes )
Petr Novak 6f4ad0db34
[dvtv] Fix live streams extraction
(also fixed test broken by changed og tags on the site)
Sergey M․ c2b3bd0451
release 2018.02.08
Sergey M․ 246a75b4ff
[extractors] Import for myvi:embed
Sergey M․ 4fac463d70
[pokemon] PEP 8
Sergey M․ 382b8182ce
[gameinformer] PEP 8
Sergey M․ ce53320b11
[myvi] Extend _VALID_URL
Sergey M․ 51b0557d1e
[myvi:embed] Add extractor (closes )
Sergey M․ 5a5860825d
[prosiebensat1] Extend _VALID_URL (closes )
Sergey M․ 237d07f114
[pokemon] Relax _VALID_URL and extend title extraction (closes )
Sergey M․ 9f4ec3de25
[gameinformer] Use geo verification headers
Vrihub 96a0bbdd0d [la7] Fix extraction (closes )
Peter Pitzulo c8064d4fab [gameinformer] Fix brightcove id extraction
Sergey M․ fde677fed4
[afreecatv] Pass referrer to video info request (closes )
Sergey M․ 0e0508c8a2
[telebruxelles] Relax _VALID_URL and add support for live streams
Sergey M․ bcf150e435
[telebruxelles] Fix extraction (closes )
Sergey M․ 240f26229d
[extractor/common] Respect secure schemes in _extract_wowza_formats
Sergey M․ b9b150def7
release 2018.02.04
Sergey M․ 5399ab3f0c
[brightcove] Pass embed page URL as referrer (closes )
Sergey M․ b91a7a4e5e
[downloader/http] Randomize HTTP chunk size
Sergey M․ e4a60912b8
[youtube] Enforce using chunked HTTP downloading for DASH formats
Sergey M․ 00c97e3e7a
[downloader/http] Add ability to pass downloader options via info dict
Sergey M․ cf7259bc93
[downloader/http] Fix 302 infinite loops by not reusing requests
Sergey M․ b54d4a5ce8
Document http_chunk_size
Sergey M․ db157d2a2a
release 2018.02.03
Sergey M․ ba515388b8
Introduce --http-chunk-size
Remita Amine e2e18694db [redbulltv] fix extraction(closes )
Sergey M․ 1367c798e3
[redtube] Fix metadata extraction (closes )
Sergey M․ 9a340af37e
[compat] Mute some F821 under python 3
Sergey M․ 3c3bceb41d
[pladform] Respect platform id and extract HLS formats (closes )
Sergey M․ 64a12edb48
[rtlnl] Remove progressive formats (closes )
Remita Amine 4bf18702e6 [6play] do no modify asset urls with a token()
Remita Amine ecc218ab14 [nationalgeographic] Relax _VALID_URL
Sergey M․ d6b152915c
[dplay] Relax _VALID_URL (closes )
M.Yasoob Ullah Khalid ☺ 5fa2a6a561 [soundcloud] Remove unused _IPHONE_CLIENT_ID
Remita Amine d2a422f548 [cbsinteractive] fix data extraction(closes )
Sergey M․ b9d52fb2ca
[seznamzpravy] Remove debug output
Remita Amine 466000fc6b [amcnetworks] add support for SundanceTV(closes )
Sergey M․ 65220c3bd6
Add support for IronPython
Sergey M․ c989bdbef8
[downloader/ism] Fix Python 3.2 support
Sergey M․ eee1692ff3
release 2018.01.27
Sergey M․ 3c3a07ee0b
[seznamzpravy] Improve and simplify (closes )
Petr Novák 27940ca09c [seznamzpravy] Add extractor (closes )
Sergey M․ 3931b84597
[extractor/common] Improve _json_ld for articles
Sergey M․ a0ee342b50
[dplay] Bypass geo restriction
Sergey M․ 864a4576b7
[dplay] Add support for disco-api videos (closes )
Yen Chi Hsuan bbb7c3f7e9 [youtube] Extract precise error messages (closes )
Sergey M․ 9d6458a206
[teachertube] Capture and output error message
Sergey M․ 837b061710
[teachertube] Fix and relax thumbnail extraction (closes )
Remita Amine 967ebbdb6c [prosiebensat1] add another clip ID regexp(fixes )
Remita Amine dc400ed6a2 [tbs] update tokenizer url(fixes )
Sergey M․ cf2820710d
Switch codebase to use compat_b64decode
Sergey M․ 5d7d805ca9
[mixcloud] Use compat_b64decode (closes )
Sergey M․ f206126df0
[compat] Add compat_b64decode
Sergey M․ 021bd012bb
[thesixtyone] Remove extractor (closes )
Sergey M․ 6e5eacb770
release 2018.01.21
Sergey M․ 721a0c3c7b
[prosiebensat1] Relax clip id
Sergey M․ e0ab56571e
[southparkdk] Add support for southparkstudios.nu
Sergey M․ 99d6e696fc
[southpark] Add tests for collections (closes )
catlover999 6289e07883
[southpark] Add support for collections
helb b2a027fc6f [franceinter] Fix upload date extraction (closes )
Sergey M․ 0d9c48de4f
[extractor/common] Improve DASH formats extraction for jwplayer (, )
Sergey M․ df58ecbeba
[rtvs] Add extractor (closes , closes )
Sergey M․ ac458e90a3
[restudy] Extend _VALID_URL ()
Sergey M․ 7df18fcc65
[restudy] Fix extraction (closes )
Mike Fährmann c384d537f8 [util] Improve scientific notation handling in js_to_json (closes )
Sergey M․ e7f3529f68
[youtube:live] Improve live detection (closes )
Sergey M․ 7d5406216a
[springboardplatform] Add extractor
Philipp Hagemeister 2a3683c378 prosiebensat1: add another clip ID regexp
Sergey M․ 154e4fdace
[ringtv] Remove extractor (closes )
Sergey M․ e2fc6df169
release 2018.01.18
Varun 67408fe0e9 [soundcloud] Update client id (closes )
Sergey M․ cad9caf76b
[kamcord] Remove extractor (closes )
Sergey M․ 4471affc34
[spiegel] Add support for nexx videos (closes )
Sergey M․ 1370dba59f
[twitch] Fix authentication and error capture (closes , closes )
Sergey M․ 1d1d60f6dd
[vk] Detect more errors due to copyright complaints ()
Sergey M․ e11ccd76c6
release 2018.01.14
Sergey M․ 391dd6f094
[youtube] Fix live streams extraction (closes )
Sergey M․ 0ce39bc542
[wdr] Fix test
Sergey M․ 1915662d4f
[wdr] Bypass geo restriction
Sergey M․ 54e8f62e01
[wdr] Rework extractors (closes )
Sebastian Leske 2d8bb80c60
[wdr:elefant] Add extractor
Sergey M․ df16e645f6
[gamestar] Fix issues (closes )
Hendrik v. Raven d4aedca3bd
[gamestar] Add support for gamepro.de (closes )
Sergey M․ 47e2a9bc53
[viafree] Skip rtmp formats (closes )
Sergey M․ 609850acfb
[pandoratv] Add support for mobile URLs (closes )
Sergey M․ 64287560e4
[pandoratv] Add support for new URL format (closes )
scil a90641fe87 [ximalaya_extractor] Add new extractor ximalaya ()
* [ximalaya_extractor] Add new extractor

* format change according by flake8

* changes accoring to review by @yan12125 at github pull 

* change %d to %s in a temp str

* seond changes accoring to review by @yan12125 at github pull 

* improve TESTS about contains

* changes accoring to third review by @yan12125 at github pull 

* forth changes accoring to forth review by @yan12125 at github pull 
Sergey M․ 1b79daffd9
[digg] Improve extraction
Sergey M․ e654829b4c
[digg] Add extractor (closes )
Sergey M․ 2b4e1ace4a
[limelight] Tolerate empty pc formats (closes , closes , closes )
Sergey M․ 310ea4661d
[ndr:embed:base] Make separate formats extraction non fatal (closes )
Yen Chi Hsuan 5eca00a2e3 [weibo] Misc improvements
Yen Chi Hsuan 1dd38dc0f4 Merge branch 'weibo' of https://github.com/sprhawk/youtube-dl into sprhawk-weibo
Sergey M․ 8005dc68cb
[ok] Add support for live streams
Remita Amine a39e15c516 [canalplus] fix extraction(closes )
Luca Steeb 3a513f29ad fix bilibili extraction (closes )
Sergey M․ 950b5f2969
release 2018.01.07
Sergey M․ b0ead0e09a
[jwplatform] Add support for multiple embeds (closes )
Sergey M․ 0a5b1295b7
[motherless:group] Relax entry extraction and add a fallback scenario
Sergey M․ a133eb7764
[motherless:group] Capture leading slash of video path
Sergey M․ f12628f934
[mitele] Fix extraction (closes )
Martin Weinelt 45283afdec [motherless] Add support for groups
Sergey M․ b7c74c0403
[lynda] Relax _VALID_URL (closes )
Parmjit Virk 0b0870f9d0 [soundcloud] Fallback to avatar picture for thumbnail (closes )
JianxinLi da35331c6c [youku] Fix list extraction.(close ) ()
* [youku] Fix list extraction.(close )

Change-Id: I2e9c920143f4f16012252625943a8f18b8ff40eb

* [youku] Remove KeyError try-except

Change-Id: Ic46327905cbef1356b7b12d5eb3db5d9746ca338
Yen Chi Hsuan de329f64ab [openload] Fix extraction (closes )
Sergey M․ 75ba0efb52
[lynda] Skip invalid subtitles (closes )
Luc Ritchie f0c6c2bce2 [twitch] Pass video id to url_result when extracting playlist
Jaime Marquínez Ferrándiz 9650c3e91d [rtve.es:alacarta] Fix extraction of some new URLs
Mattias Wadman b5e531f31a [acast] Fix extraction
Philipp Hagemeister d7cd9a9e84
[utils] Fix youtube-dl under PyPy3 on Windows
Sergey M․ b300cda476
[YoutubeDL] Output python implementation in debug header
sprhawk 6648fd8ad6 changed to use .get to get field from json object
Sergey M․ 04cf1a191a
release 2017.12.31
Ondřej Caletka 126f225bcf
[extractor/common] Add container meta field for formats extracted in _parse_mpd_formats
Windom 4f5cf31977 [slutload] Add support for mobile URLs
Sergey M․ 77341dae14
[abc:iview] Improve extraction and bypass geo restriction (closes )
d2au 2e65e7db9e
[abc:iview] Fix extraction (closes )
ABC dropped unmetering, so change to metered hls urls which
require auth.
Sergey M․ 538d4f8681
[downloader/hls] Use HTTP headers for key request
Yen Chi Hsuan 620ee8712e [openload] Fix extraction (closes )
Sergey M․ 2ca7ed41fe
[mediasite] Improve extraction and code style, add support for DASH (closes , closes , refs )
felix 8056c8542d
[mediasite] Add extractor, subsume sandia and collegerama extractors
felix 2501d41ef4
[common] use AACL as the default fourcc when AudioTag is 255
Remita Amine d97cb84b31 [ufctv] Add new extractor(closes )
50csent 2c8e11b4af
[pluralsight] Fix missing first line of subtitles (closes )
Sergey M․ d2c5b5a951
[openload] Fallback on f-page extraction (closes , closes )
Sergey M․ 580f3c79d5
[vimeo] Improve password protected videos extraction (closes )
sprhawk 48058d82dc replace unused _download_webpage_handle with _download_webpage
sprhawk 6a41a12d29 replace split with strip_jsonp
sprhawk 5c97ec5ff5 replace urlencode.encode with urlencode_postdata
Sergey M․ 9d6ac71c27
[extractor/common] Fix extraction of DASH formats with the same representation id (closes )
Remita Amine 84f085d4bd [aws] fix canonical/signed headers generation in python 2(closes )
Sergey M․ a491fd0c6f
release 2017.12.28
Sergey M․ 640788f6f4
[internazionale] Improve extraction (closes )
Leonardo Taccari 1ae0f0a21d
[internazionale] Add extractor
Ondřej Caletka 616bb95b28 [playtvak] Relax video regex and make description optional
Remita Amine be069839b4 [filmweb] improve extraction
sprhawk c33de004e1 Merge branch 'master' of github.com:rg3/youtube-dl into weibo
sprhawk 42a1012c77 fix according to "https://github.com/rg3/youtube-dl/pull/15079#discussion_r158688607"
Déstin Reed a14001a5a1 [Filmweb] Add extractor
Remita Amine db145ee54a [espn] Add new extractor for http://fivethirtyeight.com(closes )
Remita Amine 45d20488f1 [umg:de] Add new extractor(closes )(closes )
sprhawk 2593651224 fix compat_urllib_request for python2.7
sprhawk 951043724f re-format code to pass flake8
sprhawk d2be5bb5af change to use compat urllib
sprhawk 447a5a710d added weibo mobile site support
Remita Amine 0f897e0929 [espn] add support for espnfc and extract more formats(closes )
JianxinLi d3ca283235 [youku] Add test case.
Some playlist has no data-id value.

Change-Id: I97455f2907f08bda03b538cdc13ec827e2f8ce26
JianxinLi d99a1000c7 [youku] Fix list extraction.(close )
Change-Id: I578fdc5b69509bdcd8d3191e3917afe47c234ff6
Yen Chi Hsuan a75419586b [openload] Remove a confusing exception
If phantomjs is not installed, there's an error besides the missing
phantomjs exception:

Exception ignored in: <bound method PhantomJSwrapper.__del__ of <youtube_dl.extractor.openload.PhantomJSwrapper object at 0x7f8ad5e78278>>
Traceback (most recent call last):
  File "/home/yen/Projects/youtube-dl/youtube_dl/extractor/openload.py", line 142, in __del__
    os.remove(self._TMP_FILES[name].name)
AttributeError: 'PhantomJSwrapper' object has no attribute '_TMP_FILES'
Sergey M․ 273c23d960
[openload] Add support for oload.stream (closes )
JianxinLi 0e25a1a278 [youku] Update ccode
Change-Id: Id397e814e81ff560506d68563b7409eebbe5943d
Sergey M․ 307a7588b0
release 2017.12.23
Sergey M․ c2f2f8b120
[kaltura] Fix typo
Sergey M․ 69d69da98a
[kaltura] Add another embed pattern for entry_id
For cases when player configuration map is setup via indexing operator, e.g. kalturaPlayerConfiguration_1_lre6rg3i_10[entry_id] = 1_lre6rg3i (see https://www.heise.de/video/artikel/odcast-c-t-uplink-20-1-Apple-CarPlay-vs-Android-Auto-Galileo-3D-Sound-erklaert-3919694.html)
Sergey M․ 5c5e60cff8
[voot] Fix video identification
Sergey M․ 2132edaa03
[extractor/common] Move X-Forwarded-For setup code into _request_webpage
Remita Amine 4b7dd1705a [7plus] Add new extractor(closes )
Sergey M․ d2d766bc6d
[animeondemand] Fix typo
Sergey M․ 17c3aced5d
[animeondemand] Relax login error regex
Remita Amine 78466fcab5 [shahid] add support for show pages(closes )
Sergey M․ 3961c6cb9d
[YoutubeDL] Add support for playlist_uploader and playlist_uploader_id in output template (closes , )
Sergey M․ 07aeced68e
[youtube] Extract uploader, uploader_id and uploader_url for playlists (, )
Sergey M․ c10c93238e
[extractor/common] Introduce uploader, uploader_id and uploader_url meta fields for playlists (, )
Sergey M․ 4a109f81bc
[afreecatv] Improve format extraction (closes )
Sergey M․ 99081da90c
[downloader/fragment] Encode filename of fragment being removed (closes )
Remita Amine 7e81010987 [cspan] add support for audio only pages and catch page errors(closes )
Sergey M․ 549bb416f5
[mailru] Fix issues and improve (closes )
Hongjie Dong 25475dfab3
[mailru] Add support for embed URLs
Remita Amine 3dfa9ec213 [crunchyroll] Future-proof XML element checks(closes )
Sergey M․ 06dbcd7be4
[cbslocal] Fix timestamp extraction (closes , closes )
Sergey M․ b555ae9bf1
[utils] Add another date format pattern ()
Remita Amine c402e7f3a0 [discoverygo] correct ttml subtitle extension
Sergey M․ 498a8a4ca5
[vk] Make view count optional (closes )
Remita Amine d05ba4b89e [disney] skip Apple FairPlay formats()
Remita Amine 23f511f5c7 [voot] sort formats
Remita Amine 1c4804ef9b [voot] fix format extraction(closes )
Sergey M․ 8ff2b16435
release 2017.12.14
Sergey M․ 3fae11ac00
[itv] Improve extraction, extract more subtitles and duration (closes )
Sergey M․ 7974e289a1
[postprocessor/xattr] Clarify NO_SPACE message ()
Remita Amine 6bf9c28b0a [byutv] add support for geo restricted videos
Sergey M․ bec49996c6
[downloader/http] Return actual download result (closes )
Sergey M․ c8be7d5f74
[byutv] Fix extraction (closes , closes )
Remita Amine 15960255fe [tbs] fix typo
Remita Amine 6b2d8c9182 [bbc.co.uk] fix extraction for 320k m3u8 streams
broken since 197224b7a4
Remita Amine e6b8803d59 [toutv] add support special video urls(closes )
Remita Amine cb0c2310fb [discovery] fix free videos extraction()()
Remita Amine 23b6e23002 [tvnow] fix extraction(closes )
Remita Amine 127e98d31d [nickelodeon:br] correct extractor name
Remita Amine e4f201bc1b [extractors] add import for NickBrIE
Remita Amine 08d77a95c9 [nickelodeon:br] add support for Nickelodeon(Brazil) websites(closes )
Remita Amine 5868079e99 [nick.com] improve extraction(fixes )
Remita Amine b6f78d76c1 [tbs] fix extraction(fixes )
sprhawk 0c69958844 add other properties; remove print verbose
sprhawk 3281af3464 a working version
sprhawk 29ac31afaf simply get the correct webpage, but not parsed to extract information
Sergey M․ 1fa0dce2c0
release 2017.12.10
Sergey M․ c38970ca10
[culturebox] Improve video id extraction (closes )
Remita Amine 51f2863357 [twitter] improve extraction(closes )
Sergey M․ 913b61eeee
[udemy] Extract more HLS formats
Sergey M․ 6f1ec339a0
[udemy] Improve course id extraction (closes )
Sergey M․ a3de5e6c0e
[stretchinternet] Fix issues and improve (closes )
Andrew Bottom f4cc03d60b
[stretchinternet] Add extractor
Sergey M․ 2a57b62b80
[ellentube] Fix issues, improve and simplify (closes )
Alex Seiler e2707a832c
[ellentube] Fix extraction (closes )
Sergey M․ 1115271ac6
[raiplay:playlist] Fix issues and improve (closes )
Timendum d21d0ba6c1
[raiplay:playlist] Add extractor
Remita Amine 1bd4fc96e6 [sonyliv] extract higher quality formats and bypass geo restriction(closes )
Remita Amine 684ae10236 [fox] add support for adobe pass auth and extract subtitles(close )(closes )
Remita Amine 3c4fbfeca2 [dailymotion] remove dailymotion cloud extractor(closes )
https://web.archive.org/web/20160312110217/https://www.dmcloud.net/
Windom b271e33526 [xhamster] Add support for mobile URLs and fix thumbnail extraction
Sergey M․ d3f8b76b69
[extractor/generic] Fix typo (closes )
Don't pass video_id as mpd_id