Mirroring
/
yt-dlc
mirror of https://github.com/blackjack4494/yt-dlc
1
0
Fork 0
Code Issues Releases Wiki Activity
15,501 Commits
3 Branches
6 Tags
48 MiB
Commit Graph

13339 Commits (a9ee4f6e49a5910b432d0ba4d8dc60231aa7deba)

Author SHA1 Message Date
Yen Chi Hsuan 01cb57016f
[iqiyi] Fix extraction of Yule videos
Tithen-Firion 40e41780f1 [phantomjs] add cookie support
Tithen-Firion da57ebaf84 [openload] separate PhantomJS code from extractor
Sergey M․ 290f64dbaa
[downloader/fragment] Improve .ytdl format and start documenting
Sergey M․ adb4b03cd5
[downloader/fragment] Don't process ytdl file when it's not needed yet
Sergey M․ 0eee52f34b
Introduce --keep-fragments
Sergey M․ d3f0687cf7
[downloader/fragment] Use temp file for current fragment
Sergey M․ a4d6cf970c
[YoutubeDL] Fix output template for missing timestamp (closes )
Sergey M․ 3019cb0c99
[extractor/common] Rephrase comment
Sergey M․ ddd258f922
[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag
Sergey M․ 07ad0cf34f
[vidio] Improve and sort formats
Sergey M․ 9c99bef704
[extractor/common] Use float for scaled tbr
Remita Amine ffbc8386b9 [brightcove] match only video elements with data-video-id attribute
Remita Amine 4abdba643c [downloader/fragment] remove unused code
Remita Amine 3e0304fe6e [downloader/fragment] use the documented names for fragment progress_hooks fields
Yen Chi Hsuan fbf56be213
[iqiyi] Fix playlist detection ()
Yen Chi Hsuan 54f54fcca7
[socks] Report errors elegantly when credentails are required but missing 
In some non-standard implementations, the server may respond AUTH_USER_PASS
even if's not listed in available authentication methods. (it should
respond AUTH_NO_ACCEPTABLE per standards)
Yen Chi Hsuan facfd79f9a
[azubu] Remove extractor as the site is gone (closes )
Yen Chi Hsuan 3110bb937d
[porn91] Fix extraction (closes )
Sergey M․ cb2520802d
[extractor/common] Improve m3u8 extraction (closes ) 
* Extract m3u8 parsing to separate method
* Improve rendition groups extraction
* Build stream name according stream GROUP-ID
* Ignore reference to AUDIO group without URI when stream has no CODECS
+ Add test coverage for parsing m3u8 from , ,  and twitch vod
Sergey M․ f779958250
[vidzi] Fix extraction (closes )
Remita Amine 8abc7dca39 [amp] extract error message(closes )
Remita Amine ea0c2f219c [downloader/fragment] use a general file to store fragment download context
Sergey M․ 481ef51e23
[brightcove] PEP 8
Remita Amine 5b995f713b [utils] add support for ttml styles
Remita Amine 75a2485407 [fragment,hls,f4m,dash,ism] improve fragment downloading 
- resume immediately
- no need to concatenate segments and decrypt them on every resume
- no need to save temp files for segments

and for hls downloader:
- no need to download keys for segments that already downloaded
Remita Amine 58f6ab72ed [odnoklassniki] update tests
Sergey M․ 2dc48df5bc
[xfileshare] Add support for gorillavid.com and daclips.com (closes )
Sergey M․ 18848d226a
[instagram] Fix extraction (closes )
Sergey M․ a32a9a7ef5
[extractor/common] Add support multiple getters in try_get
Sergey M․ bae1404893
[extractor/common] Add support for video of WebPage context in _json_ld (closes )
Yen Chi Hsuan 06d0ad9a4e
[brightcove] Support URLs with bcpid instead of playerID 
Fixes
Sergey M․ f631b55791
[brightcove] Fix _extract_url (closes )
Remita Amine bf1b87cd91 [common] Relax JWPlayer regex and remove duplicate urls()
Remita Amine 1c35b3da44 [odnoklassniki] extract m3u8 formats
Sergey M․ 16a09aefe3
release 2017.04.17
Sergey M․ ab87c26009
[extractor/generic] Add test for
Sergey M․ 91bc57e4c5
[limelight] Add support for channels and channels lists embedded using LimelightEmbeddedPlayerFlash ()
Sergey M․ e5d39886ec
[limelight] Improve embeds extraction (closes ) 
* Move extraction code to extractor
* Add extraction for LimelightEmbeddedPlayerFlash embeds
* Extract multiple video
Sergey M․ 751c89a27d
[itv] Extract series metadata
Sergey M․ c2d7d76efd
[itv] Fix rtmp formats ()
Sergey M․ f67177cae8
[itv] Use native hls
Sergey M․ 5935ef3c5d
[itv] Lower preference for rtmp formats (closes )
Tithen-Firion 47e0cef46e [openload] rewrite extractor
remitamine 72950c4dce Merge pull request from triple-j/go90_improvements_pull_request 
[go90] Improve extraction
Jeremie J. Jarosh 334f41e0d8 [go90] Improve extraction 
- add metadata for 'series', 'episode', 'season', 'season_id',
  'season_number', and 'episode_number'
- integrate series title into the title
- extract subtitles  (fallback to `vtt` if the subtitle file type
  detection fails as that is the most likely extension)
Sergey M․ 022250a594
release 2017.04.16
Sergey M․ d35dc344af
[YoutubeDL] Apply expand_path after output template substitution 
os.path.expandvars translates '%%' into '%' making output template invalid.
Before: '%%(ext)s' -(expand path)-> '%(ext)s' -(outtmpl subst.)-> 'mp4'
After: '%%(ext)s' -(outtmpl subst.)-> '%(ext)s' -(expand path)-> '%(ext)s'
Sergey M․ 0563f7ac6e
[YoutubeDL] Propagate overridden metadata to IE results of type url (closes )
Sergey M․ 413c1f8e2f
[extractor/generic] Extract RSS entries as url_transparent ()
Sergey M․ 8068296276
[streamango] Improve extraction (closes )
Marvin Ewald 4db79fa1bc
[streamango] Add extractor
Sergey M․ b2a19e3829
[wsj] Improve and modernize (closes )
John Hawkinson 3266d08af2
[wsj:article] Add extractor
Sergey M․ 0254f93b08
[brightcove] Validate ambiguous embeds' URLs (closes , closes , closes , closes )
John Hawkinson 40158f55c9
[brightcove] Relax video tag embeds extraction 
BrightcoveNewIE.extract_urls(): Handle player data when it is all in
attributes of the <video> tag, and also the id is
data-brightcove-video-id not data-video-id.

Add test to generic extractor, note HEAD gives 404, no checksum computed(?).
Sergey M․ 3dfceb286c
[udemy] Add support for react rendition (closes )
Sergey M․ 57e2cb6c3a
[curiositystream] PEP 8
Sergey M․ 6f1b2374af
[canalplus] PEP 8
Sergey M․ d24bd4ffdb
release 2017.04.15
Sergey M․ 34c3bbe1bd
[youku] Keep old fileid extraction code as fallback ()
xuhaomin e5106ba402 [youku] Fix fileid extraction
Sergey M․ 38d2f8325f
release 2017.04.14
Sergey M․ 95728fda70
[aenetworks] Add support for specials (closes )
Remita Amine 3f7409f745 [hbo] extract m3u8 formats
Remita Amine b2fff30817 [go90] Add new extractor(closes )
Remita Amine f59746372a [downloader/hls] add basic support for EXT-X-BYTERANGE tag()
Yen Chi Hsuan 34d98cc411
[tv2hu] Fix invalid escape sequence on Py3.6
Remita Amine 40fcba5edb improve coding style
Remita Amine e4d74e2778 [tv2hu] improve extraction
Vukkk 3ef1d0c733 [tv2hu] Add new extractor
Remita Amine 0ee79a378a [generic] exclude urls with xml ext from valid video urls(closes )(closes )
Remita Amine 79a51069e5 [adobepass] improve comcast and verison login code(closes )
Daniel Twardowski a9a346535b [adobepass] Add Verizon support ()
Remita Amine 89beedd31f [youtube] improve m3u8 format extraction
Sergey M․ e109f1ff43
[afreecatv] Fix extraction for videos with different key layout (closes )
Sergey M․ d23028a8fb
[youtube] Remove explicit preference for audio-only and video-only formats 
In order not to break sorting when new formats appear
Sergey M․ 6214611a4a
[canalplus] Bypass geo restriction
Sergey M․ 1730878167
release 2017.04.11
Sergey M․ 6b9466de2f
[afreecatv] Fix extraction (closes )
John Hawkinson 61568e50cf [generic] Add support for <object> youtube embeds (closes )
Sergey M․ 6240925b40
[bbccouk] Treat bitrate as audio+video bitrate in media selector
Sergey M․ 964744af95
[bbccouk] Skip unrecognized formats in media selector ()
Sergey M․ 1af959ef9f
[bbccouk] Add support for https protocol in media selector (closes )
Remita Amine a206ef62df [curiositystream] fix extraction(closes )
Remita Amine 3f2ce6896a [adn] update subtitle decryption key
Sergey M․ a6f7263cf4
[chaturbate] Fix extraction (closes )
Sergey M․ 4372436504
release 2017.04.09
Sergey M․ 41b263ac8a
[canvas] Add IE_DESC (closes )
Sergey M․ ca8fca9d9d
[vrt] Add IE_DESC (closes )
midas02 e129fa0846 [vier] Add IE_DESC
Sergey M․ 2bd875edfe
[medici] Add extractor (closes )
Steven Maude 95152630db [rbmaradio] Add support for redbullradio.com URLs
Sergey M․ 04e431cf97
[npo:live] Improve (closes )
Aldo Gunsing 1591ba258a
[npo:live] Add support for default url
Sergey M․ 29c6726646
[mixcloud] Fix view count extraction and modernize
Sergey M․ a66e25859a
[mixcloud:playlist] Relax title extraction and fix description extraction (closes )
Kfir Breger c93c0fc2fd
[mixcloud:playlist] Fix title extraction
Sergey M․ 90e3f18fc1
[thesun] Extract playlists (closes , closes )
Entropy 5f3e0b69ef
[TheSun] Add new extractor
Sergey M․ 28b674ca23
[ceskateleveize:porady] Add extractor (closes , closes )
Sergey M․ e18f1da97a
[ceskateleveize] Improve extraction and remove URL replacement hacks
Sergey M․ 78280352ca
[kaltura] Cleanup regexes from redundant escaping
John Hawkinson a01825a541 [kaltura] Add support for iframe embeds
Sergey M․ f8f2da25ab
[wshh] Extract html5 entries and delegate to generic extractor (closes )
Yen Chi Hsuan 4c03973296
[airmozilla] Fix extraction (closes )
Sergey M․ 1b3feca0a7
[raiplay] Extract subtitles
Sergey M․ 3461f5db06
[xfileshare] Add support for vidlo.us (closes )
Sergey M․ 0378b8b917
[xfileshare] Add support for vidbom.com (closes )
Sergey M․ 7f04386b89
[aenetworks] Add more video URL regexes (closes )
Remita Amine fac39cccd4 [odnoklassniki] fix format sorting for 1080p quality
Remita Amine b68e00b08a [rtl2] add support for you.rtl2.de(closes )
Sergey M․ 2ab0bfcd81
[vshare] Add extractor (closes )
Sergey M․ b022f4f600
release 2017.04.03
Remita Amine a9bb61a425 [discoveryvr] Add new extractor(closes )
Remita Amine dbf70c489f [tv5mondeplus] clean description and use stable id
Remita Amine 61e2331ad8 [tv5mondeplus] Add new extractor(closes )
Sergey M․ fd47550885
[extractor/common] Add coding cookie
Sergey M․ 4457823dda
[extractor/common] Move censorship checks to a separate method and add check for just another ISP
Sergey M․ b3633fa0ce
[pericope] Add support for pscp.tv URLs
Sergey M․ b56e41a701
release 2017.04.02
Sergey M․ 361f293ab8
[rai] Skip not found content item id
Sergey M․ b8d8cced9b
[rai] Improve extraction (closes ) 
* Fix georestriction detection
* Detect live streams
+ Extract relinker metadata
* Improve ContentItem detection
+ Extract series metadata
* Fix tests
Timendum 51342717cd
[rai] Fix extraction
Remita Amine 48ab554feb [vrv] add support for series pages
Remita Amine a6f3a162f3 [limelight] improve extraction for audio only formats
Remita Amine 91399b2fcc [funimation] fix extraction(closes )()
Sergey M․ eecea00d36
[xfileshare] Add support for vidabc.com (closes )
Sergey M․ 2cd668ee59
[xfileshare] Improve extraction and extract hls formats
Remita Amine ca77b92f94 [crunchyroll] pass geo verifcation proxy
Remita Amine e97fc8d6b8 [cwtv] extract ISM formats
Remita Amine be61efdf17 [tvplay] Bypass geo restriction
Remita Amine 77c8ebe631 [vrv] Add new extractor
Sergey M․ 7453999580
[packtpub] Add extractor (closes )
Sergey M․ 1640eb0961
[YoutubeDL] Return early when extraction of url_transparent fails
Remita Amine 3e943cfe09 [generic] pass base_url to _parse_jwplayer_data
Remita Amine 82be732b17 [adn] Add new extractor
Sergey M․ 639e5b2a84
[allocine] Extract more metadata
plroman 128244657b [allocine] Fix extraction
Sergey M․ 12ee65ea0d
[options] Mention ISM for --fragment-retries and --skip-unavailable-fragments
Tithen-Firion aea1dccbd0 [openload] fix extractor
Sergey M․ 9e691da067
release 2017.03.26
Yen Chi Hsuan cc63259d18 Merge pull request from rndusr/fix/str-item-assignment 
Fix "'str' object does not support item assignment"
Remita Amine 2bfaf89b6c [downloader/hls] move check for m3u8 live streams to get_suitable_downloader
Random User 4f06c1c9fc Merge branch 'master' of github.com-rndusr:rg3/youtube-dl into fix/str-item-assignment
Sergey M․ d212c93d16
[pluralsight] PEP 8
Sergey M․ 15495cf3e5
[franceculture] PEP 8
Sergey M․ 5b7cc56b05
[atresplayer] PEP 8
Sergey M․ 590bc6f6a1
Use expand_path where appropriate (closes )
Sergey M․ 51098426b8
[utils] Introduce expand_path
Random User c73e330e7a _find_jwplayer_data() returns dict or None 
This simplifies code for callers of `_find_jwplayer_data()` which no longer have
to run `_parse_json()` on the return value.

It also makes sure that `_find_jwplayer_data()` returns either a `dict` or
`None` and nothing else.
Remita Amine fb4fc44928 [downloader/hls] immediately delegate downloading to ffmpeg in case live stream
Random User 03486dbb01 Add test for JWPlayer where config is passed as variable
Yen Chi Hsuan 51ef4919df
[afreecatv] Fix extraction (closes )
Remita Amine d66d43c554 [atvat] Add new extractor(closes )
Sergey M․ 610a6d1053
[atresplayer] Do not extract ISM formats 
As per @remitamine: the ISM downloader does not support videos served from wowza servers(it will produce broken files)
Remita Amine d97729c83a [fox] remove unused import
gkoelln 7aa0ee321b [fox] Add metadata extraction 
Add series, season number, episode number and episode.
John Hawkinson e8e4cc5a6a
[generic] Replace LazyYT test with skiplagged 
discourse.ubuntu.com has gone away, repalce with skiplagged.com.
Be nice to have a non-frontpage URL that might be more stable,
though I don't have one. Maybe this should move to html
in test/test_InfoExtractor.py?
Sergey M․ c7301e677b
[atresplayer] Extract DASH and ISM formats
zurfyx 048086920b
[atresplayer] Extract HD manifest
zurfyx 1088d76da6
[atresplayer] Fix login error detection
Remita Amine 31a1214076 [franceculture] fix extraction(closes )
Sergey M․ d0ba55871e
[youtube] Improve _VALID_URLs (closes )
Sergey M․ 54b960f340
[generic] Do not follow redirects to the same URL
Sergey M․ a3ccd6bd11
release 2017.03.24
Sergey M․ bea7af6947
[channel9] Remove expired comment and sort imports
Sergey M․ a5d783f525
[channel9] Extract more formats
Remita Amine d0572557c2 [ninecninemedia] remove mp4 url extraction request
Remita Amine 52d5ecabd5 [bellmedia] add support for etalk.ca(closes )
Remita Amine b0f7f21cb9 [channel9] fix extraction(closes )
Sergey M․ 579c99a284
[cloudy] Fix extraction (closes )
Remita Amine ca5ed022e9 [hbo] add support for free episode urls and new formats extraction(closes )
Sergey M․ 391d076d7c
[condenast] Fix extraction and style (closes )
Sergey M․ c183e14f89
[viu] Relax _VALID_URL (closes )
Sergey M․ 093dad9e25
release 2017.03.22
Sergey M․ 8e5a7c5e67
[pluralsight] Omit module title from video title (closes )
Sergey M․ e1e35d1ac6
[pornhub] Improve extraction and style (closes )
Throaway 21fbf0f955
[pornhub] Decode obfuscated video URL (closes )
John Hawkinson 97952bdb78 [generic] Add test for Senate ISVP iframe embed
John Hawkinson 8a8cc339b6 [senateisvp] Allow https URL scheme for embeds
Vijay Singh 957f453429 [Openload.co] Fixed Extraction 
They did it again. just a minor change though. here's quick fix
Sergey M․ 0e9a73e612
release 2017.03.20
Sergey M․ 9487ce03e9
[YoutubeDL] Allow multiple input URLs to be used with stdout as output template
John Hawkinson 46b18f2349 [BostonGlobe] New. Nonstandard version of Brightcove. 
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.

Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.

History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
Remita Amine 772b5ff57f [toongoggles] Add new extractor(closes )
Sergey M․ f68ef1e2ab
[medialaan] Remove unrelated test
Sergey M․ febfe1e262
[adobepass] Detect and output error on authz token extraction ()
Vijay Singh 5f0daab1ca [openload] Fix extraction
Sergey M․ 2a721cdff2
[medialaan] Fix and improve extraction (closes )
mrBliss e7a51a4c02
[vtm] Add extractor (closes ) 
Implementation of the approach described in .
Remita Amine 3e5856d860 [discoverynetworks] add support for more domains and bypass geo restiction
Yen Chi Hsuan ea883a687c
[openload] Fix extraction (closes ) 
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
Sergey M․ 7d539ee10a
release 2017.03.16
Philipp Hagemeister 0efbc6b56d [options] Mention flac support and sort alphabetically among the audio formats
Philipp Hagemeister 21bfcd3d6e [postprocessor/ffmpeg] Add support for flac 
Requested at http://stackoverflow.com/q/42828041/35070
Sergey M․ b51dc9db0e
[extractor/common] Extract SMIL formats from jwplayer
Sergey M․ a309684285
[extractor/generic] Add forgotten return for jwplayer formats
Remita Amine ba448445b8 [redbull] improve extraction 
- extract 1080p quality
- correct ttml subtitle ext
- catch api errors
- reduce request size
Sergey M․ 5db83d79bf
release 2017.03.15
Vijay Singh 398887b4c0 [Openload] Fixed Extraction 
They did changed it again.
Sergey M․ 66bf351f80
[facebook] Make title optional (closes )
Sergey M․ 9d08963022
[telecinco] Add test for
Sergey M․ e313d209c2
[mitele] Add support for ooyala videos (closes )
Vijay Singh ff9d509d20 [openload] Fix extraction 
Just a minor fix for openload
Lucas M c1795ca6c8 [streamable] Update API URL
Starsam80 8c99623259 [crunchyroll] Extract season name
Sergey M․ 57b0ddb35f
[discoverygo] Actualize test
Sergey M․ a28f8d7396
[discoverygo] Bypass geo restriction
Sergey M․ 7049799470
[discoverygo:playlist] Add extractor (closes )
Yen Chi Hsuan 4605c94d1a
[__init__] Fix missing subtitles if --add-metadata is used () 
The previous fix for  is incorrect
Sergey M․ a8e687a4da
release 2017.03.10
Sergey M․ c2ee861c6d
[extractor/generic] Make title optional for jwplayer embeds (closes )
Sergey M․ bd34c32bd7
[wdr] Actualize comment
runningbits f802c48660 [wdr:maus] Fix extraction and update tests
Sergey M․ 76bee08fe7
[prosiebensat1] Improve title extraction and add test
Thomas Christlieb 2913821723 [prosiebensat1] Improve title extraction (closes )
Sergey M․ 0e7f9a9b48
[dplayit] Relax playback info URL extraction
Sergey M․ 0cf2352e85
[dplayit] Separate and rewrite extractor and bypass geo restriction (closes )
Yen Chi Hsuan 0f6b87d067
[miomio] Fix extraction 
Closes 
Closes 
Closes
Sergey M․ d7344d33b1
[telequebec] Fix description extraction and update test (closes )
denneboomyo b08cc749d6 [openload] Fix extraction
Sergey M․ b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer
Sergey M․ 2e76bdc850
[brightcove:legacy] Relax videoPlayer validation check (closes )
Yen Chi Hsuan fe646a2f10
[twitch] PEP8
Sergey M․ dccd0ab35d
release 2017.03.07
Sergey M․ e30ccf7047
[soundcloud] Update client id (closes )
Yen Chi Hsuan 54a3a8827b
[__init__] Metadata should be added after conversion 
Fixes
denneboomyo da92da4b88 Openload fix extraction () 
* Fix extraction
Sergey M․ 1664702626
release 2017.03.06
Sergey M․ 4b5de77bdb
[utils] Process bytestrings in urljoin (closes )
Sergey M․ 96182695e4
[drtv] Add geo countries to GeoRestrictedError
Sergey M․ fc11ad3833
[drtv:live] Bypass geo restriction
Yen Chi Hsuan d2b64e04b4
[addanime] Skip an invalid test
Sergey M․ 5dd376345b
[tunepk] Add extractor (closes , closes )
Sergey M․ 1a2192cb90
[extractor/common] Pass arguments to _parse_jwplayer_formats and PEP8
Sergey M․ 0236cd0dfd
[extractor/common] Improve height extraction and extract bitrate
Sergey M․ ed0cf9b383
[extractor/common] Move jwplayer formats extraction in separate method
Sergey M․ a50862b735
[downloader/external] Add missing import and PEP8
John Hawkinson 6d0fe752bf [external:ffmpeg] In test harness, limit to 10k download size 
Otherwise, if you screw up a playlist test by including a playlist
dictionary key, you'll be there for eons while it downloads all the
files before erroring out.
Sergey M․ afa4597618
release 2017.03.05
Sergey M․ 5316566edc
[twitch] Use better naming and simplify (closes )
Xiao Di Guan c64c03be35
[twitch] Add basic support for two-factor authentication
Lars Vierbergen a3ba8a7acf [vier] Add support for vijf.be 
vier.be and vijf.be run on the same CMS and are property of the same company,
so the same extractor can be used for both of them.
Sergey M․ 054a587de8
[redbulltv] Improve extraction (closes , closes )
Juanjo Benages 64b7ccef3e
[redbulltv] Add extractor
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation 
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes
Sergey M․ eb3079b6ce
[generic] Add support for rutube embeds
Sergey M․ bc82f22879
[rutube] Relax _VALID_URL
Sergey M․ 4d058c9862
[vrak] Improve and update test (closes )
Sergey M․ d16f27ca27
[brightcove:new] Add ability to smuggle geo_countries into URL
Olivier Bilodeau cbb127568a
[vrak] Add extractor
Sergey M․ d02d4fa0a9
[brightcove:new] Raise GeoRestrictedError
Sergey M․ 692fa200ca
[go] Relax _VALID_URL (closes )
Sergey M․ 9bae185ba6
[24video] Use original host for requests (closes )
Sergey M․ 4d345bf17b
[ruutu] Disable DASH formats (closes ) 
Due to causing out of sync issue
Sergey M․ 250eea6821
release 2017.03.02
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes ) 
Almost all videos now use the pagelet type 'permalink_video_pagelet'
Yen Chi Hsuan c9612c0487
[youtube] Mark errors about rental videos as expected 
Closes
Yen Chi Hsuan af5049f128
[adobepass] Add Charter Spectrum () 
Thanks @tv21 for the fix!
Sergey M․ 158af5242e
[utils] Carry long doc string
Sergey M․ 40df485f55
[YoutubeDL] Don't sanitize identifiers (closes )
Sergey M․ 4b8a984c67
[npo] Add support for audio
Sergey M․ 83e8fce628
[npo] Improve extraction and update tests
Sergey M․ aa9cc2ecbf
[npo] Adapt to app.php API (closes )
Sergey M․ 1dc24093f8
release 2017.02.28
Sergey M․ 43b38424a9
[azmedien:showplaylist] Improve (closes )
Alex Seiler 948519b35d
[azmedien:showplaylist] Add support for all episodes playlists
Sergey M․ 87dadd456a
[youtube:playlist] Recognize another playlist pattern (closes , closes )
Yen Chi Hsuan 7c4aa6fd6f
[daisuki] Add subtitles ()
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes )
Yen Chi Hsuan 0a5445ddbe [utils] Add bytes_to_long() and long_to_bytes() 
Used in daisuki.net ()

Both are adapted from public domain PyCrypto:
https://github.com/dlitz/pycrypto/blob/master/lib/Crypto/Util/number.py
Yen Chi Hsuan f48409c7ac [utils] Add pkcs1pad 
Used in daisuki.net ()
Yen Chi Hsuan c9619f0a17 [aes] Add aes_cbc_encrypt 
Used in daisuki.net ()
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS 
They've switched from flv to hls

Closes
Sergey M․ ef48a1175d
release 2017.02.27
Sergey M․ 18abb74376
[npo] Relax _VALID_URL for zapp.nl
Sergey M․ dbc01fdb6f
[hetklokhuis] Fix IE_NAME
Sergey M․ f264c62334
[npo] Add support for zapp.nl
Sergey M․ 0dc5a86a32
[npo] Add support for hetklokhuis.nl (closes )
Sergey M․ 0e879f432a
[youtube:channel] Remove duplicate test
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor () 
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
Alex Seiler fdeea72611 [cda] Decode URL (fixes )
xbe 7fd4655256 [crunchyroll] Extract uploader name that's not a link 
Provide the Crunchyroll extractor with the ability to extract uploader
names that aren't links. Add a test for this new functionality.
This fixes .
Sergey M․ fd5c4aab59
[youtube] Raise GeoRestrictedError
Sergey M․ 8878789f11
[dailymotion] Raise GeoRestrictedError
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS 
Ref:
Sergey M․ b3aec47665
[tvigle] Raise GeoRestrictedError
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes )
Sergey M․ e498758b9c
[freshlive] Fix issues and improve (closes )
Ricardo Constantino 5fc8d89361
[freshlive] Add extractor
Pratyush Singh d374d943f3
[downloader/common] Limit displaying 2 digits after decimal point in sleep interval message
Sergey M․ 103f8c8d36
[xhamster] Capture and output videoClosed error ()
Sergey M․ 922ab7840b
[etonline] Add extractor (closes )
Sergey M․ 831217291a
[compat] Use try except for compat_numeric_types
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes )
Yen Chi Hsuan eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries 
Some websites, like NJPWorld, put different qualities on different
player pages.
Sergey M․ 231bcd0b6b
[amcnetworks] Relax _VALID_URL ()
Sergey M․ 204efc8509
release 2017.02.24.1
Sergey M․ ad3033037c
[noco] Modernize
Sergey M․ f3bc281239
[noco] Swtich login URL to https (closes )
Sergey M․ 441d7a32e5
[thescene] Extract more metadata
Thomas Christlieb 51ed496307 [thescene] Fix extraction (closes )
Remita Amine 68f17a9c2d [tubitv] use geo bypass mechanism
Remita Amine 39e7277ed1 [openload] fix extraction(closes )
Sergey M․ 42dcdbe11c
[ivi] Raise GeoRestrictedError
Sergey M․ 6b097cff27
release 2017.02.24
Sergey M․ be5df5ee31
Suppress help for all deprecated options and print warning when used
Sergey M․ f2980fddeb
[lynda:course] Add webpage extraction fallback (closes )
Sergey M․ 0f57447de7
[postprocessor/ffmpeg] Add mising space (closes )
Remita Amine 8e1409fd80 [go] sign all uplynk urls and use geo bypass only for free videos(closes )(closes )
Sergey M․ fafc2bf5a9
[options] Deprecate --autonumber-size
Sergey M․ b3175982c3
[YoutubeDL] Add more numeric fields for NA substitution in outtmpl
Sergey M․ 89db639dfe
[YoutubeDL] Rewrite outtmpl for playlist_index and autonumber for backward compatibility
Sergey M․ d0d9ade486 [YoutubeDL] Add support for string formatting operations in output template
Sergey M․ 28572a1a0b [compat] Add compat_numeric_types
Sergey M․ d5fd9a3be3
[skylinewebcams] Add extractor (closes )
Sergey M․ ada77fa544
[instagram] Add support for multi video posts (closes )
Remita Amine 9e03aa75c7 [crunchyroll] extract playlist entries ids
Remita Amine 30eaa3a702 [mgtv] fix extraction
Remita Amine c59f703610 [sohu] raise GeoRestrictedError
Remita Amine bc61c80c14 [leeco] raise GeoRestrictedError and use geo bypass mechanism
Sergey M․ 345b24538b
release 2017.02.22
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes )
Sergey M․ 527ef85fe9
[dailymotion] Make comment count optional (closes ) 
Not served anymore
Sergey M․ 58ad6995cd
[vidzi] Add test for
Tobias Florek a86e416088 [vidzi] Add support for vidzi.cc
Sergey M․ 71e9577b94
[24video] Add support for 24video.tube (closes )
Remita Amine abd29a2ced [crackle] use geo bypass mechanism
Remita Amine 31615ac279 [viewster] use geo verifcation headers
Remita Amine fc320a40d9 Revert "[cbc] use geo bypass mechanism" 
This reverts commit 86466a8b6f.
Remita Amine 7345d6d465 [tfo] Improve geo restriction detection and use geo bypass mechanism
Remita Amine 86466a8b6f [cbc] use geo bypass mechanism
Remita Amine 33dc173cdc [telequebec] use geo bypass mechanism
Remita Amine 3444844b04 [limelight] extract PlaylistService errors
Sergey M․ 8c6c88c7da
release 2017.02.21
Sergey M․ eea0716cae
[extractor/common] Print origin country for fake IP
Sergey M․ 336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries
Sergey M․ dc0a869e5e
[extractor/common] Fix typo
Sergey M․ e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors ()
Remita Amine e469ab2528 [ninecninemedia] use geo bypass mechanism
Remita Amine 890d44b005 [adobepass] add support for Time Warner Cable(closes )
Sergey M․ 6926304472
[spankbang] Make uploader optional (closes )
Sergey M․ 3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental
Sergey M․ da42ff0668
[iprima] Improve geo restriction detection and disable geo bypass
Sergey M․ 82f662182b
[iprima] Modernize
Sergey M․ 2cc7fcd338
[commonmistakes] Disable UnicodeBOM extractor test for python 3.2
Sergey M․ 6d4c259765
[svt] PEP 8
Sergey M․ c78dd35491
[nrk] PEP 8
Sergey M․ 8ffb8e63fe
[prosiebensat1] Throw ExtractionError on unsupported page type (closes )
Sergey M․ 983e9b7746
[nrk] Update _API_HOST and relax _VALID_URL
Sergey M․ c58b7ffef4
[tv4] Bypass geo restriction and improve detection
Sergey M․ f1a78ee4ef
[tv4] Switch to hls3 protocol (closes )
Sergey M․ de64e23c56
[downloader/ism] Honor HTTP headers when downloading fragments
Sergey M․ 553f6dbac7
[downloader/dash] Honor HTTP headers when downloading fragments 
For example, https://www.oppetarkiv.se/video/1196142/natten-ar-dagens-mor
Sergey M․ 0aa10994f4 [options] Move geo restriction related options to separate section
Sergey M․ 4248dad92b Improve geo bypass mechanism 
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
Sergey M․ 0a840f584c Rename bypass geo restriction options
Sergey M․ 0016b84e16 Add faked X-Forwarded-For to formats' HTTP headers
Sergey M․ 18a0defab0 [utils] Make random_ipv4 return unicode string
Sergey M․ 5d3fbf77d9 [viki] Improve geo restriction detection
Sergey M․ 80b59020e0 [vgtv] Improve geo restriction detection
Sergey M․ 71631862f4 [srgssr] Improve geo restriction detection
Sergey M․ 89cc7fe770 [vbox7] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ 04d906eae3 [svt] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ 8ab8066cf0 [pbs] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ 01b1aa9ff4 [ondemandkorea] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ ff4007891f [nrk] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ 28200e654b [itv] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ e633f21a96 [go] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ d392005a79 [dramafever] Improve geo restriction detection and use geo bypass mechanism
Sergey M․ 773f291dcb Add experimental geo restriction bypass mechanism 
Based on faking X-Forwarded-For HTTP header
Pierre Mdawar bf5b9d859a [utils] Introduce YoutubeDLError base class for all youtube-dl exceptions
Remita Amine 049a0f4d6d [brightcove:legacy] restrict videoPlayer value(closes )
Sergey M․ ac33accd96
[options] Mention quoted string literals for --match-filter
Sergey M․ e84888b432
[tvn24] Improve extraction (closes )
Jakub Wilk 02d9b82a23
[tvn24] Add extractor
Sergey M․ a2e3286676
[thisav] Add support for html5 media (closes )
Sergey M․ f75caf059e
[metacafe] Improve (closes )
Alex Monk bdabbc220c
[metacafe] Bypass family filter 
If you don't send this user=ffilter: false cookie, it will 301 redirect you to a page asking about it, and then the title check will fail.
Remita Amine 70bcc444a9 [viceland] improve info extraction and update test
Sergey M․ 28e35f5070
release 2017.02.17
Sergey M․ 2c1f442c2b
[options] Add missing spaces
Sergey M․ bad4ccdb5d
[heise] Improve (closes )
Tobias Gruetzmacher db76c30c6e
[heise] Support videos embedded in any article.
Déstin Reed c2bde5d081
[ellentv] Improve
Sergey M․ 90fad0e74c
[openload] Fix extraction (closes )
Vijay Singh d94badc755
[openload] Semifix extraction (closes ) 
just updated the code. i don't do much python still i tried to convert my code. lemme know if there is any prob with it
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes )
Sergey M․ 4cead6a614
[einthusan] Relax _VALID_URL (closes , closes )
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes )
Sergey M․ b898f0a173
[elpais] Fix typo and improve extraction (closes )
Sergey M․ 2480b056c1
release 2017.02.16
Sergey M․ eafaeb226a
[ceskatelevize] Lower priority for audio description sources ()
Sergey M․ de4d378c0c
[ceskatelevize] Prefix format ids
Sergey M․ db13c16ef8
[utils] Add support for quoted string literals in --match-filter (closes , closes , closes )
Remita Amine 1bd05345ea [amcnetworks] fix extraction(closes )
Sergey M․ 3021cf83b7
[pinkbike] Fix uploader extraction (closes )
Sergey M․ 04a741232f
[onetpl] Add support for businessinsider.com.pl and plejada.pl
Sergey M․ 43a3d9edfc
[onetpl] Add support for onet.pl (closes )
Sergey M․ d31aa74fdb
[onetmvp] Add shortcut extractor
Sergey M․ 6092ccd058
[vodpl] Make more robust and add another test (closes )
Marek Rusinowski 22ce9ad2bd
[vod.pl] Add new extractor
Sergey M․ 9a372f14b4
[pornhub] Extract video URL from tv platform site (, )
Sergey M․ 5cb2d36c82
[ceskatelevize] Extract DASH formats (closes , closes )
Ondřej Caletka fcca0d53a8
[ceskatelevize] Quick fix to revert to using old HLS-based playlist 
This fixes recent changes in iVysilani. Proper patch should migrate to
MPEG-DASH version, which is now the default.
Sergey M․ 58a65ba852
release 2017.02.14
Sergey M․ 50de3dbad3
[zdf] Fix extraction (closes )
Sergey M․ 085f169ffe
[xtube] Fix extraction for both kinds of video id (closes )
Vobe f6d6ca1db3
[xtube] Improve title extraction
Sergey M․ 6e5956e6ba
[lemonde] Fallback delegate extraction to generic extractor (closes , closes )
Remita Amine 89c6691f9d [bellmedia] accept longer video id(closes )
Remita Amine 454e5cdb17 [limelight] add support referer protected videos
Remita Amine 9dad941853 [disney] improve extraction 
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos

closes 
closes 
closes 
closes
Remita Amine 0dac7cbb09 [hotstar] improve extraction(closes ) 
- extract all qualities
- detect drm protected videos
- extract more metadata
Yen Chi Hsuan f8514630db
[einthusan] Fix extraction (closes ) 
The old test URLs are no longer valid, so I replace them with the one
from
Aniruddh-J 459818e280 [aenetworks] Add support for lifetimemovieclub.com
Sergey M․ 6310acf512
[youtube] Fix parsing codecs (closes )
Yen Chi Hsuan f3915452de Merge pull request from wiiaboo/python2 
utils.py: Workaround TypeError with Python 2.7.13 in Windows
Ricardo Constantino 2f49bcd690
utils.py: Workaround TypeError with Python 2.7.13 in Windows 
Fixes 

Tested with Windows Python 2.7.12 and 2.7.13.
Yen Chi Hsuan 68c22c4c15
[iqiyi] Update _TESTS
Sergey M․ 9b92a5917b
release 2017.02.11
Sergey M․ 3d7e3aaa0e
[pluralsight:course] Fix extraction (closes )
Sergey M․ 624c4b92ff
[facebook] Add coding cookie
Thomas Christlieb 2af12ad9d2 Introduce get_elements_by_class and get_elements_by_attribute utility functions
Remita Amine 97eb9bd2ac [bbc] extract m3u8 formats with 320k audio
Sergey M․ 71cdd75628
[facebook] Relax video id matching (closes , closes , closes )
Remita Amine c7d6f614f3 [corus] Add new extractor(closes )()
Remita Amine 08a00eef79 [extractor/common] skip m3u8 manifests protected with Adobe Flash Access
Sergey M․ 9dd5408c99
[pluralsight] Detect blocked account error message ()
Sergey M․ 9510709575
[bloomberg] Add another video id regex (closes )
Remita Amine 5abcca9060 [sixplay] use raw string for regex
Sergey M․ e01bfc19c3
[extractor/commonmistakes] Restrict _VALID_URL (closes )
Remita Amine 4d32b63851 [tvplayer] Add new extractor
Sergey M․ 55d4de2283
release 2017.02.10
Sergey M․ ff24261ba0
[kaltura] Add explicit port to regexes 
They should not match e.g. cdnapi.kaltura.computernetworks.com/...
Sergey M․ fbc6dc525e
[xtube] Fix shortcuts
Sergey M․ 9150d1eb69
[xtube] Fix extraction (closes )
Sergey M․ b7f9843bec
[pornhub] Simplify (closes )
Thomas Christlieb e64b0fca14
[pornhub] Fix extraction (closes )
Sergey M․ 78ef214d2d
[facebook] Improve JS data regex (closes )
Remita Amine be670b8e8f [external:ffmpeg] do not assume that ffmpeg unknown version format is new
Remita Amine 37084f6641 [kaltura] improve embed partner id extraction(fixes )
Remita Amine b04975733c [sprout] Add new extractor
Remita Amine c8b8fb0a99 [sixplay] improve extraction 
- skip drm protected formats
- extract more and better formats
- skip duplicate asset urls
Remita Amine 8298018273 [scrippsnetworks:watch] Add new extractor(closes )
Remita Amine ae8d5a5c59 [go] add support for adobe pass auth(closes )(closes )
Sergey M․ b9c9cb5f79
[6play] Fix extraction (closes )
Remita Amine fdf9b959bc [nbc] add support adobe pass auth(closes )
Sergey M․ 013877298d
release 2017.02.07
Sergey M․ f28aeff264
[pornhub] Fix extraction (closes )
Sergey M․ 242a14a1f6
[extractor/common] Fix audio only with audio group in m3u8 (closes )
Sergey M․ d5d904ff7d
[canalplus] Add support for cstar.fr ()
Sergey M․ 5620f840f6
[extractor/generic] Add test for and more metadata for rtmp
Sergey M․ b7a8c1bcfa
[extractor/generic] Improve rtmp support (closes )
Sergey M․ 7097bffba6
[downloader/fragment] Respect --no-part
Sergey M․ 2aec7256ae
[extractor/common] Speed-up media tags regex (closes )
Yen Chi Hsuan 9c14fe9681
[gaskrank] Minor change and update ChangeLog after
motophil e705755739 [gaskrank] Add new extractor () 
* [gaskrank] Add new extractor

* [gaskrank] Add new extractor - fixes as requested

* [gaskrank] Add new extractor - style fix

* [Gaskrank] Add new extractor - requested fixes

* [Gaskrank] Add new extractor - fix md5 checksum

* [gaskrank] Add new extractor - more requested fixes

* [Gaskrank] Add new extractor - fixed all but one quantified code issues

* [Gaskrank] add new extractor - more fields extracted, added second test

* [Gaskrank] Add new extractor - requested fixes.

* [Gaskrank] Add new extractor - requested changes.

* [Gaskrank] Add new extractor - final(?) fixes.
Yen Chi Hsuan 019f4c0371
[bandcamp] Fix extraction for incomplete albums 
Closes
Yen Chi Hsuan 2ab2c0d1f5
[iwara] Add width (closes ) 
The heuristic is from
Yen Chi Hsuan caf0f5f8b7
[iwara] Fix extraction (closes )
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6 
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
Sergey M․ 6ef3e65a7b
[videopress] Add extractor
Sergey M․ 6fd138bed8
[sportbox] PEP 8
Remita Amine 3d2c2752c5 [afreecatv] extract rtmp formats
Sergey M․ a713a86755
release 2017.02.04.1
Sergey M․ 9db8f6c540
[twitch:stream] Improve _VALID_URL (closes )
Remita Amine 8e4041cf3f [radiocanada] fix extraction for toutv rtmp formats
Sergey M․ 31487eb974
release 2017.02.04
John Hawkinson c2521c1ac6 [Piksel] Add another app token regex
A Connecticut Princess 643dc0fcfe
[vk] Catch author blocked error message 
Example link (video in blocked group):
https://vk.com/search?c%5Bq%5D=%D0%9F%D1%80%D1%8B%D0%B6%D0%BE%D0%BA%20c%20%D0%BA%D1%80%D0%B0%D0%BD%D0%B0%20%D0%B2%20%D1%81%D1%82%D0%B8%D0%BB%D0%B5%20%D0%A7%D0%B5%D0%BB%D0%BE%D0%B2%D0%B5%D0%BA%D0%B0-%D0%BF%D0%B0%D1%83%D0%BA%D0%B0&c%5Bsection%5D=video&c%5Bsort%5D=2&z=video-10639516_456240611
Remita Amine 36fce54816 [turner] fix downloading of secure hls formats using ffmpeg(closes )(closes )(closes )
Remita Amine 2c15db829c [drtv] add support for live and radio sections(closes )(closes )
Remita Amine f65dba7cdb [myspace] fix extraction and extract hls and http formats
Remita Amine 605fd6392f [youtube] add format info for itag 325 and 328
Sergey M․ f962790ee5
[vine] Fix extraction (closes )
Sergey M․ b7cc5f078e
[extractors] Remove remnants of sportbox extractor ()
Sergey M․ f7a10d8cd6
[sportbox] Remove extractor (closes ) 
Covered by generic extractor
Yen Chi Hsuan 8939f784d9 Merge pull request from ThomasChr/randonplaylistorder 
New parameter --playlist-random to randomize playlist download order. Fixes
Remita Amine df0588a31f Merge branch 'fstirlitz-filmon'
Remita Amine 4ce3407d08 [filmon] improve extraction
Mattias Wadman 45024183ae [infoq] Add audio only format if available () 
* [infoq] Add audio only format if available

Refactor cookie code into a function.
Renamed formats to http_video, http_audio, rtmp_video
Renamed extract functions to video instead of videos as they return
one or no video.

* [infoq] Rename to _extract_cookies as it more than one

* [infoq] Remove redundant determine_ext

* [infoq] Add comment about hardcoded URL

* [infoq] Use _hidden_inputs instead of messy regex

* [infoq] Probe if audio URL is valid

Make it possible to pass headers to _is_valid_url

* [infoq] Add audio only test
Justsoos 33da98f493
[douyutv] Improve room id regex 
http://www.douyu.com/t/lpl  source get extra '\' with "room_id\" (from js coding)
Sergey M․ 4195096ea8
[utils] Improve comments processing in js_to_json (closes )
Michal Čihař 0bbcc8a10a
[iprima] Fix extraction (closes , closes )
Michal Čihař b3ee552e4b
[utils] Handle single-line comments in js_to_json
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided 
Closes 

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
Sergey M․ c54c01f82d
[go] Relax video id regex (closes )
Sergey M․ 5a116e1302
[facebook] Fix title extraction (closes )
Sergey M․ a685751051
[youtube:playlist] Recognize TL playlists (closes )
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes ) 
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in :

http://bangumi.bilibili.com/anime/v/40062
Remita Amine 81aeafeb44 [cbc:watch] extract audio codec for audion only formats(fixes )
Remita Amine 8bdc149441 [downloader/external:ffmpeg] minimize the use of aac_adtstoasc filter
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes )
Remita Amine da162c1135 [compat] add compat_etree_register_namespace to __all__ list
Sergey M․ 5069594993
release 2017.02.01
Sergey M․ b83ef507b4
[facebook] Fix extraction (closes )
Yen Chi Hsuan fe5aa197b5
[prosiebensat1] PEP8 and update _TESTS
Thomas Christlieb 7882f1115e Added new Regex for prosiebensat1 Extractor Description. Fixes () 
* Added new Regex for prosiebensat1 Extractor Description. Fixes 

* Using _og_search_description() as a Fallback for Description-Regex

* Using _og_search_description() as a Fallback for Description-Regex - Second try

* Also added fallback regex

* Using _og_search_description() as a Fallback for Description-Regex - Third try

* removed fatal=False from search for description regex. default=None should be preferred only

* Using fatal=false for _og_search_description

* Revert "Using fatal=false for _og_search_description"

This reverts commit 2b7e123f9d0f2bd6ada54fa8e4e6035fece5dbf4.

* Deleted default=None Parameter for _og_search_property
Yen Chi Hsuan 2b2d5d319b
[crunchyroll] Remove ScaledBorderAndShadow settings 
See https://github.com/rg3/youtube-dl/pull/9028, especially @lachs0r's
comments for the reason behind this change
Sergey M․ 26c0f09935
[vimeo] PEP 8
Sergey M․ c15cd29640
[vimeo] Extract upload timestamp
Sergey M․ c38a67bcd5
[vimeo] Extract license (closes )
Sergey M․ 7c5329e6f4
[nrk] Improve extraction and update tests (closes )
Odd Stråbø 8fd65faece
[NRKTV] Added NRKTVSeriesIE 
[NRKTV] Added season and episode number to metadata.

[NRKTV] Added category to metadata.

[NRKTV] Added tests to NRKTVSeries.

[NRKTV] Fixed whitespace issues (flake8).
Sergey M․ d7e215b42d
release 2017.01.31
Sergey M․ 3c90cc8b6f
[youtube] Fix extraction for domainless player URLs 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes 
Closes
Remita Amine ae9a173b64 [vimeo] extract both mixed and separated dash formats
Thomas Christlieb 75822ca790 New parameter --playlist-random to randomize playlist download order. Fixes
Remita Amine dadb836139 [ruutu] extract dash formats
Remita Amine 4719419951 [itv] fix extraction in python 2.6
Remita Amine c2d9c25f81 [compat] add compat_etree_register_namespace
Sergey M․ 4d2fdb07c4
release 2017.01.29
Alex Seiler f13da8af28
[azmedien:playlist] Add support for topic and themen playlists
Sergey M․ e228616c6e
[extractor/common] Fix initialization template (closes , closes )
Sergey M․ c58c2d63cb
[extractor/common] Document forgotten fragment base and path interfaces
Sergey M․ d04621daf4
[extractor/common] Fix duration per dash segment (closes )
Andre Walker 56fc078da8 [npo] Update subtitles url 
NPO websites changed the domain they used for subtitles, from
e.omroep.nl to tt888.omroep.nl.
Sergey M․ 1a241a2d02
[options] Refactor autonumber options and add validation (closes , closes , closes )
Costy Petrisor acbb2374bc
added --autonumber-start NUMBER as a command line option to be able to offset the index at which autonumber formats filenames
Remita Amine 4edeac5bfa [itv] fix subtitle extraction
Remita Amine f592ff9868 [itv] extract subtitles
Sergey M․ 24ee6b9721
[options] Remove experimental mark from some options
Remita Amine a71b8d3b3b [itv] Add new extractor(closes )
Sergey M․ 732fb3f8be
[options] Move --abort-on-unavailable-fragment to download section
Sergey M․ 008f247077
[mtv81] Add extractor (closes )
Sergey M․ 661cc229d2
[vlive:channel] Improve
ping b92d3c5343 [vlive] Add support for channels
Sergey M․ ab6f6aee78
[kaltura] Add fallback for fileExt
Sergey M․ 26e40542dd
[kaltura] Improve uploader_id extraction
Alex Seiler 99a0baf370
[konserthusetplay] Add support for rspoplay.se
Sergey M․ d41ed6d243
release 2017.01.28
Sergey M․ e0b6e50ccd
[crunchyroll] Improve series and season metadata extraction (closes )
Sergey M․ 3a194cb4ec
[soundcloud] Improve formats extraction and extract audio bitrate
Sergey M․ 9b73471801
[soundcloud] Extract hls formats
Sergey M․ 489ffc1182
[soundcloud] Fix track URL extraction (closes )
Sergey M․ 0b23c222ba
[twitch:vod] Expand _VALID_URL (closes )
Remita Amine b51a4ebed4 [aenetworks] fix season episodes extraction(fixes )
Remita Amine 9463637887 [tva] Add new extractor(closes )
Sergey M․ 3cbecdd111
[jamendo] Improve and extract more metadata (closes )
Sergey M․ 15846398ca
[utils] Improve parse_duration
Stefan Pöschel c19ef77c31
[jamendo] Extract full title
Remita Amine b3277115a1 [disney] Add new extractor(closes )(closes )()()
Remita Amine 9bccdc7004 [vevo] remove request to old api and catch apiv2 errors
Sergey M․ cf0cabbe50
[cmt,mtv,southpark] Add support for episode URLs (closes )
Sergey M․ 556dbe7fe3
[youtube] Add fallback for duration extraction (closes )
Sergey M․ 2417d41535
release 2017.01.25
Sergey M․ c1fa3f4672
[openload] Fallback video extension to mp4
Sergey M․ 17f8deeb48
[extractor/generic] Add support for openload embeds (closes , closes )
Remita Amine b8a03b6660 [srgssr] fix rts video extraction(closes )
Remita Amine c60089c022 [afreecatv:global] Add new extractor(closes )
Sergey M․ af59bddc4e
[konserthusetplay] Extract subtitles ()
Remita Amine 23b35a634e [crackle] improve extraction 
- extract vtt subtitles
- extract multiple resolutions for thumbnails
- pass geo verification proxy headers
- add support for mobile urls
Sergey M․ 74af9c700d
[konserthusetplay] Add support for hls formats (closes )
Sergey M․ d61aa5eb37
[vimeo:review] Fix config URL extraction (closes )
Sergey M․ c3a65c3de0
release 2017.01.24
Sergey M․ b494d6856c
[pluralsight] Fix extraction (closes )
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視)
Yen Chi Hsuan 0c1c6f4b9f
[utils] Add another date format seen in NextTV
Sergey M․ 6d119c2a6b
[24video] Fix extraction (closes )
Sergey M․ 4201ba13e6
[youtube:playlist] Fix nonexistent/private playlist detection and skip private tests
Grzegorz P 8bc0800d7c [youtube:playlist] Fix nonexistent/private playlist detection (closes )
Alex Seiler a089545e03 [azmedien:show] Improve _VALID_URL
Gaetan Gilbert 30dda24de3 [chirbit] Extract uploader
Sergey M․ 9d5b29c881
release 2017.01.22
Sergey M․ 271808b6b2
[pornflip] Improve and extract dash formats (closes )
einstein95 8d1fbe0cb2
[pornflip] Add extractor (closes )
Sergey M․ a243abb80d
[chaturbate] Improve (closes )
einstein95 42697bab3c
[chaturbate] Fix extraction
Sergey M․ 94629e537f
[azmedien] Improve (closes )
Alex Seiler e84495cd8d
[azmedien] Add extractor (closes )
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs
ha shao 04a3d4d234
[vimeo:channel] Extract videos' titles for playlist entries
Sergey M․ 12afdc2ad6
[youtube] Extract episode metadata (closes , closes )
Iulian Onofrei f4ec8dce48 Update README.md () 
Add audio format argument dependency warning
Yen Chi Hsuan f3c21cb7a7
[cspan] Fix _TESTS
Yen Chi Hsuan 972efe60c3
[generic] Remove a dead test 
The web page does not contain a video anymore

Ref: ,
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos 
Closes
Yen Chi Hsuan d77ac73790
[ustream] Add UstreamIE._extract_url() 
Ref:
Sergey M․ 1fe84be0f3
[1tv] Add support for hls (closes )
james mike dupont cccd70a275 untie
Sergey M․ eb3f008c9e
[uol] Fix extraction (closes )
Sergey M․ f1e70fc2ff
[mtv] Relax triforce feed regex (closes )
Sergey M․ 1560baacc6
release 2017.01.18
Remita Amine baa3e1845b [bilibili] fix extraction(closes )
Sergey M․ aaf2b7c57a
[canalplus] Add fallback for video id (closes )
Sergey M․ b687c85eab
[extractor/generic] Add support for 20 minuten embeds (closes , closes )
Sergey M․ 538b17a09c
[20min] Improve
Alex Seiler 4e44598547
[20min] Fix extraction
Sergey M․ 136078966b
[imdb] Extend _VALID_URL (closes )
Sergey M․ 8a5f0a6357
[naver] Update tests for
Kagami Hiiragi c0bd51c090 [naver] Support tv.naver.com links
Sergey M․ c1c2fe2045
release 2017.01.16
Sergey M․ 79fc8496c6
[xiami] Improve extraction (closes ) 
* Relax _VALID_URLs
* Improve track metadata extraction
Sergey M․ 0ce8c66fb0
[options] Include custom conf in final argv (closes )
Sergey M․ 906420cae3
[limelight] Improve and make more robust (closes ) 
+ Add support for direct http for videos hosted on video.llnw.net
* Check handmade http URLs
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID 
Closes
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies 
Some codes are borrowed from , which is by @jlhg

Closes
Yen Chi Hsuan 8e4988f1a2
[niconico] Remove codes for downloading anonymously 
Apparently Niconico now blocks playing without an account

Closes
Sergey M․ a7acf868a5
[yourupload] Fix extraction (closes )
Sergey M․ 6f0be93747
[YoutubeDL] Improve protocol auto determining (closes )
Sergey M․ af62de104f
[beam:live] Improve and simplify (, closes )
sh!zeeg cd55c6ccd7
[beam:live] Add extractor
Sergey M․ 621a2800ca
[vevo] Improve geo restriction detection
Sergey M․ b80e2ebc8d
[dramafever] Add support for URLs with language code ()
Remita Amine 99d537a5e0 [ooyala] fix typo
Sergey M․ abe8cb763f
[cbc] Improve playlist support (closes )
Sergey M․ 5d4c7daa49
release 2017.01.14
Jakub Wilk 4f66c16f33 [brightcove:legacy] Fix misplaced backslash in a regexp
Sergey M․ e54fc0524e
[cmt] Add support for video-clips
Sergey M․ adf063dad1
[mtv,cc,cmt,spike] Improve and refactor 
- Eliminate _transform_rtmp_url
* Generalize triforce mgid extraction
+ [cmt] Add support for full-episodes (closes )
Remita Amine 5e8eebb600 [mitele] extract dash formats
Remita Amine 9837cb7507 [ooyala] add support for videos with embedToken()
Sergey M․ fb6a59205e
[mixcloud] Fix extraction (closes )
Vijay Singh 06e9363b7a
[openload] Fix extraction (closes ) 
Just a minor fix for openload
Remita Amine 1f393a3241 [tv4] improve extraction(closes ) 
- remove check for requires_subscription
- extract more formats
- extract subtitles
Remita Amine c4251b9aaa [common] add possibility to customize akamai manifest host
Sergey M․ 3a407e707a
[freesound] Improve and remove unrelated metadata (closes )
Sergey M․ cb655f34fb
[utils] Add more date formats
sh!zeeg ed06da4e7b
[freesound] Fix extraction and extended (closes )
Sergey M․ 365d136b7c
[vimeo] Fix tests
Sergey M․ 1fd0fc42bd
[vimeo:ondemand] Fix test (closes )
Sergey M․ 10cd2003b4
[nick] Add support for beta.nick.com (closes )
Sergey M․ cdd11c0540
[mtv] Use native hls by default
Sergey M․ 67fc365b86
[mtv,cc] Use hls by default (closes )
Sergey M․ 20faad74b6
[mtv] Fix non-hls extraction 
method attribute may not be present
Sergey M․ 2032d935d1
[mtv] Add default value for use_hls 
These methods are used across codebase with old number of arguments
Sergey M․ 31ea2ad89d
release 2017.01.10
Sergey M․ d1aeacd9bf
[youtube] Fix extraction (closes , )
Sergey M․ 366b759a60
[inc] Improve (closes )
Déstin Reed 7f0bdc7a31
[inc] Add extractor
Sergey M․ 022a5d663b
[youtube] Add test for itag 212 ()
Kacper Michajłow 8409b3683c [youtube] Add itag 212 
Seen on video with id 1t24XAntNCY
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists 
Individual egghead videos are already handled by the generic/Wistia extractors.
Sergey M․ e7ea724cb9
release 2017.01.08
Sergey M․ 364131584b
[hitrecord] Improve (closes )
J 553c68bbd9
[hitrecord] Add extractor
Remita Amine 827961b122 [videott] remove extractor
Remita Amine a5eefc492b [swrmediathek] skip tests correctly
Remita Amine a9cd1691b2 [swrmediathek] improve extraction
Remita Amine 2365f94412 [sharesix] remove extractor
Remita Amine 32b7c2a57e [aol] remove AolFeaturesIE
Remita Amine 221ce32529 [break] merge BreakIE and ScreenJunkiesIE
Remita Amine e5dfdc8164 [sendtonews] improve info extraction
Remita Amine a814da3f62 [skynews] update test
Sergey M․ b2727d0bee
[3sat,phoenix] Fix extraction (closes )
Philipp Hagemeister dbaf601646 [comedycentral/mtv] Add support for HLS videos (fixes ) 
Currently, the HTTP files of the RTMP urls are not present for the The Daily Show.
Use HLS instead for now.
Yen Chi Hsuan ec85ded83c
Fix "invalid escape sequences" error on Python 3.6
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing 
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: ,
Sergey M․ 7232bb299b
release 2017.01.05
Sergey M․ fb47cb5b23
[zdf] Improve (closes , closes )
Paul Hartmann b6de53ea8a
[zdf] Fix extraction
Sergey M․ 96d315c2be
[pornhub:playlist] Improve extraction (closes )
Sergey M․ 1911d77d28
[cctv] Add support for ncpa-classic.com (closes )
Sergey M․ 027e231295
[tunein] Add support for embeds (closes )
Sergey M․ 7a9e066972
[cctv] Relax some video id regexes
Sergey M․ 2021b650dd
release 2017.01.02
Sergey M․ 3783a5ccba
[cctv] Relax _VALID_URL
Sergey M․ 327caf661a
[cctv] Do not fallback on video id extracted from URL
Sergey M․ ce7ccb1caa
[cctv] Improve and merge with cntv (closes , closes , closes )
RPing 295eac6165
[cntv] Add extractor
Sergey M․ 966815e139
[nrktv:episodes] Add support for episodes ()
Sergey M․ 1f766b6e7b
[arkena] Add support for video.arkena.com (closes )
Sergey M․ dc48a35404
release 2016.12.31
Sergey M․ b6ee45e9fa
Improve custom config support (closes )
Fabian Stahl e66dca5e4a
Add option --config-location 
A configfile can now be passed to youtube_dl.

undo changes

Raise parser error if file not found, change to user_conf

change metavar hand helptext for --configfile

Fix help for --configfile

Update help for --configfile

Numbering placeholder in configfile error msg

minor fix

Change option --configfile top --config-file

Fix -config-file error
Sergey M․ 3f1ce16876
[twitch:vod] Improve _VALID_URL (closes )
Robert Smith 9a0f999585
[twitch] Added support for player.twitch.tv URLs (closes )
David Haberthür 3540fe262f
[README.md] Fix spelling and harmonize line length
Sergey M․ e186a9ec03
[videa] Add support for videa embeds
Sergey M․ 69677f3ee2
[videa] Improve and simplify (closes , closes )
Bagira e746021577
[videa] Add extractor
Sergey M․ 424ed37ec4
[vk] Fix postlive videos extraction
Sergey M․ 9cdb0a338d
[vk] Extract from playerParams (closes )
Sergey M․ 6cf261d882
[freevideo] Remove extractor (closes ) 
Handled by generic extractor
Sergey M․ df086e74e2
[showroomlive] Improve (closes )
Arjan Verwer 963bd5ecfc
[showroomlive] Add extractor
Sergey M․ 51378d359e
[xhamster] Fix duration extraction (closes )
Sergey M․ b63005f5af
[rtve:live] Fix extraction (closes )
Yen Chi Hsuan 4606c34e19 [extractor/common] Allow non-lang in subtitles' keys 
See 264e77c406
Sergey M․ 53a664edf4
[brightcove:legacy] Improve embeds detection (closes )
Sergey M․ 264e77c406
[twitch] Add support for rechat messages (closes )
Mattias Wadman 846fd69bac [acast] Add test with multiple blings
Mattias Wadman 12da830993 [acast] Fix broken audio URL and timestamp extraction 
Before first bling was used now we look for the first bling with
type BlingAudio.

Before publishingDate was a ms unix timestamp now it is iso8601.
Sergey M․ 5e77c0b58e
release 2016.12.22
Remita Amine a07588369f [common] improve detection for video only formats and m3u8 manifest(fixes )
Remita Amine f5a723a78a [theplatform] pass geo verification headers to smil request(closes )
Remita Amine f120646f04 [viu] pass geo verification headers to auth request
Remita Amine 9c5b5f2115 [rtl2] extract more formats and metadata
Sergey M․ ae806db628
[vbox7] Skip malformed JSON-LD (closes )
Remita Amine bfa1073e11 [uplynk] force downloading using hls native downloader(closes )
Remita Amine e029c43bd4 [laola1] add support for another extraction scenario(closes )
Sergey M․ 90352a8041
release 2016.12.20
Sergey M․ 3d6761ba92
[vbox7] Fix extraction (closes )
Remita Amine f59d1146c0 [uktvplay] Add new extractor(closes )
Remita Amine b1c357975d [piksel] Add new extractor(closes )
Remita Amine d8c507c9e2 [vimeo] fix extraction for hls formats and add support for dash formats(closes )
Remita Amine 7fe1592073 [common] fix dash codec information for mixed videos and fragment url construction()
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes )