Commit Graph

561 Commits (c37ca4732bf806113e2645efaebd037a6bcc0b5c)

Author SHA1 Message Date
Yen Chi Hsuan 240b60453e
[common] Support m3u8 in f4m manifests
Related: 
Yen Chi Hsuan 0a5685b26f
[common] Support non-bootstraped streams in f4m manifests
Related: 
Yen Chi Hsuan 7b2fcbfd4e
[common] Skip TYPE=CLOSED-CAPTIONS lines in m3u8 manifests
According to [1], valid values for TYPE are AUDIO, VIDEO, SUBTITLES
and CLOSED-CAPTIONS. Such a value is found in Anvato master playlists,
though I don't use _extract_m3u8_formats() in the end.

Part of .

[1] https://tools.ietf.org/html/draft-pantos-http-live-streaming-19#section-4.3.4.1
Yen Chi Hsuan 16da9bbc29
[common] Add _m3u8_meta_format() template
For extractors who handle m3u8 manifests by themselves. (eg., AnvatoIE)

Part of 
Yen Chi Hsuan ad96b4c8f5
[common] Extract audio formats in SMIL
Found in http://www.cbc.ca/player/play/2657631896

Closes 
Sergey M․ ed56f26039
[extractor/common] Improve name extraction for m3u8 formats
Sergey M․ 8a92e51c60
[extractor/common] Relax wording for creator metafield
Yen Chi Hsuan e9c6cdf4a1
[common] Fix format_id construction for HLS
Kagami Hiiragi b24d6336a7 [vlive] Add support for live videos
Yen Chi Hsuan d6712378e7
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv
remitamine fb72ec58ae [extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge
Yen Chi Hsuan 2c0d9c6217
[extractor/common] Allow empty post data
Sergey M․ 49caf3307f
[extractor/common] Remove irrelevant comment
Sergey M․ bacec0397f [extractor/common] Relax _hidden_inputs
Sergey M․ fb38aa8b53 [extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests (Closes , closes )
Sergey M․ 7a93ab5f3f [extractor/common] Introduce music album metafields
Sergey M․ b507cc925b [extractor/common] Carry long line
Sergey M․ db8ee7ec05 [extractor/common] Fix numeric identifiers conversion in DASH URL templates
remitamine df634be2ed [common] prefer using mime type over ext for smil subtitle extraction
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
Sergey M․ 41d06b0424 [extractor/common] Improve _request_webpage
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
Sergey M․ b22ca76204 [extractor/common] Filter out unsupported encrypted media for f4m formats (Closes )
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes 
Sergey M․ 15707c7e02 [compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode

Closes 
remitamine 49dea4913b Merge pull request from remitamine/dash-sort
[extractor/common] fix dash formats sorting
Sergey M․ 0fdbb3322b [extractor/common] Add _parse_f4m_formats routine
remitamine 09f572fbc0 [extractor/common] add transform_source to _download_smil and _extract_smil_formats
remitamine 15bf934de5 Merge pull request from remitamine/simple-webpage-requests
[extractor/common] simplify using data, headers and query params with _download_* methods
remitamine cdfee16818 [extractor/common] add data, headers and query params to _request_webpage
Yen Chi Hsuan a6c8b75904 [common] Use mimeType to determine file extensions ()
Yen Chi Hsuan 64f08d4ff2 Merge pull request from yan12125/dash-detect-ext
Detect file extensions of DASH formats from their codecs
Yen Chi Hsuan af7d5a63b2 [common] Document protocol http_dash_segments
Yen Chi Hsuan 2def60c5f3 [common] Use codec2ext for DASH formats ()
Yen Chi Hsuan e9c0cdd389 [jython] Introduce compat_os_name
os.name is always 'java' on Jython
Sergey M․ 7bcd2830dd [extractor/common] Document uploader_url
Sergey M․ 2bc0c46f98 [extractor/common] Document license metafield
Sergey M․ d77ab8e255 Add --mark-watched feature (Closes )
Sergey M․ 9cdffeeb3f [extractor/common] Clarify rationale on media playlist detection
Sergey M․ fbb6edd298 [extractor/common] Properly extract audio only formats in master m3u8 playlists
Sergey M․ f5bdb44443 [extractor/common] Add _remove_duplicate_formats
remitamine cafcf657a4 add more subtitles mime types to mimetype2ext and fix the platform subtitle extraction
Sergey M․ 611c1dd96e [refactor] Single quotes consistency
Sergey M․ d800609c62 [refactor] Do not specify redundant None as second argument in dict.get()
Sergey M․ bb20526b64 [extractor/common] Improve base url construction
remitamine c349456ef6 [extractor/common] strip http urls in smil manifest
remitamine 81e1c4e2fc [extractor/common] remove duplicate rtmp formats in smil manifest
remitamine dd86780596 [extractor/common] fix dash formats sorting
remitamine 154c209e2d [extractor/common] improve dash format ids
remitamine 51e9094f4a [extractor/common] extract youtube dash formats filesize(fixes )
remitamine d413095f7e [extractor/common] remove duplicated formats and subtiles in smil manifests
remitamine 6a3828fddd [common] use float conversion instead of using division from __future__
remitamine 91cb6b5065 rename _parse_mpd to _parse_mpd_formats and add default value for mpd namespace
remitamine 0826a0b555 [common] sort dash formats
remitamine 255732f0d3 [common] fix segment duration calculation
remitamine 53c269c6fd [common] fix media_template string formating
remitamine 675d001633 [common] skip drm protected dash formats
remitamine d577c79632 [common] ignore ISO 639-2 generic codes
remitamine f14be22816 [common] remove duplicate reference to namespace
remitamine 9c74423510 [common] fix media template regex
remitamine 1bac34556f [common] add a generic support for mpd manifests
Yen Chi Hsuan 2d2fa82d17 [common] Add _extract_dash_manifest_formats
Yen Chi Hsuan c94678957f [common] Remove unused arguments
Yen Chi Hsuan 16f38a699f [common] Rename to namespace
For consistency with _parse_smil_*
Yen Chi Hsuan df374b5222 [common] Prefer the manifest than formats_dict in determining codecs
Yen Chi Hsuan 5ea1eb78f5 [common] Fix for youtube
Yen Chi Hsuan b323e1707d [common] Modify _parse_dash_manifest for use in Facebook
Yen Chi Hsuan 17b598d30c [common] _parse_dash_manifest() from youtube.py
Sergey M․ 350cf045d8 [extractor/common] Restrict checks when auto calculating tbr
remitamine a9d5f12fec Merge pull request from remitamine/hls-master-detect
[extractor/common] detect media playlist in _extract_m3u8_formats
remitamine 7f32e5dc35 [extractor/common] detect media playlist in _extract_m3u8_formats
Sergey M․ b0d21deda9 [extractor/common] Auto calculate tbr when missing
Yen Chi Hsuan 77f785076f [common] Keep full codec name from m3u8 manifests
See . This is for consistency between YouTube and HLS formats.
Yen Chi Hsuan 0b26ba3fc8 [extractor/common] Allow passing more parameters to _search_json_ld
Sergey M․ 4ca2a3cf3c [extractor/common] Add initial support for JSON-LD metadata extraction into info_dict
Jakub Wilk dfb1b1468c Fix typos
Closes .
Sergey M 3f3343cd3e Merge pull request from dstftw/introduce-chapter-and-series-fields
Introduce chapter and series fields
Sergey M․ 27bfd4e526 [extractor/common] Introduce number fields for chapters and series
Philipp Hagemeister 32f9036447 [ccc] Add language information to formats
Sergey M․ 7109903e61 [extractor/common] Document chapter and series fields
Sergey M․ 7e5edcfd33 Simplify formats accumulation for f4m/m3u8/smil formats
Now all _extract_*_formats routines return a list
remitamine 39d60b715a Merge pull request from remitamine/sort
[common] lower (m3u8,rtmp,rtsp) format preference only if required program is not available
remitamine d497a201ca [common] use specific variable for protocol preference in _sort_formats
remitamine 8d29e47f54 [common] simplify the use of _extract_m3u8_formats and _extract_f4m_formats
Sergey M․ 9b9c5355e4 Rename error_to_str to error_to_compat_str
Sergey M․ 7f8b271465 Properly convert errors to strings
Sergey M․ dd85e4d707 [extractor/common] Properly decode error string on python 2 (Closes , closes , closes , closes )
Sergey M․ 62d231c004 [extractor/common] Clarify duration can be float
Sergey M? 5c2266df4b Switch codebase to use sanitized_Request instead of
compat_urllib_request.Request

[downloader/dash] Use sanitized_Request

[downloader/http] Use sanitized_Request

[atresplayer] Use sanitized_Request

[bambuser] Use sanitized_Request

[bliptv] Use sanitized_Request

[brightcove] Use sanitized_Request

[cbs] Use sanitized_Request

[ceskatelevize] Use sanitized_Request

[collegerama] Use sanitized_Request

[extractor/common] Use sanitized_Request

[crunchyroll] Use sanitized_Request

[dailymotion] Use sanitized_Request

[dcn] Use sanitized_Request

[dramafever] Use sanitized_Request

[dumpert] Use sanitized_Request

[eitb] Use sanitized_Request

[escapist] Use sanitized_Request

[everyonesmixtape] Use sanitized_Request

[extremetube] Use sanitized_Request

[facebook] Use sanitized_Request

[fc2] Use sanitized_Request

[flickr] Use sanitized_Request

[4tube] Use sanitized_Request

[gdcvault] Use sanitized_Request

[extractor/generic] Use sanitized_Request

[hearthisat] Use sanitized_Request

[hotnewhiphop] Use sanitized_Request

[hypem] Use sanitized_Request

[iprima] Use sanitized_Request

[ivi] Use sanitized_Request

[keezmovies] Use sanitized_Request

[letv] Use sanitized_Request

[lynda] Use sanitized_Request

[metacafe] Use sanitized_Request

[minhateca] Use sanitized_Request

[miomio] Use sanitized_Request

[meovideo] Use sanitized_Request

[mofosex] Use sanitized_Request

[moniker] Use sanitized_Request

[mooshare] Use sanitized_Request

[movieclips] Use sanitized_Request

[mtv] Use sanitized_Request

[myvideo] Use sanitized_Request

[neteasemusic] Use sanitized_Request

[nfb] Use sanitized_Request

[niconico] Use sanitized_Request

[noco] Use sanitized_Request

[nosvideo] Use sanitized_Request

[novamov] Use sanitized_Request

[nowness] Use sanitized_Request

[nuvid] Use sanitized_Request

[played] Use sanitized_Request

[pluralsight] Use sanitized_Request

[pornhub] Use sanitized_Request

[pornotube] Use sanitized_Request

[primesharetv] Use sanitized_Request

[promptfile] Use sanitized_Request

[qqmusic] Use sanitized_Request

[rtve] Use sanitized_Request

[safari] Use sanitized_Request

[sandia] Use sanitized_Request

[shared] Use sanitized_Request

[sharesix] Use sanitized_Request

[sina] Use sanitized_Request

[smotri] Use sanitized_Request

[sohu] Use sanitized_Request

[spankwire] Use sanitized_Request

[sportdeutschland] Use sanitized_Request

[streamcloud] Use sanitized_Request

[streamcz] Use sanitized_Request

[tapely] Use sanitized_Request

[tube8] Use sanitized_Request

[tubitv] Use sanitized_Request

[twitch] Use sanitized_Request

[twitter] Use sanitized_Request

[udemy] Use sanitized_Request

[vbox7] Use sanitized_Request

[veoh] Use sanitized_Request

[vessel] Use sanitized_Request

[vevo] Use sanitized_Request

[viddler] Use sanitized_Request

[videomega] Use sanitized_Request

[viewvster] Use sanitized_Request

[viki] Use sanitized_Request

[vk] Use sanitized_Request

[vodlocker] Use sanitized_Request

[voicerepublic] Use sanitized_Request

[wistia] Use sanitized_Request

[xfileshare] Use sanitized_Request

[xtube] Use sanitized_Request

[xvideos] Use sanitized_Request

[yandexmusic] Use sanitized_Request

[youku] Use sanitized_Request

[youporn] Use sanitized_Request

[youtube] Use sanitized_Request

[patreon] Use sanitized_Request

[extractor/common] Remove unused import

[nfb] PEP 8
Sergey M․ 019839faaa [extractor/common] Use baseURL from f4m manifest for recursive manifest extraction
Sergey M 30eecc6a04 Merge pull request from jaimeMF/xml_attrib_unicode
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
Sergey M․ dbd82a1d4f [extractor/common] Fix m3u8 extraction on failure
Sergey M․ dc519b5421 [extractor/common] Make ie_key and IE_NAME return unicode string
Jaime Marquínez Ferrándiz 36e6f62cd0 Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x ()
Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).
remitamine 3711304510 [extractor/common] get the redirected m3u8_url in _extract_m3u8_formats
Jaime Marquínez Ferrándiz 865d1fbafc [extractor/common] Remove unused import
Sergey M․ 943a1e24b8 [extractor/common] Use more generic URLError in _is_valid_url
Sergey M․ 02835c6bf4 [extractor/common] Document repost_count
Sergey M․ 448ef1f31c [extractor/common] Allow angle brackets in attributes in _og_regexes ()
Sergey M․ 7a6d76a64d [extractor/common] Require closing quote in _og_regexes (Closes )
E.g. do not match `property='og:video:type'` when `og:video` is requested.
Sergey M․ 4180a3d8b7 [extractor/common] Allow quoteless content attribute in og regexes (Closes )
Yen Chi Hsuan 57935b2564 [extractor/common] Allow HTML5 unquoted attribute values
Fixes 

HTML5 allows unquoted attribute values. See the "Unquoted attribute value
syntax" section [1] for more information

[1] http://www.w3.org/TR/html5/syntax.html
Sergey M․ 4bba371644 [YoutubeDL] Autocalculate ext for subtitles when missing
Sergey M․ e5851b963a [extractor/common] Make f4m extraction for SMIL non fatal
Sergey M․ 4de6131090 [extractor/common] Add fatal to _extract_f4m_formats
Sergey M․ 3a1341a7bc [extractor/common] Make m3u8 extraction for SMIL non fatal
Sergey M․ c78e48177c [extractor/common] Check validity of direct URLs
Sergey M․ 647eab4541 [extractor/common] Extract upload date from SMIL
Sergey M․ 1e5bcdec02 [extractor/common] Extract images from SMIL
Sergey M․ e7d8e98a9f [extractor/common] Allow float bitrates
Sergey M․ 8aab976bbd [extractor/common] Document release_date field
Sergey M․ c430802e32 [extractor/common] Add raise_geo_restricted
Sergey M․ 586f1cc532 [extractor/common] Skip html comment tags (Closes )
Sergey M․ 73eb13dfc7 [extractor/common] Case insensitive inputs extraction
Sergey M․ be0e5dbd83 [extractor/common] Extract submit inputs
Sergey M․ 43e7d3c945 [extractor/common] Add raise_login_required
Jaime Marquínez Ferrándiz 8c97f81943 [common] Follow convention of using 'cls' in classmethods
Yen Chi Hsuan f738dd7b7c [common] Remove debugging codes
Yen Chi Hsuan 912e0b7e46 [common] Add _merge_subtitles()
Yen Chi Hsuan 03bc7237ad [common] _parse_smil_subtitles: accept `lang` as the subtitle language
Sergey M․ 5cdefc4625 [extractor/common] Add more subtitle mime types for guess when ext is missing
Sergey M․ ce00af8767 [extractor/common] Add default subtitles lang
Yen Chi Hsuan f877c6ae5a [theplatform] Use InfoExtractor._parse_smil_formats()
Sergey M․ e64b756943 [extractor/common] Interactive TFA code input
Sergey M․ 201ea3ee8e [extractor/common] Improve _hidden_inputs
Sergey M․ 8b9848ac56 [extractor/common] Expand meta regex
Sergey M․ 942acef594 [extractor/common] Extract _parse_xspf
Sergey M․ 98044462b1 [extractor/common] Use playlist id as default title
Sergey M․ e0b9d78fab [extractor/common] Clarify playlists can have description field
Sergey M․ 8d6765cf48 [extractor/generic] Add generic support for xspf playist extraction
Sergey M. d5d7bdaeb5 Merge pull request from dstftw/improve-generic-smil-support
Improve generic SMIL support
Sergey M․ 5b0c40da24 [extractor/common] Expand meta regex
Sergey M․ 17712eeb19 [extractor/common] Extract namespace parse routine
Sergey M․ 41c3a5a7be [extractor/common] Fix python 3
Sergey M․ a107193e4b [extractor/common] Extract f4m and m3u8 formats, subtitles and info
remitamine 799207e838 [viewster] extract the api auth token
Closes .
Sergey M․ 864f24bd2c [extractor/common] Add _meta_regex and clarify tags field
Purdea Andrei 5316bf7487 Documented tags as a possible dict key
Sergey M․ 10952eb2cf [extractor/common] Consistent URL spelling
Jaime Marquínez Ferrándiz 297a564bee [youtube] Extract end_time
Jaime Marquínez Ferrándiz 7c80519cbf [youtube] Extract start_time
From the 't=*' in the url.
Currently youtube-dl doesn't use the value, but it was requested for the mpv plugin.
Sergey M․ 74fe23ec35 [extractor/common] Style
Yen Chi Hsuan a38436e889 [extractor/common] Add 'transform_source' parameter to _extract_f4m_formats()
Sergey M․ 31c746e5dc [extractor/common] Keep going in some media_url is missing
Sergey M․ 70f0f5a8ca [extractor/common] Recursively extract child f4m manifests
Sergey M․ cc357c4db8 [extractor/common] Properly handle full URLs
Sergey M․ 97f4aecfc1 [extractor/common] Handle malformed f4m manifests
Sergey M․ cf61d96df0 [extractor/common] Add _form_hidden_inputs
Sergey M․ f8da79f828 [extractor/common] Improve _form_hidden_inputs and rename to _hidden_inputs
Sergey M․ 27713812a0 [extractor/common] Add method for extracting form hidden input fields as dict
Yen Chi Hsuan 13af92fdc4 [common] Add 'fatal' to _extract_m3u8_formats
Sergey M․ 5414623791 [extractor/common] Remove superfluous line
Sergey M․ c342041fba [extractor/common] Use NO_DEFAULT from utils
Yen Chi Hsuan 621ed9f5f4 [common] Add note and errnote field for _extract_m3u8_formats
Sergey M․ baa43cbaf0 [extractor/common] Relax valid url check verbosity
Yen Chi Hsuan c1c924abfe [utils,common] Merge format_srt_time and _subtitles_timecode
format_srt_time uses a comma as the delimiter between seconds and
milliseconds while _subtitles_timecode uses a dot. All .srt examples I
found on the Internet uses a comma, so I use a comma in the merged
version. See http://matroska.org/technical/specs/subtitles/srt.html and
http://devel.aegisub.org/wiki/SubtitleFormats/SRT
Yen Chi Hsuan 05d5392cda [common] Ignore subtitles in m3u8
Sergey M․ 74f728249f [extractor/common] Fallback to empty string for (yet) missing `format_id` in `_sort_formats` (Closes )
Jaime Marquínez Ferrándiz 2ddcd88129 Remove code that was only used by the Grooveshark extractor
zouhair cf0649f8b7 Typo: twice "the the" to "the"
Sergey M․ 3ded7bac16 [extractor/common] Add ability to specify custom field preference for `_sort_formats`
Jaime Marquínez Ferrándiz 08f2a92c9c InfoExtractor._search_regex: Suggest updating when the regex is not found (suggested in )
Reuse the same message from ExtractorError
Yen Chi Hsuan c9a779695d [extractor/common] Add the encoding parameter
The QQMusic info extractor need forced encoding for correct working.
Sergey M․ 830d53bfae [utils] Add `video_title` for `url_result`
Sergey M․ e21a55abcc [extractor/common] Remove f4m section
It's now provided by `f4m_id`
Sergey M․ 4a34f69ea6 [extractor/common] Add subtitles timecode formatter
Sergey M․ f207019ce5 [extractor/common] Remove 'm3u8' from quality selection URL
Sergey M․ 8dc9d361c2 [extractor/common] Fix format_id when `last_media` is None and always include `m3u8_id` if present
The rationale behind `m3u8_id` was to resolve duplicates when processing several m3u8 playlists within the same media that give equal resulting `format_id`'s,
e.g. `youtube-dl http://www.rts.ch/play/tv/passe-moi-les-jumelles/video/la-fee-des-bois-mustang-les-chemins-du-vent?id=3854925 -F`
Philipp Hagemeister a0bb7c5593 [extractor/common] Improve m3u format IDs ()
Sergey M․ 2f0f6578c3 [extractor/common] Assume non HTTP(S) URLs valid
Philipp Hagemeister 72a406e7aa [extractor/common] Pass in video_id ()
Antti Ajanki 6f4ba54079 [extractor/common] Extract HTTP (possibly f4m) URLs from a .smil file
Antti Ajanki 637570326b [extractor/common] Extract the first of a seq of videos in a .smil file
Jaime Marquínez Ferrándiz bfc993cc91 Merge branch 'subtitles-rework'
(Closes PR )
Sergey M․ 9fe6ef7ab2 [extractor/common] Fix preference for m3u8 quality selection URL
Philipp Hagemeister 8fb3ac3649 PEP8: W503
Philipp Hagemeister 77b2986b5b [extractor/common] Recognize Indian censorship ()
Jaime Marquínez Ferrándiz 9868ea4936 [extractor/common] Simplify subtitles handling methods
Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.
Philipp Hagemeister fa15607773 PEP8 fixes
Jaime Marquínez Ferrándiz 4cd95bcbc3 [twitch:stream] Prefer the 'source' format (fixes )
Sergey M? 4069766c52 [extractor/common] Test URLs with GET
Jaime Marquínez Ferrándiz 360e1ca5cc [youtube] Convert to new subtitles system
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
Jaime Marquínez Ferrándiz c84dd8a90d [YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
Jaime Marquínez Ferrándiz a504ced097 Improve subtitles support
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.

The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.

Currently only the ted extractor has been updated, but the old system still works.
Philipp Hagemeister 03cd72b007 [extractor/common] Move up filesize
filesize and tbr should correlate, so it doesn't make sense to treat them differently.
Jaime Marquínez Ferrándiz 6ca7732d5e [extractor/common] Fix link to external documentation
Jaime Marquínez Ferrándiz 2d30521ab9 [youtube] Extract average rating (closes )
Philipp Hagemeister 9650885be9 [escapist] Filter video differently (Fixes )
Philipp Hagemeister 7e5db8c930 [options] Add --no-color
Philipp Hagemeister 3a5bcd0326 [extractor/common] Wrap extractor errors (Fixes )
For now, we just wrap some common errors. More may follow. We do not want to catch actual programming errors in the extractors, such as 1 // 0.
Naglis Jonaitis 69319969de [extractor/common] Add new helper method _family_friendly_search
Philipp Hagemeister 1e1896f2de [extractor/common] Correct sort order.
We should look at height and width before ext_preference.
Sergey M․ 3900eec27c [extractor/common] Fix 2.0 manifest extraction (Closes )
Sergey M․ 60ca389c64 [extractor/common] Prefix f4m/m3u8 entries with identifier
Philipp Hagemeister 9bb8e0a3f9 [wsj] Add new extractor (Fixes )
Philipp Hagemeister 1a6373ef39 [sort_formats] Prefer bitrate over video size
720p @ 1000KB/s looks way better than 1080p @ 500KB/s
Philipp Hagemeister 995029a142 [nerdist] Add new extractor (Fixes )
Philipp Hagemeister b04b885271 [extractor/common] Document all protocol values
Sergey M․ 96a53167fa [common] Generalize URLs' HTTP errors pre-testing
Philipp Hagemeister 3dee7826e7 [rtl2] PEP8, simplify, make rtmp tests run ()
Philipp Hagemeister cfb56d1af3 Add --list-thumbnails
Jaime Marquínez Ferrándiz e1554a407d [extractors] Use http_headers for setting the User-Agent and the Referer
Philipp Hagemeister 121c09c7be Merge remote-tracking branch 'Dineshs91/f4m-2.0'
Philipp Hagemeister 6271f1cad9 [youtube|ffmpeg] Automatically correct video with non-square pixels (Fixes )
Philipp Hagemeister ff21a8e0ee Merge remote-tracking branch 'Tithen-Firion/master'
Philipp Hagemeister dd622d7c4e [netzkino] Add new extractor (Fixes )
Philipp Hagemeister bec2248141 [InfoExtractor/common] Correct and test meta tag matching
Philipp Hagemeister 0590062925 Respect age_limit when listing extractors (Fixes )
Philipp Hagemeister e65566a9cc [youtube] Correct handling when DASH manifest is not necessary to find all formats
Sergey M․ 6c6f1408f2 [extractor/common] Allow multiline content tags
Jaime Marquínez Ferrándiz 5d3808524d [extractor/common] Update docstring: replace FileDownloader with YoutubeDL
Philipp Hagemeister bf94e38d3d Merge remote-tracking branch 'Tithen-Firion/hsw-update'
Philipp Hagemeister f5e43bc695 [vine] Provide alt_title (Fixes )
Sergey M․ e89a2aabed [extractor/common] Add generic SMIL formats extraction routine
Philipp Hagemeister f58766ce5c [extractor/common] Document ie_key in url results
Sergey M․ acf5cbfe93 [extractor/common] Add description to playlist_result
Philipp Hagemeister b82f815f37 Allow iterators for playlist result entries
Tithen-Firion ebb6419960 [common] Split _download_json
Add ability for extractor to use _parse_json
Tithen-Firion 995ad69c54 [common] Add new parameters for _download_webpage
Philipp Hagemeister 810fb84d5e pep8 and minor beautification all around
Jaime Marquínez Ferrándiz 42939b6129 [youtube] Use a cookie for seeting the language
This way, we don't have to do an aditional request
Philipp Hagemeister 4e262a8838 [generic] Detect direct video links (Fixes , )
Jouke Waleson 9e1a5b8455 PEP8: applied even more rules
Jouke Waleson 5f6a1245ff PEP8 applied
Philipp Hagemeister fed5d03260 [extractor/common] Document _type values (Motivated by )
Philipp Hagemeister aff2f4f4f5 [arte] Clean up format sorting mess
We now use our standard sorting facilities. As a side effect, it's finally possible to download German videos from French URLs and vice versa.
Philipp Hagemeister 711ede6e1b [heise] Fix description, thumbnail and format ID
Philipp Hagemeister 8c25f81bee [util] Move compatibility functions out of util
utils is large enough without these compatibility functions.

Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
Philipp Hagemeister 2c8e03d937 Sort formats by fps as well
Philipp Hagemeister fbb21cf528 [youtube] Add formats 298, 299 (Fixes )
Philipp Hagemeister 81515ad9f6 [extractor/common] Improve m3u8 output
Philipp Hagemeister 23be51d8ce [generic] Handle audio streams that do not implement HEAD (Fixes )
Philipp Hagemeister c64ed2a310 [viddler] Use API
Philipp Hagemeister 1ede5b2481 [glide] Simplify
dinesh 7a47d07c6d [extractor/common] href attribute added
dinesh 34e48bed3b [extractor/common] Added support for f4m manifest Version 2.0
Sergey M․ 5f58165def [extractor/common] Fix dumping requests with long file abspath on Windows
Philipp Hagemeister d838b1bd4a [utils] Default age_limit to None
If we can't parse it, it means we don't have any information, not that the content is unrestricted.
Philipp Hagemeister e7b6d12254 [utils] Improve and test js_to_json
Philipp Hagemeister b14f3a4c1d [golem] Simplify ()
Philipp Hagemeister ed9266db90 [common] Add new helper function _match_id
Philipp Hagemeister f4b1c7adb8 [muenchentv] Move live title generation to common
Philipp Hagemeister f0b5d6af74 [vevo] Support 1080p videos (Fixes )
Philipp Hagemeister 7267bd536f [muenchentv] Add support (Fixes )
Sergey M․ 9ebf22b7d9 [common] Improve codecs extraction from m3u8
Philipp Hagemeister daebaab692 [extractor/common] Correct typo
Philipp Hagemeister 3524cc25ca [sportdeutschland] Add support for more plain videos
Philipp Hagemeister f1a9d64eea [extractor/common] Modernize
Philipp Hagemeister da9ec3b932 [muscivault] Add extractor (Fixes )
Philipp Hagemeister 704df56da7 [sportdeutschland] add new extractor
Philipp Hagemeister b252735910 [extractor/common] Generate better f4m format IDs
Philipp Hagemeister 9480d1a566 Merge remote-tracking branch 'riking/twofactor'