Commit Graph

54 Commits (63c55e9f2245b24f437564e616ebff76994978cf)

Author SHA1 Message Date
Sergey M․ 6e6bc8dae5 Use urlencode_postdata across the codebase
Sergey M․ 15707c7e02 [compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode

Closes 
Sergey M․ cc162f6a0a [crunchyroll] Fix custom _download_webpage (Closes )
Sergey M․ 611c1dd96e [refactor] Single quotes consistency
oittaa e4f49a8753 check video_play_path and use xpath_text
"This check should take place earlier and should be more general if not video_url:. Same should be done for video_play_path. Also these fields better extracted with xpath_text."

Suggestions by @dstftw
Sergey M? 5c2266df4b Switch codebase to use sanitized_Request instead of
compat_urllib_request.Request

[downloader/dash] Use sanitized_Request

[downloader/http] Use sanitized_Request

[atresplayer] Use sanitized_Request

[bambuser] Use sanitized_Request

[bliptv] Use sanitized_Request

[brightcove] Use sanitized_Request

[cbs] Use sanitized_Request

[ceskatelevize] Use sanitized_Request

[collegerama] Use sanitized_Request

[extractor/common] Use sanitized_Request

[crunchyroll] Use sanitized_Request

[dailymotion] Use sanitized_Request

[dcn] Use sanitized_Request

[dramafever] Use sanitized_Request

[dumpert] Use sanitized_Request

[eitb] Use sanitized_Request

[escapist] Use sanitized_Request

[everyonesmixtape] Use sanitized_Request

[extremetube] Use sanitized_Request

[facebook] Use sanitized_Request

[fc2] Use sanitized_Request

[flickr] Use sanitized_Request

[4tube] Use sanitized_Request

[gdcvault] Use sanitized_Request

[extractor/generic] Use sanitized_Request

[hearthisat] Use sanitized_Request

[hotnewhiphop] Use sanitized_Request

[hypem] Use sanitized_Request

[iprima] Use sanitized_Request

[ivi] Use sanitized_Request

[keezmovies] Use sanitized_Request

[letv] Use sanitized_Request

[lynda] Use sanitized_Request

[metacafe] Use sanitized_Request

[minhateca] Use sanitized_Request

[miomio] Use sanitized_Request

[meovideo] Use sanitized_Request

[mofosex] Use sanitized_Request

[moniker] Use sanitized_Request

[mooshare] Use sanitized_Request

[movieclips] Use sanitized_Request

[mtv] Use sanitized_Request

[myvideo] Use sanitized_Request

[neteasemusic] Use sanitized_Request

[nfb] Use sanitized_Request

[niconico] Use sanitized_Request

[noco] Use sanitized_Request

[nosvideo] Use sanitized_Request

[novamov] Use sanitized_Request

[nowness] Use sanitized_Request

[nuvid] Use sanitized_Request

[played] Use sanitized_Request

[pluralsight] Use sanitized_Request

[pornhub] Use sanitized_Request

[pornotube] Use sanitized_Request

[primesharetv] Use sanitized_Request

[promptfile] Use sanitized_Request

[qqmusic] Use sanitized_Request

[rtve] Use sanitized_Request

[safari] Use sanitized_Request

[sandia] Use sanitized_Request

[shared] Use sanitized_Request

[sharesix] Use sanitized_Request

[sina] Use sanitized_Request

[smotri] Use sanitized_Request

[sohu] Use sanitized_Request

[spankwire] Use sanitized_Request

[sportdeutschland] Use sanitized_Request

[streamcloud] Use sanitized_Request

[streamcz] Use sanitized_Request

[tapely] Use sanitized_Request

[tube8] Use sanitized_Request

[tubitv] Use sanitized_Request

[twitch] Use sanitized_Request

[twitter] Use sanitized_Request

[udemy] Use sanitized_Request

[vbox7] Use sanitized_Request

[veoh] Use sanitized_Request

[vessel] Use sanitized_Request

[vevo] Use sanitized_Request

[viddler] Use sanitized_Request

[videomega] Use sanitized_Request

[viewvster] Use sanitized_Request

[viki] Use sanitized_Request

[vk] Use sanitized_Request

[vodlocker] Use sanitized_Request

[voicerepublic] Use sanitized_Request

[wistia] Use sanitized_Request

[xfileshare] Use sanitized_Request

[xtube] Use sanitized_Request

[xvideos] Use sanitized_Request

[yandexmusic] Use sanitized_Request

[youku] Use sanitized_Request

[youporn] Use sanitized_Request

[youtube] Use sanitized_Request

[patreon] Use sanitized_Request

[extractor/common] Remove unused import

[nfb] PEP 8
Sergey M․ 6d02b9a392 [crunchyroll] Fix description extraction
Sergey M․ 2c740cf28d [crunchyroll] Simplify description extraction
Sergey M․ 5214f1e31d [crunchyroll] Fix title extraction (Closes )
Jaime Marquínez Ferrándiz 36e6f62cd0 Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x ()
Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).
Sergey M․ 7690787553 [crunchyroll] Improve subtitle regex (Closes )
Sergey M․ 49941c4e4f [crunchyroll] Add maturity wall reference tests ()
Sergey M․ 80f48920c8 [crunchyroll] Bypass maturity wall (Closes )
Sergey M․ 47004d9579 [crunchyroll] Fix uploader and upload date extraction
Sergey M․ 12810c9cd3 [crunchyroll] Force Accept-Language to any for all requests (Closes )
Jaime Marquínez Ferrándiz 725d1c58aa [crunchyroll] Extract width and height (closes )
Sergey M․ 39affb5aa4 [crunchyroll] Fix typo
Sergey M․ bbb43a39fd [crunchyroll] Use raise_login_required
Sergey M․ 2f72e83bbd [crunchyroll] Detect required login ()
Sergey M․ a01da8bbf8 [crunchyroll] Workaround fplive.net rtmp URLs (Closes )
Sergey M․ a60cccbf9f [crunchyroll] Use compat_urllib_parse_unquote
Sergey M․ ede21449c8 [crunchyroll] Fix extraction (Closes , closes )
Sergey M․ 1a5b77dc21 [crunchyroll] Fix python 3.2
Sergey M․ 0385d64223 [crunchyroll] Extract subtitles extraction routine
Yen Chi Hsuan a9b0d4e1f4 [Crunchyroll] Fix extraction on Python 2.6
XPath with recursive children selection not supported
Jaime Marquínez Ferrándiz 85698c5086 [crunchyroll] Remove unused class
Philipp Hagemeister 499bfcbfd0 Make sure netrc works for all extractors with login support
Fixes 
Jaime Marquínez Ferrándiz b5857f62e2 [crunchyroll] Convert to new subtitles system
Jaime Marquínez Ferrándiz a221f22969 [crunchyroll] Fix format extraction
Reported in https://github.com/rg3/youtube-dl/issues/2782#issuecomment-68556780
Sergey M․ a8896c5ac2 [crunchyroll] Add .fr domain ()
Philipp Hagemeister 7af808a5ef Improve code style
Philipp Hagemeister 1cc79574fc Fix imports and general cleanup
· Import from compat what comes from compat. Yes, some names are available in utils too, but that's an implementation detail.
· Use _match_id consistently whenever possible
· Fix some outdated tests
· Use consistent valid URL (always match the whole protocol, no ^ at start required)
· Use modern test definitions
Philipp Hagemeister b74e86f48a Fix all PEP8 issues except E501
Jouke Waleson 2514d2635e PEP8: E225,E227
Jouke Waleson 8bcc875676 PEP8: more applied
Jouke Waleson 5f6a1245ff PEP8 applied
Philipp Hagemeister 0cc8888038 [crunchyroll] Remove NOP code ()
Philipp Hagemeister 8c25f81bee [util] Move compatibility functions out of util
utils is large enough without these compatibility functions.

Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
Jaime Marquínez Ferrándiz d65d628613 [crunchycroll] Fix building of ass subtitles (reported in )
Parse the xml document instead of using regexes, otherwise unicode characters are left unescaped.
Philipp Hagemeister 09e5d6a6e5 [crunchyroll:playlist] Simplify ()
Philipp Hagemeister 274b12b5a8 Merge remote-tracking branch 'gabeos/crunchyroll-show-playlist'
Philipp Hagemeister b1edd7a48a [crunchyroll] Correct parsing (Fixes )
Gabriel Schubiner 1b10a011ec Forgot to reverse extracted video urls so they are in correct order for video selection args
Gabriel Schubiner 8230018c20 Added extractor for crunchyroll 'playlists' i.e. series. so that one can, e.g. download all episodes of a series
Naglis Jonaitis 11b3ce8509 [crunchyroll] Allow to list subtitles (fixes )
Adam 78272a076e Add SSA (.ass) subtitle output for Crunchyroll
Adam 723e04d0be Add login support to Crunchyroll extractor
Jaime Marquínez Ferrándiz d0a72674c6 [crunchyroll] Use `enumerate`
Sergey M. 1d430674c7 [crunchyroll] Handle error message
Sergey M 70cb73922b [crunchyroll] Fix subtitle lang code extraction