Commit Graph

8911 Commits (ab4bdc913fafc71217c1196602525e0382c4eea3)

Author SHA1 Message Date
ashutosh-mishra 17cc153435 Typo fix, found while going through the code.
Sergey M․ 67446fd49b [instagram] Improve _VALID_URL (Closes )
Sergey M․ 325bb615a7 [theplatform] Style
Sergey M․ ee5cd8418e [theplatform] Handle protocolless feed URLs (Closes )
Sergey M․ 342609a1b4 [bloomberg] Reax _VALID_URL (Closes )
Sergey M f270cf1a26 Merge pull request from barlik/master
Clarify that automatic subtitles are generated.
hedii 371c3b796c [YoutubeDL] Add playlist finished downloading message (Closes )
Conflicts:
	youtube_dl/YoutubeDL.py
Sergey M․ 6b7ceee1b9 [vimeo] Add test for
Sergey M․ fdb20a27a3 [vimeo:group] Improve _VALID_URL (Closes )
Sergey M․ 2c94198eb6 [vimeo] Improve playlists extraction
Philipp Hagemeister e8110b8125 release 2015.11.19
Yen Chi Hsuan c39fd7b1ca [UDNEmbed] Fix generic UDN pages
Closes 
Sergey M․ a9c09a7c62 [pbs] Update API URL (Closes )
Philipp Hagemeister 82beaabb41 release 2015.11.18
Jaime Marquínez Ferrándiz 63b4295d20 [youtube:playlist] fix title extraction (fixes and )
Sergey M․ 312a3f389b [pbs] Extend _VALID_URL
Jaime Marquínez Ferrándiz 609af1ae1c [dplay] Add 'encoding: utf-8' line
Jaime Marquínez Ferrándiz 4cd759f73d [dplay] Add extractor (closes )
Since I haven't figured out how to download the hds stream, we use the hls one instead.
Jaime Marquínez Ferrándiz e156e70281 [rtve] Remove unused import
Sergey M․ 9b464929fe [rtve.es:alacarta] Fix extraction
Sergey M 0c176d7bde Merge pull request from ping/patch-7301
[neteasemusic] Fixes 
Sergey M․ 7a3f0c00ad [utils] Style
Sergey M․ 7aefc49c40 [utils] Skip invalid/non HTML entities (Closes )
Rastislav Barlik 741dd8ea65 Clarify that automatic subtitles are generated.
It wasn't clear what automatic word mean.
ping 76adc82068 [neteasemusic] Fixes
Philipp Hagemeister bd1512d196 release 2015.11.15
Sergey M․ 9a4acbfaf5 [theplatform] Add test for
Sergey M․ ad1f4e7902 [theplatform] Handle explicitly specified SMIL ()
Sergey M b328295910 Merge pull request from davidbz/add_proxy_to_update_procedure
Add proxy support for update_self
David Ben Zakai 828b2a5cd9 Removing an unnecessary import
Sergey M․ 2ff7cbeaaa [nowtv:list] Add extrator (Closes )
Sergey M․ b2f7738830 [dumpert] Use original protocol
Sergey M․ dc0279532a [dumpert] Disable SSL (Closes )
Sergey M․ 0c59d02bdc [periscope] Relax _VALID_URL (Closes )
Jaime Marquínez Ferrándiz 0f72beb515 [periscope] Remove unused imports
Sergey M․ d781e29316 [bbc] Allow selectionunavailable errors (Closes )
Sergey M․ 3b3e8ed332 [quickscope] Remove extractor (2)
Sergey M․ dcdfeb33d2 [quickscope] Remove extractor
Sergey M․ 0d85c3a732 [lynda] Style
Sergey M․ 903d136942 [lynda] Logout only when login info present (Closes )
Yen Chi Hsuan 9d584da7d0 [xfileshare] Correct _VALID_URL
Yen Chi Hsuan 31752f76f7 [twitter:card] Add add_ie for the external test
Yen Chi Hsuan 5f1b2aea80 [twitter:card] Support vine.co embeds (closes )
Sergey M․ 4479600d57 [instagram] Add test for
Sergey M․ a90189c3ad [instagram] Relax _VALID_URL (Closes )
Sergey M․ d8a1caf04f [brightcove:new] Style
Sergey M․ cb33d389ed [brightcove:new] Add test with rtmp streams
Sergey M․ e01b432ad3 [brightcove:new] Fix test
Sergey M․ fd91257c40 [brightcove] Order imports alphabetically
Sergey M․ c7b959ce38 [utils] Remove unused function
Sergey M․ 75eac8961e [brightcove] Remove unused import
Sergey M․ 3b7d9aa487 Rename all references to legacy studio Brightcove extractor
Sergey M․ 1f4b722b00 [generic] Clarify Brightcove Legacy Studio comment
Sergey M․ f6519f89b0 [generic] Extract Brightcove New Studio embeds
Sergey M․ 24af85298e [brightcove] Fix _extract_urls
Sergey M․ e721d857c2 [brightcove] Clarify IE_NAMEs
Sergey M․ 5c17f0a67a [brightcove:embedinpage] Rename extractor to brightcove new
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
Sergey M․ 4fcaa4f4a5 [brightcove] Rename extractor to brightcove legacy
Old embedding approaches are now "Legacy Studio"
Sergey M․ 536f819eda [brightcove] Imrove extraction of new embeds
Sergey M․ a662489877 [brightcove:embedinpage] Make more robust and extract rtmp streams
Sergey M․ a2973eb597 Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed
Sergey M․ 4e21b3a94f [cbs] Use android UA for higher quality streams (Closes )
Jaime Marquínez Ferrándiz b703ebeeaf [twitter] Don't fail if the description doesn't contain an URL (fixes )
Jaime Marquínez Ferrándiz b84a5f0337 [twitter] Update tests checksums
Philipp Hagemeister a1ec9a7553 release 2015.11.13
Sergey M․ 91d644b5ba [ruutu] Relax formats extraction
Sergey M․ 5d6c3d6a66 [ruutu] Skip NOT-USED URLs(Closes )
Jaime Marquínez Ferrándiz 1ebb4717df [cbsnews] Fix construction of 'play_path' in some videos (fixes )
Yen Chi Hsuan cf5881fc4d Credit @ferama
For providing idea for vidto.me () and extending nowvideo support ()
Sergey M․ fcd817a326 [vimeo] Fix extraction (Closes )
Sergey M․ 031ec536f0 [gorillavid] Rename to xfileshare
Sergey M․ 668db403f9 [gorillavid] Add test for vidto.me and strip title
Sergey M․ b9ad101926 [gorillavid] Add support for vidto.me
Sergey M․ 435911029f [vidto] Remove extractor
Sergey M․ 699ed30cee [novamov] Modernize
Sergey M․ 9eab37dca0 [vimeo] Simplify set cookie
Sergey M․ 9a8a12b7d8 [vimeo] Append cookies instead of overriding
Yen Chi Hsuan a4c2ab35c1 Merge remote-tracking branch 'upstream/master'
Sergey M․ 3d9c4bf09a [vimeo] Fix password protected videos (Closes )
Yen Chi Hsuan 8b8a39e279 [vidto] Several simplifications and improvements
1. Use InfoExtractor._hidden_inputs
2. Fetch title from <title> tag
3. Cookies are preserved automatically
4. Use single quotes everywhere
5. Do not declare variables for one-time use only
Sergey M․ 82393e2bb2 [novamov] Follow continue-to-the-video button if any (Closes )
Sergey M․ 2eb99a4b98 [nowvideo] Replace main host to resolvable one
Yen Chi Hsuan 990e6e8fa3 [vidto] Minor fixes
1. import order
2. fatal is already True in helper functions
Rémy Léone d8b7e80d29 Remove duplicate key
Yen Chi Hsuan 37120974dc [vidto] PEP8
Marco Ferragina 42fc93c709 vidto extractor: code cleanup
Marco Ferragina a625e56543 [vidto] Add extractor
Sergey M․ 9b738b2caa [funnyordie] Fix extraction and extract m3u8 formats
David Ben Zakai 90bb5667bf Using internal opener
David Ben Zakai d3d3e2e3aa Adding proxy to update procedure
Philipp Hagemeister 37ca7b22b5 release 2015.11.10
Yen Chi Hsuan 50f84a9ae1 [youtube] Support new base.js html5 player
Yen Chi Hsuan ff29bf81f8 [jsinterp] Support alternative function definition form
Sergey M․ b25f753397 [kaltura] Relax _VALID_URL
Sergey M․ 6a5d6de1e3 [generic] Improve kaltura embed detection (2)
Sergey M․ 1c31a5b0e0 [generic] Improve kaltura embed detection (Closes )
Sergey M․ 4f5cdf7c9b [cmt] Extend _VALID_URL to support shows (Closes )
Sergey M․ f09a767d31 [mit] Allow external embeds (Closes )
Sergey M․ cc8034cc4c [extremetube] Modernize
Sergey M․ 50506cb607 [extremetube] Fix extraction (Closes )
Sergey M․ aa8d2d5be6 [rtbf] Make www optional in _VALID_URL
Sergey M․ 114e6025b0 [rtbf] Expand _VALID_URL (Closes )
Sergey M․ fda2717ef9 [movieclips] Add coding cookie
Frans de Jonge 937511dfc0 Added support for the RTBF OUFtivi subpage
Jaime Marquínez Ferrándiz d5c181a14e [movieclips] Fix extraction (fixes )
They use theplatform now.
Changed the test, because the old one seems to be georestricted.
Sergey M? e8ce2375e0 [viidea] Improve and cleanup (Closes )
* Optimize requests for multipart videos
* Fix cfg regex
* Improve titles and identifiers
remitamine 6fdb39ded1 [viidia] Cleaup
[viidea] extract playlist if lecture is an event

[viidia] use compat_str
remitamine 8e3a2bd620 [viidea] fix _VALID_URL regex and tests
remitamine a06bf87a2c [viidea] add support for sites using viidea service
remitamine ee4337d100 [videolecture] add support for multi part videos
Jaime Marquínez Ferrándiz cff551c0b0 [googleplus] Fix extraction of formats
Sergey M․ 6d02b9a392 [crunchyroll] Fix description extraction
Sergey M․ 2c740cf28d [crunchyroll] Simplify description extraction
Sergey M․ 5214f1e31d [crunchyroll] Fix title extraction (Closes )
Sergey M․ 5d0f84d32c [beeg] Skip empty URLs (Closes )
Mister Hat ee223abb88 [vidzi] fixed. finds url from hash and host in script
Closes .
Sergey M․ 21d0c33ecd [pbs] Make flp embed lookup non fatal
Sergey M․ 8b6d9406db [pbs] Add test for flp frontline embeds
Sergey M․ 686f98816e [pbs] Add support for flp frontlines (Closes )
Sergey M․ 0fa6b17dcc [pbs] Simplify and speed up player URL search
Sergey M․ 472404953a [miomio] PEP 8
Sergey M․ ae4ddf9efa [lynda] PEP 8
Sergey M․ ea8ed40b2f [lynda] Modernize and make more robust
Sergey M․ 71bb016160 [lynda:course] Modernize and make more robust
Sergey M․ 179ffab69c [lynda:course] Force log out (Closes )
Sergey M․ deb85c32bb [postprocessor/ffmpeg] Use ffmpeg as prefix since it's used all over the places (Closes )
Sergey M․ 92366d189e [njoy:embed] Relax _VALID_URL
Sergey M․ 81413c0165 [ndr:embed] Relax _VALID_URL
Sergey M․ 1e2eb4b40d [njoy] Relax _VALID_URL
Sergey M․ 01003d072c [ndr] Add test for
Sergey M․ 5003e4283b [ndr] Relax _VALID_URL (Closes )
remitamine e68dd1921a [miomio] use the formats urls headers for downloading xml
remitamine 6953d8e95a [miomio] fix info extraction (fixes )
Sergey M․ b3613d36da [YoutubeDL] Sanitize path after output template substitution (Closes )
Sergey M․ 53472df857 [periscope] Add note on where to find alive example URLs
Sergey M․ 2549e113b8 [periscope] Add test for broadcast_id based URL
Sergey M․ b15c44cd36 [periscope] Add support for videos with broadcast_id (Closes )
Sergey M․ f93ded9852 [prosiebensat1] Add support for .ch domains (Closes )
Sergey M․ 89ea063eeb [youtube] Clarify rationale for preferring a video info with token ()
Sergey M․ 44b2264fea [youtube] Prefer video_info with token available
Jaime Marquínez Ferrándiz cb5a470635 [vimeo] Remove unused import
Sergey M․ 17d1900581 [vk] Fix view count extraction (Closes )
Sergey M․ 5d501a0901 [globo] Add more tests
Sergey M․ c13722480b [globo:article] Fix test
Sergey M․ e7d34c03f2 [globo] Force uploader id to be string
Sergey M․ 264cd00fff [globo] Update tests
Sergey M․ a4a6b7b80f [globo] Improve http formats
Sergey M․ aebb42d32b [globo] Remove like count
It's no longer provided
Sergey M․ b4ef6a0038 [globo] Remove non available test
Sergey M․ 5d235ca7f6 [globo] Prefer native m3u8
Sergey M․ c3459d24f1 [globo] Skip unsupported smooth streaming
Sergey M․ e3778cce0e [globo] Improve m3u8 extraction
Sergey M․ ad607563a2 [globo] Separate article extractor
Yen Chi Hsuan 236cb2131b Merge remote-tracking branch 'upstream/master'
Yen Chi Hsuan f3cb54e6d9 Merge branch 'atomicdryad-pr-democracynow'
Yen Chi Hsuan 0aeb9a106e [democracynow] Prevent required fields to be None
Yen Chi Hsuan fd8102820c [democracynow] Rename js to json_data
Sergey M․ bfdf891fd3 [vimeo] Fix non-ASCII album passwords
Sergey M․ 3fa3ff1bc3 [vimeo] Fix non-ASCII login
Sergey M․ 0a0110fc6b [vimeo] Fix non-ASCII video passwords (2)
Sergey M․ 852fad922f [vimeo] Fix non-ASCII video passwords (Closes )
Yen Chi Hsuan fc68d52bb9 [democracynow] Add MD5 sums
Yen Chi Hsuan dde9fe9788 [democracynow] Simplify
Philipp Hagemeister a230068ff7 release 2015.11.02
Jaime Marquínez Ferrándiz 6a75040278 [utils] unified_strdate: Return None if the date format can't be recognized (fixes )
This issue was introduced with ae12bc3ebb, it returned 'None'.
remitamine c514b0ec65 [videofy.me] fix info extraction
Closes .
Jaime Marquínez Ferrándiz eb97f46e8b [mitele] Fix extraction and update test checksum (fixes )
Sergey M․ c90d16cf36 [utils:sanitize_path] Disallow trailing whitespace in path segment (Closes )
Philipp Hagemeister ab6ca04802 release 2015.11.01
Sergey M․ 999079b454 [eitb] Improve hds extraction
Sergey M․ 8a06999ba0 [eitb] Improve, make more robust and extract f4m formats (Closes )
remitamine 80dcee5cd5 [eitb] fix info extraction
remitamine 9550ca506f [utils] change extract_attributes to work in python 2
Sergey M 30eecc6a04 Merge pull request from jaimeMF/xml_attrib_unicode
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
Sergey M․ dbd82a1d4f [extractor/common] Fix m3u8 extraction on failure
Sergey M․ 76f0c50d3d [mdr] Fix failed formats processing
Sergey M․ dc519b5421 [extractor/common] Make ie_key and IE_NAME return unicode string
Sergey M․ ae12bc3ebb [utils] Make unified_strdate always return unicode string
Sergey M․ e327b736ca [generic] Update test
Sergey M․ 82b69a5cbb [mdr] PEP 8
Sergey M․ 11465da702 [mdr] Simplify xpath
Sergey M․ 578c074575 [utils] Support list of xpath in xpath_element
Sergey M․ 8cdb5c8453 [mdr] Add audio test
Sergey M․ 2b1b2d83ca [mdr] Modernize and include kika.de
Jaime Marquínez Ferrándiz c3040bd00a [kika] Cleanup
Closes .
Jaime Marquínez Ferrándiz 8c1aa28c27 [kika] Replace non working tests and recognize 'einzelsendung' urls.
Yen Chi Hsuan 78d7ee19dc [democracynow] Fix _TESTS
Lucas 892015b088 replaced inefficient code
Lucas 47f2d01a5a Add new extractor
Yen Chi Hsuan 33a513faf7 Merge branch 'pr-democracynow' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-democracynow
remitamine 240384afe6 [clipfish] improve info extraction
Sergey M․ 6722ebd437 [anitube] Relax key regex (Closes )
Another variant seen http://anitubebr.xpg.uol.com.br/embed/
remitamine 9a605c8859 [adobetv] add support for show and channel extraction
remitamine 402ca40c9d [adobetv] extract AdobeTVVideo info from json directly
remitamine 30bd1c16c8 [adobetv] use api for extraction and add support specific language videos
Sergey M․ 721f5a277c [moniker] Add tests for
Sergey M․ 6fb8ace671 [moniker] Add support for builtin embedded videos (Closes )
Jaime Marquínez Ferrándiz ae37338e68 [compat] compat_etree_fromstring: clarify comment
Sergey M․ 03c2c162f9 [clyp] Improve and cleanup (Closes )
Sergey M․ 52c3a6e49d [utils] Improve parse_iso8601
Cian Ruane 4e16c1f80b [clyp] Add extractor
Update __init__.py

[clyp.it] Extract ID idiomatically and make duration and description optional
Jaime Marquínez Ferrándiz 7ccb2b84dd [francetv] fix style issues reported by flake8
* Don't redefine variable in list comprehension
* Line missing indentation
Sergey M․ 0a192fbea7 [pluzz] Fix mobile support and modernize (Closes )
Pierre Fenoll a526167d40 [francetv] Accept mobile URLs
Jaime Marquínez Ferrándiz f78546272c [compat] compat_etree_fromstring: also decode the text attribute
Deletes parse_xml from utils, because it also does it.
Sergey M․ c137cc0d33 [francetv] Add subtitles test
Sergey M․ 6e4b8b2891 [francetv] Make subtitles more robust (Closes )
Frans de Jonge 5dadae079b [francetv] Add subtitles support
Lukáš Lalinský 5f9f87c06f [vidme] Check for deleted videos
Jaime Marquínez Ferrándiz 387db16a78 [compat] compat_etree_fromstring: only decode bytes objects
Jaime Marquínez Ferrándiz 36e6f62cd0 Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x ()
Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).
Sergey M․ 755ff8d22c [youporn] Extract comment count
Sergey M․ 7b3a19e533 [stitcher] Remove origEpisodeURL
It's always 404
Sergey M․ 4f13f8f798 [youporn] Improve uploader extraction
Sergey M․ feb7711cf5 [youporn] Make description optional
Some videos does not contain any description
Sergey M․ 589c33dade [youporn] Improve and make more robust (Closes , closes )
Erik e572a1010b [youporn] Fix extraction
[youporn] Added description and thumbnail

[youporn] Added uploader and date

[youporn] Removed Try and Except lines

[youporn] Fixed date, fatal, formats and /s*

[youporn] Undid removing comment about video url components & Undid and fixed removal of encrypted URL detection

[youporn] Fix: Add encrypted link to links array only if not already in it

[youporn] Fix: Add encrypted link to links array only if not already in it

[youporn] Fix: cleanup
Sergey M․ 7e0dc61334 [njoy] Add support for URLs without display id
Sergey M․ 8e82ecfe8f [dailymotion] Extract f4m formats
Sergey M․ ec29539e06 [senateisvp] Pass extra param as query segment without `?`
Sergey M․ 8cd9614abf [downloader/f4m] More accurate fragment URL construction
remitamine 324ac0a243 [downloader/f4m] get the redirected f4m_url and handle url query string properly
remitamine 3711304510 [extractor/common] get the redirected m3u8_url in _extract_m3u8_formats
Jaime Marquínez Ferrándiz 50b936936d [tutv] Fix test
Jaime Marquínez Ferrándiz d97da29da2 [abc] Support more URL formats
remitamine 7687b354c5 [abc] add support for audio extraction
Jaime Marquínez Ferrándiz 36d7281037 [spiegeltv] Fix style issue
Use two spaces before comment.
Jaime Marquínez Ferrándiz 865d1fbafc [extractor/common] Remove unused import
Sergey M․ ac21e71968 [spiegeltv] Check formats
Sergey M․ 943a1e24b8 [extractor/common] Use more generic URLError in _is_valid_url
Sergey M․ 50f01302d3 [spiegeltv] Do not extract m3u8 formats since it's already a format
Christoph Döpmann 0198807ef9 [spiegeltv] Fix Accept-Encoding issue (server chokes on gzip)
Jaime Marquínez Ferrándiz 6856139705 [mitele] Fix test checksum
Jaime Marquínez Ferrándiz c93153852f [mitele] Don't encode the URL query (closes )
This seems to produce sporadic errors when trying to access the URL, because on python 3.x when you do '%s' % b'somedata' you get "b'somedata'".
Philipp Hagemeister ab9c7214ee release 2015.10.24
Jaime Marquínez Ferrándiz 5c43afd40f [youtube:channel] Support age restricted channels (fixes )
Jaime Marquínez Ferrándiz 9170ca5b16 [youtube:channel] Fix test
Philipp Hagemeister ab03c0b47c release 2015.10.23
Sergey M․ 7690787553 [crunchyroll] Improve subtitle regex (Closes )
Yen Chi Hsuan a65402ef42 [bbc.co.uk:article] Add new extractor ()
Yen Chi Hsuan 7033bc1a51 [bbc] Fix test_BBC_9
Yen Chi Hsuan 89d5fbf354 [iqiyi] Update key
Jaime Marquínez Ferrándiz 8c3533ba97 [adultswim] Don't default to the native m3u8 downloader (closes )
Some of the streams are encrypted, which is not supported .
Sergey M․ 44d6dd08b2 [facebook] Fix extraction (Closes )
Sergey M․ cc449417c4 [vine] Use _search_regex for JSON data (Closes , closes )
remitamine 497f5fd93f [bilibili] extract multiple backup_urls
Sergey M․ 7308b8cb3d [stitcher] Improve (Closes , closes )
mjdubell 4211c83aa4 [stitcher] Add extractor
Stitcher review updates

Removed re import

Stitcher review updates
Sergey M․ d01949dc89 [utils:js_to_json] Fix bad escape in double quoted strings
Sergey M. 63a6494834 Merge pull request from lalinsky/vimeo-seed-status
[vimeo] Fix error parsing