Commit Graph

8759 Commits (59fd8f931d274cc702a7e260e9ec996f8db7c9f0)

Author SHA1 Message Date
Sergey M․ 196c6ba067
[facebook] Extract timestamp (Closes #10508) 8 years ago
Remita Amine 165620e320 [yahoo] extract more and better formats 8 years ago
Sergey M․ a249ab83cb
[pyvideo] Remove debugging code 8 years ago
Sergey M․ f7043ef39c
[soundcloud] Fix _VALID_URL clashes with sets (Closes #10505) 8 years ago
Sergey M․ 64fc49aba0
[bandcamp:album] Fix title extraction (Closes #10455) 8 years ago
Sergey M․ 245023a861
[pyvideo] Fix extraction (Closes #10468) 8 years ago
Remita Amine 3c77a54d5d [turner] keep video id intact 8 years ago
Remita Amine da30a20a4d [turner,cnn] move a check for wrong timestamp to CNNIE 8 years ago
Remita Amine 1fe48afea5 [cnn] update _TEST for CNNBlogsIE and CNNArticleIE(closes #10489) 8 years ago
Remita Amine 42e05be867 [ctv] add support for (tsn,bnn,thecomedynetwork).ca websites(#10016) 8 years ago
Remita Amine fe45b0e060 [9c9media] fix multiple stacks extraction and extract more metadata(#10016) 8 years ago
Sergey M․ a06e1498aa
[kusi] Update test 8 years ago
Sergey M․ 5a80e7b43a
[turner] Skip invalid subtitles' URLs 8 years ago
Sergey M․ 3fb2a23029
[adultswim] Extract video info from onlineOriginals (Closes #10492) 8 years ago
PeterDing 7be15d4097 [bilibili] Support episodes
[extractor/bilibili] add md5 for testing

[extractor/bilibili] remove unnecessary headers

[extractor/bilibili] correct _TESTS; find thumbnail for episode

[extractor/bilibili] [Fix] restore removed tests
8 years ago
Sergey M․ cd10b3ea63
[turner] Extract all formats 8 years ago
Sergey M․ 547993dcd0
[turner] Fix subtitles extraction 8 years ago
Remita Amine 93b8404599 [generic,vodplatform] improve embed regex 8 years ago
Sergey M․ 9ba1e1dcc0
[played] Remove extractor (Closes #10470) 8 years ago
Remita Amine b8079a40bc [turner] fix secure m3u8 formats downloading 8 years ago
Remita Amine 5bc8a73af6 [cartoonnetwork] make extraction work for more videos in the website
some videos require `networkName=CN2` to be present in the feed url
8 years ago
Remita Amine b3eaeded12 [tbs] Add new extractor(#10222) 8 years ago
Remita Amine ec65b391cb [cartoonnetwork] Add new extractor(#10110) 8 years ago
Remita Amine 2982514072 [turner,nba,cnn,adultswim] add base extractor to parse cvp feeds 8 years ago
Yen Chi Hsuan 98908bcf7c
[openload] Update algorithm again (#10408) 8 years ago
Yen Chi Hsuan 04b32c8f96
[bilibili] Fix extraction (closes #10375)
Thanks @gdkchan for the algorithm
8 years ago
Yen Chi Hsuan 40eec6b15c
[openload] Fix extraction (closes #10408)
Thanks to @yokrysty again!
8 years ago
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 8 years ago
Sergey M․ 92c27a0dbf
[periscope:user] Fix extraction (Closes #10453) 8 years ago
Yen Chi Hsuan 3b4b82d4ce
[douyutv] Simplify 8 years ago
Yen Chi Hsuan 545ef4f531
Merge branch 'patch-2' of https://github.com/steven7851/youtube-dl into steven7851-patch-2 8 years ago
Yen Chi Hsuan 906b87cf5f
[crackle] Revert to template-based thumbnail extraction
To reduce to number of HTTP requests
8 years ago
steven7851 b281aad2dc [douyutv] Use new api
use lapi for flv info, and html5 api for room info
#10153 #10318
8 years ago
Sergey M․ 6b18a24e6e
[tnaflix] Fix extraction (Closes #10434) 8 years ago
Sergey M․ f9b373afda
[nhk:vod] Improve extraction (Closes #10424) 8 years ago
Aleksander Nitecki 298a120ab7
[nhk] Add extractor for VoD. 8 years ago
Sergey M․ e3faecde30
[trutube] Remove extractor (Closes #10438) 8 years ago
Remita Amine a0f071a50d [usanetwork] Add new extractor 8 years ago
Yen Chi Hsuan b54a2da433
[crackle] Fix extraction and update _TESTS (closes #10333) 8 years ago
Yen Chi Hsuan dc2c37f316
[spankbang] Fix description and uploader (closes #10339) 8 years ago
Remita Amine 5c13c28566 raise unexpected error when no stream found 8 years ago
Remita Amine f70e9229e6 [discoverygo] detect when video needs authentication(closes #10425) 8 years ago
Remita Amine 30afe4aeb2 [cbc] Add support for watch.cbc.ca 8 years ago
Remita Amine f39ffc5877 [common] extract formats from #EXT-X-MEDIA tags 8 years ago
Yen Chi Hsuan 08773689f3 [kickstarter] Silent the warning for og:description
Closes #10415
8 years ago
Yen Chi Hsuan 0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
8 years ago
Yen Chi Hsuan 97653f81b2 [bilibili] Mark as broken
Bilibili now uses emscripten, which is very difficult for reverse
engineering. I don't expect it to be fixed in near future, so I mark
it as broken.

Ref: #10375
8 years ago
Sergey M․ 30317f4887
[pluralsight] Modernize and make more robust 8 years ago
Sergey M․ 8c3e35dd44
[pluralsight] Add support for subtitles (Closes #9681) 8 years ago
Sergey M․ 05bddcc512
[youtube] Fix authentication (2) (Closes #10392) 8 years ago
Sergey M․ 1212e9972f
[youtube] Fix authentication (#10392) 8 years ago
Remita Amine ccb6570e9e [syfy,bravotv] restrict drupal settings regex 8 years ago
Yen Chi Hsuan 18b6216150
[openload] Fix extraction (closes #10408)
Thanks @yokrysty for the algorithm
8 years ago
Remita Amine fb009b7f53 [bravotv] correct clip info extraction and add support for adobe pass auth(closes #10407) 8 years ago
Sergey M․ 3083e4dc07
[eagleplatform] Improve detection of embedded videos (Closes #10409) 8 years ago
Remita Amine 7367bdef23 [awaan] fix extraction, modernize, rename the extractors and add test for live stream 8 years ago
Remita Amine ad31642584 [nrk,abc:iview] use _extract_akamai_formats 8 years ago
Remita Amine c7c43a93ba [common] add helper method to extract akamai m3u8 and f4m formats 8 years ago
Yen Chi Hsuan 96229e5f95
[mtvservices:embedded] Update config URL
All starts from #10363. The test case in mtvservices:embedded uses
config.xml, while the video from #10363 and the test case in generic.py
is broken. Both uses index.html for fetching the feed URL.
8 years ago
Remita Amine 55d119e2a1 [abc:iview] Add new extractor(closes #6148) 8 years ago
Sergey M․ 3d897cc791
[ivi] Fix episode number extraction 8 years ago
Sergey M․ cf143c4d97
[ivi] Add support for 720p and 1080p 8 years ago
Yen Chi Hsuan ad120ae1c5
[extractor/common] Change the default m3u8 protocol in HTML5
Helper functions should have consistent default values
8 years ago
Remita Amine d0fa172e5f [firsttv] keep a test videos with multiple formats 8 years ago
Yen Chi Hsuan f97f9f71e5
Merge branch 'TRox1972-charlierose' 8 years ago
Yen Chi Hsuan 526656726b
[charlierose] Simplify and improve 8 years ago
Remita Amine 9b8c554ea7 [firsttv] fix extraction(closes #9249) 8 years ago
Yen Chi Hsuan d13bfc07b7
Merge branch 'charlierose' of https://github.com/TRox1972/youtube-dl into TRox1972-charlierose 8 years ago
Sergey M․ efe470e261
[twitch] Renew authentication 8 years ago
Sergey M․ e3f6b56909
[twitch] Refactor API calls 8 years ago
Sergey M․ b1e676fde8
[twitch] Modernize 8 years ago
Sergey M․ 92d4cfa358
[kaltura] Fallback ext calculation on caption's format 8 years ago
Remita Amine 3d47ee0a9e [zingmp3] fix extraction and add support for video clips(closes #10041) 8 years ago
Déstin Reed db29af6d36 [charlierose] Add new extractor 8 years ago
Sergey M․ 2c6acdfd2d
[kaltura] Add test for #10279 8 years ago
Sergey M․ fddaa76a59
[kaltura] Assume ttml to be default subtitles' extension 8 years ago
Sergey M․ a809446750
[kaltura] Add subtitles support when entry_id is unknown beforehand (Closes #10279) 8 years ago
Sergey M․ d8f30a7e66
[kaltura] Remove unused code 8 years ago
Remita Amine e25586e471 [cultureunplugged] fix extraction(closes #10330) 8 years ago
Remita Amine 292a2301bf [cnn] add support for money.cnn.com videos(closes #2797) 8 years ago
Remita Amine dabe15701b [cbs, cbsnews] fix extraction(fixes #10393) 8 years ago
Sergey M․ 4245f55880
[dotsub] Replace test (Closes #10386) 8 years ago
Déstin Reed 5b9d187cc6
[imdb] Improve title extraction and make thumbnail non-fatal 8 years ago
Yen Chi Hsuan 39e1c4f08c
[litv] Support 'promo' URLs (closes #10385) 8 years ago
Yen Chi Hsuan 19f35402c5
[snotr] Fix extraction (closes #10338) 8 years ago
Yen Chi Hsuan a9a3b4a081
[miomio] Adapt to the new API and update _TESTS
The test case is from #9680
8 years ago
Yen Chi Hsuan ecc90093f9
[vuclip] Adapt to the new API and update _TEST 8 years ago
Yen Chi Hsuan 520251c093
[extractor/common] Recognize m3u8 manifests in HTML5 multimedia tags 8 years ago
Yen Chi Hsuan 55af45fcab
[radiobremen] Update _TEST (closes #10337) 8 years ago
Yen Chi Hsuan b82232036a
[n-tv.de] Fix extraction (closes #10331) 8 years ago
Sergey M․ 9e5751b9fe
[globo:article] Relax _VALID_URL and video id regex (Closes #10379) 8 years ago
Sergey M․ 850837b67a
[porncom] Add extractor (Closes #2251, closes #10251) 8 years ago
Sergey M․ fd3ec986a4
[generic] Fix dbtv test (Closes #10364) 8 years ago
Sergey M․ b0d578ff7b
[dbtv] Relax embed regex 8 years ago
Déstin Reed b0c8f2e9c8
[DBTV:generic] Add support for embeds 8 years ago
Sergey M․ 51815886a9
[vk:wallpost] Fix audio extraction 8 years ago
Sergey M․ 08a42f9c74
[vk] Fix authentication on python3 8 years ago
Sergey M․ e15ad9ef09
[keezmovies] PEP 8 8 years ago
Sergey M․ 4e9fee1015
[hgtvcom:show] Add extractor (Closes #10365) 8 years ago
Remita Amine 7273e5849b [discoverygo] extend _VALID_URL to support other networks 8 years ago
Sergey M․ b505e98784
[extremetube] Revert display_id 8 years ago
Sergey M․ 92cd9fd565
[keezmovies] Make display_id optional 8 years ago
Sergey M․ ab19b46b88
[extremetube] Modernize 8 years ago
Sergey M․ 8804f10e6b
[tube8] Modernize 8 years ago
Sergey M․ 6be17c0870
[mofosex] Extract all formats and modernize (Closes #10335) 8 years ago
Sergey M․ 8652770bd2
[keezmovies] Improve and modernize 8 years ago
Sergey M․ 2a1321a272
[vbox7:generic] Add support for vbox7 embeds 8 years ago
Sergey M․ 9c0fa60bf3
[vbox7] Add support for embed URLs 8 years ago
Sergey M․ 502d87c546
[mtg] Improve view count extraction 8 years ago
Sergey M․ b35b0d73d8
[viafree] Add extractor (Closes #10358) 8 years ago
Sergey M․ 6e7e4a6edf
[mtg] Add support for viafree URLs (#10358) 8 years ago
Remita Amine 53fef319f1 [fxnetworks] extend _VALID_URL to support simpsonsworld.com 8 years ago
Remita Amine 2cabee2a7d [amcnetworks] fix typo 8 years ago
Remita Amine 11f502fac1 [theplatform] extract subtitles with multiple formats from the metadata 8 years ago
Sergey M․ 98affc1a48
[xvideos] Fix test 8 years ago
Sergey M․ 70a2829fee
[xvideos] Fix HLS extraction (Closes #10356) 8 years ago
Remita Amine 837e56c8ee [amcnetworks] extract episode metadata 8 years ago
Remita Amine b5ddee8c77 [amcnetworks] Add new extractor 8 years ago
Sergey M․ fb64adcbd3
[adobepass] PEP 8 8 years ago
Sergey M․ 4f640f2890
[bbc:playlist] Fix tests 8 years ago
Sergey M․ 254e64a20a
[bbc:playlist] Add support for pagination (Closes #10349) 8 years ago
Remita Amine 818ac213eb [adobepass] add IE suffix to the extractor and remove duplicate constant 8 years ago
Remita Amine cbef4d5c9f [fxnetworks] add test and check geo restriction 8 years ago
Remita Amine bf90c46790 [fxnetworks] Add new extractor(closes #9462) 8 years ago
Yen Chi Hsuan 69eb4d699f
[cbsnews] Remove invalid tests. CBS Live videos gets deleted soon. 8 years ago
Yen Chi Hsuan 760845ce99
[cbslocal] Adapt to SendtoNewsIE 8 years ago
Yen Chi Hsuan 5c2d087221
[sendtonews] Fix extraction 8 years ago
Yen Chi Hsuan b6c4e36728
[jwplatform] Parse video_id from JWPlayer data
And remove a mysterious comma from 115c65793a
8 years ago
Sergey M․ 1a57b8c18c
[zippcast] Remove extractor (Closes #10332)
ZippCast is shut down
8 years ago
Remita Amine 24eb13b1c6 [uplynk,viceland] update tests and change uplynk extractors names 9 years ago
Remita Amine 525e0316c0 [adobepass] fix check for pendingLogout errors 9 years ago
Remita Amine 7e60ce9cf7 [adobepass] clear cache in case of pendingLogout errors 9 years ago
Remita Amine e811bcf8f8 [viceland] raise ExtractorError for errors other than HTTP 400 9 years ago
Remita Amine 6103f59095 [viceland] remove outdated comment 9 years ago
Remita Amine 9fa5789279 [viceland] fix info extraction(closes #8799) 9 years ago
Remita Amine d2ac04674d [viceland] Add new extractor(#8799) 9 years ago
Remita Amine 1fd6e30988 [adobepass] create separate class for adobe pass authentication 9 years ago
Sergey M․ 884cdb6cd9
[life:embed] Improve extraction 9 years ago
Remita Amine 9771b1f901 [theplatform] use _get_netrc_login_info and fix session expiration check(#10345) 9 years ago
Remita Amine 2118fdd1a9 [common] add separate method for getting netrc ligin info 9 years ago
Sergey M․ 320d597c21
[vgtv] Detect geo restricted videos (#10348) 9 years ago
Remita Amine aaf44a2f47 [uplynk] Add new extractor 9 years ago
phi 097eba019d bug fix for extractor xiami.py
Before applying this patch, when downloading resources from xiami.com, it crashes with these:
Traceback (most recent call last):
  File "/home/phi/.local/bin/youtube-dl", line 11, in <module>
    sys.exit(main())
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 433, in main
    _real_main(argv)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 423, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1786, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 691, in extract_info
    ie_result = ie.extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 347, in extract
    return self._real_extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 116, in _real_extract
    return self._extract_tracks(self._match_id(url))[0]
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 43, in _extract_tracks
    '%s/%s%s' % (self._API_BASE_URL, item_id, '/type/%s' % typ if typ else ''), item_id)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 562, in _download_json
    json_string, video_id, transform_source=transform_source, fatal=fatal)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 568, in _parse_json
    return json.loads(json_string)
  File "/usr/lib/python3.5/json/__init__.py", line 312, in loads
    s.__class__.__name__))
TypeError: the JSON object must be str, not 'NoneType'

This patch solves exactly this problem.
9 years ago
Sergey M․ 5ec5461e1a
[pbs] Clarify comment on http formats 9 years ago
Sergey M․ 542130a5d9
[pbs] Fix description extraction and update tests 9 years ago
Sergey M․ 82997dad57
[franceculture] Fix extraction (Closes #10324) 9 years ago
Sergey M․ 647a7bf5e8
[pornotube] Fix extraction (Closes #10322) 9 years ago
Sergey M․ 77afa008dd
[4tube] Fix metadata extraction (Closes #10321) 9 years ago
Yen Chi Hsuan db535435b3
[bigflix] Remove an invalid test
There's no video anymore
9 years ago
Sergey M․ c2a453b461
[imgur] Fix width and height extraction (Closes #10325) 9 years ago
Sergey M․ cd29eaab95
[vbox7] Remove unused imports 9 years ago
Sergey M․ e97c55ee6a
[expotv] Improve extraction and update test 9 years ago
Sergey M․ cb55908e51
[vbox7] Fix extraction (Closes #10309) 9 years ago
Yen Chi Hsuan e581224843
[tapely] Remove extractor. It's shut down
Closes #10323
9 years ago
Remita Amine f50365e91c [pbs] add test for videos with undocumented http formats and remove unused import 9 years ago
Sergey M․ c366f8d30a
[24video] Add support for me and xxx TLDs 9 years ago
Sergey M․ 6a26c5f9d5
[muenchentv] Fix extraction (Closes #10313) 9 years ago
Sergey M․ bd6fb007de
[24video] Fix comment count extraction 9 years ago
Sergey M․ b69b2ff736
[sunporno] Add support for embed URLs 9 years ago
Sergey M․ 794e5dcd7e
[sunporno] Fix metadata extraction (Closes #10316) 9 years ago
Remita Amine f0d3669437 [hgtv] Add new extractor(closes #3999) 9 years ago
Remita Amine 3cddb8d6a7 [pbs] check all http formats and remove unnecessary request
- some of the quality that not reported in the documentation
are available(4500k, 6500k)
- the videoInfo request doesn't work for a long time
9 years ago
Sergey M․ 990d533ee4
[crunchyroll] Add support for HLS (Closes #10301) 9 years ago
Sergey M․ a3be69b7f0
[viu] Remove from extractors 9 years ago
Sergey M․ 0fd1b1624c
[goldenmoustache] Remove extractor (Closes #10298)
Now uses dailymotion
9 years ago
Sergey M․ 367976d49f
[drtuber] Improve title extraction 9 years ago
Sergey M․ 0aef0771f8
[drtuber] Make dislike count optional (Closes #10297) 9 years ago
Sergey M․ 0c070681c5
[chirbit] Fix extraction (Closes #10296) 9 years ago
Sergey M․ 30b25d382d
[francetvinfo] Relax _VALID_URL 9 years ago
Sergey M․ 7f2ed47595
[rtlnl] Relax _VALID_URL (Closes #10282) 9 years ago
Sergey M․ c3fa77bdef
[formula1] Relax _VALID_URL (Closes #10283) 9 years ago
Remita Amine 57ce8a6d08 [wat] improve extraction(#10281)
add alternative method to extract http formats
works even if the video is geo-restricted or removed
from public access(most of the cases)
9 years ago
Yen Chi Hsuan 69d8eeeec5
[ctsnews] Fix extraction 9 years ago
Remita Amine 20ef4123b9 [uol] remove unused import 9 years ago
Remita Amine 4e62d26aa2 [uol] Add new extractor(#4263) 9 years ago
Sergey M․ 3a380766d1
[rbmaradio] Improve, simplify and extract all formats (Closes #10242) 9 years ago
Petr Zvoníček affaea0688
[rbmaradio] Fixed extractor 9 years ago
Sergey M․ 77426a087b
[sonyliv] Improve (Closes #10258) 9 years ago
Sukhbir Singh 8991844ea2
[sonyliv] Add new extractor 9 years ago
Sergey M․ 082395d0a0
[extractor/generic] Add proper default to _search_json_ld call 9 years ago
Sergey M․ e8ed7354e6
[flipagram] Add proper default to _search_json_ld call 9 years ago
Sergey M․ 1e7f602e2a
[condenast] Make _search_json_ld call non fatal 9 years ago
Sergey M․ 522f6c066d
[bbc] Add proper default to _search_json_ld call 9 years ago
Sergey M․ 321b5e082a
[extractor/common] Respect default in _search_json_ld 9 years ago
Sergey M․ 3711fa1eb2
Revert "[flipagram] Make _search_json_ld non fatal"
This reverts commit d34995a9e3.
9 years ago
Sergey M․ 395c74615c
Revert "[extractor/generic] Make _search_json_ld non fatal"
This reverts commit 958849275f.
9 years ago
Yen Chi Hsuan 3dc240e8c6
[sohu] Update _TESTS (closes #10260) 9 years ago
Yen Chi Hsuan a41a6c5094
[chaturbate] Skip the invalid test 9 years ago
Yen Chi Hsuan d71207121d
[biqle] Skip an invalid test 9 years ago
Yen Chi Hsuan b1c6f21c74
[aparat] Fix extraction 9 years ago
Yen Chi Hsuan 412abb8760
[bilibili] Update _TESTS 9 years ago
Yen Chi Hsuan f17d5f6d14
[features.aol.com] Fix _TESTS 9 years ago
Remita Amine 6bb801cfaf [cwtv] extract http formats 9 years ago
Sergey M․ de02d1f4e9
[rozhlas] Fix regexes and improve extraction (Closes #10253) 9 years ago
Petr Zvoníček e1f93a0a76
[rozhlas] Add new extractor 9 years ago
Yen Chi Hsuan b2bd968f4b
[kuwo:singer] Fix extraction 9 years ago
Sergey M․ d92cb46305
[discoverygo] Add extractor (Closes #10245) 9 years ago
Sergey M․ d34995a9e3
[flipagram] Make _search_json_ld non fatal 9 years ago
Sergey M․ 958849275f
[extractor/generic] Make _search_json_ld non fatal 9 years ago
Sergey M․ 998f094452
[bbc] Remove proxy from test 9 years ago