Commit Graph

9562 Commits (b022f4f600a2d73c65e569a9f0a19eed47272938)

Author SHA1 Message Date
Sergey M․ 0236cd0dfd
[extractor/common] Improve height extraction and extract bitrate 8 years ago
Sergey M․ ed0cf9b383
[extractor/common] Move jwplayer formats extraction in separate method 8 years ago
Sergey M․ 5316566edc
[twitch] Use better naming and simplify (closes #11974) 8 years ago
Xiao Di Guan c64c03be35
[twitch] Add basic support for two-factor authentication 8 years ago
Lars Vierbergen a3ba8a7acf [vier] Add support for vijf.be
vier.be and vijf.be run on the same CMS and are property of the same company,
so the same extractor can be used for both of them.
8 years ago
Sergey M․ 054a587de8
[redbulltv] Improve extraction (closes #11948, closes #3919) 8 years ago
Juanjo Benages 64b7ccef3e
[redbulltv] Add extractor 8 years ago
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
8 years ago
Sergey M․ eb3079b6ce
[generic] Add support for rutube embeds 8 years ago
Sergey M․ bc82f22879
[rutube] Relax _VALID_URL 8 years ago
Sergey M․ 4d058c9862
[vrak] Improve and update test (closes #11452) 8 years ago
Sergey M․ d16f27ca27
[brightcove:new] Add ability to smuggle geo_countries into URL 8 years ago
Olivier Bilodeau cbb127568a
[vrak] Add extractor 8 years ago
Sergey M․ d02d4fa0a9
[brightcove:new] Raise GeoRestrictedError 8 years ago
Sergey M․ 692fa200ca
[go] Relax _VALID_URL (closes #12341) 8 years ago
Sergey M․ 9bae185ba6
[24video] Use original host for requests (closes #12339) 8 years ago
Sergey M․ 4d345bf17b
[ruutu] Disable DASH formats (closes #12322)
Due to causing out of sync issue
8 years ago
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
8 years ago
Yen Chi Hsuan c9612c0487
[youtube] Mark errors about rental videos as expected
Closes #12324
8 years ago
Yen Chi Hsuan af5049f128
[adobepass] Add Charter Spectrum (#11465)
Thanks @tv21 for the fix!
8 years ago
Sergey M․ 4b8a984c67
[npo] Add support for audio 8 years ago
Sergey M․ 83e8fce628
[npo] Improve extraction and update tests 8 years ago
Sergey M․ aa9cc2ecbf
[npo] Adapt to app.php API (closes #12311) 8 years ago
Sergey M․ 43b38424a9
[azmedien:showplaylist] Improve (closes #12160) 8 years ago
Alex Seiler 948519b35d
[azmedien:showplaylist] Add support for all episodes playlists 8 years ago
Sergey M․ 87dadd456a
[youtube:playlist] Recognize another playlist pattern (closes #11928, closes #12286) 8 years ago
Yen Chi Hsuan 7c4aa6fd6f
[daisuki] Add subtitles (#4738) 8 years ago
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 8 years ago
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
8 years ago
Sergey M․ 18abb74376
[npo] Relax _VALID_URL for zapp.nl 8 years ago
Sergey M․ dbc01fdb6f
[hetklokhuis] Fix IE_NAME 8 years ago
Sergey M․ f264c62334
[npo] Add support for zapp.nl 8 years ago
Sergey M․ 0dc5a86a32
[npo] Add support for hetklokhuis.nl (closes #12293) 8 years ago
Sergey M․ 0e879f432a
[youtube:channel] Remove duplicate test 8 years ago
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
8 years ago
Alex Seiler fdeea72611 [cda] Decode URL (fixes #12255) 8 years ago
xbe 7fd4655256 [crunchyroll] Extract uploader name that's not a link
Provide the Crunchyroll extractor with the ability to extract uploader
names that aren't links. Add a test for this new functionality.
This fixes #12267.
8 years ago
Sergey M․ fd5c4aab59
[youtube] Raise GeoRestrictedError 8 years ago
Sergey M․ 8878789f11
[dailymotion] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
8 years ago
Sergey M․ b3aec47665
[tvigle] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 8 years ago
Sergey M․ e498758b9c
[freshlive] Fix issues and improve (closes #12175) 8 years ago
Ricardo Constantino 5fc8d89361
[freshlive] Add extractor 8 years ago
Sergey M․ 103f8c8d36
[xhamster] Capture and output videoClosed error (#12263) 8 years ago
Sergey M․ 922ab7840b
[etonline] Add extractor (closes #12236) 8 years ago
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 8 years ago
Yen Chi Hsuan eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries
Some websites, like NJPWorld, put different qualities on different
player pages.
8 years ago
Sergey M․ 231bcd0b6b
[amcnetworks] Relax _VALID_URL (#12127) 8 years ago
Sergey M․ ad3033037c
[noco] Modernize 8 years ago
Sergey M․ f3bc281239
[noco] Swtich login URL to https (closes #12246) 8 years ago
Sergey M․ 441d7a32e5
[thescene] Extract more metadata 8 years ago
Thomas Christlieb 51ed496307 [thescene] Fix extraction (closes #12235) 8 years ago
Remita Amine 68f17a9c2d [tubitv] use geo bypass mechanism 8 years ago
Remita Amine 39e7277ed1 [openload] fix extraction(closes #10408) 8 years ago
Sergey M․ 42dcdbe11c
[ivi] Raise GeoRestrictedError 8 years ago
Sergey M․ f2980fddeb
[lynda:course] Add webpage extraction fallback (closes #12238) 8 years ago
Remita Amine 8e1409fd80 [go] sign all uplynk urls and use geo bypass only for free videos(closes #12087)(closes #12210) 8 years ago
Sergey M․ d5fd9a3be3
[skylinewebcams] Add extractor (closes #12221) 8 years ago
Sergey M․ ada77fa544
[instagram] Add support for multi video posts (closes #12226) 8 years ago
Remita Amine 9e03aa75c7 [crunchyroll] extract playlist entries ids 8 years ago
Remita Amine 30eaa3a702 [mgtv] fix extraction 8 years ago
Remita Amine c59f703610 [sohu] raise GeoRestrictedError 8 years ago
Remita Amine bc61c80c14 [leeco] raise GeoRestrictedError and use geo bypass mechanism 8 years ago
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 8 years ago
Sergey M․ 527ef85fe9
[dailymotion] Make comment count optional (closes #12209)
Not served anymore
8 years ago
Sergey M․ 58ad6995cd
[vidzi] Add test for #12213 8 years ago
Tobias Florek a86e416088 [vidzi] Add support for vidzi.cc 8 years ago
Sergey M․ 71e9577b94
[24video] Add support for 24video.tube (closes #12217) 8 years ago
Remita Amine abd29a2ced [crackle] use geo bypass mechanism 8 years ago
Remita Amine 31615ac279 [viewster] use geo verifcation headers 8 years ago
Remita Amine fc320a40d9 Revert "[cbc] use geo bypass mechanism"
This reverts commit 86466a8b6f.
8 years ago
Remita Amine 7345d6d465 [tfo] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Remita Amine 86466a8b6f [cbc] use geo bypass mechanism 8 years ago
Remita Amine 33dc173cdc [telequebec] use geo bypass mechanism 8 years ago
Remita Amine 3444844b04 [limelight] extract PlaylistService errors 8 years ago
Sergey M․ eea0716cae
[extractor/common] Print origin country for fake IP 8 years ago
Sergey M․ 336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries 8 years ago
Sergey M․ dc0a869e5e
[extractor/common] Fix typo 8 years ago
Sergey M․ e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors (#11970) 8 years ago
Remita Amine e469ab2528 [ninecninemedia] use geo bypass mechanism 8 years ago
Remita Amine 890d44b005 [adobepass] add support for Time Warner Cable(closes #12191) 8 years ago
Sergey M․ 6926304472
[spankbang] Make uploader optional (closes #12193) 8 years ago
Sergey M․ 3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental 8 years ago
Sergey M․ da42ff0668
[iprima] Improve geo restriction detection and disable geo bypass 8 years ago
Sergey M․ 82f662182b
[iprima] Modernize 8 years ago
Sergey M․ 2cc7fcd338
[commonmistakes] Disable UnicodeBOM extractor test for python 3.2 8 years ago
Sergey M․ 6d4c259765
[svt] PEP 8 8 years ago
Sergey M․ c78dd35491
[nrk] PEP 8 8 years ago
Sergey M․ 8ffb8e63fe
[prosiebensat1] Throw ExtractionError on unsupported page type (closes #12180) 8 years ago
Sergey M․ 983e9b7746
[nrk] Update _API_HOST and relax _VALID_URL 8 years ago
Sergey M․ c58b7ffef4
[tv4] Bypass geo restriction and improve detection 8 years ago
Sergey M․ f1a78ee4ef
[tv4] Switch to hls3 protocol (closes #12177) 8 years ago
Sergey M․ 4248dad92b Improve geo bypass mechanism
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
8 years ago
Sergey M․ 0a840f584c Rename bypass geo restriction options 8 years ago
Sergey M․ 0016b84e16 Add faked X-Forwarded-For to formats' HTTP headers 8 years ago
Sergey M․ 5d3fbf77d9 [viki] Improve geo restriction detection 8 years ago
Sergey M․ 80b59020e0 [vgtv] Improve geo restriction detection 8 years ago
Sergey M․ 71631862f4 [srgssr] Improve geo restriction detection 8 years ago
Sergey M․ 89cc7fe770 [vbox7] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 04d906eae3 [svt] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 8ab8066cf0 [pbs] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 01b1aa9ff4 [ondemandkorea] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ ff4007891f [nrk] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 28200e654b [itv] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ e633f21a96 [go] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ d392005a79 [dramafever] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 773f291dcb Add experimental geo restriction bypass mechanism
Based on faking X-Forwarded-For HTTP header
8 years ago
Remita Amine 049a0f4d6d [brightcove:legacy] restrict videoPlayer value(closes #12040) 8 years ago
Sergey M․ e84888b432
[tvn24] Improve extraction (closes #11679) 8 years ago
Jakub Wilk 02d9b82a23
[tvn24] Add extractor 8 years ago
Sergey M․ a2e3286676
[thisav] Add support for html5 media (closes #11771) 8 years ago
Sergey M․ f75caf059e
[metacafe] Improve (closes #10371) 8 years ago
Alex Monk bdabbc220c
[metacafe] Bypass family filter
If you don't send this user=ffilter: false cookie, it will 301 redirect you to a page asking about it, and then the title check will fail.
8 years ago
Remita Amine 70bcc444a9 [viceland] improve info extraction and update test 8 years ago
Sergey M․ bad4ccdb5d
[heise] Improve (closes #9725) 8 years ago
Tobias Gruetzmacher db76c30c6e
[heise] Support videos embedded in any article. 8 years ago
Déstin Reed c2bde5d081
[ellentv] Improve 8 years ago
Sergey M․ 90fad0e74c
[openload] Fix extraction (closes #12002) 8 years ago
Vijay Singh d94badc755
[openload] Semifix extraction (closes #10408)
just updated the code. i don't do much python still i tried to convert my code. lemme know if there is any prob with it
8 years ago
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 8 years ago
Sergey M․ 4cead6a614
[einthusan] Relax _VALID_URL (closes #12141, closes #12159) 8 years ago
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 8 years ago
Sergey M․ b898f0a173
[elpais] Fix typo and improve extraction (closes #12139) 8 years ago
Sergey M․ eafaeb226a
[ceskatelevize] Lower priority for audio description sources (#12119) 8 years ago
Sergey M․ de4d378c0c
[ceskatelevize] Prefix format ids 8 years ago
Remita Amine 1bd05345ea [amcnetworks] fix extraction(closes #12127) 8 years ago
Sergey M․ 3021cf83b7
[pinkbike] Fix uploader extraction (closes #12054) 8 years ago
Sergey M․ 04a741232f
[onetpl] Add support for businessinsider.com.pl and plejada.pl 8 years ago
Sergey M․ 43a3d9edfc
[onetpl] Add support for onet.pl (closes #10507) 8 years ago
Sergey M․ d31aa74fdb
[onetmvp] Add shortcut extractor 8 years ago
Sergey M․ 6092ccd058
[vodpl] Make more robust and add another test (closes #12122) 8 years ago
Marek Rusinowski 22ce9ad2bd
[vod.pl] Add new extractor 8 years ago
Sergey M․ 9a372f14b4
[pornhub] Extract video URL from tv platform site (#12007, #12129) 8 years ago
Sergey M․ 5cb2d36c82
[ceskatelevize] Extract DASH formats (closes #12119, closes #12133) 8 years ago
Ondřej Caletka fcca0d53a8
[ceskatelevize] Quick fix to revert to using old HLS-based playlist
This fixes recent changes in iVysilani. Proper patch should migrate to
MPEG-DASH version, which is now the default.
8 years ago
Sergey M․ 50de3dbad3
[zdf] Fix extraction (closes #12117) 8 years ago
Sergey M․ 085f169ffe
[xtube] Fix extraction for both kinds of video id (closes #12088) 8 years ago
Vobe f6d6ca1db3
[xtube] Improve title extraction 8 years ago
Sergey M․ 6e5956e6ba
[lemonde] Fallback delegate extraction to generic extractor (closes #12115, closes #12116) 8 years ago
Remita Amine 89c6691f9d [bellmedia] accept longer video id(closes #12114) 8 years ago
Remita Amine 454e5cdb17 [limelight] add support referer protected videos 8 years ago
Remita Amine 9dad941853 [disney] improve extraction
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos

closes #4975
closes #11000
closes #11882
closes #11936
8 years ago
Remita Amine 0dac7cbb09 [hotstar] improve extraction(closes #12096)
- extract all qualities
- detect drm protected videos
- extract more metadata
8 years ago
Yen Chi Hsuan f8514630db
[einthusan] Fix extraction (closes #11416)
The old test URLs are no longer valid, so I replace them with the one
from #11416
8 years ago
Aniruddh-J 459818e280 [aenetworks] Add support for lifetimemovieclub.com 8 years ago
Sergey M․ 6310acf512
[youtube] Fix parsing codecs (closes #12091) 8 years ago
Yen Chi Hsuan 68c22c4c15
[iqiyi] Update _TESTS 8 years ago
Sergey M․ 3d7e3aaa0e
[pluralsight:course] Fix extraction (closes #12075) 8 years ago
Sergey M․ 624c4b92ff
[facebook] Add coding cookie 8 years ago