Commit Graph

9419 Commits (5fc8d893612285ddba082f381006337573b36afa)

Author SHA1 Message Date
Remita Amine f65dba7cdb [myspace] fix extraction and extract hls and http formats 8 years ago
Remita Amine 605fd6392f [youtube] add format info for itag 325 and 328 8 years ago
Sergey M․ f962790ee5
[vine] Fix extraction (closes #11955) 8 years ago
Sergey M․ b7cc5f078e
[extractors] Remove remnants of sportbox extractor (#11954) 8 years ago
Sergey M․ f7a10d8cd6
[sportbox] Remove extractor (closes #11954)
Covered by generic extractor
8 years ago
Remita Amine df0588a31f Merge branch 'fstirlitz-filmon' 8 years ago
Remita Amine 4ce3407d08 [filmon] improve extraction 8 years ago
Mattias Wadman 45024183ae [infoq] Add audio only format if available (#11565)
* [infoq] Add audio only format if available

Refactor cookie code into a function.
Renamed formats to http_video, http_audio, rtmp_video
Renamed extract functions to video instead of videos as they return
one or no video.

* [infoq] Rename to _extract_cookies as it more than one

* [infoq] Remove redundant determine_ext

* [infoq] Add comment about hardcoded URL

* [infoq] Use _hidden_inputs instead of messy regex

* [infoq] Probe if audio URL is valid

Make it possible to pass headers to _is_valid_url

* [infoq] Add audio only test
8 years ago
Justsoos 33da98f493
[douyutv] Improve room id regex
http://www.douyu.com/t/lpl  source get extra '\' with "room_id\" (from js coding)
8 years ago
Michal Čihař 0bbcc8a10a
[iprima] Fix extraction (closes #11920, closes #11896) 8 years ago
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
8 years ago
Sergey M․ c54c01f82d
[go] Relax video id regex (closes #11937) 8 years ago
Sergey M․ 5a116e1302
[facebook] Fix title extraction (closes #11941) 8 years ago
Sergey M․ a685751051
[youtube:playlist] Recognize TL playlists (closes #11945) 8 years ago
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
8 years ago
Remita Amine 81aeafeb44 [cbc:watch] extract audio codec for audion only formats(fixes #11893) 8 years ago
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 8 years ago
Sergey M․ b83ef507b4
[facebook] Fix extraction (closes #11926) 8 years ago
Yen Chi Hsuan fe5aa197b5
[prosiebensat1] PEP8 and update _TESTS 8 years ago
Thomas Christlieb 7882f1115e Added new Regex for prosiebensat1 Extractor Description. Fixes #11810 (#11929)
* Added new Regex for prosiebensat1 Extractor Description. Fixes #11810

* Using _og_search_description() as a Fallback for Description-Regex

* Using _og_search_description() as a Fallback for Description-Regex - Second try

* Also added fallback regex

* Using _og_search_description() as a Fallback for Description-Regex - Third try

* removed fatal=False from search for description regex. default=None should be preferred only

* Using fatal=false for _og_search_description

* Revert "Using fatal=false for _og_search_description"

This reverts commit 2b7e123f9d.

* Deleted default=None Parameter for _og_search_property
8 years ago
Yen Chi Hsuan 2b2d5d319b
[crunchyroll] Remove ScaledBorderAndShadow settings
See https://github.com/rg3/youtube-dl/pull/9028, especially @lachs0r's
comments for the reason behind this change
8 years ago
Sergey M․ 26c0f09935
[vimeo] PEP 8 8 years ago
Sergey M․ c15cd29640
[vimeo] Extract upload timestamp 8 years ago
Sergey M․ c38a67bcd5
[vimeo] Extract license (closes #11880) 8 years ago
Sergey M․ 7c5329e6f4
[nrk] Improve extraction and update tests (closes #11571) 8 years ago
Odd Stråbø 8fd65faece
[NRKTV] Added NRKTVSeriesIE
[NRKTV] Added season and episode number to metadata.

[NRKTV] Added category to metadata.

[NRKTV] Added tests to NRKTVSeries.

[NRKTV] Fixed whitespace issues (flake8).
8 years ago
Sergey M․ 3c90cc8b6f
[youtube] Fix extraction for domainless player URLs
Closes #11890
Closes #11891
Closes #11892
Closes #11894
Closes #11895
Closes #11897
Closes #11900
Closes #11903
Closes #11904
Closes #11906
Closes #11907
Closes #11909
Closes #11913
Closes #11914
Closes #11915
Closes #11916
Closes #11917
Closes #11918
Closes #11919
8 years ago
Remita Amine ae9a173b64 [vimeo] extract both mixed and separated dash formats 8 years ago
Remita Amine dadb836139 [ruutu] extract dash formats 8 years ago
Remita Amine 4719419951 [itv] fix extraction in python 2.6 8 years ago
Alex Seiler f13da8af28
[azmedien:playlist] Add support for topic and themen playlists 8 years ago
Sergey M․ e228616c6e
[extractor/common] Fix initialization template (closes #11605, closes #11825) 8 years ago
Sergey M․ c58c2d63cb
[extractor/common] Document forgotten fragment base and path interfaces 8 years ago
Sergey M․ d04621daf4
[extractor/common] Fix duration per dash segment (closes #11868) 8 years ago
Andre Walker 56fc078da8 [npo] Update subtitles url
NPO websites changed the domain they used for subtitles, from
e.omroep.nl to tt888.omroep.nl.
8 years ago
Remita Amine 4edeac5bfa [itv] fix subtitle extraction 8 years ago
Remita Amine f592ff9868 [itv] extract subtitles 8 years ago
Remita Amine a71b8d3b3b [itv] Add new extractor(closes #9240) 8 years ago
Sergey M․ 008f247077
[mtv81] Add extractor (closes #7619) 8 years ago
Sergey M․ 661cc229d2
[vlive:channel] Improve 8 years ago
ping b92d3c5343 [vlive] Add support for channels 8 years ago
Sergey M․ ab6f6aee78
[kaltura] Add fallback for fileExt 8 years ago
Sergey M․ 26e40542dd
[kaltura] Improve uploader_id extraction 8 years ago
Alex Seiler 99a0baf370
[konserthusetplay] Add support for rspoplay.se 8 years ago
Sergey M․ e0b6e50ccd
[crunchyroll] Improve series and season metadata extraction (closes #11832) 8 years ago
Sergey M․ 3a194cb4ec
[soundcloud] Improve formats extraction and extract audio bitrate 8 years ago
Sergey M․ 9b73471801
[soundcloud] Extract hls formats 8 years ago
Sergey M․ 489ffc1182
[soundcloud] Fix track URL extraction (closes #11852) 8 years ago
Sergey M․ 0b23c222ba
[twitch:vod] Expand _VALID_URL (closes #11846) 8 years ago
Remita Amine b51a4ebed4 [aenetworks] fix season episodes extraction(fixes #11669) 8 years ago
Remita Amine 9463637887 [tva] Add new extractor(closes #11842) 8 years ago
Sergey M․ 3cbecdd111
[jamendo] Improve and extract more metadata (closes #11836) 8 years ago
Stefan Pöschel c19ef77c31
[jamendo] Extract full title 8 years ago
Remita Amine b3277115a1 [disney] Add new extractor(closes #7409)(closes #11801)(#4975)(#11000) 8 years ago
Remita Amine 9bccdc7004 [vevo] remove request to old api and catch apiv2 errors 8 years ago
Sergey M․ cf0cabbe50
[cmt,mtv,southpark] Add support for episode URLs (closes #11837) 8 years ago
Sergey M․ 556dbe7fe3
[youtube] Add fallback for duration extraction (closes #11841) 8 years ago
Sergey M․ c1fa3f4672
[openload] Fallback video extension to mp4 8 years ago
Sergey M․ 17f8deeb48
[extractor/generic] Add support for openload embeds (closes #11536, closes #11812) 8 years ago
Remita Amine b8a03b6660 [srgssr] fix rts video extraction(closes #11831) 8 years ago
Remita Amine c60089c022 [afreecatv:global] Add new extractor(closes #11807) 8 years ago
Sergey M․ af59bddc4e
[konserthusetplay] Extract subtitles (#11823) 8 years ago
Remita Amine 23b35a634e [crackle] improve extraction
- extract vtt subtitles
- extract multiple resolutions for thumbnails
- pass geo verification proxy headers
- add support for mobile urls
8 years ago
Sergey M․ 74af9c700d
[konserthusetplay] Add support for hls formats (closes #11823) 8 years ago
Sergey M․ d61aa5eb37
[vimeo:review] Fix config URL extraction (closes #11821) 8 years ago
Sergey M․ b494d6856c
[pluralsight] Fix extraction (closes #11820) 8 years ago
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 8 years ago
Sergey M․ 6d119c2a6b
[24video] Fix extraction (closes #11811) 8 years ago
Sergey M․ 4201ba13e6
[youtube:playlist] Fix nonexistent/private playlist detection and skip private tests 8 years ago
Grzegorz P 8bc0800d7c [youtube:playlist] Fix nonexistent/private playlist detection (closes #11604) 8 years ago
Alex Seiler a089545e03 [azmedien:show] Improve _VALID_URL 8 years ago
Gaetan Gilbert 30dda24de3 [chirbit] Extract uploader 8 years ago
Sergey M․ 271808b6b2
[pornflip] Improve and extract dash formats (closes #11795) 8 years ago
einstein95 8d1fbe0cb2
[pornflip] Add extractor (closes #11556) 8 years ago
Sergey M․ a243abb80d
[chaturbate] Improve (closes #11797) 8 years ago
einstein95 42697bab3c
[chaturbate] Fix extraction 8 years ago
Sergey M․ 94629e537f
[azmedien] Improve (closes #11784) 8 years ago
Alex Seiler e84495cd8d
[azmedien] Add extractor (closes #11785) 8 years ago
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs 8 years ago
ha shao 04a3d4d234
[vimeo:channel] Extract videos' titles for playlist entries 8 years ago
Sergey M․ 12afdc2ad6
[youtube] Extract episode metadata (closes #9695, closes #11774) 8 years ago
Yen Chi Hsuan f3c21cb7a7
[cspan] Fix _TESTS 8 years ago
Yen Chi Hsuan 972efe60c3
[generic] Remove a dead test
The web page does not contain a video anymore

Ref: #2694, #2696
8 years ago
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
8 years ago
Yen Chi Hsuan d77ac73790
[ustream] Add UstreamIE._extract_url()
Ref: #11547
8 years ago
Sergey M․ 1fe84be0f3
[1tv] Add support for hls (closes #11786) 8 years ago
james mike dupont cccd70a275 untie 8 years ago
Sergey M․ eb3f008c9e
[uol] Fix extraction (closes #11770) 8 years ago
Sergey M․ f1e70fc2ff
[mtv] Relax triforce feed regex (closes #11766) 8 years ago
Remita Amine baa3e1845b [bilibili] fix extraction(closes #11077) 8 years ago
Sergey M․ aaf2b7c57a
[canalplus] Add fallback for video id (closes #11764) 8 years ago
Sergey M․ b687c85eab
[extractor/generic] Add support for 20 minuten embeds (closes #11683, closes #11751) 8 years ago
Sergey M․ 538b17a09c
[20min] Improve 8 years ago
Alex Seiler 4e44598547
[20min] Fix extraction 8 years ago
Sergey M․ 136078966b
[imdb] Extend _VALID_URL (closes #11744) 8 years ago
Sergey M․ 8a5f0a6357
[naver] Update tests for #11743 8 years ago
Kagami Hiiragi c0bd51c090 [naver] Support tv.naver.com links 8 years ago
Sergey M․ 79fc8496c6
[xiami] Improve extraction (closes #11699)
* Relax _VALID_URLs
* Improve track metadata extraction
8 years ago
Sergey M․ 906420cae3
[limelight] Improve and make more robust (closes #11737)
+ Add support for direct http for videos hosted on video.llnw.net
* Check handmade http URLs
8 years ago
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
8 years ago
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
8 years ago
Yen Chi Hsuan 8e4988f1a2
[niconico] Remove codes for downloading anonymously
Apparently Niconico now blocks playing without an account

Closes #11170
8 years ago
Sergey M․ a7acf868a5
[yourupload] Fix extraction (closes #11601) 8 years ago
Sergey M․ af62de104f
[beam:live] Improve and simplify (#10702, closes #11596) 8 years ago
sh!zeeg cd55c6ccd7
[beam:live] Add extractor 8 years ago
Sergey M․ 621a2800ca
[vevo] Improve geo restriction detection 8 years ago
Sergey M․ b80e2ebc8d
[dramafever] Add support for URLs with language code (#11714) 8 years ago
Remita Amine 99d537a5e0 [ooyala] fix typo 8 years ago
Sergey M․ abe8cb763f
[cbc] Improve playlist support (closes #11704) 8 years ago
Jakub Wilk 4f66c16f33 [brightcove:legacy] Fix misplaced backslash in a regexp 8 years ago
Sergey M․ e54fc0524e
[cmt] Add support for video-clips 8 years ago
Sergey M․ adf063dad1
[mtv,cc,cmt,spike] Improve and refactor
- Eliminate _transform_rtmp_url
* Generalize triforce mgid extraction
+ [cmt] Add support for full-episodes (closes #11623)
8 years ago
Remita Amine 5e8eebb600 [mitele] extract dash formats 8 years ago
Remita Amine 9837cb7507 [ooyala] add support for videos with embedToken(#11684) 8 years ago
Sergey M․ fb6a59205e
[mixcloud] Fix extraction (closes #11674) 8 years ago
Vijay Singh 06e9363b7a
[openload] Fix extraction (closes #10408)
Just a minor fix for openload
8 years ago
Remita Amine 1f393a3241 [tv4] improve extraction(closes #11698)
- remove check for requires_subscription
- extract more formats
- extract subtitles
8 years ago
Remita Amine c4251b9aaa [common] add possibility to customize akamai manifest host 8 years ago
Sergey M․ 3a407e707a
[freesound] Improve and remove unrelated metadata (closes #11608) 8 years ago
sh!zeeg ed06da4e7b
[freesound] Fix extraction and extended (closes #11602) 8 years ago
Sergey M․ 365d136b7c
[vimeo] Fix tests 8 years ago
Sergey M․ 1fd0fc42bd
[vimeo:ondemand] Fix test (closes #11651) 8 years ago
Sergey M․ 10cd2003b4
[nick] Add support for beta.nick.com (closes #11655) 8 years ago
Sergey M․ cdd11c0540
[mtv] Use native hls by default 8 years ago
Sergey M․ 67fc365b86
[mtv,cc] Use hls by default (closes #11641) 8 years ago
Sergey M․ 20faad74b6
[mtv] Fix non-hls extraction
method attribute may not be present
8 years ago
Sergey M․ 2032d935d1
[mtv] Add default value for use_hls
These methods are used across codebase with old number of arguments
8 years ago
Sergey M․ 366b759a60
[inc] Improve (closes #11647) 8 years ago
Déstin Reed 7f0bdc7a31
[inc] Add extractor 8 years ago
Sergey M․ 022a5d663b
[youtube] Add test for itag 212 (#11575) 8 years ago
Kacper Michajłow 8409b3683c [youtube] Add itag 212
Seen on video with id 1t24XAntNCY
8 years ago
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
8 years ago
Sergey M․ 364131584b
[hitrecord] Improve (closes #11626) 8 years ago
J 553c68bbd9
[hitrecord] Add extractor 8 years ago
Remita Amine 827961b122 [videott] remove extractor 8 years ago
Remita Amine a5eefc492b [swrmediathek] skip tests correctly 8 years ago
Remita Amine a9cd1691b2 [swrmediathek] improve extraction 8 years ago
Remita Amine 2365f94412 [sharesix] remove extractor 8 years ago
Remita Amine 32b7c2a57e [aol] remove AolFeaturesIE 8 years ago
Remita Amine 221ce32529 [break] merge BreakIE and ScreenJunkiesIE 8 years ago
Remita Amine e5dfdc8164 [sendtonews] improve info extraction 8 years ago
Remita Amine a814da3f62 [skynews] update test 8 years ago
Sergey M․ b2727d0bee
[3sat,phoenix] Fix extraction (closes #11619) 8 years ago
Philipp Hagemeister dbaf601646 [comedycentral/mtv] Add support for HLS videos (fixes #11600)
Currently, the HTTP files of the RTMP urls are not present for the The Daily Show.
Use HLS instead for now.
8 years ago
Yen Chi Hsuan ec85ded83c
Fix "invalid escape sequences" error on Python 3.6 8 years ago
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
8 years ago
Sergey M․ fb47cb5b23
[zdf] Improve (closes #11055, closes #11063) 8 years ago
Paul Hartmann b6de53ea8a
[zdf] Fix extraction 8 years ago
Sergey M․ 96d315c2be
[pornhub:playlist] Improve extraction (closes #11594) 8 years ago
Sergey M․ 1911d77d28
[cctv] Add support for ncpa-classic.com (closes #11591) 8 years ago
Sergey M․ 027e231295
[tunein] Add support for embeds (closes #11579) 8 years ago
Sergey M․ 7a9e066972
[cctv] Relax some video id regexes 8 years ago
Sergey M․ 3783a5ccba
[cctv] Relax _VALID_URL 8 years ago
Sergey M․ 327caf661a
[cctv] Do not fallback on video id extracted from URL 8 years ago
Sergey M․ ce7ccb1caa
[cctv] Improve and merge with cntv (closes #879, closes #6753, closes #8541) 8 years ago
RPing 295eac6165
[cntv] Add extractor 8 years ago
Sergey M․ 966815e139
[nrktv:episodes] Add support for episodes (#11571) 8 years ago
Sergey M․ 1f766b6e7b
[arkena] Add support for video.arkena.com (closes #11568) 8 years ago
Sergey M․ 3f1ce16876
[twitch:vod] Improve _VALID_URL (closes #11537) 8 years ago
Robert Smith 9a0f999585
[twitch] Added support for player.twitch.tv URLs (closes #11535) 8 years ago
Sergey M․ e186a9ec03
[videa] Add support for videa embeds 8 years ago
Sergey M․ 69677f3ee2
[videa] Improve and simplify (closes #8181, closes #11133) 8 years ago
Bagira e746021577
[videa] Add extractor 8 years ago
Sergey M․ 424ed37ec4
[vk] Fix postlive videos extraction 8 years ago
Sergey M․ 9cdb0a338d
[vk] Extract from playerParams (closes #11555) 8 years ago
Sergey M․ 6cf261d882
[freevideo] Remove extractor (closes #11515)
Handled by generic extractor
8 years ago
Sergey M․ df086e74e2
[showroomlive] Improve (closes #11458) 8 years ago
Arjan Verwer 963bd5ecfc
[showroomlive] Add extractor 8 years ago
Sergey M․ 51378d359e
[xhamster] Fix duration extraction (closes #11549) 8 years ago
Sergey M․ b63005f5af
[rtve:live] Fix extraction (closes #11529) 8 years ago
Yen Chi Hsuan 4606c34e19 [extractor/common] Allow non-lang in subtitles' keys
See 264e77c406
8 years ago
Sergey M․ 53a664edf4
[brightcove:legacy] Improve embeds detection (closes #11523) 8 years ago
Sergey M․ 264e77c406
[twitch] Add support for rechat messages (closes #11524) 8 years ago
Mattias Wadman 846fd69bac [acast] Add test with multiple blings 8 years ago
Mattias Wadman 12da830993 [acast] Fix broken audio URL and timestamp extraction
Before first bling was used now we look for the first bling with
type BlingAudio.

Before publishingDate was a ms unix timestamp now it is iso8601.
8 years ago
Remita Amine a07588369f [common] improve detection for video only formats and m3u8 manifest(fixes #11507) 8 years ago
Remita Amine f5a723a78a [theplatform] pass geo verification headers to smil request(closes #10146) 8 years ago
Remita Amine f120646f04 [viu] pass geo verification headers to auth request 8 years ago
Remita Amine 9c5b5f2115 [rtl2] extract more formats and metadata 8 years ago
Sergey M․ ae806db628
[vbox7] Skip malformed JSON-LD (closes #11501) 8 years ago
Remita Amine bfa1073e11 [uplynk] force downloading using hls native downloader(closes #11496) 8 years ago
Remita Amine e029c43bd4 [laola1] add support for another extraction scenario(closes #11460) 8 years ago
Sergey M․ 3d6761ba92
[vbox7] Fix extraction (closes #11494) 8 years ago
Remita Amine f59d1146c0 [uktvplay] Add new extractor(closes #11027) 8 years ago
Remita Amine b1c357975d [piksel] Add new extractor(closes #11246) 8 years ago
Remita Amine d8c507c9e2 [vimeo] fix extraction for hls formats and add support for dash formats(closes #11490) 8 years ago
Remita Amine 7fe1592073 [common] fix dash codec information for mixed videos and fragment url construction(#11490) 8 years ago
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 8 years ago
Sergey M․ c80db5d398
[nrktv:direkte] Add support for live streams (#11488) 8 years ago
Remita Amine 5aaf012a4e [pbs] fix extraction for geo restricted videos(#7095) 8 years ago
Remita Amine 954529c10f [brightcove:new] skip widevine classic videos 8 years ago
Remita Amine ed7b333fbf [viu] extract supported hls manifest 8 years ago
Remita Amine 723103151e [viu] improve extraction(closes #10607)(closes #11329) 8 years ago
ping e7b6caef24 [viu] New extractor for viu.com 8 years ago
Remita Amine 199a47abba [ccma] Add new extractor(closes #11359) 8 years ago
Remita Amine b42a0bf360 [laola1tv] add support embed urls and improve extraction(#11460) 8 years ago
Remita Amine 6e416b210c [nbc] fix extraction for msnbc videos(fixes #11466) 8 years ago
Sergey M․ 04bf59ff64
[extractors] Add missing twitch imports 8 years ago
Sergey M․ 87a449c1ed
[extractor/common] Recognize DASH formats in html5 media entries 8 years ago
Sergey M․ 93753aad20
[twitch] Adapt to new videos pages schema (closes #11469) 8 years ago