Commit Graph

12651 Commits (0700fde6403aa9eec1ff02bff7323696a205900c)

Author SHA1 Message Date
Remita Amine 6beb1ac65b [extractor/common] keep support for non standard JSON-LD VideoObject author values 4 years ago
Remita Amine 3ae9c0f410 [vimeo] improve extraction(closes #28591) 4 years ago
Remita Amine e165f5641f [extractor/common] fix JSON-LD VideoObject author extraction 4 years ago
RomanEmelyanov aee6feb02a
[youku] Update ccode(closes #17852, closes #28447, closes #28460) (#28648) 4 years ago
Remita Amine 654b4f4ff2 [youtube] prioritize information from YoutubeIE for playlist entries(closes #28619, closes #28636) 4 years ago
Remita Amine 1df2596f81 [extractor/common] fix _get_cookies method for python 2(#20673, #23256, #20326, closes #28640) 4 years ago
Remita Amine 04d4a3b136 [screencastomatic] fix extraction(closes #11976, closes #24489) 4 years ago
Allan Daemon 392c467f95 [palcomp3] Add new extractor(closes #13120) 4 years ago
Vid c5aa8f36bf [arnes] Add new extractor(closes #28483) 4 years ago
Remita Amine 3748863070 [youtube:tab] Add support for hashtag videos extraction(closes #28308) 4 years ago
Sergey M․ 14f29f087e
[youtube] Setup CONSENT cookie when needed (closes #28604) 4 years ago
Remita Amine b97fb2edac [vimeo] fix password protected review extraction(closes #27591) 4 years ago
Remita Amine 28bab774a0 [youtube] imporve age-restricted video extraction(#28578) 4 years ago
Remita Amine 955894e72f [vlive] fix inkey request(closes #28589) 4 years ago
Sergey M․ 287e50b56b
[francetvinfo] Improve video id extraction (closes #28584) 4 years ago
Chris Hranj da762c4e32
[instagram] Improve title extraction and extract duration (#28469)
Co-authored-by: Sergey M. <dstftw@gmail.com>
4 years ago
Remita Amine 87a8bde777 [sbs] add support for ondemand watch URLs(closes #28566) 4 years ago
Remita Amine 49fc0a567f [youtube] fix video's channel extraction(closes #28562) 4 years ago
Remita Amine cc777dcaa0 [picarto] fix live stream extraction(closes #28532) 4 years ago
Remita Amine c785911870 [vimeo] fix unlisted video extraction(closes #28414) 4 years ago
Remita Amine 605e7b5e47 [youtube:tab] fix playlist/comunity continuation items extraction(closes #28266) 4 years ago
Remita Amine 8562218350 [ard] improve clip id extraction(#22724)(closes #28528) 4 years ago
Roman Sebastian Karwacik d1069d33b4 [zoom] Add new extractor(closes #16597, closes #27002, closes #28531) 4 years ago
The Hatsune Daishi eafcadea26
[extractor] escape forgotten dot for hostnames in regular expression (#28530) 4 years ago
Remita Amine a40002444e [bbc] fix BBC IPlayer Episodes/Group extraction(closes #28360) 4 years ago
Sergey M․ 5208ae92fc
[youtube] Fix default value for youtube_include_dash_manifest (closes #28523) 4 years ago
Remita Amine 8117d613ac [zingmp3] fix extraction(closes #11589, closes #16409, closes #16968, closes #27205) 4 years ago
Martin Ström 00b4d72d1e
[vgtv] Add support for new tv.aftonbladet.se URL schema (#28514)
Co-authored-by: Sergey M <dstftw@gmail.com>
4 years ago
Remita Amine 21ccd0d7f4 [tiktok] detect private videos(closes #28453) 4 years ago
Sergey M․ 7e79ba7dd6
[vimeo:album] Fix extraction for albums with number of videos multiple to page size (closes #28486) 4 years ago
Remita Amine fa6bf0a711 [vvvvid] fix kenc format extraction(closes #28473) 4 years ago
Remita Amine f912d6c8cf [mlb] fix video extracion(#21241) 4 years ago
Sergey M․ 357bfe251d
[svtplay] Improve extraction (closes #28448) 4 years ago
Remita Amine 3be098010f [applepodcasts] fix extraction(closes #28445) 4 years ago
Remita Amine 9955bb4a27 [rtve] improve extraction
- extract all formats
- fix RTVE Infantil extraction(closes #24851)
- extract is_live and series
4 years ago
Sergey M․ 1860d0f41c
[southpark] Fix extraction and add support for southparkstudios.com (closes #26763, closes #28413) 4 years ago
Remita Amine 60845121ca [sportdeutschland] fix extraction(closes #21856)(closes #28425) 4 years ago
Remita Amine 1182f9567b [pinterest] reduce the number of HLS format requests 4 years ago
Remita Amine ef414343e5 [peertube] improve thumbnail extraction(closes #28419) 4 years ago
Remita Amine 43d986acd8 [tver] improve title extraction(closes #28418) 4 years ago
Remita Amine 9c644a6419 [fujitv] fix HLS formats extension(closes #28416) 4 years ago
Remita Amine fc2c6d5323 [shahid] fix format extraction(closes #28383) 4 years ago
Remita Amine 64ed3af328 [lbry] add support for channel filters(closes #28385) 4 years ago
Sergey M․ bae7dbf78b
[bandcamp] Extract release_timestamp 4 years ago
Sergey M․ 15c24b0346
[lbry] Extract release_timestamp (closes #28386) 4 years ago
Sergey M․ 477bff6906
Introduce release_timestamp meta field (refs #28386) 4 years ago
Sergey M․ 1a1ccd9a6e
[pornhub] Detect flagged videos 4 years ago
Sergey M․ 7dc513487f
[pornhub] Extract formats from get_media end point (#28395) 4 years ago
Remita Amine c6a14755bb [bilibili] fix video info extraction(closes #28341) 4 years ago
Remita Amine 7f064d50db [cbs] add support for Paramount+ (closes #28342) 4 years ago
Remita Amine b8b622fbeb [trovo] Add Origin header to VOD formats(closes #28346) 4 years ago
Remita Amine ec64ec9651 [voxmedia] fix volume embed extraction(closes #28338) 4 years ago
Sergey M․ 061c030133
[youtube:tab] Switch continuation to browse API (closes #28289, closes #28327)
Until further investigation.
4 years ago
Remita Amine 8f56907afa [9c9media] fix extraction for videos with multiple ContentPackages(closes #28309) 4 years ago
Remita Amine e1adb3ed4f [bbc] correct catched exception type 4 years ago
dirkf e465b25c1f [bbc] add support for BBC Reel videos(closes #21870, closes #23660, closes #28268) 4 years ago
Sergey M․ 3fb14cd214
[zdf] Rework extractors (closes #11606, closes #13473, closes #17354, closes #21185, closes #26711, closes #27068, closes #27930, closes #28198, closes #28199, closes #28274)
* Generalize unique video ids for zdf based extractors
* Improve extraction
* Fix 3sat and phoenix
4 years ago
Remita Amine bee6182680 [stretchinternet] Fix extraction(closes #28297) 4 years ago
Remita Amine 38fe5e239a [urplay] fix episode data extraction(closes #28292) 4 years ago
Remita Amine 678d46f6bb [bandaichannel] Add new extractor(closes #21404) 4 years ago
Alexander Seiler 3c58f9e0b9 [srgssr] improve extraction
- extract subtitle
- fix extraction for new videos
- update srf download domains

closes #14717
closes #14725
closes #27231
closes #28238
4 years ago
Remita Amine ef28e33249 [vvvvid] reduce season request payload size 4 years ago
nixxo 9662e4964b
[vvvvid] extract series sublists playlist_title (#27601) (#27618) 4 years ago
Remita Amine 44603290e5 [dplay] Extract Ad-Free uplynk URLs(#28160) 4 years ago
Remita Amine 1631fca1ee [wat] detect DRM protected videos(closes #27958) 4 years ago
Remita Amine 295860ff00 [tf1] improve extraction(closes #27980)(closes #28040) 4 years ago
Sergey M․ 8cb4b71909
[tmz] Fix and improve extraction (closes #24603, closes #24687, closes #28211) 4 years ago
Remita Amine d81421af4b [gedidigital] improve asset id matching 4 years ago
nixxo 7422a2194f [gedidigital] Add new extractor(closes #7347)(closes #26946) 4 years ago
Remita Amine 2090dbdc8c [youtube] fix get_video_info request 4 years ago
Sergey M․ aa9118a373
[apa] Improve extraction (closes #27750) 4 years ago
Adrian Heine 36abc16c3c
[apa] Fix extraction 4 years ago
Sergey M․ 919d764600
[youporn] Skip test 4 years ago
piplongrun 696183e133
[youporn] Extract duration (#28019)
Co-authored-by: Sergey M <dstftw@gmail.com>
4 years ago
SirCipherz f90d825a6b
[peertube] Add support for canard.tube (#28190) 4 years ago
Remita Amine 3037ab00c7 [youtube] fixup m4a_dash formats(closes #28165) 4 years ago
Isaac-the-Man 21e872b19a [samplefocus] Add new extractor(closes #27763) 4 years ago
Remita Amine cf2dbec630 [vimeo] add support for unlisted video source format extraction 4 years ago
Remita Amine b92bb0e02a [viki] improve extraction(closes #26522)(closes #28203)
- extract uploader_url and episode_number
- report login required error
- extract 480p formats
- fix API v4 calls
4 years ago
Remita Amine 40edffae3d [ninegag] unscape title(#28201) 4 years ago
Sergey M․ 9fc5eafb8e
[youtube] Improve _VALID_URL (refs #28193) 4 years ago
bopol 08c2fbb844
[youtube] Add support for redirect.invidious.io (#28193)
Co-authored-by: Sergey M <dstftw@gmail.com>
4 years ago
Remita Amine 3997efb65e [dplay] add support for de.hgtv.com (closes #28182) 4 years ago
Remita Amine a7356dffe9 [dplay] Add support for discoveryplus.com (closes #24698) 4 years ago
dmsummers e20ec43094 [simplecast] Add new extractor(closes #24107) 4 years ago
PrinceOfPuppers 8980f53b42
[youtube] Fix uploader extraction in flat playlist mode (#28045) 4 years ago
Sergey M․ a363fb5d28
[yandexmusic:playlist] Request missing tracks in chunks (closes #27355, closes #28184) 4 years ago
Stephen Stair 844e4cbc54 [storyfire] Add new extractor(closes #25628)(closes #26349) 4 years ago
Remita Amine 56c63c8c02 [zhihu] Add new extractor(closes #28177) 4 years ago
Sergey M․ 07eb8f1916
[youtube] Fix controversial videos when authenticated with cookies (closes #28174) 4 years ago
Remita Amine 4b5410c5c8 [ccma] fix timestamp parsing in python 2 4 years ago
Remita Amine be2e9b76ee [videopress] add support for video.wordpress.com 4 years ago
Remita Amine d8085580f6 [kakao] improve info extraction and detect geo restriction(closes #26577) 4 years ago
Remita Amine 6d32c6c6d3 [xboxclips] fix extraction(closes #27151) 4 years ago
Sergey M․ f94d764993
[ard] Improve formats extraction (closes #28155) 4 years ago
Kevin Velghe f28f1b4d6e
[canvas] Add new extractor for Dagelijkse Kost (#28119) 4 years ago
Sergey M․ a4c7ed6b1e
[youtube:tab] Improve grid continuation extraction (closes #28130) 4 years ago
Remita Amine 7f8b8bc418 [ign] fix extraction(closes #24771) 4 years ago
Sergey M․ 311ebdd9a5
[xhamster] Extract formats from xplayer settings and extract filesizes (closes #28114) 4 years ago
Remita Amine 99c68db0a8 [youtube] add support phone/tablet JS player(closes #26424) 4 years ago
Sergey M․ 5fc53690cb
[archiveorg] Fix and improve extraction (closes #21330, closes #23586, closes #25277, closes #26780, closes #27109, closes #27236, closes #28063) 4 years ago
Sergey M․ 7a9161578e
[cda] Detect geo restricted videos (refs #28106) 4 years ago
Adrian Heine né Lang 2405854705
[urplay] Fix extraction (closes #28073) (#28074) 4 years ago
Sergey M․ 0cf09c2b41
[youtube] Fix release date extraction (closes #28094) 4 years ago
Sergey M․ 0156ce95c5
[youtube] Extract abr and vbr (closes #28100) 4 years ago
Remita Amine 1641b13232 [youtube] skip OTF formats(#28070) 4 years ago
Sergey M․ 7215691ab7
[youtube] Prefer DASH formats (closes #28070) 4 years ago
Adrian Heine né Lang fc88e8f0e3
[azmedien] Fix extraction (#28064) 4 years ago
Sergey M․ 89c5a7d5aa
[pornhub] Implement lazy playlist extraction 4 years ago
Sergey M․ 2adc0c51cd
[pornhub] Add placeholder netrc machine 4 years ago
Sergey M․ 1f0910bc27
[svtplay] Fix video id extraction (closes #28058) 4 years ago
Sergey M․ e22ff4e356
[pornhub] Add support for authentication (closes #18797, closes #21416, closes #24294) 4 years ago
Sergey M․ 83031d749b
[pornhub:user] Add support for URLs unavailable via /videos page and improve paging (closes #27853) 4 years ago
Remita Amine 1b731ebcaa [bravotv] add support for oxygen.com(closes #13357)(closes #22500) 4 years ago
Remita Amine ab25f3f431 [youtube] pass embed URL to get_video_info request 4 years ago
Guillem Vela 07f7aad81c [ccma] improve metadata extraction(closes #27994)
- extract age_limit, alt_title, categories, series and episode_number
- fix timestamp multiple subtitles extraction
4 years ago
Remita Amine b111a64135 [egghead] fix typo 4 years ago
Viren Rajput 0e3a968479 [egghead] update API domain(closes #28038) 4 years ago
Remita Amine c11f7cf9bd [vidzi] remove extractor(closes #12629) 4 years ago
Remita Amine 8fa7cc387d [vidio] improve metadata extraction 4 years ago
Remita Amine 65eee5a745 [youtube] improve subtitle extraction 4 years ago
Remita Amine efef4ddf51 [youtube] fix chapter extraction fallback 4 years ago
Remita Amine 159a3d48df [youtube] keep _formats array for format sorting tests 4 years ago
Remita Amine 9c724601ba [youtube] remove description chapters tests
video description no longer contain yt.www.watch.player.seekTo
function
4 years ago
Remita Amine 67299f23d8 [youtube] Rewrite Extractor
- improve format sorting
- remove unused code(swf parsing, ...)
- fix series metadata extraction
- fix trailer video extraction
- improve error reporting
- extract video location
4 years ago
Adrian Heine né Lang 8bf9591a70
[AENetworks] update AENetworksShowIE test playlist id (#27851) 4 years ago
nixxo a800838f5a
[vvvvid] add support for youtube embeds (#27825) 4 years ago
Remita Amine ba15b2fee6 [googledrive] report download page errors(closes #28005) 4 years ago
ping 56a7ee9033
[vlive] Fix error message decoding for python 2 (#28004) 4 years ago
Remita Amine 0b4f03a563 [youtube] improve DASH formats file size extraction 4 years ago
knapior 7b8fa658f8
[cda] Improve birth validation detection (closes #14022) (#27929)
Co-authored-by: Sergey M <dstftw@gmail.com>
4 years ago
Adrian Heine né Lang fd95fc33b1
[awaan] Extract uploader id (#27963) 4 years ago
Remita Amine c669554ef5 [medialaan] add support DPG Media MyChannels based websites
closes #14871
closes #15597
closes #16106
closes #16489
4 years ago
Remita Amine 11b68df7a4 [abcnews] fix extraction(closes #12394)(closes #27920) 4 years ago
Adrian Heine né Lang d18f4419a7
[AMP] Fix upload_date and timestamp extraction (#27970) 4 years ago
Remita Amine 0f7d413d5b [tv4] relax _VALID_URL(closes #27964) 4 years ago
Remita Amine 286e5d6724 [tv2] improve MTV Uutiset Article extraction 4 years ago
tpikonen 395981288b
[tv2] Add support for mtvuutiset.fi (#27744) 4 years ago
Remita Amine 55bb3556c8 [adn] improve login warning reporting 4 years ago
Remita Amine 57f2488bbe [zype] fix uplynk id extraction(closes #27956) 4 years ago
Adrian Heine né Lang ea399a53eb
[ADN] Implement login (#27937)
closes #17091
closes #27841
4 years ago
Sergey M․ f08c31cf33
[franceculture] Make thumbnail optional (closes #18807) 4 years ago
Aurélien Grosdidier d8dab85419
[franceculture] Fix extraction (closes #27891) (#27903)
Co-authored-by: Sergey M. <dstftw@gmail.com>
4 years ago
aarubui 4542e3e555
[njpwworld] fix extraction (#27890) 4 years ago
Remita Amine fa8f6d8580 [comedycentral] fix extraction(closes #27905) 4 years ago
Remita Amine 3bb7769c40 [wat] remove unused variable 4 years ago
Remita Amine 8d286bd5b6 [wat] fix format extraction(closes #27901) 4 years ago
Remita Amine cff72b4cc0 [americastestkitchen] improve season extraction 4 years ago
Brian Marks 657221c81d
[americastestkitchen] Add support for downloading entire seasons (#27861) 4 years ago
Remita Amine 62acf5fa2c [trovo] Add new extractor(closes #26125) 4 years ago
Remita Amine b79977fb6b [aol] add support for yahoo videos(closes #26650) 4 years ago
Remita Amine bc7c8f3d4e [yahoo] fix single video extraction 4 years ago
Remita Amine 015e19b350 [lbry] unescape lbry uri(closes #27872) 4 years ago
Remita Amine 54856480d7 [ninegag] improve extraction 4 years ago
DrWursterich 1dd12708c2
[9gag] Fix Extraction (#23022) 4 years ago
Brian Marks f9201cef58
[americastestkitchen] Improve metadata extraction for ATK episodes (#27860) 4 years ago
Remita Amine 26499ba823 [aljazeera] fix extraction(closes #20911)(closes #27779) 4 years ago
Remita Amine 58f6c2112d [minds] improve extraction 4 years ago
Tatsh de026a6acd
[Minds] Add new extractor (#17934) 4 years ago
Adrian Heine né Lang d4564afc70
[ard] Fix title and description extraction and update tests (#27761) 4 years ago
Adrian Heine né Lang 360a5e0f60
[aenetworks] Fix test (#27847) 4 years ago
Remita Amine 55a3ca16d3 [spotify] Add new extractor for Spotify Podcasts(closes #27443) 4 years ago
Sergey M․ f1487d4fca
[mixcloud:playlist:base] Fix video id extraction in flat playlist mode (refs #27787) 4 years ago
Sergey M․ 0cd4c402f0
[animeondemand] Add support for lazy playlist extraction (closes #27829) 4 years ago
Remita Amine 9d50f86232 [twitter] Add tests for more cards 4 years ago
Sergey M․ 7e92f9015e
[youporn] Restrict fallback download URL (refs #27822) 4 years ago
Sergey M․ aa860b8016
[youporn] Improve height and tbr extraction (refs #23659, refs #20425) 4 years ago
Sergey M․ b484097b01
[youporn] Fix extraction (closes #27822) 4 years ago
Sergey M․ ab9001dab5
[twitter] Add support for unified cards (closes #27826) 4 years ago
main() 879866a230
[twitch] Set OAuth token for GraphQL requests using auth-token cookie (#27790)
Co-authored-by: remitamine <remitamine@gmail.com>
4 years ago
Aarni Koskela 7c2d18a13f
[Mixcloud] Harmonize ID generation from lists with full ID generation (#27787)
Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
4 years ago
Remita Amine 2408e6d26a [cspan] improve info extraction(closes #27791) 4 years ago
Remita Amine cf862771d7 [adn] improve info extraction 4 years ago
Adrian Heine né Lang a938f111ed
[ADN] Fix extraction (#27732)
Closes #26963.
4 years ago
Remita Amine 4759543f6e [youtube:search] fix view_count and try to extract all video sections(closes #27588)(closes #27604) 4 years ago
Sergey M․ 70f572585d
[twitch] Improve login error extraction 4 years ago
Sergey M․ c2d06aef60
[twitch] Fix authentication (refs #27743) 4 years ago
Remita Amine ff1e765400 [threeqsdn] Improve extraction(closes #21058) 4 years ago
0l-l0 170e1c1995
[peertube] Extract files also from streamingPlaylists (#27728)
JSON objects with an empty "files" tag seem to be a valid PeerTube API
response. In those cases the "files" arrays contained in the
"streamingPlaylists" members can be used instead.
closes #26002
closes #27586
4 years ago
Remita Amine 61e669acff [khanacademy] fix extraction(closes #2887)(closes #26803) 4 years ago
Remita Amine 2c337f4e85 [spike] Update Paramount Network feed URL(closes #27715) 4 years ago
nixxo 3a61e6d360
[rai] improve subtitles extraction (#27705)
closes #27698
4 years ago
Remita Amine 3d8e32dcc0 [canvas] Match only supported VRT NU URLs(#27707) 4 years ago
Remita Amine 8f29b2dd38 [extractors] add BibelTVIE import 4 years ago
Remita Amine a29e340efa [bibeltv] Add new extractor(closes #14361) 4 years ago
Remita Amine b13f29098f [bfmtv] Add new extractor(closes #16053)(closes #26615) 4 years ago
Remita Amine 430c4bc9d0 [sbs] Add support for ondemand play and news embed URLs(closes #17650)(closes #27629) 4 years ago
Sergey M․ 4ae243fc6c
[twitch] Refactor 4 years ago
Sergey M․ 8f20ad36dc
[twitch] Drop legacy kraken API v5 code altogether 4 years ago
Sergey M․ 799c794947
[twitch:vod] Switch to GraphQL for video metadata 4 years ago
Remita Amine 1ae7ae0b96 [canvas] Fix VRT NU extraction(closes #26957)(closes #27053) 4 years ago
Sergey M․ ccc7112291
[twitch] Improve access token extraction and remove unused code (closes #27646) 4 years ago
23rd 5b24f8f505
[twitch] Switch access token to GraphQL and refactor. 4 years ago
nixxo fcd90d2583
[rai] Detect ContentItem in iframe (closes #12652) (#27673)
Co-authored-by: Sergey M. <dstftw@gmail.com>
4 years ago
Remita Amine 8f757c7353 [ketnet] fix extraction(closes #27662) 4 years ago
Remita Amine be1a3f2d11 [dplay] Add suport Discovery+ domains(closes #27680) 4 years ago
Sergey M․ ecae54a98d
[motherless] Fix review issues and improve extraction (closes #26495, closes #27450) 4 years ago
cladmi f318882955
[motherless] Fix recent videos upload date extraction (closes #27661)
Less than a week old videos use a '20h ago' or '1d ago' format.

I kept the support for 'Ago' with uppercase start at is was already in the code.
4 years ago
Yurii H f6ea29e24b
[iheart] Update test description value (#27037)
the description has no HTML tags now.
4 years ago
Remita Amine 8a3797a4ab [nrk] fix extraction for videos without a legalAge rating 4 years ago