Commit Graph

13378 Commits (44cca168cc36a71ea77d8635a44f6ee9d2c33a99)

Author SHA1 Message Date
Sergey M․ c46680fb2a
[condenast] Fix extraction (closes , closes )
Philipp Hagemeister fad9fc537d [tv4] fix a test URL
Philipp Hagemeister 0732a90579 [orf] Add new extractor for f4m stories
Sergey M․ 319fc70676
[tv4] Relax _VALID_URL (closes )
Sergey M․ e7c3e33456
[downloader/fragment] Restart inconsistent incomplete fragment downloads ()
Yen Chi Hsuan 757984af90 Merge pull request from remitamine/raw-sub
[YoutubeDL] write raw subtitle files
Sergey M․ 2f483758bc
[animeondemand] Improve and modernize
Sergey M․ 018cc61549
[animeondemand] Bypass geo restriction
Sergey M․ 2709d9fa28
[animeondemand] Add support for flash videos (closes )
Sergey M․ 7dacceae75
release 2017.09.11
Sergey M․ f12a6e88b2
[rutube:playlist] Fix suitable (closes )
Sergey M․ 806498cf2f
release 2017.09.10
Sergey M․ bf6ec2fea9
[fox] Fix extraction ()
Sergey M․ c3dd44e085
[rutube] Use bool_or_none
Sergey M․ c7e327c4d4
[utils] Introduce bool_or_none
Sergey M․ 48b813748d
[rutube] Rework and generalize playlist extractors (closes )
luceatnobis debed8d759
[rutube:playlist] Add extractor (closes )
Olivier Bilodeau 931edb2ada [radiocanada] Add fallback for title extraction
Sergey M․ 5113b69124
[abcnews,chilloutsoze,cracked,vice,vk] Use dedicated YouTube embeds extraction routines
Sergey M․ 66c9fa36c1
[youtube] Separate methods for embeds extraction
Sergey M․ c5c9bf0c12
[YoutubeDL] Ensure dir existence for each requested format (closes )
Sergey M․ 880fa66f4f
[redtube] Fix formats extraction (closes )
Sergey M․ 6348671c4a
[arte] Relax unavailability check (closes )
Sergey M․ efc57145c1
[manyvids] Improve (closes )
John D e9b865267a
[manyvids] Add support for preview videos (closes )
Sergey M․ bc35f07537
[vidme:user] Make tests only matching (closes )
theychx 0b4a8eb3ac
[vidme:user] Relax _VALID_URLs
Sergey M․ c1c1585b31
[bpb] Improve (closes )
Timendum 0cbb841ba9
[bpb] Fix extraction (closes )
Sergey M d7c7100e3d
[soundcloud] Simplify and add test (closes )
Tatsuyuki Ishi 73602bcd0c
[soundcloud] Fix download URL with private tracks
Sergey M․ 23b2df82c7
[aliexpress:live] Fix issues (closes , closes )
dubber0 503115540d
[aliexpress:live] Add extractor
Sergey M․ 64f0e30b93
[viidea] Capture and output lecture error message ()
Sergey M․ a3431e1224
[radiocanada] Skip unsupported platforms (closes )
Sergey M․ a2022b0c40
release 2017.09.02
Sergey M․ 8d81f3e36d
[youtube] Force old layout for each webpage (closes )
Sergey M․ 7998520933
[youtube] Fix upload date extraction (closes )
Sergey M․ 5b4bfbfc3b
[charlierose] Add support for episodes (closes )
Sergey M․ 53647dfd0a
[bbccouk] Add support for w-prefixed ids (closes )
Sergey M․ 1b41da488d
[googledrive] Extend _VALID_URL (closes )
Sergey M․ fea82c1780
[googledrive] Add support for source format (closes )
Sergey M․ 3902cdd0e3
[pornhd] Fix extraction (closes )
Sergey M․ 2cfa7cbdd0
release 2017.08.27.1
Sergey M․ 1c9c8de29e
[youtube] Fix extraction with --youtube-skip-dash-manifest enabled (closes )
Sergey M․ f031b76065
release 2017.08.27
Sergey M․ ff17be3ac9
[extractor/generic] Extract from LD-JSON last of all
Previous sources may contain several formats, e.g. http://tamasha.com/v/PgGZ
Sergey M․ 1ed4549942
[extractor/common] Extract format id from label attribute of source tag for HTML5 videos ()
Sergey M․ dd121cc1ca
[extractor/common] Extract height from res attribute of source tag for HTML5 videos (closes )
Sergey M․ a3c3a1e128
[http] Rework HTTP downloader
* Simplify code and split into separate routines to facilitate maintaining
* Make retry mechanism work on errors during actual download not only during connection establishment phase
* Retry on ECONNRESET and ETIMEDOUT during reading data from network
* Retry on content too short and various timeout errors
* Show error description on retry
* Closes , closes , closes , closes , closes , closes , closes 
Sergey M․ 085d9dd9be
[rai] Fix audio formats extraction (closes )
Vijay Singh 151978f38a [mixcloud] Fix extraction (closes )
Sergey M․ c7121fa7b8
[youtube] Fix controversy videos extraction (closes , closes )
Vijay Singh 745968bc72 [mixcloud] Fix extraction (closes )
Sergey M․ df235dbba8
release 2017.08.23
Sergey M․ 5bae33485c
[toutv] PEP 8
Sergey M․ 0830f3e048
[cbc:watch] Bypass geo-restriction (closes )
Sergey M․ 8d7a24aff6
[toutv] Relax DRM check (closes )
Sergey M․ 37d9af306a
[googledrive] Simplify and carry long lines ()
Sergey M․ e01c3d2ef7
[extractor/common] Introduce _parse_xml
Parmjit Virk 05915e379a [googledrive] Add support for subtitles (fixes )
Sergey M․ 8d9c2a681a
[pornhub] Relax uploader regex (closes , closes )
Luca Steeb 8239c6791a [bandcamp:album] Extract track titles
Sergey M․ b359e977b9
[extractor/common] Make HLS and DASH extraction non fatal in _parse_html5_media_entries (closes )
Sergey M․ d3d45e0a45
[bbccouk] Add support for events URLs (closes )
Yen Chi Hsuan 381ad4f309
[liveleak] Support multi-video pages (closes )
Yen Chi Hsuan 09747ba766
[liveleak] Support another liveleak embedding pattern (closes )
Yen Chi Hsuan f8f18f332f
[cda] Fix extraction (closes )
Yen Chi Hsuan 95f3f7c20a
[utils] Fix unescapeHTML for misformed string like "&a"" ()
Sergey M․ f5469da9e6
[laola1tv] Add support for tv.ittf.com (closes )
Sergey M․ d14d9d8903
[mixcloud] Fix extraction (closes )
Sergey M․ ea004d34f8
release 2017.08.18
Sergey M․ 4a91910365
[qqmusic:toplist] PEP 8
Sergey M․ c0892b2b46
[arte] Detect unavailable videos (closes )
Sergey M․ a5ac0c4755
[YoutubeDL] Sanitize byte string format URLs ()
Sergey M․ 5551d7714d
[generic] Convert redirect URLs to unicode strings (closes )
Sergey M․ 5f5c7b92dd
[udemy] Fix paid course detection ()
Sergey M․ 93d0583e34
[pluralsight] Use RPC API for course extraction (closes )
Genki Sky bfabd17b33 Add new extractor
Yen Chi Hsuan 25a6e769a1 [qqmusic] Fix tests and cleanup
Yen Chi Hsuan d22b67f356 Merge pull request from gam2046/master
Fix QQ Music url changed
Sergey M․ a1aa659662
[periscope] Renew HLS extraction (closes )
Sergey M․ 4850478543
[extractor/common] Add support for float durations in _parse_mpd_formats (closes )
forDream 134d85a7bd [qqmusic] review
forDream 5c037c0d1f [qqmusic]support QQMusicSingerIE
forDream 5d1bd3b907 [qqmusic]update valid url
forDream 19ada898dc fix QQ Music Url changed
Sergey M․ da20951a57
[mixcloud] Extract decrypt key
Sergey M․ 16393d6535
release 2017.08.13
Sergey M․ 475bcb225f
[pornhub:playlistbase] Skip videos from drop-down menu for all playlists (closes , closes )
Sergey M․ b3c6515365
[fourtube] Add support for other sites (closes , closes , closes )
Sergey M․ eb02940cc7
[generic] Add test for
Sergey M․ 4ef9152428
[limelight] Improve embeds detection (closes )
Sergey M․ 0c43a481b9
[reddit] Add extractors (closes )
Sergey M․ 868f79db41
[extractor/common] Fix _media_formats
Sergey M․ 70851a95c3
[aparat] Extract all formats (closes )
Sergey M․ e74e3b63e3
[YoutubeDL] Make sure format id is not empty
Sergey M․ ac8491fcca
[extractor/common] Make _family_friendly_search optional
Sergey M․ 82889d4ae5
[extractor/common] Respect source's type attribute for HTML5 media (closes )
Sergey M․ 92a5c41532
[mixcloud] Fix play info decryption (closes )
Sergey M․ 1663bd6e1c
[generic] Replace vzaar embed test
tetra-eder 41918eaa5c [generic] Add support for vzaar embeds
Sergey M․ 6ed99754bb
release 2017.08.09
Sergey M․ baba5f4d1d
[xxxymovies] Fix title extraction (closes )
Sergey M․ dee04d24a4
[nick] Add support for nick.com.pl (closes )
Sergey M․ 5b3ddadcc3
[mixcloud] Fix play info decryption (closes )
Sergey M․ 5b232f46dc
[utils] Skip missing params in cli_bool_option (closes )
Alex Seiler 4bf22f7a10 [20min] Fix embeds extraction
Sergey M․ 15d1e8a23d
[dplayit] Fix extraction (closes )
Yen Chi Hsuan ee6a611665
[niconico] Support videos with multiple formats (closes )
Yen Chi Hsuan 463e7216c8
[niconico] Support HTML5-only videos (closes )
Sergey M․ 903a183b6a
release 2017.08.06
Sergey M․ fac188c695
[pluralsight] Fix format selection
Sergey M․ 16afce174e
[mpora] Remove extractor (closes )
Sergey M․ e2b4808fd8
[voot] Improve extraction (, closes )
Ashutosh Chaudhary daaaf5f594
[voot] Add extractor
Sergey M․ f172c86dcd
[vlive:channel] Limit number of videos per page to 100 (closes )
Sergey M․ 1d5472290f
[podomatic] Extend _VALID_URL (closes )
Sergey M․ c983cc3b71
[cinchcast] Extend _VALID_URL
Sergey M․ 1141e9104b
Use relative paths for DASH fragments (closes )
10x reduced JSON size
refs 
Sergey M․ 8519b88f67
[yandexdisk] Relax _VALID_URL (closes )
Sergey M․ bbbe1cebfc
[mlb] Update test (closes )
Sergey M․ f31fd0693b
[vidme] Extract DASH and HLS formats
Sergey M․ 799802f368
[teamfour] Remove extractor (closes )
Now covered with generic extractor
Sergey M․ b3b5870cba
[pornhd] Fix extraction (closes )
Sergey M․ 57a38a38c3
[udemy] Fix subtitles extraction (closes )
Matt Crupi 11a6793f80 [mlb] Extend _VALID_URL (closes )
Sergey M․ 183062a4ab
[pbs] Add support for new URL schema (closes )
Tithen-Firion feee8d32e4 [phantomjs] add exe version to debug info
Sergey M․ 9118c9f18a
[nrktv] Update API host (closes )
Sergey M․ 5c9ea67bc0
release 2017.07.30.1
Sergey M․ 8b9f50d7cb
[watchbox] Add extractor ()
Sergey M․ 0ed4758023
[clipfish] Remove extractor
Sergey M․ a0a477b885
[youjizz] Fix extraction (closes )
Grzegorz Ruciński 198d4cb40c [generic] Add support for another ooyala embed pattern (closes )
Sergey M․ ca127ab2c1
[ard] Add support for lives (closes )
Sergey M․ e445850e69
[soundcloud] Update client id
Sergey M․ 836ef26486
[soundcloud:trackstation] Add extractor (closes )
Sergey M․ c04017519d
[svtplay] Use geo verification proxy for API request
Sergey M․ 2a7a823211
[svtplay] Update API URL (closes )
Sergey M․ 95908ce453
[extractor/generic] PEP 8
Sergey M․ cbbe66635f
[yandexdisk] Add extractor (closes )
Sergey M․ c5a49ff084
[downloader/hls] Use redirect URL as manifest base ()
Philipp Hagemeister 24e966e8da [megaphone] Add extractor
Sergey M․ 9682666bda
[amcnetworks] Make rating optional (closes )
Sergey M․ f9c48d895b
[cloudy] Fix extraction (closes )
Sergey M․ c99d6890cb
[nickru] Add extractor
Sergey M․ 70bfab0e9a
[mtv] Improve thumbnal extraction
nyuszika7h f0e31e32c9 [nick] Automate geo-restriction bypass ()
Yen Chi Hsuan e3ce912c3d
[niconico] improve error reporting ()
Yen Chi Hsuan 905d18a7aa
[options] Correctly hide login info from debug outputs ()
Iterate over opts instead of PRIVATE_OPTS for both performance and
correctness
Sergey M․ 0db492c02a
release 2017.07.23
Sergey M․ 71dde5eecf
[itv] Fix production id extraction (closes )
Sergey M․ 935d6c20c0
[vidio] Make duration non fatal and fix typo
Sergey M․ e0f1fb0a27
[mtv] Skip missing video parts (closes )
Sergey M․ 0017d9ad6d
[YoutubeDL] Improve default format specification (closes )
Sergey M․ 327c8364f1
[sportbox:embed] Fix extraction
dubber0 359aa2fdd1 [npo] Add support for npo3.nl URLs
Sergey M․ f76c02c87b
[dramafever] Fix tests
Sergey M․ 7d9a1db111
[dramafever] Remove video id from title (closes )
Sergey M․ 0396806f67
[YoutubeDL] Do not override id, extractor and extractor_key in url_transparent
All these meta fields must be borrowed from final extractor that actually performs extraction.
This commit fixes extractor id in download archives for url_transparent downloads. Previously, 'transparent' extractor was erroneously
used for extractor archive id, e.g. 'eggheadlesson 4n8ugwwj5t' instead of 'wistia 4n8ugwwj5t'.
Sergey M․ dc6520aa3d
[egghead:lesson] Add extractor ()
Sergey M․ c653326a14
[funnyordie] Extract more metadata (closes )
Yen Chi Hsuan 3fcf346ac1
[youku:show] Refine playlist extraction
Handle playlists that the initial page is not the first page
Yen Chi Hsuan fa63cf6c23
[youku:show] Fix playlist extraction (closes )
Yen Chi Hsuan 85f5a74b6c
[tbs] Mark as broken and skip invalid tests
Yen Chi Hsuan d20b1c6725
[dispeak] Recognize sevt subdomain (closes )
Sergey M․ bb176df3bb
[spiegel:article] Move test
Sergey M․ 83d00044c1
[adn] Improve error reporting ()
Sergey M․ 7abed4e06c
[crunchyroll] Relax series and season regex (closes )
Sergey M․ 13eb526f11
[nexx:embed] PEP 8
Sergey M․ 00d06e3cfc
[spiegel:article] Add support for nexx iframe embeds (closes )
Sergey M․ 749ca5eced
[extractor/common] Fix playlist_from_matches
Sergey M․ 3f59b0154a
[nexx:embed] Add extractor for iframe embeds
Sergey M․ 089b97cfee
[nexx] Improve JS embed extraction
Sergey M․ decf86044d
[pearvideo] Improve (closes )
troywith77 94b817edeb
[pearvideo] Add extractor
Sergey M․ cea931a9e5
release 2017.07.15
Sergey M․ 961ea474b6
[YoutubeDL] PEP 8
Sergey M․ ea3f20494f
[youtube] PEP 8
Sergey M․ c7604d79e9
[spiegeltv] Delegate extraction to nexx (closes )
Sergey M․ 4e826cd9ae
[nexx] Add extractor (closes , closes )
Robin Neatherway 2583c0b54e Fix bugs caused by typos
Sergey M․ 7d02dcfaa2
[youtube] Don't capture YouTube Red ad for creator meta field (closes )
satunnainen 00dbdfc1f7 [slideshare] Fix extraction
rrooij f354d84807 [5tv] Add another video URL pattern (closes )
Sergey M․ 15da37c7dc
[YoutubeDL] Don't expand env variables in meta fields (closes )
Sergey M․ 9a0942ad55
[drtv] Make HLS and HDS extraction non fatal
Sergey M․ f2bb33a986
[ted] Fix subtitles extraction (closes , closes )
Yen Chi Hsuan 3615bfe1b4
[twitter] Fix remaining tests
Yen Chi Hsuan e8f20ffa03
[vine] Make sure the title won't be empty
And fix a relevant TwitterCard test case
Yen Chi Hsuan 9be31e771c
[twitter] Support HLS streams in vmap URLs
Yen Chi Hsuan 7f176ac477
[periscope] Support pscp.tv URLs in embedded frames
And fix a relevant twitter test
Yen Chi Hsuan 2edfd745df [twitter] Extract mp4 urls via mobile API (closes )
Yen Chi Hsuan bb13949197 [niconico] Check login errors ()
Yen Chi Hsuan c3c94ca4a4
[giantbomb] Extract m3u8 formats (closes )
Sergey M․ e3cd1fcdd1
[vlive:playlist] Relax and simplify
coreynicholson b71c18b434 [vlive:playlist] Add extractor
Sergey M․ 7bf539edcc
[eagleplatform] Fix test
Sergey M․ 65c416dda8
release 2017.07.09