779822d945
Add experimental support for lazy loading the info extractors
...
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
9 years ago
1b3d5e05a8
Move the extreactors import to youtube_dl/extractor/extractors.py
9 years ago
e52d7f85f2
Delay initialization of InfoExtractors until they are needed
9 years ago
568d2f78d6
[tnaflix] Fix metadata extraction
9 years ago
2f2fcf1a33
[tnaflix] Fix extraction ( Closes #9074 )
9 years ago
bacec0397f
[extractor/common] Relax _hidden_inputs
9 years ago
3c6c7e7d7e
[gdcvault] Fix extraction ( Closes #9107 , closes #9114 )
9 years ago
fb38aa8b53
[extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests ( Closes #9119 , closes #9120 )
9 years ago
18da24634c
[democracynow] Improve extraction
9 years ago
a134426d61
[democracynow] Fix tests
9 years ago
a64c0c9b06
[democracynow] Make description optional ( Closes #9115 )
9 years ago
56019444cb
[novamov] Improve _VALID_URL template ( Closes #9116 )
9 years ago
a1ff3cd5f9
[acast] fix channel extraction( closes #9117 )
9 years ago
9a32e80477
[acast] fix extraction( #9117 )
9 years ago
536a55dabd
[YoutubeDL] Sanitize single thumbnail URL
9 years ago
ed6fb8b804
[vrt] Add support for direct hls playlists and YouTube ( Closes #9108 )
9 years ago
3afef2e3fc
[beeg] Improve extraction
9 years ago
e90d175436
[yandexmusic] Extract music album metafields ( Closes #7354 )
9 years ago
7a93ab5f3f
[extractor/common] Introduce music album metafields
9 years ago
c41cf65d4a
release 2016.04.06
9 years ago
92d5477d84
[compat] Handle tuples properly in urlencode()
...
Fixes #9055
9 years ago
8790249c68
[iqiyi] Improve error detection for VIP-only videos
...
Closes #9071
9 years ago
416930d450
release 2016.04.05
9 years ago
65150b41bb
[deezer] Fix extraction ( Closes #9086 )
9 years ago
e42f413716
[rte] Improve thumbnail extraction ( Closes #9085 )
9 years ago
40a056d85d
[extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically
9 years ago
e7d77efb9d
[auroravid] Add extractor ( Closes #9070 )
9 years ago
995cf05c96
[novamov] Make title fatal
9 years ago
5bf28d7864
[utils] dfxp2srt: add additional namespace
...
Used by the ZDF subtitles (#9081 ).
9 years ago
8c7d6e8e22
[zdf] Extract subtitles ( closes #9081 )
9 years ago
6d4fc66bfc
[youtube] Add support for zwearz ( Closes #9062 )
9 years ago
23576edbfc
[brightcove:legacy] skip None value for uploader_id
9 years ago
4d4cd35f48
[brightcove:legacy] extract uploader_id as a string
9 years ago
3aac9b2fb1
[nowness] update tests
9 years ago
e47d19e991
[brightcove:new] extract subtitles and strip video title
9 years ago
41f5492fbc
[brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp
9 years ago
2defa7d75a
[instagram:user] Fix extraction ( fixes #9059 )
...
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
9 years ago
bbc26c8a01
[bbc] Set vcodec to none for audio formats
9 years ago
b507cc925b
[extractor/common] Carry long line
9 years ago
db8ee7ec05
[extractor/common] Fix numeric identifiers conversion in DASH URL templates
9 years ago
08136dc138
[brightcove] fix format sorting
9 years ago
fe7ef95e91
[cbsinteractive] Add support for ZDNet videos
9 years ago
5f705baf5e
[cnet] extract more formats
9 years ago
0750b2491f
[ffmpeg] try to convert tt subtitles usng dfxp2srt
9 years ago
df634be2ed
[common] prefer using mime type over ext for smil subtitle extraction
...
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
9 years ago
6d628fafca
[camwithher] Remove extra blank line
9 years ago
0f28777f58
[cbsnews] Remove unused import
9 years ago
329c1eae54
[aenetworks] Make pep8 happy
9 years ago
9aaaf8e8e8
[camwithher] Improve extraction ( Closes #8989 )
9 years ago
04819db58e
[camwithher] Add extractor
...
Corrected unnecessary test
Sane variable naming
RTMP all .flv & url_id for _download_webpage()
Corrected all outstanding issues, next up is a squash!
9 years ago
79ba9140dc
[theplatform] extract timestamp and uploader
9 years ago
75d572e9fb
[screencast] Improve title regexes ( Closes #9025 )
9 years ago
791d6aaecc
screencast.com: fallback on page title
...
When determining the title of the page, use the <title> tag of the page
9 years ago
81de73e5b4
[screencast] Add test
9 years ago
83cedc1cf2
screencast.com: support missing www
...
The "www." part of the URL is not mandatory
9 years ago
244cd04237
[pluralsight] Remove unnecessary login/password encode
9 years ago
fbdaced256
[lynda] Remove unnecessary login/password encode
9 years ago
a3373823e1
[udemy] Remove unnecessary login/password encode
...
This is now covered by compat_urllib_parse_urlencode
9 years ago
03caa463e7
[udemy:course] Skip non-video lectures
9 years ago
3f64379eda
[movieclips] fix extraction
9 years ago
3e0c3d14d9
[cbs] add base extractor
9 years ago
d8873d4def
[aenetworks] improve format extraction
9 years ago
db1c969da5
[theplatform] sign https urls
9 years ago
1e02bc7ba2
release 2016.04.01
9 years ago
63c55e9f22
[cbs] improve extraction( closes #6321 )
9 years ago
f9b1529af8
[generic] remove sbnation test(handled by VoxMediaIE)
9 years ago
961fc024d2
[voxmedia] improve sbnation support
9 years ago
b53a06e3b9
[udemy:course] Use new URL format
9 years ago
4ecc1fc638
[howstuffworks] improve extraction
9 years ago
5b012dfce8
[tudou] Improve error handling ( closes #8988 )
9 years ago
8369942773
[voxmedia] Add new extractor( closes #3182 )
9 years ago
86f3b66cec
[udemy] Remove unused import
9 years ago
6bb4600717
[udemy:course] Simplify course curriculum downloading
9 years ago
41d06b0424
[extractor/common] Improve _request_webpage
...
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
9 years ago
15d260ebaa
[utils] Use update_Request in http_request
9 years ago
ed0291d153
[utils] Add update_Request
9 years ago
81da8cbc45
[udemy] Switch to api 2.0 ( Closes #9035 )
9 years ago
5299bc3f91
[beeg] Switch to api v6 ( Closes #9036 )
9 years ago
c9c39c22c5
[nationalgeographic] add support for channel.nationalgeographic.com urls
9 years ago
d84b48e3f1
[nationalgeographic] improve extraction
9 years ago
dd17041c82
[tenplay] remove extractor( fixes #6927 )
9 years ago
fea7295b14
[brightcove] relax embed_in_page regex
9 years ago
9cf01f7f30
[nbc] add new extractor for csnne.com( #5432 )
9 years ago
ce548296fe
[cnbc] fix test
9 years ago
c02ec7d430
[cnbc] Add new extractor( closes #8012 )
9 years ago
6b820a2376
[myspace] improve extraction
9 years ago
e621a344e6
[kwuo] Port to new API and enable --cn-verification-proxy
9 years ago
3ae6f8fec1
[kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
...
Following the idea proposed in 19dbaeece3
9 years ago
597d52fadb
[kuwo:song] Correct song ID extraction ( fixes #9033 )
...
Bug introduced in daef04a4e7
9 years ago
afca767d19
[tumblr] Improve _VALID_URL ( Closes #9027 )
9 years ago
6e359a1534
[comcarcoff] don not depend on crackle extractor( closes #8995 )
...
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995 .
9 years ago
33f3040a3e
[YoutubeDL] Fix sanitizing subtitles' url
9 years ago
03442072c0
[pornhub] Fix typo ( Closes #9008 )
9 years ago
c8b13fec02
[foxnews] Restore upload time fields in test
9 years ago
87d105ac6c
[amp] Fix upload timestamp extraction ( Closes #9007 )
9 years ago
3454139576
[pornhub:uservideos] Add support for multipage videos ( Closes #9006 )
9 years ago
3a23bae9cc
[pornhub:playlistbase] Do not include videos not from playlist
9 years ago
8f9a477e7f
[pornhub:playlistbase] Use orderedSet
9 years ago
a1cf3e38a3
[bbc] Extend vpid regex ( Closes #9003 )
9 years ago
a122e7080b
release 2016.03.27
9 years ago
b22ca76204
[extractor/common] Filter out unsupported encrypted media for f4m formats ( Closes #8573 )
9 years ago
f7df343b4a
[downloader/f4m] Extract routine for removing unsupported encrypted media
9 years ago
19dbaeece3
Remove _sort_formats from _extract_*_formats methods
...
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.
Closes #8051
9 years ago
395fd4b08a
[twitter] Handle another form of embedded Vine
...
Fixes #8996
9 years ago
8018028d0f
[pluralsight] Extract chapter metadata ( Closes #8993 )
9 years ago
00322ad4fd
[lynda] Extract chapter metadata ( #8993 )
9 years ago
4cf3489c6e
[vevo] Update videoservice API URL ( Closes #8900 )
9 years ago
b24ab3e341
[udemy] Improve paid course detection
9 years ago
af4116f4f0
[udemy] Improve format_id
9 years ago
f973e5d54e
[udemy] Drop outputs' formats
...
Always results in 403
9 years ago
62f55aa68a
[udemy] Add outputs metadata to view_html formats
9 years ago
02d7634d24
[udemy] Fix outputs' formats format_id
9 years ago
48dce58ca9
[udemy] Use custom sorting
9 years ago
efcba804f6
[udemy] Extract formats from view_html ( Closes #8979 )
9 years ago
6dee688e6d
[youtube:playlistsbase] Restrict playlist regex ( Closes #8986 )
9 years ago
eedb7ba536
[YoutubeDL] Sort imports
9 years ago
dcf77cf1a7
[YoutubeDL] Sanitize final URLs ( Closes #8991 )
9 years ago
17bcc626bf
[utils] Extract sanitize_url routine
9 years ago
b5a5bbf376
[mailru] Extend _VALID_URL ( Closes #8990 )
9 years ago
e68d3a010f
[twitter] Fix extraction ( closes #8966 )
...
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
9 years ago
d10fe8358c
[generic] Add a test case for brightcove embed
...
Closes #8862
9 years ago
d6c340cae5
[brightcove] Extract more formats ( #8862 )
9 years ago
5964b598ff
[brightcove] Support alternative BrightcoveExperience layout
...
The full URL lays in the `data` attribute of <object> (#8862 )
9 years ago
62cdb96f51
release 2016.03.26
9 years ago
6e6bc8dae5
Use urlencode_postdata across the codebase
9 years ago
15707c7e02
[compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
...
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode
Closes #8974
9 years ago
2156f16ca7
[thescene] Fix extraction and improve style ( Closes #8978 )
9 years ago
4db441de72
[once] Relax _VALID_URL ( Closes #8976 )
9 years ago
0be8314dc8
release 2016.03.25
9 years ago
d7f62b049a
[iqiyi] Update enc_key
9 years ago
3bb3356812
[douyutv] Extend _VALID_URL
9 years ago
98e68806fb
[mnet] Improve ( Closes #8958 )
9 years ago
e031768666
[mnet] Add new extractor
9 years ago
5eb7db4ee9
[udemy] Add support for new URL schema
9 years ago
f0e83681d9
[udemy] Extract formats from outputs
9 years ago
ff9d5d0938
[udemy] Improve course enrolling
9 years ago
d041a73674
[extractor/__init__] Add youtube:live and sort youtube extractors alphabetically
9 years ago
f07e276a04
[youtube:live] Add extractor ( Closes #8959 )
9 years ago
993271da0a
[nytimes] Tolerate missing metadata ( Closes #8952 )
9 years ago
369e7e3ff0
[iprima] Fix extraction ( Closes #8953 )
9 years ago
5767b4eeae
[mtv] Fix description extraction ( Closes #8962 )
9 years ago
622d19160b
[utils] Clarify Python versions affected by buggy struct module
9 years ago
32d88410eb
[tumblr] Add a test with Instagram embed
...
Closes #8817
9 years ago
5a51775a58
[generic] Extract Instagram embeds ( #8817 )
9 years ago
87696e78d7
[instagram] Unescape description ( #8817 )
9 years ago
c4096e8aea
[instagram] Extract embed videos ( #8817 )
9 years ago
fc27ea9464
[tumblr] Support Vine embeds ( #8817 )
9 years ago
088e1aac59
[generic] Support Vine embeds ( #8817 )
9 years ago
4333d56494
Merge pull request #8898 from dstftw/fragment-retries
...
Add --fragment-retries option (Fixes #8466 )
9 years ago
882c699296
[tunein] Fix stream data extraction ( Closes #8899 , closes #8924 )
9 years ago
efbed08dc2
[utils] Encode hostnames before passing to urllib
...
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError
Fixes #8890
9 years ago
7da2c87119
Add extractor for thescene.com ( closes #8929 )
9 years ago
c6ca11f1b3
[once] Prevent ads from embedding into m3u8 playlists ( Closes #8893 )
9 years ago
2beeb286e1
[laola1tv] Add support for livestreams ( Closes #8934 )
9 years ago
cc7397b04d
[ceskatelevize] Make m3u8 formats extraction non fatal ( Closes #8933 )
9 years ago
bc5d16b302
[animeondemand] Skip dash for now
9 years ago
85c637b737
[animeondemand] Extract teaser when no full episode available ( #8923 )
9 years ago
5c69f7a479
[animeondemand] Respect startvideo ( Closes #8923 )
9 years ago
ff5873b72d
[motherless] Detect friends only videos
9 years ago
065c4b27bf
[xhamster:embed] Extract vars ( Closes #8912 )
9 years ago
1600ed1ff9
[rutv] Improve flash version pattern ( Closes #8911 )
9 years ago
5886b38d73
Add support for https for all extractors as preventive and future-proof measure
9 years ago
0cef27ad25
Add missing r prefix for _VALID_URLs
9 years ago
12af4beb3e
[mailru] Add support for https ( Closes #8920 )
9 years ago
9016d76f71
[YoutubeDL] Improve _format_note
9 years ago
3c5d183c19
[animeondemand] Extract all formats ( Closes #8906 )
9 years ago
3e8bb9a972
[animeondemand] Detect geo restriction
9 years ago
daef04a4e7
[kwuo] Fix KuwoChartIE and KuwoSingerIE and accept new URL forms
9 years ago
2648918c81
[vlive] Fix creator extraction ( closes #8814 )
9 years ago
9e3c2f1d74
[openload] Misc improvements
...
* Add thumbnail
* Detect errors (#6469 )
* Match more (#6469 , #8489 )
9 years ago
2bfeee69b9
[openload] Add new extractor ( closes #8489 )
9 years ago
664bcd80b9
[tudou] Use InAdvancePagedList ( closes #8884 )
9 years ago
3c20208eff
[francetv] Improve formats extraction
9 years ago
db264e3cc3
[francetvinfo] Add support for france3-regions and strip title ( Closes #7673 )
9 years ago
96a9f22d98
[discovery] Relax _VALID_URL ( Closes #8903 )
9 years ago
40025ee2a3
[postprocessort/ffmpeg] Allow embedding webvtt into webm ( Closes #8874 )
9 years ago
298c04b464
[91porn] Use common messages' wording
9 years ago
d95114dd83
[91porn] Unquote final URL ( Closes #8881 )
9 years ago
fa023ccb2c
[biobiochiletv] Fix extraction, extract m3u8 formats and overall improve ( Closes #7314 )
9 years ago
e36f4aa72b
[biobiotv] Add extractor
9 years ago
f1ced6df51
[cda] Improve and simplify ( Closes #8805 )
9 years ago
8b0d7a66ef
[cda] Add new extractor for cda.pl
...
Fixes #8760
9 years ago
3aec71766d
[safari:api] Separate extractor ( Closes #8871 )
9 years ago
16a8b7986b
[downloader/fragment] Document fragment_retries
9 years ago
617e58d850
[downloader/{common,fragment}] Fix total retries reporting on python 2.6
9 years ago
e33baba0dd
[downloader/dash] Add fragment retry capability
...
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
9 years ago
721f26b821
[downloader/fragment] Add report_retry_fragment
9 years ago
52bb437e41
[options] Add --fragment-retries option
9 years ago
782b1b5bd1
[utils] lookup_unit_table: Match word boundary instead of end of string
9 years ago
0d769bcb78
[extractor/generic] Fix missing byte literal prefix
9 years ago
4cd70099ea
[hbo] Add new extractor
9 years ago
09fc33198a
utils: lookup_unit_table: Use a stricter regex
...
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
9 years ago
d5aacf9a90
Added format_id to the filers on -f.
9 years ago
19e2617a6f
[commonprotocols] Add generic support for rtmp URLs ( Closes #8488 )
9 years ago
edd9b71c2c
[extractor/generic] Add a test for m3u playlist served without proper Content-Type
9 years ago
5940862d5a
[extractor/generic] Detect m3u playlists served without proper Content-Type
9 years ago
de6c51e88e
[extractor/generic] Fix direct link semantics
9 years ago
303dcdb995
[extractor/generic] Simplify upload_date extraction
9 years ago
20938f768b
[extractor/generic] Add another test for generic m3u8
9 years ago
955737b2d4
[extractor/generic] Force Content-Type to lowecase
9 years ago
263eff9537
[extractor/generic] Properly extract format id from Content-Type
...
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
9 years ago
cae21032ab
[theplatform] Improve geo restriction detection
9 years ago
6187091532
[once] check http formats availability
9 years ago
0d33166ec5
release 2016.03.18
9 years ago
87c03c6bd2
[theplatform] remove unnecessary import
9 years ago
4c92fd2e83
[theplatform] always force theplatform to return a smil for _extract_theplatform_smil
9 years ago
e3d17b3c07
[noz] Fix extraction on python 2.6 by means of using compat_xpath
9 years ago
810c10baa1
[utils] Use compat_xpath
9 years ago
57f7e3c62d
[compat] Add compat_xpath
9 years ago
0d0e282912
[animeondemand] Fix typo and improve
9 years ago
85e8f26b82
[animeondemand] Improve extraction
9 years ago
b57fecfddd
[animeondemand] Add test
9 years ago
8c97e7efb6
[animeondemand] Expand episode title regex ( Closes #8875 )
9 years ago
cc162f6a0a
[crunchyroll] Fix custom _download_webpage ( Closes #8883 )
9 years ago
cf45ed786e
[wistia] extract more metadata
9 years ago
574b2a7393
[nbc:nbcnews] improve extraction( fixes #6922 )
...
- extract more metadata and formats
- relax regex
9 years ago
9f02ff537c
[theplatform] extract brightcove once formats
9 years ago
0436ec0e7a
[once] Add new format extractor
9 years ago
11f12195af
[youtube] Added itag 91
...
Seen in https://www.youtube.com/watch?v=jMN4cxyhJjk
9 years ago
a646a8cf98
[sbs] improve extraction( fixes #3811 )
...
- extract error messages
- force the platform smil url(previously the manifest param
in the query is not respected which make theplatform return non working
mp4 files for some videos)
9 years ago
63f41d3821
[bravotv] Add new extractor( #4657 )
9 years ago
c5229f3926
[utils] PEP 8
9 years ago
96f4f796fb
[brightcover] Remove unused import
9 years ago
70cab344c4
[udemy] Improve course id v4 regex
9 years ago
a7ba57dc17
[udemy] Update course id regex to cover v4 layout ( Closes #8753 , closes #8868 , closes #8870 )
9 years ago
83548824c2
Merge pull request #8092 from bpfoley/twitter-thumbnail
...
[utils] Add extract_attributes for extracting html tag attributes
9 years ago
354dbbd880
[brightcove:new] extract protocol-less embed URLs( closes #2914 )
9 years ago
23edc49509
[tv3] Add new extractor( closes #8059 )
9 years ago
48254c3f2c
[brightcove] some improvements and fixes
...
- use FFmpeg downloader to download m3u8 formats extracted
from BrightcoveNew(some of the m3u8 media playlists use AES-128)
- update comment and update_url_query to handle url query
9 years ago
2cab48704c
[thestar] Add new extractor( closes #5955 )
9 years ago
64d4f31d78
[brightcove:new] update embed_in_page embeds regex to match non numeric ref id
9 years ago
0c9ff24041
[noz] fix extraction in python 2.6
9 years ago
3ff8279e80
[kuwo:mv] Fix the test and extraction of georestricted MVs
9 years ago
cb6e477dfe
[aljazeera] update the extractor to use BrightcoveNewIE
9 years ago
edfd93518e
[svt] extract dashhbbtv formats( #8867 )
9 years ago
89807d6a82
[brightcove] extract dash formats and detect audio formats
9 years ago
49dea4913b
Merge pull request #8513 from remitamine/dash-sort
...
[extractor/common] fix dash formats sorting
9 years ago
dec2cae0a7
[twitch:playlistbase] Clarify pagination bug
...
Pagination bug has been fixed by twitch on 15.03.2016.
9 years ago
cf6cd07396
[noz] extract f4m and m3u8 formats
9 years ago
975b9c9ab0
[brightcove:new] detect m3u8 manifests by M2TS container
9 years ago
8ac73bdbe4
[brightcove:new] Add support for non numeric ref: preffixed video ids
9 years ago
877f440f7b
[rice] Add new extractor( closes #1736 )
9 years ago
d13bdc3824
[brightcove] raise ExtractorError on 403 errors and fix regex to work with tenplay
9 years ago
744daf9418
[gameinformer] remove unused imports
9 years ago
bf475e1990
[tlc] fix extraction and update extractor to use BrightcoveNewIE
9 years ago
203f3d779a
[gameinformer] update the extractor to use BrightcoveNewIE
9 years ago
4230c4894d
[external/downloader] fix rtmp downloading using FFmpegFD
9 years ago
6bb266693f
release 2016.03.14
9 years ago
5d53c32701
[usatoday] Add new extractor( closes #8655 )
9 years ago
2e7e561c1d
Merge pull request #8611 from remitamine/ffmpegfd
...
[downloader/external] Add FFmpegFD
9 years ago
d8515fd41c
[downloader/external] pass configuration args to ffmpeg
9 years ago
694c47b261
[external/downloader] don't pass -t and -ss to ffmpeg
9 years ago
77dea16ac8
[downloader/external] check for ffmpeg availablity when it used for m3u8 download
9 years ago
6ae27bed01
[download/external] move the check for multiple selected formats to get_suitable_downloader
9 years ago
da1973a038
[extractor/__init__] disable time range downloading
9 years ago
be24916a7f
[downloader/rtsp] Add rtsp and mms downloader
9 years ago
2cb99ebbd0
[downloader/external] add can_download mathod for checking downloader availibilty and support
9 years ago
91ee320bfa
[downloader/external] wrap available_opt in a list
9 years ago
8fb754bcd0
Merge pull request #8821 from remitamine/list-thumbnails-order
...
[YoutubeDL] check for --list-thumbnails immediately after processing them
9 years ago
b7b72db9ad
[YoutubeDL] check for --list-thumbnails immediately after processing them
9 years ago
634415ca17
[downloader/external] skip FFmpegFD when requesting multiple formats
9 years ago
2f7ae819ac
[utils] PEP 8
9 years ago
0a477f8731
[vice:show] Add extractor ( Closes #8847 )
9 years ago
a755f82549
[ffmpeg] convert format ext to ffmpeg output formats codes
9 years ago
7f4173ae7c
[mixcloud] Fix view count extraction ( Closes #8831 , closes #8845 )
9 years ago
fb47597b09
[bbc] Generalize unit table lookup and add parse_count
9 years ago
450b233cc2
[bbc] Update test
9 years ago
b7d7674f1e
[bbc] Update test
9 years ago
0e832c2c97
[bbc] Improve title and description extraction ( Closes #8826 , closes #8822 )
9 years ago
8e4aa7bf18
[bbc] Fix BBC Extractor to work with 'School Report'
9 years ago
a42dfa629e
[makerschannel] Add new extractor( closes #8839 )
9 years ago
b970dfddaf
[minoto] Add new extractor
9 years ago
46a4ea8276
[safari] Remove unused imports
9 years ago
3f2f4a94aa
[extractor/generic] Extract f4m formats from final URLs
9 years ago
f930e0c76e
[extractor/generic] Extract f4m formats and refactor common info
9 years ago
0fdbb3322b
[extractor/common] Add _parse_f4m_formats routine
9 years ago
e9c8999ede
[safari] Fix authentication
9 years ago
73cbd709f9
[safari] Respect kaltura session ( Closes #7491 )
9 years ago
9dce3c095b
[kaltura] Respect kaltura session
9 years ago
e5a2e17a9c
[kaltura] optimize url info extraction
9 years ago
0ec589fac3
Merge pull request #8827 from remitamine/safari
...
[safari] extract free and preview videos(#7491 )
9 years ago
36bb63e084
[dw] add support for article pages( closes #8790 )
9 years ago
91d6aafb48
[dw] add support for audio pages
9 years ago
c8868a9d83
[dw] Add new extractor
9 years ago
09f572fbc0
[extractor/common] add transform_source to _download_smil and _extract_smil_formats
9 years ago
58e6d097d8
[googledrive] Relax _VALID_URL ( Closes #8829 )
9 years ago
15bf934de5
Merge pull request #8819 from remitamine/simple-webpage-requests
...
[extractor/common] simplify using data, headers and query params with _download_* methods
9 years ago
cdfee16818
[extractor/common] add data, headers and query params to _request_webpage
9 years ago
bcb668de18
[safari] extract free and preview videos( #7491 )
9 years ago
fac7e79277
[kaltura] add support for videos with reference id
9 years ago
a6c8b75904
[common] Use mimeType to determine file extensions ( #8766 )
9 years ago
25cb05bda9
[utils] Remove codec2ext
...
This function is orignally used for determining file extensions of DASH
formats. Now in DASH, ext is determined by mime_type. See #8766 for more
information.
9 years ago
883c052378
[audioboom] Improve robustness and extract uploader ( Closes #8812 )
9 years ago
61f317c24c
Added extractor for AudioBoom.com
9 years ago
64f08d4ff2
Merge pull request #8766 from yan12125/dash-detect-ext
...
Detect file extensions of DASH formats from their codecs
9 years ago
e738e43358
[facebook] Support videos in groups
...
Viewing/Downloading videos in groups requires logging in, even for
those in public groups.
Fixes #6951 .
9 years ago
f6f6217a98
[facebook] Don't override variable in list comprehension
9 years ago
31db8709bf
[iqiyi] Update enc_key
9 years ago
5080cbf9fd
[facebook] Handle escaped swf params
...
Fixes #8713
9 years ago
9880124196
[facebook] Fix for m.facebook.com URLs
9 years ago
9c7b509b2a
[facebook] Merge FacebookPostIE into FacebookIE
...
Fixes #8713
9 years ago
5d583bdf6c
[YoutubeDL] Improve _format_note
9 years ago
1e501364d5
[vimeo:ondemand] Clarify IE_NAME
9 years ago
74278def2e
[vimeo:ondemand] Separate ondemand extractor ( Closes #8330 , closes #8801 )
9 years ago
e375a149e1
[livestream] Properly build smil URLs ( #8794 )
9 years ago
ac45505528
Added flag for 'allow_audio_only' format in Twitch queries
9 years ago
46c329d6f6
[arte] Improve extraction ( Closes #8768 )
9 years ago
1818e4c2b4
[arte] Fix typo
9 years ago
e7bd17373d
[sexu] Improve extraction ( Closes #8782 )
9 years ago
c58e74062f
[Sexu] fix extractor
9 years ago
6d210f2090
[utils] Add more codecs to codec2ext
...
BBC uses avc3. Here's an example (thanks to @remitamine for this example)
http://rdmedia.bbc.co.uk/dash/ondemand/bbb/2/client_manifest-common_init.mpd
See also https://trac.ffmpeg.org/ticket/5217
9 years ago
af7d5a63b2
[common] Document protocol http_dash_segments
9 years ago
e41acb6364
[safari] Don't pollute std_headers ( #8778 )
9 years ago
bdf7f13954
release 2016.03.06
9 years ago
0f56a4b443
[vimeo] Don't pollute std_headers
...
Fixes #8778
9 years ago
1b5284b13f
[downloader/fragment] Make speed more smooth
...
At the beginning of every segment there was a drop to Unknown speed due to timeslice being too small to calculate speed.
Now last speed from the previous fragment is used.
9 years ago
d1e4a464cd
[YoutubeDL] Carry long lines and improve readability
9 years ago
ff059017c0
[YoutubeDL] Fix typo in m3u8_native fixup
9 years ago
f22ba4bd60
update tests related to the change in youtube http format sorting
...
the change was done in 82156fdbf0
9 years ago
1db772673e
[cinemassacre] update tests
9 years ago
75313f2baa
[cnet] fix info extraction
9 years ago
090eb8e25f
Merge pull request #8718 from remitamine/m3u8-fixup
...
Add fixup for media files produced by HlsNative downloader(fixes #4776 )
9 years ago
a9793f58a1
Merge pull request #8754 from remitamine/5min
...
update 5min related web sites info extraction and add support for Aol features.
9 years ago
7177fd24f8
[vgtv] support ap.vgtv.no and fix old videos extraction( fixes #8719 )
9 years ago
1e501f6c40
[jeuxvideo] Fix config URL extraction ( Closes #8774 )
9 years ago
2629a3802c
[revison3] fix video_id for --download-archive
9 years ago
51ce91174b
[YoutubeDL] Fix resolution with missing height in output template dict
9 years ago
107d0c421a
[revision3] add support for pages of type tag
9 years ago
18b0b23992
[revision3] add support pages of type embed
9 years ago
d1b29d1342
[elpais] Add support for alternative layout ( Closes #8744 )
9 years ago
2def60c5f3
[common] Use codec2ext for DASH formats ( #8764 )
9 years ago
19a17d4623
[utils] Add codec2ext
9 years ago
845817aadf
[twitter] Provide more metadata
9 years ago
3233a68fbb
[utils] update_url_query: Encode the strings in the query dict
...
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
9 years ago
cf074e5ddd
[foxnews] update test
9 years ago
002c755248
[youporn] Fix sources regex
9 years ago
d627cec608
[youporn] Fix quality extraction ( Closes #8758 )
9 years ago
1315224cbb
[bleacherreport] update tests
9 years ago
7760b9ff4d
[audimedia] update _VALID_URL and video_id regex and improve http format_id
9 years ago
28559564b2
[kusi] Correct test_KUSI
9 years ago
fa880d20ad
[kusi] Two fixes
...
Thanks @dstftw for pointing out those
9 years ago
ae7d31af1c
[yandexmusic] Capture and output API errors
9 years ago
5f1688f271
[kusi] Simplify and improve
9 years ago
1d4c9ed90c
[aol] imporve extraction
...
- add support for aol features
- remove support for legacy urls
9 years ago
d48352fb5d
[engadget] remove support for legacy urls
9 years ago
6d6536acb2
[fivemin] improve extraction
...
- skip m3u8 formats(404 error)
- skip unavailable test
- download embed page only when it's needed
- update _VALID_URL regex(joystiq.com redirect to engadget.com)
9 years ago
b6f94d81ea
[kusi] Add a test for the alternative form of URL
9 years ago
8477a69283
Merge branch 'kusi' of https://github.com/mutantmonkey/youtube-dl into mutantmonkey-kusi
9 years ago
d58cb3ec7e
[leeco] Skip an invalid test. test_LePlaylist_1 is sufficient
9 years ago
8a370aedac
[leeco] format_id should be strings
9 years ago
24ca0e9c0b
[douyutv] Fix tests
9 years ago
e1dd521e49
[livestream] Fix FutureWarning ( Closes #8742 )
9 years ago
1255733945
Merge pull request #8739 from remitamine/update_url_params
...
[utils] add update_url_query function to create or update query string params
9 years ago
d0ff690d68
[indavideo:embed] Fix tags extraction ( Closes #8738 )
9 years ago
38f9ef31dc
[utils] add update_url_query function
9 years ago
a8276b2680
[twitch:playlistbase] Fix all at once fetch
9 years ago
ececca6cde
[twitch:playlistbase] Restore original _PAGE_LIMIT
9 years ago
8bbb4b56ee
[twitch:playlistsbase] Use orderedSet
9 years ago
539a1641c6
[twitch] Workaround broken paging ( Closes #8740 )
9 years ago
e9c0cdd389
[jython] Introduce compat_os_name
...
os.name is always 'java' on Jython
9 years ago
0cae023b24
Merge branch 'jython-support'
...
Closes #8302
9 years ago
8ee239e921
[utils] Jython support - handle filenames correctly
...
Now test:youtube downloads
9 years ago
8bb56eeeea
[utils] Add extract_attributes for extracting html tag attributes
...
This is much more robust than just using regexps, and handles all
the common scenarios, such as empty/no values, repeated attributes,
entity decoding, mixed case names, and the different possible value
quoting schemes.
9 years ago
fa9e259fd9
[extractor/common] use compat_parse_qs in update_url_params
9 years ago
f3bdae76de
[extractor/common] add update_url_params helper method to add or update query string params
9 years ago
03879ff054
[twitter] Media info is not always in the first entity
...
Fixes #8704
9 years ago
c8398a9b87
[twitter] Now Twitter serves the same file for Firefox and Chrome
9 years ago
b8972bd69d
[twitter] Fix extraction of test_Twitter and test_Twitter_1
9 years ago
0ae937a798
[twitter] Support twitter.com/i/videos/tweet/ URLS
...
Closes #8737
9 years ago
4459bef203
[thepltform] detect other types of errors
9 years ago
e07237f640
[utils] remove check for val from find_xpath_attr
9 years ago
8c5a994424
[leeco] Letv renamed to LeEco
...
LeEco is the company name and Le is the domain name.
For more information see the Chinese news post
http://www.techorz.com/company-news/letv-renamed-to-leeco-and-new-logo/
9 years ago
2eb25b256b
[letv] Merge LetvTvIE into LetvPlaylistIE
...
And
1. Add more URL examples
2. Improve the matching pattern
9 years ago
f3bc19a989
[letv] Correct regular expressions and fix a typo
9 years ago
7a8fef3173
[letv] Order imports alphabetically
9 years ago
7465e7e42d
[letv] Keep videos' order in playlists
9 years ago
5e73a67d44
[letv] Domain name changed
9 years ago
2316dc2b9a
[twitch:playlistbase] Mark broken
...
Twitch paging mechanism is completely broken on twitch side serving all videos all the time and making our travis builds stall.
9 years ago
a2d7797cee
[vimeo] Extract uploader_url ( Closes #8727 )
9 years ago
fd050249af
[youtube] Extract uploader_url ( Closes #8724 )
9 years ago
7bcd2830dd
[extractor/common] Document uploader_url
9 years ago
7caf9830b0
[youtube] Extract license ( Closes #8725 )
9 years ago
2bc0c46f98
[extractor/common] Document license metafield
9 years ago
3318832e9d
[youtube] improve width and height extraction from fmt_list
9 years ago
e7d2084568
Merge branch 'master' of github.com:rg3/youtube-dl
9 years ago
c2d3cb4c63
Revert "[youtube] add tbr to _formats extracted from watch_as3.swf"
...
This reverts commit 4a5ba28a87
9 years ago
c48dd4400f
Revert "[youtube] add basic info for some unknown formats extracted from watch_as3.swf"
...
This reverts commit 85ca019d96
9 years ago
e38cafe986
[YoutubeDL] Skip postprocessing and archive report when outputting to stdout ( Closes #8729 )
9 years ago
85ca019d96
[youtube] add basic info for some unknown formats extracted from watch_as3.swf
9 years ago
4a5ba28a87
[youtube] add tbr to _formats extracted from watch_as3.swf
9 years ago
82156fdbf0
[youtube] extract width and height from fmt_list
9 years ago
6114090418
[nrk:skole] Relax _VALID_URL
9 years ago
3099b31276
[nrk:skole] Add extractor ( Closes #8728 )
9 years ago
f17f86513e
Add fixup for media files produced by HlsNative downloader( fixes #4776 )
9 years ago
90f794c6c3
[options] Add --no-mark-watched ( #5054 )
9 years ago
66ca2cfddd
[wistia] Fix extraction ( Closes #8707 )
9 years ago
269dd2c6a7
Merge pull request #8703 from dstftw/mark-watched
...
Add --mark-watched feature (Closes #5054 )
9 years ago
e7998f59aa
[lifenews] Fix extraction and improve ( Closes #2482 , closes #8714 )
9 years ago
9fb556eef0
[iqiyi] SWF URLs are not used anymore
...
Since automatic detection of enc_key failed
Closes #8705
9 years ago
e781ab63db
release 2016.03.01
9 years ago
3e76968220
[rtve.es:live] Fix extraction
...
* Update _VALID_URL to match the current URLs
* Use the m3u8 manifest since I haven't figured out how to use the rtmp stream
9 years ago
2812c24c16
[mdr] Fix extraction ( Closes #8702 )
9 years ago
d77ab8e255
Add --mark-watched feature ( Closes #5054 )
9 years ago
4b3cd7316c
[tf1] Improve wat id regex ( Closes #8691 )
9 years ago
6dae56384a
[screenwavemedia] Check formats' URLs
9 years ago
2b2dfae83e
[screenwavemedia] Improve formats sorting
9 years ago
6c10dbeae9
[screenwavemedia] Improve formats extraction
9 years ago
9173202b84
[zdf] Ignore hls manifests that use https ( closes #8665 )
...
The certificates are misconfigured, you get the following error mesage:
ssl.CertificateError: hostname u'zdf-hdios-none-i.zdf.de' doesn't match either of 'a248.e.akamai.net', '*.akamaihd.net', '*.akamaihd-staging.net', '*.akamaized.net', '*.akamaized-staging.net'
9 years ago
8870bb4653
[webofstories] Tolerate malforder og:title ( Closes #8417 )
9 years ago
da665ddc25
release 2016.02.27
9 years ago
5add979d91
[dplay] Add support for dplay.no
9 years ago
940b606a07
[dplay] Improve, extract all formats and metadata ( Closes #8463 )
9 years ago
9505053704
[dplay] add support for it.dplay.com and dplay.dk
9 years ago
2c9ca78281
[extractor/generic] Add support for tnaflix network embeds ( Closes #7505 )
9 years ago
63719a8ac3
[tnaflixnetwork:embed] Add _extract_urls
9 years ago
8fab62482a
[tnaflixnetwork] Fallback age limit to 18
9 years ago
d6e9c2706f
[tnaflixnetwork:embed] Add extractor
9 years ago
f7f2e53a0a
[imdb] Recognize 1080p formats ( Closes #8677 )
9 years ago
9cdffeeb3f
[extractor/common] Clarify rationale on media playlist detection
9 years ago
fbb6edd298
[extractor/common] Properly extract audio only formats in master m3u8 playlists
9 years ago
5eb6bdced4
[utils] Multiple changes to base_n()
...
1. Renamed to encode_base_n()
2. Allow tables longer than 62 characters
3. Raise ValueError instead of AssertionError for invalid input data
4. Return the first character in the table instead of '0' for number 0
5. Add tests
9 years ago
5633b4d39d
[infoq] Use BokeCC extractor function
9 years ago
4435c6e98e
[bokecc] Add new extractor ( #2336 )
9 years ago
2ebd2eac88
[letv] Speedup M3U8 decryption
9 years ago
b78b292f0c
[youtube] Add alternative automatic captions extraction approach ( Closes #8667 )
9 years ago
efbd6fb8bb
[vidzi] Use decode_packed_codes
...
Javascript codes found on Vidzi are slightly different from those found
in VideoMega and iQiyi. Nevertheless, the difference has no effects on
the final result.
9 years ago
680079be39
[utils] Relaxing regex in decode_packed_codes for vidzi
9 years ago
e4fc8d2ebe
[videomega] Fix extraction ( closes #7606 )
9 years ago
f52354a889
[utils] Move codes for handling eval() from iqiyi.py
9 years ago
59f898b7a7
[utils] Merge base_n functions
9 years ago
8f4a2124a9
[vidzi] Fix extraction
9 years ago
481888294d
[utils] Add base36 for use in Vidzi
9 years ago
d1e440a4a1
[jwplatform] Separate codes for for parsing jwplayer data
9 years ago
81bdc8fdf6
[utils] Move base62 to utils
9 years ago
e048d87fc9
[kuwo] Fix a test
9 years ago
e26cde0927
[space] Remove extractor ( Closes #8662 )
...
Now uses ooyala embed
9 years ago
20108c6b90
[ustudio] Improve ( Closes #8574 )
9 years ago
9195ef745a
[uStudio] Add new extractor
9 years ago
d0459c530d
[motherless] Update tests
9 years ago
f160785c5c
[utils] Remove AM/PM from unified_strdate patterns
9 years ago
5c0a57185c
[motherless] Detect non-existing videos
9 years ago
43479d9e9d
[motherless] Make categories optional ( Closes #8654 )
9 years ago
c24883a1c0
[facebook] Fix format sorting
...
'hd' formats should have higher priorities
9 years ago
1b77ee6248
[c56] Support videos hosted on Sohu ( closes #8073 )
9 years ago
bf4b3b6bd9
[vk] Extract video URL from extra_data ( Closes #8646 )
9 years ago
efbeddead3
[facebook] Support mobile URLs ( closes #8638 )
9 years ago
3cfeb1624a
[nba] Support channels ( #5362 , #4167 )
9 years ago
b95dc034ca
[utils] Implement cache for OnDemandPagedList
9 years ago
86a7dbe66e
[nba] Support non-video/ pages
...
Fixes #8589
9 years ago
1ad6143061
[xfileshare] Add support for powerwatch ( Closes #8628 )
9 years ago
92da3cd848
release 2016.02.22
9 years ago
6212bcb191
[tf1] fix info extraction( fixes #8599 )
9 years ago
d69abbd3f0
[googledrive] Make thumbnail optional ( Closes #8629 )
9 years ago
1d00a8823e
[arte] PEP 8
9 years ago
5d6e1011df
[pbs] Extract all formats ( Closes #8538 )
9 years ago
f5bdb44443
[extractor/common] Add _remove_duplicate_formats
9 years ago
7efc1c2b49
[twitter] Fix metadata extraction and test_Twitter_1
9 years ago
132e3b74bd
[twitter] Fix a typo
9 years ago
bdbf4ba40e
[twitter:amplify] Extract more metadata
9 years ago
acb6e97e6a
[twitter] Fix several failed tests
9 years ago
445d72b8b5
[twitter:amplify] Add TwitterAmplifyIE for handling Twitter smart URLs
...
Closes #8075
9 years ago
92c5e11b40
[arte:future] Fix test
9 years ago
0dd046c16c
[arte:magazine] Fix test
9 years ago
305168ca3e
[arte:+7] Detect more embeds ( Closes #8613 )
9 years ago
b72f6163dc
[arte:+7] Improve _VALID_URL
9 years ago
33d4fdabfa
[extractor/generic] Add support for ok embeds ( #8619 )
9 years ago
cafcf657a4
add more subtitles mime types to mimetype2ext and fix the platform subtitle extraction
9 years ago
7360db05b4
[postprocessor/embedthumbnail] Allow mkv to embed thumbnails
...
Fixes #6046
9 years ago
c1c05c67ea
[utils] Jython support - disable setproctitle() until ctypes is complete
9 years ago
399a76e67b
[utils] Jython support: tolerate missing fcntl module
9 years ago
765ac263db
[utils] mimetype2ext: return 'm4a' for 'audio/mp4' ( fixes #8620 )
...
The youtube extractor was using 'mp4' for them, therefore filters like 'bestaudio[ext=m4a]' stopped working (94278f7202
9 years ago
73f9c2867d
[iqiyi] Support playlists ( closes #8019 )
9 years ago
9c86d50916
[faz] Future-proof XML element check
9 years ago
99709cc3f1
[iqiyi] Implement _login()
...
Currently only email login supported
9 years ago
5bc880b988
[utils] Add OHDave's RSA encryption function
9 years ago
958759f44b
[appletrailers] Extend _VALID_URL ( #8524 )
9 years ago
f34294fa0c
[downloader/external:ffmpegfd] check for None value of start_time
9 years ago
99cbe98ce8
[downloader/external] check for external downloaders availability
9 years ago
04cbc4980d
[mtv] imporove duration extraction
9 years ago
8765151c8a
[mtv] Extract duration from each playlist item
...
RSS used instead of manifest files because it's exact to the millisecond
with the video I tested while in manifest it's only exact to the second.
9 years ago
12b84ac8c1
[downloader/external] Add FFmpegFD( fixes #622 )
...
- replace HlsFD and RtspFD
- add basic support for downloading part of the video or audio
9 years ago
ed8648a322
[pornhub] Fix thumbnail and duration extraction ( Closes #8604 )
9 years ago
88641243ab
[pornhub:playlistbase] Improve extract entries
9 years ago
40e146aa1e
[pornhub:user:videos] Add extractor ( Closes #8548 )
9 years ago
f3f9cd9234
[francetv] Improve video id regex ( Closes #8563 )
9 years ago
ebf1b291d0
[youtube:watchlater] Respect --no-playlist
9 years ago
bc7a9cd8fb
[youtube:watchlater] Improve _VALID_URL ( Closes #8594 )
9 years ago
d48502b82a
[arte] Improve _VALID_URLs
9 years ago
479ec54a8d
[arte:magazine] Improve ( Closes #8473 )
9 years ago
49625662a9
[arte:magazine] Add extractor
9 years ago
8b809a079a
[cbsnews] use find_xpath_attr
9 years ago
778433cb90
[cbsnews] extract subtitle url from theplatform SMIL manifest( fixes #8568 )
9 years ago
411cb8f476
[dailymotion] Fix view count extraction
...
Fix view count parsing when the decimal marker is a whitespace, e.g. '101 101'
9 years ago
63bf4f0dc0
[vrt] Detect geo restriction
9 years ago
80e59a0d5d
[vrt] Make formats extraction non fatal ( Closes #8587 )
9 years ago
8bbd3d1476
[arte] Fix upload date extraction ( Closes #8581 )
9 years ago
e725e4bced
[arte] PEP 8
9 years ago
08d65046f0
[arte] Make sorting aware of en/es formats
9 years ago
44b9745000
[arte] Extend more _VALID_URLs for en and es support
9 years ago
9654fc875b
[arte:+7] Fix extraction for react-based layout
9 years ago
Jaime Marquínez Ferrándiz
Sergey M․
remitamine
Philipp Hagemeister
Yen Chi Hsuan
theGeekPirate
Martin Trigaux
Kagami Hiiragi
jjatria
Kacper Michajłow
John Peel
Quan Hua
Benjamin Congdon
aystroganov@gmail.com
Brian Foley
Aidan Rowe
mutantmonkey
RiCON
Thomas Jost
cazulu