Commit Graph

11981 Commits (199a47abba4ce57b6df4cd9f3223837ac6c4ee85)

Author SHA1 Message Date
Remita Amine 639e3b5c99 extract ISM formats in some of the extractors 8 years ago
Remita Amine b2758123c5 add Basic support for Smooth Streaming protocol(#8118) 8 years ago
Sergey M․ f449c061d0
[nicknight] Improve extraction (closes #10769) 8 years ago
Sergey M․ 9c82bba05d
[nickde] Improve extraction 8 years ago
NeroBurner e3577722b0
[nicknight] Add extractor 8 years ago
Sergey M․ b82c33dd67
[extractor/common] Improve mpd base URL extraction (closes #10909, closes #11079) 8 years ago
Sergey M․ e5a088dc4b
[utils] Fix --match-filter for int-like strings (closes #11082) 8 years ago
Sergey M․ 2c6da7df4a
release 2016.10.31 8 years ago
Sergey M․ e70a5e6566
release 2016.10.30 8 years ago
Sergey M․ a901fc5fc2
[vessel] Add tests for #11068 8 years ago
dundua cae6bc0118 [vessel] Improve video id extraction 8 years ago
Yen Chi Hsuan d9ee2e5cf6
[facebook] Remove SWF params so that 1080P are detected
Closes #11073

In the provided link, SWF params give up to 720P, and VideoConfig
gives 1080P for both best and bestvideo. I guess all Facebook videos
supports HTML5 now, so I remove the old detection for SWF params
8 years ago
Yen Chi Hsuan e1a0b3b81c
[imgur] Recognize /r/ URLs (closes #11071) 8 years ago
Sergey M․ 2a048f9878
[beeg] Fix extraction (closes #11069) 8 years ago
Yen Chi Hsuan f02700a1fa
[openload] Fix extraction (#10408)
Thanks @TwelveCharzz again for studying openload codes
8 years ago
Sergey M․ f3517569f6
[gvsearch] Modernize and fix page result request (closes #11051) 8 years ago
neutric c725333d41 [ard] Fix typo 8 years ago
Yen Chi Hsuan a5a8877f9c
[adultswim] Fix extraction (closes #10979) 8 years ago
Remita Amine 43c53a1700 [nobelprize] Add new extractor(closes #9999) 8 years ago
Yen Chi Hsuan ec8705117a
[hornbunny] Fix extraction (#10981) 8 years ago
Remita Amine 3d8d44c7b1 [tvp] improve video id extraction(closes #10585) 8 years ago
Sergey M․ 88839f4380
release 2016.10.26 8 years ago
Sergey M․ 773017c648
[rentv] Move rentv test from generic extractor and add only matching tests 8 years ago
Remita Amine 777d90dc28 [rentv] Add new extractor(closes #10620) 8 years ago
Sergey M․ 3791d84acc
[ard] Detect unavailable videos (closes #11018) 8 years ago
Sergey M․ 9305a0dc60
[vk] Fix extraction (closes #11022) 8 years ago
Sergey M․ 94e08950e3
release 2016.10.25 8 years ago
Sergey M․ d3b6b3b95b
[jamendo] Improve 8 years ago
Thor77 b17422753f [jamendo] Add extractor 8 years ago
Sergey M․ d2e96a8ed4
[pandatv] Extract m3u8, document reverse source and PEP 8 8 years ago
Zhong Jianxin 2e7c8cab55 [pandatv] Add new extractor 8 years ago
Sergey M․ d7d4481c6a
[movieclips] Fix _VALID_URL 8 years ago
Yen Chi Hsuan 5ace137bf4
[dotsub] Support vimeo embed (closes #10964) 8 years ago
Yen Chi Hsuan 9dde0e04e6
[litv] Fix extraction (#11006) 8 years ago
Sergey M․ f16f8505b1
[vimeo] Delegate ondemand redirects to ondemand extractor (closes #10994) 8 years ago
Sergey M․ 9dc13a6780
[vivo] Fix extraction (closes #11003) 8 years ago
Sergey M․ 9aa929d337
[twitch:stream] Add support for rebroadcasts (closes #10995) 8 years ago
Sergey M․ 425f3fdfcb
[pluralsight] Fix subtitles conversion (closes #10990) 8 years ago
Yen Chi Hsuan b64d04c119
[utils] Clarify for redirecting STDIN in get_exe_version() 8 years ago
John Hawkinson 00ca755231 [get_exe_version] Do version probes with <&-
When doing version probes for ffmpeg, do the
equivalent of calling it as:

    ffmpeg -version <&-

Where <&- is shell syntax for closing stdin before calling the
program. This is roughly equivalent to </dev/null without actually
opening /dev/null.

This prevents ffmpeg -version from hanging when run in the background.
Fixes #955.

The reason is that ffmpeg tries to manipulate stdin to set up terminal
characteristic, and that causes the kernel to suspend the parent
process (youtube-dl).

Note that closing stdin is achieved by calling subprocess.Popen() with
stdin set to subprocess.PIPE and without passing any input to
Popen.communicate(). This is somewhat subtle.
8 years ago
Sergey M․ 69c2d42bd7
release 2016.10.21.1 8 years ago
Sergey M․ 859447a28d
[adobepass] PEP 8 8 years ago
Sergey M․ f8ae2c7f30
[pluralsight] Process all clip URLs (closes #10984) 8 years ago
Sergey M․ 9ce0077485
release 2016.10.21 8 years ago
Sergey M․ 9df6b03caf
[pluralsight] Adapt to new API (closes #10972) 8 years ago
Yen Chi Hsuan 8e2915d70b
Revert "[postprocessor/embedthumbnail] Allow mkv to embed thumbnails"
This reverts commit 7360db05b4.

This commit was added as an attempt to fix #6046. Unfortunately, the fix
is completely wrong. As reported on #10359, embedded thumbnails are not
displayed in VLC, and Se7en on IRC reports that the embedded thumbnail
misleads mpv as well.

The correct way is using -attachment of ffmpeg, while the current
run_ffmpeg_multiple_files API can't handle it cleanly.
8 years ago
Kacper Michajłow 60633ae9a0 [openload] Fix extraction.
Fixes #10408
8 years ago
remitamine 9218a6b4f5 Merge pull request #10819 from raleeper/adobepass
[adobepass] Add Comcast
8 years ago
Remita Amine 02af6ec707 [natgeo] extract m3u8 formats(closes #10959) 8 years ago
raleeper 46f6052950 [adobepass] Add Comcast with fixed _download_webpage calls 8 years ago
Sergey M․ c8802041dd
release 2016.10.19 8 years ago
Sergey M․ 2b96b06bf0
[vidzi] Fix extraction (closes #10908, closes #10952) 8 years ago
Sergey M․ 06b3fe2926
[utils] Expose PACKED_CODES_RE 8 years ago
Remita Amine efb6242916 [urplay] add supprt for urskola.se and fix subtitle extraction(closes #10915) 8 years ago
Remita Amine 0384932e3d [extractor/common] try to extract non smil wowza mpd manifests 8 years ago
Remita Amine edd6074cea [extractor/common] detect f4m audio only formats 8 years ago
Remita Amine 791d29dbf8 [orf] add subtitles support(closes #10939) 8 years ago
Sergey M․ 481cc7335c
[youtube] Fix --no-playlist behavior for youtu.be/id URLs (closes #10896) 8 years ago
Sergey M․ 853a71b628
[nrk] Improve _VALID_URL 8 years ago
Sergey M․ e2628fb6a0
[nrk] Relax _VALID_URL (closes #10928) 8 years ago
Sergey M․ df4939b1cd
[nytimes] Fix typo 8 years ago
Sergey M․ 0b94dbb115
[postprocessor/ffmpeg] PEP 8 8 years ago
Sergey M․ 8d76bdf12b
[extractor/common] Mention podcast in series fields section 8 years ago
Sergey M․ 47da782337
[nytimes] Improve (closes #10926) 8 years ago
John Hawkinson 74324a7ac2
[nytimes] Add support for podcasts 8 years ago
Sergey M․ b0dfcab60a
[pluralsight] Relax _VALID_URL (closes #10941) 8 years ago
Sergey M․ bbd7706898
release 2016.10.16 8 years ago
Sergey M․ c0b1e88895
[huajiao] Improve feed regex 8 years ago
Sergey M․ 7cdfbbf9b8
[extractors] Change import for theoperaplatform extractor 8 years ago
Déstin Reed ac943d48d3 [Beatport] Update extractor name and tests 8 years ago
arza 73498a8921 [ruutu] Add support for supla.fi 8 years ago
Pierre Mdawar 2273e2c530 [postprocessor/ffmpeg] Return correct filepath and ext in updated information in FFmpegExtractAudioPP
Return correct audio's filepath and ext instead of the video's when extracting audio and audio file already exists.
8 years ago
Sergey M․ 4b492e3579
[theoperaplatform] Rename, fix _VALID_URL and fix test 8 years ago
Juanjo Benages 9c4258bcec
[theoperaplatform] Add extractor 8 years ago
Sergey M․ ea8aefd1d7
[lynda] Fix height for prioritized streams 8 years ago
Sergey M․ 6edfc40a0e
[lynda] Add fallback extraction scenario 8 years ago
Sergey M․ 68d9561ca1
[lynda] Switch to https (closes #10916) 8 years ago
Yen Chi Hsuan d32fa0f12c
[huajiao] Coding style 8 years ago
Yen Chi Hsuan a347a0d088
Merge branch 'huajiao' of https://github.com/pyx/youtube-dl into pyx-huajiao 8 years ago
Yen Chi Hsuan 77c5b98dcd
[crunchyroll] Skip an invalid _TEST 8 years ago
Yen Chi Hsuan 88ebefc054
[cmt] Fix mgid extraction (closes #10813)
The example in #10813 requires TV provider authentication in Firefox,
while youtube-dl can download it directly with an US proxy.

I'm not sure whether the mgid fix is cmt-specific or it applies to all
mtv-based sites. I keep it in cmt.py until similar patterns are found in
other websites.
8 years ago
Philip Xu 2e638d7bca Made optional fields optional 8 years ago
Sergey M․ a26b174c61
[safari:course] Add support for techbus.safaribooksonline.com 8 years ago
Sergey M․ 73c801d660
[orf:tvthek] Fix extraction and modernize (closes #10898) 8 years ago
Yen Chi Hsuan 8c3e448e80
[clipfish] Update _TEST; the old one is gone 8 years ago
Yen Chi Hsuan 2ecbd2ad6f
[chirbit:profile] Fix extraction 8 years ago
Yen Chi Hsuan 62a0b86e4f
[carambatv] Fix extraction
The video requested in #9815 now has videomore embeds.
8 years ago
Yen Chi Hsuan 146969e05b
[videomore] Support <iframe> embed videos
Seen in CarambaTVPage
8 years ago
Yen Chi Hsuan e2004ccaf7
[canalplus] Fix video_id and update _TESTS
Some tests are gone, and some redirect to different videos
8 years ago
Yen Chi Hsuan a5f8473145
[cbsinteractive] Fix extraction for cnet.com 8 years ago
Philip Xu b7f59a3bf6 [huajiao] Add new extractor 8 years ago
Yen Chi Hsuan 580d411931
[parliamentliveuk] Recognize lower case URLs
Closes #10912

Seems parliamentliveuk matches URLs case-insentive. For example this URL
also works:
http://parliamentlive.tv/EvEnt/Index/3F24936f-130f-40bf-9a5d-b3d6479da6a4
8 years ago
Sergey M․ 5c4bfd4da5
release 2016.10.12 8 years ago
Sergey M․ bcd6276520
[downloader/common] Remove debug output 8 years ago
Sergey M․ 591e384552
[streamable] Remove debug output 8 years ago
Yen Chi Hsuan 9feb1c9731
[dailymotion] Fix extraction and update _TESTS
Closes #10901

Seems all videos use player V5 syntax now
8 years ago
Yen Chi Hsuan a093cfc78b
[vimeo:review] Fix extraction (#10900)
Now Vimeo Review videos uses React. Thanks @davekaro for analyzing the
problem!
8 years ago
Yen Chi Hsuan cea364f70c
[extractor/common] Support HTML media elements without child nodes 8 years ago
Yen Chi Hsuan 55642487f0
[nhl] Skip invalid m3u8 formats (closes #10713) 8 years ago
Yen Chi Hsuan 3d643f4cec
[hbo] Add HBOEpisodeIE (#10892) 8 years ago
Yen Chi Hsuan c452e69d3d
[footyroom] Fix extraction and update _TESTS (closes #10810) 8 years ago
Yen Chi Hsuan 555787d717
[streamable] Add helper for extracting embedded videos 8 years ago
Yen Chi Hsuan f165ca70eb
[abc.net.au:iview] Fix for non-series videos (closes #10895) 8 years ago
Yen Chi Hsuan 27b8d2ee95
[hbo] Add display_id and another test (#10892) 8 years ago
Yen Chi Hsuan 71cdcb2331
[hbo] Support episode pages (closes #10892) 8 years ago
Yen Chi Hsuan 176006a120
[allocine] Fix for /video/ videos (closes #10860) 8 years ago
Yen Chi Hsuan 65f4c1de3d
[allocine] Fix extraction (closes #10860)
I change the URL of the third test case, because now the original URL
does not contain a video anymore, and there's no easy to get the real
URL from the /film/ one.
8 years ago
Yen Chi Hsuan b0082629a9
[nextmedia] Support action news (動新聞) on Apple Daily 8 years ago
Déstin Reed 2b51dac1f9
[slutload] Fix test and simplify 8 years ago
Sergey M․ f68901e50a
[reverbnation] Eliminate code duplication in thumbnails extraction 8 years ago
Déstin Reed 3adb9d119e
[reverbnation] Modernize 8 years ago
Remita Amine 1dd58e14d8 [lego] improve info extraction and bypass geo restriction(closes #10872) 8 years ago
Sergey M․ dd4291f729
release 2016.10.07 8 years ago
Sergey M․ f475e88121
[vimeo] PEP 8
[ci skip]
8 years ago
Remita Amine 3c6b3bf221 [iprima] detect geo restriction 8 years ago
Yen Chi Hsuan 38588ab977
[facebook] Fix for new handleServerJS syntax (closes #10846)
According to the dump file in #10846, handleServerJS() now accepts
an optional second argument. It's a string from available dump files.
8 years ago
Yen Chi Hsuan 85bcdd081c
[extractors] Add MmsIE 8 years ago
Yen Chi Hsuan 9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
And use _generic_* helpers in those extractors
8 years ago
Yen Chi Hsuan 98763ee354
[extractor/common] Add id and title helpers for generic IEs 8 years ago
Yen Chi Hsuan 3d83a1ae92
[generic] Support direct MMS links (closes #10838) 8 years ago
Sergey M․ 09b9c45e24
[generic] Add support for multiple vimeo embeds (Closes #10862) 8 years ago
Remita Amine 33898fb19c [nzz] Add new extractor(#4407) 8 years ago
Remita Amine 017eb82934 [npo] detect geo restriction 8 years ago
Sergey M․ b1d798887e
[npo] Add support for 2doc.nl (Closes #10842) 8 years ago
Remita Amine 185744f92f [lego] Add new extractor(closes #10369) 8 years ago
Remita Amine 7232e54813 [tonline] Add new extractor(#10376) 8 years ago
Sergey M․ 6eb5503b12
[techtalks] Relax _VALID_URL 8 years ago
Aleksander Nitecki 539c881bfc
[techtalks] Allow URL-s with name part omitted. 8 years ago
Sergey M․ c1b2a0858c
[youtube:live] Extend _VALID_URL (Closes #10839) 8 years ago
Remita Amine 215ff6e0f3 [theweatherchannel] Add new extractor(closes #7188) 8 years ago
Déstin Reed dcdb292fdd
Unify coding cookie 8 years ago
Remita Amine c1084ddb0c [thisoldhouse] Add new extractor(closes #10837) 8 years ago
Sergey M․ ee5de4e38e
[nhl] Add support for wch2016.com (Closes #10833) 8 years ago
Yen Chi Hsuan 25291b979a Merge pull request #10829 from TRox1972/pornoxo_improve
[pornoxo] Use JWPlatform to improve metadata extraction
8 years ago
Déstin Reed 567a5996ca [pornoxo] Use JWPlatform to improve metadata extraction 8 years ago
Sergey M․ 6c152ce20f
release 2016.10.02 8 years ago
Yen Chi Hsuan 703b3afa93
[amcnetworks] Skip a restricted _TEST 8 years ago
Yen Chi Hsuan 99ed78c79e
[jwplatform] Support DASH streams 8 years ago
Yen Chi Hsuan fd15264172
[jwplatform] Support old-style jwplayer playlists 8 years ago
Yen Chi Hsuan bd26441205
[utils] Fix xattr error handling 8 years ago
Yen Chi Hsuan b19e275d99
[__init__] Fix lost xattr if --embed-thumbnail used
Reported at
https://github.com/rg3/youtube-dl/issues/9054#issuecomment-250451823
8 years ago
Sergey M․ f6ba581f89
[byutv:event] Add extractor 8 years ago
Sergey M․ 6d2549fb4f
[byutv] Fix id and display id 8 years ago
Déstin Reed 4da4516973
[byutv] Rely on _match_id and _parse_json 8 years ago
Sergey M․ e1e97c2446
[periscope:user] Fix extraction (Closes #10820) 8 years ago
Yen Chi Hsuan 53a7e3d287
[utils] Support xattr as well as pyxattr
Closes #9054

There are two xattr packages in Python, pyxattr [1] and xattr [2]. They
have different APIs.

In old days pyxattr supports Linux only and xattr supports Linux, Mac,
FreeBSD and Solaris, and pyxattr supports Linux only. Recently pyxattr
adds support for Mac OS X. [3]

An old version of [2] is shipped with Mac OS X. However, some Linux
distributions have pyxattr only, for example PLD-Linux [4] and old Arch
Linux. [5] As a result, supporting both is the way to go.

[1] https://github.com/iustin/pyxattr
[2] https://github.com/xattr/xattr
[3] https://github.com/iustin/pyxattr/pull/9
[4] https://github.com/rg3/youtube-dl/issues/5498
[5] https://git.archlinux.org/svntogit/community.git/commit/?id=427c4c76401e386d865ccddea4fbfdc74df80492
    https://git.archlinux.org/svntogit/community.git/commit/?id=59b40da7b69622a6761d364a8b07909e9cccaa56
    python-xattr is added on 2016/06/29 while pyxattr is there for more
    than 6 years
8 years ago
Yen Chi Hsuan d54739a2e6
[downloader/http] xattr values should be bytes 8 years ago
Yen Chi Hsuan 63e0fd5bcc Merge pull request #10818 from TRox1972/criterion_match_id
[criterion] Rely on _match_id, improve regex and add thumbnail to test
8 years ago
Déstin Reed 9c51a24642 [criterion] Rely on _match_id, improve regex and add thumbnail to test 8 years ago
Yen Chi Hsuan 9bd7bd0b80
[twitch] Skip a 404 test 8 years ago
Yen Chi Hsuan 4a76b73c6c Merge pull request #10817 from TRox1972/clubic_match_id
[clubic] Rely on _match_id and _parse_json
8 years ago
Yen Chi Hsuan e295618f9e
[dctp] Fix extraction (closes #10734) 8 years ago
Yen Chi Hsuan d7753d1948
[downloader/http] Use write_xattr function for --xattr-set-filesize 8 years ago
Déstin Reed eaf9b22f94 [clubic] Rely on _match_id and _parse_json 8 years ago
Sergey M․ a1001f47fc
[instagram] PEP 8 8 years ago
Déstin Reed 1609782258
[Instagram] Extract video dimensions 8 years ago
Sergey M․ de6babf922
[tvland] Extend _VALID_URL (Closes #10812) 8 years ago
Sergey M․ b0582fc806
[vgtv] Add support for tv.aftonbladet.se (Closes #10800) 8 years ago
Sergey M․ af33dd8ee7
[aftonbladet] Remove extractor 8 years ago
Sergey M․ 70d7b323b6
[vk] Improve view count extraction 8 years ago
Sergey M․ a7ee8a00f4
[vk] Extract timestamp (Closes #10760) 8 years ago
Sergey M․ c6eed6b8c0
[utils] Lower priority for rare date formats and add tests 8 years ago
Kacper Michajłow 3aa3953d28
[vk] Fix date and view count extraction. 8 years ago
Yen Chi Hsuan efa97bdcf1
Move write_xattr to utils.py
There are some other places that use xattr functions. It's better to
move it to a common place so that others can use it.
8 years ago
Sergey M․ 475f8a4580
[vk] Add support for running live streams (Closes #10799) 8 years ago
Sergey M․ 93aa0b6318
[vk] Add support for finished live streams (#10799) 8 years ago
Yen Chi Hsuan 0ce26ef228 Merge pull request #10788 from TRox1972/instagram_comments
[Instagram] Extract comments
8 years ago
Yen Chi Hsuan 0d72ff9c51
[leeco] Recognize more Le Sports URLs (#10794) 8 years ago
Déstin Reed a56e74e271 [Instagram] Extract comments 8 years ago
Sergey M․ f533490bb7
[ketnet] Extract mzsource formats (#10770) 8 years ago
Remita Amine 8bfda726c2 [limelight:media] improve http formats extraction 8 years ago
Sergey M․ 8f0cf20ab9
release 2016.09.27 8 years ago
Sergey M․ cdfcc4ce95
[mtv] Improve _VALID_URL 8 years ago
Kacper Michajłow e384552590
[vk] Add support for dailymotion embeds
Fixes #10661
8 years ago
Sergey M․ 1a2fbe322e
[periscope] Treat timed_out state as finished stream 8 years ago
Sergey M․ f9dd86a112
[npo] Clarify IE_NAMEs (Closes #10775) 8 years ago
Remita Amine 2342733f85 fix tests related to 1978540a5122c53012e17a78841f3da0df77fd34(closes #10774) 8 years ago
Remita Amine 93933c9819 [awaan:video] fix test(closes #10773) 8 years ago
Yen Chi Hsuan d75d9e343e
[einthusan] Fix extraction (closes #10714) 8 years ago
Sergey M․ 72c3d02d29
[promptfile] Improve and modernize 8 years ago
Ondřej Bárta d3dbb46330
[promptfile] Fix extraction (Closes #10634) 8 years ago
Sergey M․ fffb9cff94
[kaltura] Speed up embed regexes (#10764) 8 years ago
Sergey M․ 2d5b4af007
[extractors] Add import for anderetijden extractor 8 years ago
Sergey M․ 5742c18bc1
[npo] Add support for anderetijden.nl (Closes #10754) 8 years ago
Sergey M․ ddb19772d5
[vpro] Fix playlist title extraction and update tests 8 years ago
Sergey M․ a3d8b38168
[npo] Generalize playlist extractors 8 years ago
stepshal 2d3d29976b
[youtube] Change test URLs from http to https 8 years ago
Sergey M․ 493353c7fd
[prosiebensat1] Add support for advopedia 8 years ago
Sergey M․ 0a078550b9
[prosiebensat1] Improve _VALID_URL 8 years ago
Sergey M․ f92bb612c6
[mwave] Relax _VALID_URLs (Closes #10735, closes #10748) 8 years ago
Sergey M․ ddde91952f
[prosiebensat1] Fix playlist support (Closes #10745) 8 years ago
Sergey M․ 63c583eb2c
[prosiebensat1] Add support for sat1gold (#10745) 8 years ago
Remita Amine 7fd57de6fb [cbsnews:livevideo] fix extraction and extract m3u8 formats 8 years ago
Remita Amine e71a450956 [common] add hdcore sign to akamai f4m formats 8 years ago
Remita Amine 27e99078d3 [brightcove:new] add support for live streams 8 years ago
Remita Amine 6f126d903f [download/hls] Delegate downloading to ffmpeg for live streams 8 years ago
Sergey M․ 7518a61d41
[soundcloud] Fix typo in playlist base class name 8 years ago
Sergey M․ 8e45e1cc4d
[soundcloud] Generalize playlist entries extraction (#10733) 8 years ago
Yen Chi Hsuan f0bc5a8609
[twitter] Support Periscope embeds (closes #10737)
Also update _TESTS
8 years ago
Remita Amine a54ffb8aa7 [mtv] add common IE_NAME prefix for MTVIE and MTVVideoIE 8 years ago