Mirroring
/
yt-dlp
mirror of https://github.com/yt-dlp/yt-dlp
1
0
Fork 0
Code Issues Releases Wiki Activity
11,051 Commits
3 Branches
112 Tags
147 MiB
Commit Graph

9420 Commits (e047922be01ca346cee8f53b7972773d64eed6f4)

Author SHA1 Message Date
Sergey M․ 4763b624a6 [xhamster] Fix upload date extraction
Sergey M․ 6609b3ce37 [xhamster] Improve title extraction
atomic83 5777f5d386 Extract xHamster title fix
Sergey M․ 5dbe81a1d3 [vimeo] Automatically pickup full movie when rented (Closes )
Sergey M․ 4cf096a4a9 [ivideon] Add support for map bound URLs
Sergey M․ 18e6c97c48 [adultswim] Skip georestricted hls (Closes )
Sergey M․ 97afd99a18 [soundcloud:likes] Adapt to API changes (Closes )
Sergey M․ 23f13e9754 [youtube] Support expanding alternative format of links in description (Closes )
Sergey M․ 2e02ecbccc [ivideon] Add extractor
oittaa e4f49a8753 check video_play_path and use xpath_text 
"This check should take place earlier and should be more general if not video_url:. Same should be done for video_play_path. Also these fields better extracted with xpath_text."

Suggestions by @dstftw
Sergey M․ 51d3045de2 [npr] Fix extractor (Closes )
kaspi 76048b23e8 [npr] Add extractor 
removed md5 from _TEST

moved from xml data to json

test

changed _TEST url to one that will not expire, so tests would not be failing
Sergey M․ f20756fb10 [udemy] Fix non free course message
Sergey M․ 17b2d7ca77 [udemy] Detect non free courses (Closes )
Sergey M․ 2f546d0a3c [vrt] Prefix format ids
Sergey M․ 18c782ab26 [vrt] Extend _VALUD_URL
Sergey M․ 33cee6c7f6 [dramafever] Add test for custom episode title
Sergey M․ a2e51e7b49 [dramafever] Fix episode fallback
Sergey M․ bd19aa0ed3 [dramafever] Extract episode
Sergey M․ 8f4c56f334 [dramafever] Extract episode number
Sergey M․ 1dcc38b233 [dramafever] Improve subtitles extraction (Closes )
Sergey M․ fff79f1867 [amp] Add missing subtitles to info dict
Jaime Marquínez Ferrándiz 3f17c357d9 [downloader/hls] Don't let ffmpeg read from stdin () 
If you run 'while read aurl ; do youtube-dl "${aurl}"; done < path_to_batch_file'  (batch_file contains one url per line that uses the hls downloader) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url

(This is the same problem that was fixed for the ffmpeg postprocessors in cffcbc02de)
Sergey M․ 9938a17f92 [rte:radio] Extract timestamp
Sergey M․ 9746f4314a [rte:radio] Simplify
Sergey M․ 0238451fc0 [rte] PEP 8
Sergey M 2098aee7d6 Merge pull request from bpfoley/rteradio 
[rte:radio] Add support for RTE radio player
bpfoley 896c7a23cd [extractor/rte.py] Add support for RTE radio player 
While here, stop RteIE changing filename extensions to .mp4. The files
saved are .flv containers with h264 video.
Sergey M․ 1463c5b9ac [ivi] Extract season info
Sergey M․ c6270b2ed5 [ivi:compilation] Fix extraction
Sergey M․ ab3176af34 [ivi] Fix extraction and modernize
Sergey M․ 5aa535c329 [bbccouk] Update tests (Closes )
Sergey M․ 133b1886fc [20min] Improve (Closes )
pingtux 66295fa4a6 [20min.ch] Added support for videoportal
pingtux e54c44eeab [20min.ch] Add new extractor (closes )
Sergey M․ a7aaa39863 [utils] Extract known extensions for reuse
Sergey M ea6abd740f [nowtv] Mark broken
dyn888 e1a0bfdffe [youtube] added vcodec/acodec/abr for multiple itags 
Should make downloading with filters more precise and easier, ie. bestvideo[vcodec=h264]. By default a lot of codecs are specified as avc1.xxxxxx and unique for each format, which makes them unusable for bestvideo selection.
Sergey M 3f3343cd3e Merge pull request from dstftw/introduce-chapter-and-series-fields 
Introduce chapter and series fields
remitamine 4059eabd58 [dreisat] use extract_from_xml_url from ZDFIE for info extraction(fixes )(fixes )(closes )
remitamine 6b46102661 [zdf] fix rtmpt format downloading handle errors
Yen Chi Hsuan 141a273a8b [qqmusic] Update tests
Yen Chi Hsuan 2fffb1dcd0 [qqmusic:playlist] Capture errors and update tests
Yen Chi Hsuan e698e4e533 Merge branch 'remitamine-baidu'
Yen Chi Hsuan b7546397f0 [baidu] Use list comprehension
Yen Chi Hsuan 0311677258 [baidu] Add notes for API calls
Sergey M․ 88fb59d91b [bbccouk] Extend title extraction
Yen Chi Hsuan a1d9f6c5dc [baidu] Improve playlist description
Yen Chi Hsuan c579c5e967 [baidu] Cleanups
Yen Chi Hsuan c9c194053d Merge branch 'baidu' of https://github.com/remitamine/youtube-dl into remitamine-baidu
Sergey M․ f20a11ed25 [bbccouk] Extend _VALID_URL (Closes )
Sergey M․ 76a353c9e5 [ruutu] Fix extraction (Closes )
pingtux 94de6cf59c Remove testtube import 
Extractor got deleted in remitamine/youtube-dl@8af2804
remitamine 8af2804a5d [testtube] Remove Extractor
remitamine 054479754c [revision3] Add new extractor(closes ) 
- revision3.com
- testtube.com
- animalist.com
Sergey M․ 5bafcf6525 [udemy] Use chapter_number
Sergey M․ 306c51c669 [videomore] Use number fields for series
Sergey M․ 27bfd4e526 [extractor/common] Introduce number fields for chapters and series
Jaime Marquínez Ferrándiz ca227c8698 [yahoo] Support pages that use an alias (fixes )
Philipp Hagemeister 32f9036447 [ccc] Add language information to formats
Philipp Hagemeister 190ef07981 release 2016.01.01
Sergey M․ 82597f0ec0 [ccc] Extract duration
Sergey M․ 8499d21158 [ccc] Fix description extraction and update test
Sergey M․ c9154514c4 [ccc] Fix upload date extraction
Sergey M․ 0d5095fc65 [ccc] Update _VALID_URL (Closes )
Yen Chi Hsuan 034caf70b2 [youku] Fix extraction ()
remitamine e565cf6048 [nextmovie] Add new extractor
remitamine a0e5beb0fb [nick] Add new extractor
remitamine c1e90619bd [mtv] extract mgid extraction and query building into separate methods
Sergey M․ b26afec81f [einthusan] Improve extraction (Closes )
Sergey M․ 8f7c4f7d2e Merge branch 'master' of github.com:rg3/youtube-dl
j 0416006a30 Fix einthusan parser
remitamine 7f9134fb2d [tvland] inherit from MTVServicesInfoExtractor
remitamine 91e274546c [tvland] Add new extractor
Jaime Marquínez Ferrándiz 69f8595256 [espn] Extract better titles
Jaime Marquínez Ferrándiz 930087f2f6 [espn] Support 'intl' videos ()
Jaime Marquínez Ferrándiz 9f9f7664b5 [espn] Update test
Sergey M․ 72528252e3 [pandoratv] Add IE names
Sergey M․ e4bd63f9c0 [pandoratv] Improve extraction (Closes )
j 9accfed4e7 [pandoratv] Add new extractor (closes )
remitamine f1e21efe63 [tlc] remove TlcIE
remitamine b05641ce40 [discovery] improve _VALID_URL regex
remitamine fec040e754 [discovery] add support for discovery related sites 
- investigationdiscovery.com
- discoverylife.com
- animalplanet.com
- ahctv.com
- destinationamerica.com
- sciencechannel.com
- tlc.com
- velocity.com
Sergey M․ 34a9da136f [regiotv] Improve extraction (Closes )
j c43fda4c1a [regiotv] Add new extractor (closes )
Philipp Hagemeister 7de81fcc53 release 2015.12.31
remitamine 9d46608efa [ora] Add new extractor(closes )
remitamine 80b8b72cb8 [animalplanet] Add new extractor(closes )
remitamine 9787c5f4c8 [fox] Add new extractor(closes )
remitamine d5f6429de8 [canalplus] improve extraction(fixes ) 
- extract data from json instead of xml
- fix http format urls
- extract more metadata
- update tests
- make m3u8 and f4m format extraction non fatal
- use m3u8_native implementation
Sergey M․ df827a983a [discovery] Allow https (Closes )
Sergey M․ 29f3683901 [espn] Remove broken flag
Jaime Marquínez Ferrándiz c7932289e7 [cbsnews] Fix extraction of the URL for the 'RtmpDesktop' format (fixes )
Sergey M․ 7a0b07c719 [videomore] Extract series info
Sergey M․ 4d402db521 [udemy] Extract chapter info
Sergey M․ 7109903e61 [extractor/common] Document chapter and series fields
Sergey M․ 3092fc4035 [udemy] Fix typo
Sergey M․ f5bc4b5f95 [options] Prefer --convert-subs spelling
Sergey M․ 69759a5990 [videomore] Set IE_NAME
Sergey M․ 453fe2a345 [dramafever] Fix subtitles extraction (Closes )
Sergey M․ ff18735cb2 [extractor/generic] Add support for videomore embeds
Sergey M․ 030dfb04e0 [videomore] Add extractor (Closes )
remitamine 06e4874c99 Merge branch 'jukebox' of https://github.com/remitamine/youtube-dl into remitamine-jukebox
remitamine 0d8a0fdc30 [srgssr] use SRFIE format ids
remitamine 0368181998 [wdr] split long lines
remitamine 6101f45ef9 [ooyala] split long lines, fix test duration and add hdcode param to hds url
remitamine bf96b45238 [rai] split long lines
remitamine 98d7c0f4f7 [tele13] split long lines
remitamine f2017cb020 [srgssr] split long lines and use m3u8_native
remitamine f889ac45b8 [ign] split long lines
remitamine eccde5e9de [audimedia] split long lines
remitamine ce7d243c7e [srgssr] fix IE_DESC
remitamine 6c4d6609ad [phoenix] fix IE_NAME
remitamine db710571fd [daum] fix IE_NAME
remitamine 574dd17882 Merge branch 'remitamine-srgssr'
remitamine 422f7c112c [srgssr] update tests
Philipp Hagemeister e974356f32 release 2015.12.29
remitamine b19ad2fb53 Merge branch 'srgssr' of https://github.com/remitamine/youtube-dl into remitamine-srgssr
remitamine 126d7701b0 Merge branch 'daum' of https://github.com/remitamine/youtube-dl into remitamine-daum
flatgreen ecf17d1653 [franceculture] Add extractor for '/emission-*' urls (closes , closes )
Jaime Marquínez Ferrándiz 7447661e9b [franceculture] Fix test
Sergey M․ 7e5edcfd33 Simplify formats accumulation for f4m/m3u8/smil formats 
Now all _extract_*_formats routines return a list
remitamine 39d60b715a Merge pull request from remitamine/sort 
[common] lower (m3u8,rtmp,rtsp) format preference only if required program is not available
remitamine d497a201ca [common] use specific variable for protocol preference in _sort_formats
remitamine 54537cdfb3 Merge pull request from remitamine/extract-formats 
[common] simplify the use of _extract_m3u8_formats and _extract_f4m_formats
remitamine bc737bd61a Merge branch 'zdf'(fixes )
remitamine a5c1d95500 [zdf] fix formats extraction
Sergey M․ c1f49e1684 [facebook] Fix authentication
Sergey M․ 9f66931e16 [facebook] Extract login error
Jaime Marquínez Ferrándiz 6c6b8bd5cc [cspan] Fix extraction (fixes )
Jaime Marquínez Ferrándiz 04e24906be [cspan] Initialize 'video_type' to avoid 'UnboundLocalError' exceptions ()
remitamine 974c1b2d42 Merge branch 'dcn' of github.com:remitamine/youtube-dl into remitamine-dcn
remitamine bca9bea1c1 [dcn] make m3u8 formats extraction non fatal
remitamine bd3f9ecabe [tunein] add support for tunein topic,clip and program(fixes )
Yen Chi Hsuan c047270c02 [utils] Remove Content-encoding from headers after decompression 
With cn_verification_proxy, our http_response() is called twice, one from
PerRequestProxyHandler.proxy_open() and another from normal
YoutubeDL.urlopen(). As a result, for proxies honoring Accept-Encoding, the
following bug occurs:

$ youtube-dl -vs --cn-verification-proxy https://secure.uku.im:993 "test:letv"
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-vs', '--cn-verification-proxy', 'https://secure.uku.im:993', 'test:letv']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2015.12.23
[debug] Git HEAD: 97f18fa
[debug] Python version 3.5.1 - Linux-4.3.3-1-ARCH-x86_64-with-arch-Arch-Linux
[debug] exe versions: ffmpeg 2.8.4, ffprobe 2.8.4, rtmpdump 2.4
[debug] Proxy map: {}
[TestURL] Test URL: http://www.letv.com/ptv/vplay/22005890.html
[Letv] 22005890: Downloading webpage
[Letv] 22005890: Downloading playJson data
ERROR: Unable to download JSON metadata: Not a gzipped file (b'{"') (caused by OSError('Not a gzipped file (b\'{"\')',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/extractor/common.py", line 330, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/YoutubeDL.py", line 1886, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.5/urllib/request.py", line 471, in open
    response = meth(req, response)
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 773, in http_response
    raise original_ioerror
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 761, in http_response
    uncompressed = io.BytesIO(gz.read())
  File "/usr/lib/python3.5/gzip.py", line 274, in read
    return self._buffer.read(size)
  File "/usr/lib/python3.5/gzip.py", line 461, in read
    if not self._read_gzip_header():
  File "/usr/lib/python3.5/gzip.py", line 409, in _read_gzip_header
    raise OSError('Not a gzipped file (%r)' % magic)
remitamine 97f18fac3a [vgtv] fix f4m downloading(fixes )
remitamine c71d2e2087 [livestream] change test url
Yen Chi Hsuan 59185202c6 [iqiyi] Add tests for
forDream bee83e84f6 [iqiyi]fix valid url 
eg:
http://yule.iqiyi.com/zbj.html
gam2046 82e02ea5fc Update iqiyi.py 
Fix part of the address can not be resolved.
eg:http://www.iqiyi.com/w_19rt6o8t9p.html
Sergey M․ a95c26a06a [jwplatform] Carry long line
Sergey M․ 0b0a17ae9d [viki] Fix typo
Sergey M․ 30f51acbc8 [rai] Fix typos
Sergey M․ e0898585a1 [jwplatform] Fix typo
Sergey M․ 62bdc9fecc [esri] Fix typo
Sergey M․ e73277c7e8 [abc7news] Remove redundant formats sorting
remitamine 8d29e47f54 [common] simplify the use of _extract_m3u8_formats and _extract_f4m_formats
remitamine 2db772b9ea Merge branch 'master' of github.com:rg3/youtube-dl
remitamine 7b81316508 [livestream] skip m3u8 manifest in progressive_urls
Philipp Hagemeister 05358deeca Merge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister 9f610f3a9e [sportdeutschland] Do not abort if meta info is missing 
This fixes http://sportdeutschland.tv/badminton/yonex-copenhagen-masters-2015 . No testcase though since the event will be over by 2016.
remitamine dbfd06730c Merge pull request from remitamine/livestream 
[livestream] improve extraction(fixes )(fixes )(fixes )(fixes )
remitamine 5b025168c7 [livestream] improve extraction 
- split long lines
- use m3u8 entry protocol for live streams
- extend _VALID_URL regex for livestream original
- extract livestream original live streams
remitamine 46124a49b2 Merge pull request from remitamine/kaltura 
[kaltura] extract more formats
remitamine 608cc3b85c [kaltura] add referrer to m3u8 url
remitamine 6afe044b51 [dcn] improve extraction
Sergey M․ 15aad84dc5 [lrt] Extract counters
Sergey M․ f7e1d82d40 [lrt] Improve
Giedrius Statkevičius 339b1944e7 [lrt] fix the rest of extractor 
Closes .
Giedrius Statkevičius 85367c3a47 [lrt] fix duration parsing
Sergey M․ 607d65fbce [ign] flake8
remitamine 9f0ee2a388 Merge pull request from remitamine/ign 
[ign] add support for pcmag and extract all formats and more metadata(fixes )(fixes )
remitamine 1fc0b47fdf [srmediathek] improve extraction
Sergey M․ 6418b2439b [rutv] Fix extraction (Closes )
remitamine 06d5556dfa [rai] improve extraction
remitamine fb8e402ad2 [hotstar] Add new extractor
Sergey M․ c24044635b [zdf:channel] Add more tests
Sergey M․ 67ba388efb [zdf:channel] Relax _VALID_URL
Boris Wachtmeister e41604227c [zdf] expand valid-url pattern for channels 
The webpage also creates URLs which include additional text that defines
the sorting order on the page like "aktuellste" (most current) and
"meist-gesehen" (most seen), e.g.:

http://www.zdf.de/ZDFmediathek/kanaluebersicht/aktuellste/332
http://www.zdf.de/ZDFmediathek/kanaluebersicht/meist-gesehen/332
Sergey M․ 8a609c32fd [chaturbate] Improve error extraction (Closes )
remitamine 96db61ffb8 [theintercept] improve extraction
remitamine c153bd8b2f Merge branch 'theintercept' of https://github.com/bit/youtube-dl into bit-theintercept
Sergey M․ 2c566d02fe [pbs] Extend PBS station regex (Closes )
Jaime Marquínez Ferrándiz a8f1d167f6 [arte] Prefer json URLs that contain the video id from the 'vid' parameter in the URL (fixes )
remitamine 261b4c23c7 [appletrailers] skip clips with empty url
Sergey M․ dcdc352371 [instagram:user] Improve _VALID_URL (Closes )
Sergey M․ be514c856c [24video] Fix test
Sergey M․ 128eb31d90 [24video] Fix extraction on python 2.6
Sergey M․ 747b028412 [24video] Fix extraction (Closes )
Jaime Marquínez Ferrándiz 7fe37d8a05 [appletrailers] Improve regex for fixing '<img>' tags ()
Philipp Hagemeister f10c27b8cb release 2015.12.23
remitamine 60427f63d1 [appletrailers] Add support for AppleTrailers Section
Sergey M․ 178b47e6af [daum] Add test for
Sergey M․ 3a70ed9ebe [daum] Fix extraction (Closes )
Sergey M․ 89abf7bf4d [periscope] Fix token based extraction (Closes )
Sergey M․ cfe9e5aa6c [comcarcoff] Extract duration
Sergey M․ 4c24ed9464 [comcarcoff] Improve json data regex and modernize
Sergey M 11208ebbf1 Merge pull request from ausbin/comcarcoff-json-fix 
[comcarcoff] adjust for json updates
Sergey M․ 774ce35571 [imgur] Improve (Closes )
Abhishek Kedia dbee18b552 Improve extraction (Closes ) 
remove outer parentheses in if

Conflicts:
	youtube_dl/extractor/imgur.py

checked code with flake8

not returning list in case of single images.

using the fact that id with length 5 are albums and more are single videos.
Also for single videos ie ImgurIE both urls - http://imgur.com/gallery/oWeAMW2 and http://imgur.com/oWeAMW2 are equally fine. Change regex to allow thuis.
For albums urls - http://imgur.com/gallery/Q95ko and http://imgur.com/Q95ko are ok. Change regex to allow this also.

update description in ImgurIE Tests.
Also move single video test 'https://imgur.com/gallery/YcAQlkx' from ImgurAlbumIE to ImgurIE.
remitamine 31d9ea4a3e Merge pull request from remitamine/vgtv 
[vgtv] extract videos from FTV, Aftenposten, Aftonbladet using VGTVIE
remitamine 3b68efdc6a [vgtv] update tests and correct format sorting
j 2be689b7e2 [theintercept] Add new extractor
remitamine 2db5806991 [franceinter] use _match_id
remitamine 220bc3f0e3 [franceinter] fix title extraction
remitamine 48a6c984b8 [bleacherreport] update test
remitamine dc016bf521 [viki] detect errors and fix formats extraction
remitamine ff43d2365f [soompi] remove extractor 
http://tv.soompi.com now redirect to viki.com because Viki has acquired
Soompi
http://www.soompi.com/2015/08/19/we-got-married-soompi-joins-viki/
Austin Adams ed63cbd6ee [comcarcoff] adjust for json updates
Founder Fang 5f432ac8f5 [Weiqitv] Add new extractor