wubloader/downloader/setup.py

from setuptools import setup, find_packages

setup(
	name = "wubloader-downloader",
	version = "0.0.0",
	packages = find_packages(),
	install_requires = [
		"argh==0.28.1",
		"python-dateutil",
		"gevent",
		"monotonic",
		"prometheus-client==0.7.1", # locked version as we rely on internals
		"requests",
		"wubloader-common",
	],
)
Add skeleton of downloader service 6 years ago			`from setuptools import setup, find_packages`

			`setup(`
			`name = "wubloader-downloader",`
			`version = "0.0.0",`
			`packages = find_packages(),`
			`install_requires = [`
Pin argh to avoid stupid breaking changes 1 year ago			`"argh==0.28.1",`
downloader: Fix dateutil lib, which is actually called python-dateutil 6 years ago			`"python-dateutil",`
Unpin gevent as that was a workaround for a py2 issue 3 years ago			`"gevent",`
Re-write downloader to be resilient to failures as much as possible This makes the code crazy complicated and messy, but means we can be persistent about not giving up, while still retrying at the same time, and trying multiple urls at once until we find one that works. See docstrings for a full discussion on some of the failures we're trying to work around. 6 years ago			`"monotonic",`
downloader: Track timestamp of latest segment This gives us a "stream delay" metric. Prom doesn't have any native way to check the current value of a metric, in order to take max(). It only offers increment and set. We reach into some internals to do this in a hacky way, but the cleaner way would be to track the value ourselves and have a prom callback that gets the value. Sigh, I hate this prom library. I might write my own that's less dumb. 5 years ago			`"prometheus-client==0.7.1", # locked version as we rely on internals`
Add skeleton of downloader service 6 years ago			`"requests",`
			`"wubloader-common",`
			`],`
			`)`