wubloader

Commit Graph

Author	SHA1	Message	Date
Mike Lang	6c3501db6f	downloader: Fix dateutil lib, which is actually called python-dateutil	6 years ago
Mike Lang	f193bd0f54	Re-write downloader to be resilient to failures as much as possible This makes the code crazy complicated and messy, but means we can be persistent about not giving up, while still retrying at the same time, and trying multiple urls at once until we find one that works. See docstrings for a full discussion on some of the failures we're trying to work around.	6 years ago
Mike Lang	439b623599	Add skeleton of downloader service	6 years ago

Author

SHA1

Message

Date

Mike Lang

6c3501db6f

downloader: Fix dateutil lib, which is actually called python-dateutil

Mike Lang

f193bd0f54

Re-write downloader to be resilient to failures as much as possible

This makes the code crazy complicated and messy, but means we can be persistent about
not giving up, while still retrying at the same time, and trying multiple urls at once
until we find one that works.

See docstrings for a full discussion on some of the failures we're trying to work around.

Mike Lang

439b623599

Add skeleton of downloader service

3 Commits (530b9f7d5e361945f137ff05be15b60f89ec49cf)