Mike Lang
671079861a
thrimbletrimmer: Fix lack of usage of var throughout code
...
Chalk this one up to not knowing the language.
You need to declare variables as var otherwise they're implicitly globals.
This leads to many bugs where if a function runs twice at once it'll do weird things.
5 years ago
Mike Lang
8accc1338e
thrimbletrimmer: Refactor how time formatting is handled
...
Instead of having two input fields and switching between them,
we just have one and re-write the value on switch.
We also handle invalid or empty dates a LOT better, and clean up some
other things around query strings.
5 years ago
Mike Lang
316504899a
thrimbletrimmer: Fix a bug on initial load
...
loadPlaylist was happening before bustime was set, resulting
in the wrong times being loaded.
5 years ago
Mike Lang
971841d73b
thrimbletrimmer: Move last bit of code into IO.js
...
since everything else is there anyway.
5 years ago
Mike Lang
c740090c53
sheetsync: Add more metrics
5 years ago
Christopher Usher
09d7feebfb
changed list comprehension to concatenation
5 years ago
Christopher Usher
02fd265407
allow for multiple channels in docker-compose
5 years ago
Mike Lang
f9b48bc70e
cutter: Add more metrics
5 years ago
Mike Lang
4f900c5925
Collect metrics around cutting time
5 years ago
Mike Lang
8ad61e9870
downloader: Collect metrics on http calls
5 years ago
Mike Lang
52e6c4ad41
sheetsync, cutter: Collect metrics on http calls
...
In particular, to google apis.
5 years ago
Mike Lang
d63ae573b7
backfiller: Collect metrics on http calls
5 years ago
Mike Lang
a2edb38a85
Add an InstrumentedSession wrapper that automatically gathers metrics on http calls
5 years ago
Mike Lang
b4655f18c6
downloader: Track total duration of downloaded segments
5 years ago
Christopher Usher
4dd4c83ff1
updated INSTALL.md
5 years ago
Christopher Usher
12badbff03
Update documentation to reflect recent changes
5 years ago
Christopher Usher
dc1c31fef4
fixes to the error handling as suggested by ekim
5 years ago
Christopher Usher
553b11bc84
typo in error handler
5 years ago
Christopher Usher
9dfffe0a62
improvements based on ekims suggestions plus delete_hours yeilds to the
...
rest of the backfiller
5 years ago
Christopher Usher
8579fcaeea
check start is not None before checking whether hour is before start
5 years ago
Christopher Usher
f8835cd253
documentation for --delete-old; check that start is not none
5 years ago
Christopher Usher
a361249145
renamed delete_before to keep_hours
5 years ago
Christopher Usher
be562b8448
added warnings if keeping fewer hours than backfilling
5 years ago
Christopher Usher
9d81569d98
Added the ability to delete old hours
5 years ago
Christopher Usher
28ef77b5a7
error handling changes as suggested by ekim
5 years ago
Christopher Usher
34e8d0a64b
Handle the case where an hour directory disappears between listing the
...
hours and trying to list the segments in that hour. This could happen if the
backfiller is deleting old hours.
5 years ago
Christopher Usher
3207dd6878
Fixed temporary segments crashing segment coverage
5 years ago
Christopher Usher
49ccb6df86
warns when a directory does not exist or when there are no hours to make
...
a map from
5 years ago
Mike Lang
eaf69fac1a
Merge pull request #118 from ekimekim/mike/nginx/serve-segments
...
nginx: Serve the segments directly from the segments dir
5 years ago
Mike Lang
7183b25ce9
Merge pull request #119 from ekimekim/mike/database-resilience
...
Changes to improve behaviour if the DB is down
5 years ago
Christopher Usher
3130e770c8
made while loop more pythonic
5 years ago
Christopher Usher
a1880b2414
fixes based on ekim's suggestions
5 years ago
Christopher Usher
bea876e0cc
removed obsolete code
5 years ago
Christopher Usher
43e19c3c56
removed unneeded package
5 years ago
Christopher Usher
44390173ed
comments, code style and better handling of empty hours
5 years ago
Christopher Usher
003261eae4
Promethous gauges and new style coverage plots
5 years ago
Christopher Usher
46b7c7a3b6
new plotting
5 years ago
Christopher Usher
9711dbab0e
changing what I mean by overlap
5 years ago
Christopher Usher
8e79ac772a
started on the guages
5 years ago
Christopher Usher
92a4cf0d7b
bit of a clean up
5 years ago
Christopher Usher
20a8a214d6
working!
5 years ago
Christopher Usher
ac72f775c9
functional
5 years ago
Christopher Usher
223af52265
added coverage to docker-compose
5 years ago
Christopher Usher
722cbd20fa
first pass at checking for holes and repeats
5 years ago
Christopher Usher
66f5a06a5c
basic segment counting working
5 years ago
Christopher Usher
3618510f35
basic functionality
5 years ago
Christopher Usher
929308f3e7
started on the segment_coverage service
5 years ago
Mike Lang
a42e7b48f6
thrimshim: Allow degraded operation even if DB broken
...
Any endpoints that don't need a DB conn will still work fine.
Notably, this includes /defaults, which is needed for
thrimbletrimmer to work in a non-specific-row mode.
5 years ago
Mike Lang
17af1c4e89
cutter, sheetsync: Wait for DB to connect on startup
...
This is a nicer error than crashing in the depths of some error handler
(which is what will happen if the DB goes unavailable while they're running),
and it's a far more common case (eg. the DB is misconfigured) than having it fail
halfway through.
Neither of these services can do anything meaningful without the DB,
so crashing without it is acceptable behaviour.
5 years ago
Mike Lang
0e437566aa
backfiller: Don't crash on DB errors
...
We move all connection handling into get_nodes().
This means that problems connecting won't cause further errors
and cause the application to completely crash.
In turn, this means that the behaviour if the database goes down becomes
"continue backfilling from the nodes we know about" instead of crashing.
5 years ago