henine
/
wubloader
mirror of https://github.com/ekimekim/wubloader
1
0
Fork 0
Code Issues Releases Wiki Activity
701 Commits
34 Branches
0 Tags
19 MiB
master
thrimbletrimmer-solid
bus-post-processing
bus-progress-ui
chrusher/bus_synthesizer
HubbeKing-multiplatform-builds
mike/faster-chat-merge
mike/chat-no-end-time
chrusher-playlist-thumbnails
chrusher-thumbnail-frontend
mike/prizebot
condor-scripts
mike/chat-subs
mike/bad-segment-hack
mike/backfill-extras
mike/cropping
mike/shorts
mike/download-frame-2
mike/debug-playlists
chrusher/backfiller_error_handler
sheet-updates
mike/generate-videos
suspect-segments
mike/testing
gunner/thrimbletrimmer-improvements
mike/render-dashboard
mike/database/initial
downloader/follow-game
mike/downloader/conn-pooling
mike/common/split-up
mike/backdoor
mike/downloader/handle-404
mike/non-restreamer-stats
archive/original-v2.1
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'a236509470'
${ noResults }
Commit Graph

701 Commits (a2365094706161d7f7537ab91ebe9e96c2933b32)
 

Author SHA1 Message Date
Mike Lang f9b48bc70e cutter: Add more metrics 5 years ago
Mike Lang 4f900c5925 Collect metrics around cutting time 5 years ago
Mike Lang 8ad61e9870 downloader: Collect metrics on http calls 5 years ago
Mike Lang 52e6c4ad41 sheetsync, cutter: Collect metrics on http calls 
In particular, to google apis.
 5 years ago
Mike Lang d63ae573b7 backfiller: Collect metrics on http calls 5 years ago
Mike Lang a2edb38a85 Add an InstrumentedSession wrapper that automatically gathers metrics on http calls 5 years ago
Mike Lang b4655f18c6 downloader: Track total duration of downloaded segments 5 years ago
Christopher Usher 4dd4c83ff1 updated INSTALL.md 5 years ago
Christopher Usher 12badbff03 Update documentation to reflect recent changes 5 years ago
Christopher Usher dc1c31fef4 fixes to the error handling as suggested by ekim 5 years ago
Christopher Usher 553b11bc84 typo in error handler 5 years ago
Christopher Usher 9dfffe0a62 improvements based on ekims suggestions plus delete_hours yeilds to the 
rest of the backfiller
 5 years ago
Christopher Usher 8579fcaeea check start is not None before checking whether hour is before start 5 years ago
Christopher Usher f8835cd253 documentation for --delete-old; check that start is not none 5 years ago
Christopher Usher a361249145 renamed delete_before to keep_hours 5 years ago
Christopher Usher be562b8448 added warnings if keeping fewer hours than backfilling 5 years ago
Christopher Usher 9d81569d98 Added the ability to delete old hours 5 years ago
Christopher Usher 28ef77b5a7 error handling changes as suggested by ekim 5 years ago
Christopher Usher 34e8d0a64b Handle the case where an hour directory disappears between listing the 
hours and trying to list the segments in that hour. This could happen if the
backfiller is deleting old hours.
 5 years ago
Christopher Usher 3207dd6878 Fixed temporary segments crashing segment coverage 5 years ago
Christopher Usher 49ccb6df86 warns when a directory does not exist or when there are no hours to make 
a map from
 5 years ago
Mike Lang eaf69fac1a
Merge pull request #118 from ekimekim/mike/nginx/serve-segments 
nginx: Serve the segments directly from the segments dir
 5 years ago
Mike Lang 7183b25ce9
Merge pull request #119 from ekimekim/mike/database-resilience 
Changes to improve behaviour if the DB is down
 5 years ago
Christopher Usher 3130e770c8 made while loop more pythonic 5 years ago
Christopher Usher a1880b2414 fixes based on ekim's suggestions 5 years ago
Christopher Usher bea876e0cc removed obsolete code 5 years ago
Christopher Usher 43e19c3c56 removed unneeded package 5 years ago
Christopher Usher 44390173ed comments, code style and better handling of empty hours 5 years ago
Christopher Usher 003261eae4 Promethous gauges and new style coverage plots 5 years ago
Christopher Usher 46b7c7a3b6 new plotting 5 years ago
Christopher Usher 9711dbab0e changing what I mean by overlap 5 years ago
Christopher Usher 8e79ac772a started on the guages 5 years ago
Christopher Usher 92a4cf0d7b bit of a clean up 5 years ago
Christopher Usher 20a8a214d6 working! 5 years ago
Christopher Usher ac72f775c9 functional 5 years ago
Christopher Usher 223af52265 added coverage to docker-compose 5 years ago
Christopher Usher 722cbd20fa first pass at checking for holes and repeats 5 years ago
Christopher Usher 66f5a06a5c basic segment counting working 5 years ago
Christopher Usher 3618510f35 basic functionality 5 years ago
Christopher Usher 929308f3e7 started on the segment_coverage service 5 years ago
Mike Lang a42e7b48f6 thrimshim: Allow degraded operation even if DB broken 
Any endpoints that don't need a DB conn will still work fine.

Notably, this includes /defaults, which is needed for
thrimbletrimmer to work in a non-specific-row mode.
 5 years ago
Mike Lang 17af1c4e89 cutter, sheetsync: Wait for DB to connect on startup 
This is a nicer error than crashing in the depths of some error handler
(which is what will happen if the DB goes unavailable while they're running),
and it's a far more common case (eg. the DB is misconfigured) than having it fail
halfway through.

Neither of these services can do anything meaningful without the DB,
so crashing without it is acceptable behaviour.
 5 years ago
Mike Lang 0e437566aa backfiller: Don't crash on DB errors 
We move all connection handling into get_nodes().
This means that problems connecting won't cause further errors
and cause the application to completely crash.

In turn, this means that the behaviour if the database goes down becomes
"continue backfilling from the nodes we know about" instead of crashing.
 5 years ago
Mike Lang fc791e03d4 DBManager: Don't test connection on start 
This gives the individual services more freedom in how to handle
a failing connection.
 5 years ago
Mike Lang 3c20a9aece nginx: Serve the segments directly from the segments dir 
instead of proxying through restreamer.

This should improve performance when serving the (large) segment files,
and free up restreamer for things like generating the playlist.
 5 years ago
Mike Lang 095e391b60
Merge pull request #116 from ekimekim/mike/thrimbletrimmer-things 
A lot of changes to thrimbletrimmer and related stuff
 5 years ago
Mike Lang 934c640a04 thrimbletrimmer: Display edit notes below the video 
In nice distracting pink so they're sure to see it.
 5 years ago
Mike Lang f7f07a2688 Add /defaults to thrimshim, use it to populate config stuff in thrimbletrimmer 
Thrimbletrimmer needs to know stuff like the bustime start time,
default channel, even if it's not looking at a specific row.
 5 years ago
Mike Lang d03120548b thrimbletrimmer: Always respect the channel given by thrimshim 5 years ago
Mike Lang 6cfad08a26 thrimbletrimmer: Restore previously saved advanced options 
and show the advanced pane if any are non-default.
 5 years ago