henine
/
wubloader
mirror of https://github.com/ekimekim/wubloader
1
0
Fork 0
Code Issues Releases Wiki Activity
1,139 Commits
34 Branches
0 Tags
19 MiB
thrimbletrimmer-solid
HubbeKing-multiplatform-builds
bus-progress-ui
master
bus-post-processing
chrusher/bus_synthesizer
mike/faster-chat-merge
mike/chat-no-end-time
chrusher-playlist-thumbnails
chrusher-thumbnail-frontend
mike/prizebot
condor-scripts
mike/chat-subs
mike/bad-segment-hack
mike/backfill-extras
mike/cropping
mike/shorts
mike/download-frame-2
mike/debug-playlists
chrusher/backfiller_error_handler
sheet-updates
mike/generate-videos
suspect-segments
mike/testing
gunner/thrimbletrimmer-improvements
mike/render-dashboard
mike/database/initial
downloader/follow-game
mike/downloader/conn-pooling
mike/common/split-up
mike/backdoor
mike/downloader/handle-404
mike/non-restreamer-stats
archive/original-v2.1
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '0895ce44ff'
${ noResults }
Commit Graph

1139 Commits (0895ce44ff859e9cf9046fc7e30c9b40872c243e)
 

Author SHA1 Message Date
Mike Lang 0895ce44ff generate media playlist: Yield in chunks for performance 
Flask sends a chunked response with one chunk per item yielded.
This adds a lot of overhead per yielded item.
We avoid this by collecting the lines of the media playlist into larger chunks
and only flushing once every 1000 segments.

For small playlists this means they'll be emitted as one chunk,
but for large playlists we still get the streaming behaviour.
 8 months ago
Mike Lang 1857a998c9 reduce overhead of gevent.idle() by only yielding once per 1000 segments 8 months ago
Mike Lang 7e90346b87 restreamer: Have playlist cache stream results 8 months ago
Mike Lang 8ede4622ca CachedIterator: Re-serve any errors encountered while iterating 
instead of the second one to reach the error treating it as a successful end of iterator.
 8 months ago
Mike Lang 909cece196 restreamer: Move media playlist cache to also cover HLS playlist generation 8 months ago
Mike Lang cb2c58c75c restreamer: Yield the event loop during playlist generation 8 months ago
Mike Lang be7a9cd1fa restreamer: Make media playlist streamed 
To deal better with very large playlists
 8 months ago
Mike Lang a6d4f2466a restreamer: coalesce concurrent requests for the same playlist URL 8 months ago
Christopher Usher 28a468477d
Update DATABASE.md 
Fixed some minor formatting issues
 8 months ago
HubbeKing b46d9f30bb Proper example for edit_url 1 year ago
HubbeKing 7715a9c702 Run chat_archiver by default and backfill emotes by default 1 year ago
HubbeKing c9af44c327 Always create credentials secret 1 year ago
HubbeKing a98fea2489 Update NFS mount options 1 year ago
HubbeKing 517b881674 Remove old URL from edit_url config setting 1 year ago
HubbeKing 209cc6d876 Add config parameter for NFS mount options 1 year ago
HubbeKing 17596655f6 Update k8s.jsonnet file to support 2023 changes to images 1 year ago
Mike Lang 2a1f7207a8 Allow a fudge factor when checking for gaps/overlaps between segments 
Sometimes in the wild (particularly on youtube) segments may not be timed perfectly, so allow up to 10ms of gap or overlap
to be counted as "equal" for purposes of finding the best segment.
 1 year ago
Mike Lang b8cf0f20b0 segment_coverage: Allow alternate output location + single-run mode 1 year ago
Mike Lang 3606fadaa8 Pin gevent version to work around build issues 
Seeing the following error on latest versions of gevent:

 Traceback (most recent call last):
   File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
     return _run_code(code, main_globals, None,
   File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
     exec(code, run_globals)
   File "/usr/lib/python3.9/site-packages/zulip_bots/schedulebot.py", line 2, in <module>
     import gevent.monkey
   File "/usr/lib/python3.9/site-packages/gevent/__init__.py", line 72, in <module>
     from gevent._hub_local import get_hub
   File "/usr/lib/python3.9/site-packages/gevent/_hub_local.py", line 150, in <module>
     import_c_accel(globals(), 'gevent.__hub_local')
   File "/usr/lib/python3.9/site-packages/gevent/_util.py", line 148, in import_c_accel
     mod = importlib.import_module(cname)
   File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module
     return _bootstrap._gcd_import(name[level:], package, level)
ModuleNotFoundError: No module named 'gevent._gevent_c_hub_local'
 1 year ago
Mike Lang 859852fc50 memes 1 year ago
Christopher Usher b7e8b83c8d corrected shift names 1 year ago
Christopher Usher e12e361525 Shifts graphs 1 year ago
Christopher Usher e66540087a Fixes suggested by ekim 1 year ago
Christopher Usher eae430d5f3 removed local script 1 year ago
Christopher Usher 9a3b1fd5c3 Refactor in preperation for multiple graphs 1 year ago
Christopher Usher a6e990db68 Donation graph now works in a container 1 year ago
Christopher Usher 2c8a27330f graphs container now builds 1 year ago
Christopher Usher 3e8b4dfcf1 Starting integration of donation graphs 1 year ago
Mike Lang c65eb2eae3 Add a default timeout on google APIs 1 year ago
Mike Lang b9b7a6ca27 more schedulebot formatting 1 year ago
Mike Lang 4786154bca One more schedulebot format tweak 1 year ago
Mike Lang 7637633936 fix typo 1 year ago
Mike Lang d338c785ff schedulebot: formatting changes 1 year ago
Mike Lang f63e68f609 schedulebot: List all currently active people by role (except shift sup) 1 year ago
Mike Lang b65203ce0e bus_analyzer: Parallelize and fix error handling 1 year ago
Mike Lang c5acfe3ae0 bus_analyzer: Fix listing segments to respect tombstones 1 year ago
Mike Lang 8ac6e71d48 bus_analyzer: Normalize brightness across all digits, not one by one 1 year ago
Mike Lang bd9e22bc1f Revert "bus_analyzer: blank is grey, not black" 
This reverts commit 3e0280cf33.

Now that we look at all digits at once for normalization, blank is black
 1 year ago
Mike Lang 86951d5916 thrimshim: Fix bug in extrapolate code when time is a float 1 year ago
Mike Lang cd4d08adc1 Yield after each segment when doing fast/smart cuts 
To avoid blocking for long periods
 1 year ago
ElementalAlchemist db8c3a986f
Refresh just the images on the segment coverage page (#367) 
This allows users on the page to preserve attributes like the current horizontal scroll value.
 1 year ago
Mike Lang 0ed808688e cutter: Handle case where existing video has no last written thumb 1 year ago
Mike Lang 4d962ba187 Fix typo in cutter 1 year ago
Mike Lang e689626815 Add a small time range around the timestamp when extracting a frame 
This should hopefully result in frames on the edge of timestamps being extracted
from a combination of the neighboring segment and the naive one,
so that we don't get errors extracting a frame.
 1 year ago
Mike Lang 7a27938244 thrimshim: Expose time of day and 24h time 1 year ago
Mike Lang 3e0280cf33 bus_analyzer: blank is grey, not black 1 year ago
Mike Lang 01f93a798a bus_analyzer: Also determine time of day 1 year ago
Mike Lang 78c053000e Upgrade pip in order to make wheels work 1 year ago
Mike Lang bbcbed8c51 try again to disable fail-fast in github 1 year ago
Mike Lang 5256577d00 sheetsync: unmapped columns aren't a problem. 1 year ago