Commit Graph

1148 Commits (d571bbe81effe510ce32a306de46605dd6a2060b)
 

Author SHA1 Message Date
Mike Lang d571bbe81e ffmpeg_cut_stdin: Remove cut_start and duration built-in args
Of 4 users of this function, all but one set them to None.
We're about to replace that one usage with something else, so it makes more sense
to not have them as options at all and just have the user add to the encode args manually.
ZeldaZach e7a839c6cd Remove need to download twice on startup
ZeldaZach 07fc84e85e Relabel Comment to show new config values
ZeldaZach 8bbc72184c Support hot reload of Zulip Schedule
- Move sheets API into common dir, since multi use
- Live download from Google Sheets using Config
- Falls back on old schedule if new one can't be downloaded for some reason
Mike Lang a34af372d0
thrimbletrimmer: Validate chapter titles are ascii only
We are not sure what characters are allowed in chapter titles.
Emoji seem to be disallowed. It is unknown whether things like accents or smart quotes are allowed.
To be conservative, we warn if there are any non-ascii characters in the chapter title.
Mike Lang cb144866a6 Change wording of "submit anyway" button when saving a draft
Mike Lang f9ff537b84 restreamer: Fix a bug where playlist reports video is finished spuriously
This happens when we are live viewing a stream, and the last available segment
is at the end of an hour.
We generate the end timestamp as being the end of the last available hour,
which might be within the range of the last available segment. When this happens
we stream the last segment then say we reached the requested end point.
This makes the player stop asking for more segments.

The fix is to pad the end time by an extra hour so we're asking for 1 hour more than the
last available hour.
Mike Lang daf6001402 restreamer: Move get_best_segments() inside playlist cache
Mike Lang 264545eb9d CachedIterator: Fix bug where state can change while taking the lock
Resulting in a case where we grab the wrong result, or even try to get the next item
after the iterator has already been discarded.
Mike Lang 0895ce44ff generate media playlist: Yield in chunks for performance
Flask sends a chunked response with one chunk per item yielded.
This adds a lot of overhead per yielded item.
We avoid this by collecting the lines of the media playlist into larger chunks
and only flushing once every 1000 segments.

For small playlists this means they'll be emitted as one chunk,
but for large playlists we still get the streaming behaviour.
Mike Lang 1857a998c9 reduce overhead of gevent.idle() by only yielding once per 1000 segments
Mike Lang 7e90346b87 restreamer: Have playlist cache stream results
Mike Lang 8ede4622ca CachedIterator: Re-serve any errors encountered while iterating
instead of the second one to reach the error treating it as a successful end of iterator.
Mike Lang 909cece196 restreamer: Move media playlist cache to also cover HLS playlist generation
Mike Lang cb2c58c75c restreamer: Yield the event loop during playlist generation
Mike Lang be7a9cd1fa restreamer: Make media playlist streamed
To deal better with very large playlists
Mike Lang a6d4f2466a restreamer: coalesce concurrent requests for the same playlist URL
Christopher Usher 28a468477d
Update DATABASE.md
Fixed some minor formatting issues
HubbeKing b46d9f30bb Proper example for edit_url
HubbeKing 7715a9c702 Run chat_archiver by default and backfill emotes by default
HubbeKing c9af44c327 Always create credentials secret
HubbeKing a98fea2489 Update NFS mount options
HubbeKing 517b881674 Remove old URL from edit_url config setting
HubbeKing 209cc6d876 Add config parameter for NFS mount options
HubbeKing 17596655f6 Update k8s.jsonnet file to support 2023 changes to images
Mike Lang 2a1f7207a8 Allow a fudge factor when checking for gaps/overlaps between segments
Sometimes in the wild (particularly on youtube) segments may not be timed perfectly, so allow up to 10ms of gap or overlap
to be counted as "equal" for purposes of finding the best segment.
Mike Lang b8cf0f20b0 segment_coverage: Allow alternate output location + single-run mode
Mike Lang 3606fadaa8 Pin gevent version to work around build issues
Seeing the following error on latest versions of gevent:

 Traceback (most recent call last):
   File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
     return _run_code(code, main_globals, None,
   File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
     exec(code, run_globals)
   File "/usr/lib/python3.9/site-packages/zulip_bots/schedulebot.py", line 2, in <module>
     import gevent.monkey
   File "/usr/lib/python3.9/site-packages/gevent/__init__.py", line 72, in <module>
     from gevent._hub_local import get_hub
   File "/usr/lib/python3.9/site-packages/gevent/_hub_local.py", line 150, in <module>
     import_c_accel(globals(), 'gevent.__hub_local')
   File "/usr/lib/python3.9/site-packages/gevent/_util.py", line 148, in import_c_accel
     mod = importlib.import_module(cname)
   File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module
     return _bootstrap._gcd_import(name[level:], package, level)
ModuleNotFoundError: No module named 'gevent._gevent_c_hub_local'
Mike Lang 859852fc50 memes
Christopher Usher b7e8b83c8d corrected shift names
Christopher Usher e12e361525 Shifts graphs
Christopher Usher e66540087a Fixes suggested by ekim
Christopher Usher eae430d5f3 removed local script
Christopher Usher 9a3b1fd5c3 Refactor in preperation for multiple graphs
Christopher Usher a6e990db68 Donation graph now works in a container
Christopher Usher 2c8a27330f graphs container now builds
Christopher Usher 3e8b4dfcf1 Starting integration of donation graphs
Mike Lang c65eb2eae3 Add a default timeout on google APIs
Mike Lang b9b7a6ca27 more schedulebot formatting
Mike Lang 4786154bca One more schedulebot format tweak
Mike Lang 7637633936 fix typo
Mike Lang d338c785ff schedulebot: formatting changes
Mike Lang f63e68f609 schedulebot: List all currently active people by role (except shift sup)
Mike Lang b65203ce0e bus_analyzer: Parallelize and fix error handling
Mike Lang c5acfe3ae0 bus_analyzer: Fix listing segments to respect tombstones
Mike Lang 8ac6e71d48 bus_analyzer: Normalize brightness across all digits, not one by one
Mike Lang bd9e22bc1f Revert "bus_analyzer: blank is grey, not black"
This reverts commit 3e0280cf33.

Now that we look at all digits at once for normalization, blank is black
Mike Lang 86951d5916 thrimshim: Fix bug in extrapolate code when time is a float
Mike Lang cd4d08adc1 Yield after each segment when doing fast/smart cuts
To avoid blocking for long periods
ElementalAlchemist db8c3a986f
Refresh just the images on the segment coverage page ()
This allows users on the page to preserve attributes like the current horizontal scroll value.