Mike Lang
b866b5d21c
playlist manager: run more often
1 month ago
Mike Lang
9ad0f5f512
Pass db connect to restreamer
1 month ago
Mike Lang
48c91b7828
docker-compose: Set buscribe tag seperately
...
It's big and slow and most of the time doesn't need updating.
1 month ago
Mike Lang
4cd0ef1327
schedulebot: Take creds as a file
...
Avoids needing to put the creds in docker-compose.jsonnet.
The existing "import" trick didn't work due to the way we run jsonnet in docker.
1 month ago
Mike Lang
8533c01d7f
docker-compose changes for passing schedule sheet to schedulebot
1 month ago
Mike Lang
0dfc8ea127
bus_analyzer: fix docker-compose
1 month ago
Mike Lang
0e229dc80b
lower backfill_max_hours_ago so we aren't backfilling 6 months of chat logs
1 month ago
Mike Lang
1e7e400096
docker-compose: Pass correct database args for buscribe
1 month ago
Mike Lang
834d27c17d
Add buscribe to docker-compose
1 month ago
Mike Lang
9b19c12a53
Add pubnub-watching zulip bot
...
Which also records all pubnub messages for archival to a file SEGMENTS/pubnub-log.json.
We ran this for most of last year, but not as part of wubloader.
2 months ago
Mike Lang
7483794a23
docker-compose: Set up sheetsync for downloading media links
...
This involves giving it access to the SEGMENTS/media directory.
3 months ago
Mike Lang
15f86551d4
docker-compose: Backfill of media, with or without chat archiver
3 months ago
Mike Lang
9dfb00f4ab
chat_archiver: Logic for checking and downloading media links
3 months ago
Mike Lang
48725ac739
docker-compose: fix typos
4 months ago
Mike Lang
96181fd875
Support archive sync in sheetsync again
4 months ago
Mike Lang
73eaac16f3
Update sheetsync CLI interface to allow any combination of types and backends
4 months ago
Mike Lang
eebfa5885b
sheetsync: pass in event id instead of event name
4 months ago
Mike Lang
db3a779292
docker-compose: Allow setting up sheetsync for sheets or streamlog
4 months ago
Mike Lang
986a1db964
sheetsync: Change how options are specified to allow multiple backends / syncs
4 months ago
Mike Lang
9dec3cb729
Allow the youtube-manual upload backend to modify videos
...
So we can modify youtube videos we manually uploaded.
If the video isn't actually ours, it will error when the modify is attempted which is ok.
4 months ago
Christopher Usher
e66540087a
Fixes suggested by ekim
1 year ago
Christopher Usher
a6e990db68
Donation graph now works in a container
1 year ago
Mike Lang
ce665047ac
Add bus_analyzer to docker-compose
1 year ago
Mike Lang
590e056f7a
docker-compose: Add support for backfill only, chat only channels
...
And don't try to archive twitch chat for non-twitch channels
1 year ago
Mike Lang
0192e5246a
docker-compose: Add support for new channel format
1 year ago
Mike Lang
bc08d97e56
downloader: Add framework to allow alternate "providers" besides twitch
...
This abstracts out the process of obtaining media playlists so that we can support non-twitch
streaming services.
1 year ago
Mike Lang
30c1877b36
Fix bugs with chat_archiver
...
* Order of arguments matters - option can't be between other positional args and *args
* Messed up the count structure
1 year ago
Mike Lang
66603bf648
docker-compose: Update some defaults
...
These more closely match our actual run usage
1 year ago
Mike Lang
c3d5405ebc
docker-compose: archive sheet support
1 year ago
Mike Lang
5c7061efd2
docker-compose: Have chat-archiver archive all watched channels
1 year ago
Mike Lang
260293d40d
chat_archiver: Allow passing multiple channels on CLI
1 year ago
Mike Lang
5a8bf99d12
schedulebot: Add ability to hard-code a group membership by shift
...
This feature is intended for implementing a "current wub wrangler" group, which:
a) Isn't on the schedule
b) Can't be put on the schedule as it would overlap with other duties
c) We don't want to announce in "starting/ending shift" messages.
1 year ago
Mike Lang
e146ed97db
docker-compose: Add ability to give downloader an auth token
1 year ago
Mike Lang
dce0b3a5fc
Update docker-compose defaults
...
with values that are common (not for a particular year or node) but aren't secrets.
1 year ago
Mike Lang
fff01876a9
docker-compose: Backfill emotes directory
1 year ago
Mike Lang
491945cc24
docker-compose: Run zulip bots
1 year ago
Mike Lang
30d5ccc483
Fix all old references to github.com/ekimekim/wubloader
1 year ago
Mike Lang
8e314eea94
Collect metrics for chat_archiver on port 8008
2 years ago
Mike Lang
46468409cb
Add "public" column to control if videos are unlisted
...
This column is modifyable.
This replaces the old "hidden" argument to youtube upload backends.
2 years ago
Mike Lang
c50224415c
more backfiller chat fixes
...
fixup: more backfiller fixes
Enable backfilling of chat logs
2 years ago
Mike Lang
4cfc362f76
chat-archiver: pass in node name
...
instead of using container hostname
2 years ago
Mike Lang
315c9c8297
Integrate chat archiver as a proper component
2 years ago
Mike Lang
0756539b85
chat-archiver: Early work and basic archival
2 years ago
Mike Lang
467edf3d19
Read dynamic playlist manager config from sheet
...
The sheetsync loads playlist ids and tags into a new table `playlists`.
playlist manager reads this table and merges it with the playlists given on the command line.
3 years ago
ElementalAlchemist
2b4e7a23e7
Update the default edit_url to make sense with the new Thrimbletrimmer structure
3 years ago
ElementalAlchemist
e4204d9b9a
Add Thrimbletrimmer dev option
3 years ago
Mike Lang
415932e289
docker-compose: fix bug where database_tag isn't respected
3 years ago
Mike Lang
3e768aa2a9
switch from quay.io to ghcr.io for image registry
3 years ago
Mike Lang
5f81c383bc
Add day 8
3 years ago
Mike Lang
317d45f16d
Manually specify upload locations that should be added to playlists
...
This lets us exclude some youtube locations (like unlisted),
and include non-youtube ones (like manual-youtube)
3 years ago