henine
/
wubloader
mirror of https://github.com/ekimekim/wubloader
1
0
Fork 0
Code Issues Releases Wiki Activity
1,133 Commits
34 Branches
0 Tags
19 MiB
thrimbletrimmer-solid
HubbeKing-multiplatform-builds
bus-progress-ui
master
bus-post-processing
chrusher/bus_synthesizer
mike/faster-chat-merge
mike/chat-no-end-time
chrusher-playlist-thumbnails
chrusher-thumbnail-frontend
mike/prizebot
condor-scripts
mike/chat-subs
mike/bad-segment-hack
mike/backfill-extras
mike/cropping
mike/shorts
mike/download-frame-2
mike/debug-playlists
chrusher/backfiller_error_handler
sheet-updates
mike/generate-videos
suspect-segments
mike/testing
gunner/thrimbletrimmer-improvements
mike/render-dashboard
mike/database/initial
downloader/follow-game
mike/downloader/conn-pooling
mike/common/split-up
mike/backdoor
mike/downloader/handle-404
mike/non-restreamer-stats
archive/original-v2.1
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '06fad6357b'
${ noResults }
Commit Graph

101 Commits (06fad6357b7cf8495bb0d4162919729d0375cf3d)

Author SHA1 Message Date
VodBox 1df734eff1 downloader: local provider source with symlinks 
To work with a local recording from OBS, requires that the output format
is set to m3u8 + ts, and that the custom muxer settings includes
``hls_flags=+program_date_time``. ``hls_list_size=0`` will also ensure
that OBS provides the full playlist and appends new segments without
getting rid of old ones, which is useful for ensuring all segments are
downloaded
 9 months ago
Christopher Usher e66540087a Fixes suggested by ekim 1 year ago
Christopher Usher a6e990db68 Donation graph now works in a container 1 year ago
Mike Lang ce665047ac Add bus_analyzer to docker-compose 1 year ago
Mike Lang 590e056f7a docker-compose: Add support for backfill only, chat only channels 
And don't try to archive twitch chat for non-twitch channels
 1 year ago
Mike Lang 0192e5246a docker-compose: Add support for new channel format 1 year ago
Mike Lang bc08d97e56 downloader: Add framework to allow alternate "providers" besides twitch 
This abstracts out the process of obtaining media playlists so that we can support non-twitch
streaming services.
 1 year ago
Mike Lang 30c1877b36 Fix bugs with chat_archiver 
* Order of arguments matters - option can't be between other positional args and *args
* Messed up the count structure
 1 year ago
Mike Lang 66603bf648 docker-compose: Update some defaults 
These more closely match our actual run usage
 1 year ago
Mike Lang c3d5405ebc docker-compose: archive sheet support 1 year ago
Mike Lang 5c7061efd2 docker-compose: Have chat-archiver archive all watched channels 1 year ago
Mike Lang 260293d40d chat_archiver: Allow passing multiple channels on CLI 1 year ago
Mike Lang 5a8bf99d12 schedulebot: Add ability to hard-code a group membership by shift 
This feature is intended for implementing a "current wub wrangler" group, which:
a) Isn't on the schedule
b) Can't be put on the schedule as it would overlap with other duties
c) We don't want to announce in "starting/ending shift" messages.
 1 year ago
Mike Lang e146ed97db docker-compose: Add ability to give downloader an auth token 1 year ago
Mike Lang dce0b3a5fc Update docker-compose defaults 
with values that are common (not for a particular year or node) but aren't secrets.
 1 year ago
Mike Lang fff01876a9 docker-compose: Backfill emotes directory 1 year ago
Mike Lang 491945cc24 docker-compose: Run zulip bots 1 year ago
Mike Lang 30d5ccc483 Fix all old references to github.com/ekimekim/wubloader 1 year ago
Mike Lang 8e314eea94 Collect metrics for chat_archiver on port 8008 2 years ago
Mike Lang 46468409cb Add "public" column to control if videos are unlisted 
This column is modifyable.
This replaces the old "hidden" argument to youtube upload backends.
 2 years ago
Mike Lang c50224415c more backfiller chat fixes 
fixup: more backfiller fixes

Enable backfilling of chat logs
 2 years ago
Mike Lang 4cfc362f76 chat-archiver: pass in node name 
instead of using container hostname
 2 years ago
Mike Lang 315c9c8297 Integrate chat archiver as a proper component 2 years ago
Mike Lang 0756539b85 chat-archiver: Early work and basic archival 2 years ago
Mike Lang 467edf3d19 Read dynamic playlist manager config from sheet 
The sheetsync loads playlist ids and tags into a new table `playlists`.
playlist manager reads this table and merges it with the playlists given on the command line.
 3 years ago
ElementalAlchemist 2b4e7a23e7 Update the default edit_url to make sense with the new Thrimbletrimmer structure 3 years ago
ElementalAlchemist e4204d9b9a Add Thrimbletrimmer dev option 3 years ago
Mike Lang 415932e289 docker-compose: fix bug where database_tag isn't respected 3 years ago
Mike Lang 3e768aa2a9 switch from quay.io to ghcr.io for image registry 3 years ago
Mike Lang 5f81c383bc Add day 8 3 years ago
Mike Lang 317d45f16d Manually specify upload locations that should be added to playlists 
This lets us exclude some youtube locations (like unlisted),
and include non-youtube ones (like manual-youtube)
 3 years ago
Mike Lang 463843668d segment-coverage: Render a monitoring page 3 years ago
Mike Lang e9b2831b71 docker-compose: Fix bug preventing playlist manager metrics from being routed 4 years ago
Mike Lang 2327c7c9a8 docker-compose: Fix typos in configuring playlist manager 4 years ago
Mike Lang 6e5e4b41df docker-compose/k8s: Limit segment-coverage start/end times 
Instead of defaulting to oldest/newest.
 4 years ago
Mike Lang 324d180c5e docker-compose: Default to only backfilling things from this year 
By setting a 6-month limit
 4 years ago
Mike Lang b029250c1c Disable stacksampler by default 
It causes problems due to the sheer number of unique metrics emitted, which makes
the prometheus endpoint be very expensive / fail a lot.

The data is not useful enough to justify the cost.
 4 years ago
Mike Lang a89bfcd271 Add playlist manager to all the various other places 4 years ago
Mike Lang 61d934f333 docker-compose.jsonnet: Use seperate tag for database 
The database changes rarely, and is disruptive to re-deploy,
so we track its image version seperately so it only needs to be upgraded
when there's actually a change.
 4 years ago
Christopher Usher 1325ccf280 added a read only user to database setup script 5 years ago
Mike Lang 64766bcf35 Add SSL to nginx if certs are given 5 years ago
Mike Lang 8bcc38d386 docker-compose: Add generic option to pass env vars to all services 5 years ago
Mike Lang 5921066ee0 docker-compose: Pass node name into cutter 
Otherwise it doesn't have a stable node name (hostname inside containers
is random) and this results in orphaned videos on unclean shutdown.
 5 years ago
Mike Lang 2554b72c3a Fix slightly wrong default sheet name 5 years ago
Mike Lang a6cd07077a docker-compose: Wrap DSN values in quotes so spaces are allowed 5 years ago
Mike Lang b2a07ef114
Merge pull request #140 from ekimekim/mike/build-improvements 
Refactor dockerfiles for more shared layers
 5 years ago
Mike Lang 751472217b Default to using the current commit, instead of latest 
This is generally what you want, and will behave better than using latest.
 5 years ago
Mike Lang b2cd0fa6f7 docker-compose: Support channel importance markers 
Only pass them to downloader, strip them otherwise.
 5 years ago
Christopher Usher 09d7feebfb changed list comprehension to concatenation 5 years ago
Christopher Usher 02fd265407 allow for multiple channels in docker-compose 5 years ago