wubloader

Commit Graph

Select branches

Hide Pull Requests

HubbeKing-multiplatform-builds

archive/original-v2.1

bus-post-processing

bus-progress-ui

chrusher-playlist-thumbnails

chrusher-thumbnail-frontend

chrusher/backfiller_error_handler

chrusher/bus_synthesizer

condor-scripts

downloader/follow-game

gunner/thrimbletrimmer-improvements

master

mike/backdoor

mike/backfill-extras

mike/bad-segment-hack

mike/chat-no-end-time

mike/chat-subs

mike/common/split-up

mike/cropping

mike/database/initial

mike/debug-playlists

mike/download-frame-2

mike/downloader/conn-pooling

mike/downloader/handle-404

mike/faster-chat-merge

mike/generate-videos

mike/non-restreamer-stats

mike/prizebot

mike/render-dashboard

mike/shorts

mike/testing

sheet-updates

suspect-segments

thrimbletrimmer-solid

#1

#10

#100

#101

#102

#103

#107

#109

#11

#113

#114

#115

#116

#118

#119

#12

#120

#128

#129

#13

#132

#133

#134

#136

#137

#138

#139

#14

#140

#142

#143

#144

#146

#147

#148

#149

#15

#150

#151

#152

#153

#154

#155

#156

#157

#158

#159

#160

#163

#17

#173

#174

#175

#176

#177

#178

#18

#180

#181

#182

#183

#184

#185

#186

#187

#188

#189

#19

#190

#191

#192

#193

#194

#195

#196

#197

#198

#199

#2

#20

#200

#201

#202

#203

#204

#205

#206

#207

#21

#210

#211

#212

#213

#22

#222

#223

#224

#225

#227

#229

#23

#230

#231

#233

#234

#235

#236

#237

#239

#24

#240

#242

#243

#244

#245

#246

#247

#248

#249

#25

#250

#253

#254

#255

#256

#257

#258

#26

#260

#261

#262

#263

#264

#265

#266

#267

#268

#269

#27

#270

#28

#288

#289

#29

#290

#291

#292

#294

#295

#297

#298

#299

#3

#30

#300

#302

#304

#305

#306

#307

#308

#309

#31

#310

#311

#312

#313

#314

#315

#315

#316

#317

#318

#319

#32

#320

#321

#322

#323

#324

#327

#328

#329

#33

#330

#331

#332

#334

#335

#336

#337

#34

#340

#342

#343

#344

#347

#349

#35

#350

#352

#353

#354

#355

#356

#357

#36

#360

#361

#362

#363

#367

#369

#37

#370

#373

#374

#375

#38

#388

#388

#389

#39

#390

#391

#392

#396

#397

#4

#40

#400

#401

#407

#408

#409

#41

#410

#413

#414

#415

#416

#417

#418

#419

#42

#423

#425

#426

#427

#428

#428

#43

#432

#433

#434

#435

#436

#437

#438

#439

#44

#440

#441

#441

#443

#444

#447

#448

#449

#45

#452

#453

#454

#455

#456

#456

#457

#459

#46

#460

#461

#462

#463

#464

#464

#465

#465

#466

#467

#468

#47

#471

#472

#476

#478

#48

#480

#481

#483

#483

#484

#487

#487

#488

#49

#495

#495

#5

#50

#51

#52

#53

#54

#55

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#70

#71

#72

#73

#74

#75

#76

#77

#78

#79

#87

#89

#93

#94

#96

#97

4d3fd0815e backfiller: Track number of successful backfills Mike Lang 2019-01-06 05:43:08 -0800
27d7dcf6f4 backfiller: Add ability to set nodes as CLI arg Mike Lang 2019-01-06 05:40:00 -0800
91b85eb99a docker-compose: Expose metrics ports for other services Mike Lang 2019-01-06 02:14:08 -0800
47d8dbc86b Expose prometheus metrics for backfiller and downloader Mike Lang 2019-01-06 01:55:52 -0800
09cf238bb9 common: Create general function for timing things, and use it to time get_best_segments Mike Lang 2019-01-06 01:50:14 -0800
87978db8eb Add a logging handler which counts logs for prometheus stats Mike Lang 2019-01-06 00:14:39 -0800
c9d02b3318 restreamer: Prevent prom client blowing up after two different endpoints are hit Mike Lang 2019-01-05 17:56:27 -0800
7914210ea4 restreamer: Prevent prom client blowing up after two different endpoints are hit Mike Lang 2019-01-05 17:56:27 -0800
30c4bbec1d restreamer: return the actual response from after_request even if untracked Mike Lang 2019-01-05 17:03:34 -0800
96e6904c85 Added monotonic to restreamer setup.py Christopher Usher 2019-01-05 02:04:51 -0800
1a3a511051

Added monotonic to restreamer setup.py Christopher Usher 2019-01-05 02:04:51 -0800
225288980a Added the backfiller to docker-compose Christopher Usher 2019-01-05 00:37:33 -0800
f9f2937bc8 Added the backfiller to docker-compose Christopher Usher 2019-01-05 00:37:33 -0800
3fcd374449 Moved encode_strings to common Christopher Usher 2019-01-04 00:03:30 -0800
93dd216f89 Fixes and suggestions from ekimekim Christopher Usher 2019-01-03 21:25:43 -0800
db1b4e6539 Updated logging to match the other components Christopher Usher 2019-01-03 21:02:48 -0800
bae039977b trying getting the backfiller to actually start Christopher Usher 2019-01-01 20:22:14 -0800
1fcd9b5b36 Adding in stuff to hopefully get this to run Christopher Usher 2019-01-01 19:52:27 -0800
013ad65c68 added a Dockerfile for the backfiller Christopher Usher 2019-01-01 19:30:16 -0800
48d11045d4 Change to backfiller.main to backfill the last 3 hours on start up before doing a full backfill Christopher Usher 2019-01-01 16:26:25 -0800
176633bf7d More messing around with backfill_node to allow finer grained control of order segments are fetched Christopher Usher 2019-01-01 16:12:38 -0800
3a7624b107 added a setup file for the backfiller Christopher Usher 2019-01-01 15:04:25 -0800
ba499fe835 added more logging to backfiller Christopher Usher 2019-01-01 14:47:01 -0800
34372aa7dd

Merge branch 'master' into chrusher/backfiller Christopher Usher 2019-01-04 23:18:47 -0800
7525b7c135 restreamer: Add basic prometheus stats to all endpoints Mike Lang 2019-01-03 21:10:23 -0800
d0e2ce6ae1 restreamer: Add basic prometheus stats to all endpoints Mike Lang 2019-01-03 21:10:23 -0800
747faf6f91 Moved encode_strings to common Christopher Usher 2019-01-04 00:03:30 -0800
7abff26c5d Fixes and suggestions from ekimekim Christopher Usher 2019-01-03 21:25:43 -0800
eeaa4f8d6c Updated logging to match the other components Christopher Usher 2019-01-03 21:02:48 -0800
726b2ec0ff trying getting the backfiller to actually start Christopher Usher 2019-01-01 20:22:14 -0800
22ccd927cf Adding in stuff to hopefully get this to run Christopher Usher 2019-01-01 19:52:27 -0800
fc03f965ca added a Dockerfile for the backfiller Christopher Usher 2019-01-01 19:30:16 -0800
9d69afcfb3 Change to backfiller.main to backfill the last 3 hours on start up before doing a full backfill Christopher Usher 2019-01-01 16:26:25 -0800
54679383df More messing around with backfill_node to allow finer grained control of order segments are fetched Christopher Usher 2019-01-01 16:12:38 -0800
6379d5f71d added a setup file for the backfiller Christopher Usher 2019-01-01 15:04:25 -0800
bcdcc8d634 added more logging to backfiller Christopher Usher 2019-01-01 14:47:01 -0800
f20a779756 Fix some bugs and linter errors introduced by backfiller Mike Lang 2019-01-01 14:27:08 -0800
17972b87aa Allow setting of log level via WUBLOADER_LOG_LEVEL env var Mike Lang 2019-01-03 19:28:45 -0800
c0357680cf downloader: Use caller's logger inside soft_hard_timeout Mike Lang 2019-01-03 19:18:43 -0800
a628676e74 downloader: Log to subloggers instead of the root logger Mike Lang 2019-01-03 19:16:29 -0800
692cdbfa4b Allow setting of log level via WUBLOADER_LOG_LEVEL env var Mike Lang 2019-01-03 19:28:45 -0800
05b33fbe11 downloader: Use caller's logger inside soft_hard_timeout Mike Lang 2019-01-03 19:18:43 -0800
16aed99fdf downloader: Log to subloggers instead of the root logger Mike Lang 2019-01-03 19:16:29 -0800
57e665df2e generate-docker-compose: Clean up the container afterwards Mike Lang 2019-01-03 17:59:39 -0800
c8cc4a68a0 cutter: Fix bugs that meant things wouldn't actually be cut Mike Lang 2019-01-02 07:13:27 -0800
6bf709287a cutter: Introduce an alternate cutting approach that is much faster Mike Lang 2019-01-02 06:36:27 -0800
22df6f0b45 cutter: Fix bugs that meant things wouldn't actually be cut Mike Lang 2019-01-02 07:13:27 -0800
4c49722d95 cutter: Introduce an alternate cutting approach that is much faster Mike Lang 2019-01-02 06:36:27 -0800
6815924097 Fix some bugs and linter errors introduced by backfiller Mike Lang 2019-01-01 14:27:08 -0800
70d1bc466c Fix some bugs and linter errors introduced by backfiller Mike Lang 2019-01-01 14:27:08 -0800
78a9a4e525 Set up a docker compose file to run all images Mike Lang 2019-01-01 14:16:20 -0800
dadbbf6e85 Set up a docker compose file to run all images Mike Lang 2019-01-01 14:16:20 -0800
25185f8f1f travis.yml: Make script into individual lines Mike Lang 2019-01-01 12:39:16 -0800
4dc00052f6 Add .travis.yaml to set up CI Mike Lang 2019-01-01 12:13:12 -0800
92cdaa51b7 travis.yml: Make script into individual lines Mike Lang 2019-01-01 12:39:16 -0800
e5e08f40b8 Add .travis.yaml to set up CI Mike Lang 2019-01-01 12:13:12 -0800
18aadd6b82 restreamer: Also have an endpoint for generating cut videos on demand Mike Lang 2018-12-29 21:32:18 -0800
b42202434f Minor Fixes as sugged by ekimekim Christopher Usher 2019-01-01 04:47:23 -0800
0b524a72cb docstings and a few minor feature additions to the backfiller Christopher Usher 2018-12-30 17:24:28 -0800
a59f6e1569 ignore tempuary files Christopher Usher 2018-12-30 03:06:03 -0800
3b0342b872 added options to limit range of hours backfilled and to randomise hours backfilled Christopher Usher 2018-12-29 15:32:13 -0800
fec0975d18 fixed white space and the like Christopher Usher 2018-12-29 02:14:38 -0800
afd948576d Forgot to try to remove temporary file Christopher Usher 2018-12-28 23:47:26 -0800
3cdfaad664 moved rename, ensure_directory and jitter to common Christopher Usher 2018-12-28 23:21:44 -0800
7d26997b1f modifications to the backfiller in response to ekimekim's comments Christopher Usher 2018-12-28 23:13:09 -0800
ba52bf7f5d hopefully more robust Christopher Usher 2018-12-28 19:56:41 -0800
50bcb84c0c Moving things around to make the backfiller a bit more like a proper package Christopher Usher 2018-12-28 19:06:29 -0800
494725fe34 Getting close to something I can show ekimekim Christopher Usher 2018-12-28 19:05:22 -0800
5615c1bdb0 Chipping away at backfiller I'm going to have to learn to write better commit messages Christopher Usher 2018-12-28 13:18:11 -0800
2fb17fff59 much closer to being functional Christopher Usher 2018-12-28 04:18:06 -0800
05fed36ac8 a few ideas extra Christopher Usher 2018-12-26 22:22:05 -0800
0e7ba25b76 start of a rough prototype of the backfiller Christopher Usher 2018-12-12 17:40:59 +0000
6000936616 Minor Fixes as sugged by ekimekim Christopher Usher 2019-01-01 04:47:23 -0800
dca00cac78 restreamer: Also have an endpoint for generating cut videos on demand Mike Lang 2018-12-29 21:32:18 -0800
97d77e19d6 restreamer: Add CORS headers to all responses Mike Lang 2018-12-31 13:19:37 -0800
70a19b27ed restreamer: Add CORS headers to all responses Mike Lang 2018-12-31 13:19:37 -0800
941b9b017e build script: Add ability to push to remote repository after building Mike Lang 2018-12-30 03:29:38 -0800
afe19ca33e restreamer: Implement graceful stop on SIGTERM Mike Lang 2018-12-30 03:29:26 -0800
7ffa90c7e6 restreamer: Make docker image work, fix missing dependencies Mike Lang 2018-12-30 03:07:50 -0800
1dce14bf77 downloader: Fix and improve the stop mechanism, stop on SIGTERM Mike Lang 2018-12-30 02:19:49 -0800
7b10429846 downloader: Dockerfile fixes to make it work Mike Lang 2018-12-30 01:22:26 -0800
6c3501db6f downloader: Fix dateutil lib, which is actually called python-dateutil Mike Lang 2018-12-30 01:09:51 -0800
7257fb9b73 downloader: Include channel name in path, instead of assuming it's already in base_dir Mike Lang 2018-12-30 01:04:54 -0800
dc1d485600 Merge branch 'chrusher/backfiller' of https://github.com/ekimekim/wubloader into chrusher/backfiller Christopher Usher 2018-12-30 17:26:05 -0800
612cb54ba1 docstings and a few minor feature additions to the backfiller Christopher Usher 2018-12-30 17:24:28 -0800
4371a9cf06 build script: Add ability to push to remote repository after building Mike Lang 2018-12-30 03:29:38 -0800
bf0e933973 restreamer: Implement graceful stop on SIGTERM Mike Lang 2018-12-30 03:29:26 -0800
bc68803118 restreamer: Make docker image work, fix missing dependencies Mike Lang 2018-12-30 03:07:50 -0800
6248accd39 ignore tempuary files Christopher Usher 2018-12-30 03:06:03 -0800
ebbfb66c72 downloader: Fix and improve the stop mechanism, stop on SIGTERM Mike Lang 2018-12-30 02:19:49 -0800
f1d7032f35 downloader: Dockerfile fixes to make it work Mike Lang 2018-12-30 01:22:26 -0800
6ee553552a downloader: Fix dateutil lib, which is actually called python-dateutil Mike Lang 2018-12-30 01:09:51 -0800
aeb2b42f28 downloader: Include channel name in path, instead of assuming it's already in base_dir Mike Lang 2018-12-30 01:04:54 -0800
d42c6ec89d added options to limit range of hours backfilled and to randomise hours backfilled Christopher Usher 2018-12-29 15:32:13 -0800
a9b4b32a11 fixed white space and the like Christopher Usher 2018-12-29 02:14:38 -0800
e1ba794be5 Forgot to try to remove temporary file Christopher Usher 2018-12-28 23:47:26 -0800
bd65871010

Merge branch 'master' into chrusher/backfiller Christopher Usher 2018-12-28 23:37:14 -0800
828b23e12a moved rename, ensure_directory and jitter to common Christopher Usher 2018-12-28 23:21:44 -0800
d2dfcdc8f7 modifications to the backfiller in response to ekimekim's comments Christopher Usher 2018-12-28 23:13:09 -0800
9ce479a2a0 hopefully more robust Christopher Usher 2018-12-28 19:56:41 -0800