wubloader

Commit Graph

Select branches

Hide Pull Requests

HubbeKing-multiplatform-builds

archive/original-v2.1

bus-post-processing

bus-progress-ui

chrusher-playlist-thumbnails

chrusher-thumbnail-frontend

chrusher/backfiller_error_handler

chrusher/bus_synthesizer

condor-scripts

downloader/follow-game

gunner/thrimbletrimmer-improvements

master

mike/backdoor

mike/backfill-extras

mike/bad-segment-hack

mike/chat-no-end-time

mike/chat-subs

mike/common/split-up

mike/cropping

mike/database/initial

mike/debug-playlists

mike/download-frame-2

mike/downloader/conn-pooling

mike/downloader/handle-404

mike/faster-chat-merge

mike/generate-videos

mike/non-restreamer-stats

mike/prizebot

mike/render-dashboard

mike/shorts

mike/testing

sheet-updates

suspect-segments

thrimbletrimmer-solid

#1

#10

#100

#101

#102

#103

#107

#109

#11

#113

#114

#115

#116

#118

#119

#12

#120

#128

#129

#13

#132

#133

#134

#136

#137

#138

#139

#14

#140

#142

#143

#144

#146

#147

#148

#149

#15

#150

#151

#152

#153

#154

#155

#156

#157

#158

#159

#160

#163

#17

#173

#174

#175

#176

#177

#178

#18

#180

#181

#182

#183

#184

#185

#186

#187

#188

#189

#19

#190

#191

#192

#193

#194

#195

#196

#197

#198

#199

#2

#20

#200

#201

#202

#203

#204

#205

#206

#207

#21

#210

#211

#212

#213

#22

#222

#223

#224

#225

#227

#229

#23

#230

#231

#233

#234

#235

#236

#237

#239

#24

#240

#242

#243

#244

#245

#246

#247

#248

#249

#25

#250

#253

#254

#255

#256

#257

#258

#26

#260

#261

#262

#263

#264

#265

#266

#267

#268

#269

#27

#270

#28

#288

#289

#29

#290

#291

#292

#294

#295

#297

#298

#299

#3

#30

#300

#302

#304

#305

#306

#307

#308

#309

#31

#310

#311

#312

#313

#314

#315

#315

#316

#317

#318

#319

#32

#320

#321

#322

#323

#324

#327

#328

#329

#33

#330

#331

#332

#334

#335

#336

#337

#34

#340

#342

#343

#344

#347

#349

#35

#350

#352

#353

#354

#355

#356

#357

#36

#360

#361

#362

#363

#367

#369

#37

#370

#373

#374

#375

#38

#388

#388

#389

#39

#390

#391

#392

#396

#397

#4

#40

#400

#401

#407

#408

#409

#41

#410

#413

#414

#415

#416

#417

#418

#419

#42

#423

#425

#426

#427

#428

#428

#43

#432

#433

#434

#435

#436

#437

#438

#439

#44

#440

#441

#441

#443

#444

#447

#448

#449

#45

#452

#453

#454

#455

#456

#456

#457

#459

#46

#460

#461

#462

#463

#464

#464

#465

#465

#466

#467

#468

#47

#471

#472

#476

#478

#48

#480

#481

#483

#483

#484

#487

#487

#488

#49

#495

#495

#5

#50

#51

#52

#53

#54

#55

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#70

#71

#72

#73

#74

#75

#76

#77

#78

#79

#87

#89

#93

#94

#96

#97

e995ea00b7 improvements suggested by ekim Christopher Usher 2019-06-04 00:05:26 +0100
d94096db96 more improvements based on ekims comments Christopher Usher 2019-05-29 03:35:27 +0100
038cb55abc Initial thrimshim commit Christopher Usher 2019-05-29 03:00:47 +0100
292188ad7c database: Remove retry_on_conflict helper and default to autocommit Mike Lang 2019-05-24 19:19:20 -0700
73640ed4ab database: Add column video_id for storing upload-location-specific metadata for identifying video Mike Lang 2019-05-28 02:36:10 -0700
dc2eb6ed74 Add some common database code Mike Lang 2019-02-03 06:17:27 -0800
cea66a4bbf database: Rename start/end to event_start/end, add channel and quality Mike Lang 2019-02-03 05:04:03 -0800
7423f8c4ef Update DATABASE.md MasterGunner 2019-05-28 22:38:36 -0300
d89458c27d Update DATABASE.md MasterGunner 2019-05-27 19:43:17 -0300
61db8e9b33

Update DATABASE.md MasterGunner 2019-05-28 22:38:36 -0300
542520c3ed started in on ekim's comments Chris Usher 2019-05-28 11:21:55 +0100
7976cb3736 database: Remove retry_on_conflict helper and default to autocommit mike/database/initial Mike Lang 2019-05-24 19:19:20 -0700
0a31ba2590 database: Add column video_id for storing upload-location-specific metadata for identifying video Mike Lang 2019-05-28 02:36:10 -0700
4172ad9e7f Add some common database code Mike Lang 2019-02-03 06:17:27 -0800
47868f956d database: Rename start/end to event_start/end, add channel and quality Mike Lang 2019-02-03 05:04:03 -0800
ad38661202

Update DATABASE.md MasterGunner 2019-05-27 19:43:17 -0300
5ec8cb01a4 comments and some whitespace handling Christopher Usher 2019-05-27 16:27:00 +0100
64e5a7bc59 Added localhost option to backfill to avoid backfilling the local machine Christopher Usher 2019-05-26 00:48:13 +0100
437d38e646 DATABASE.md: Add image_links column Mike Lang 2019-05-22 09:35:59 -0700
cc5f9a2afd

DATABASE.md: Add image_links column Mike Lang 2019-05-22 09:35:59 -0700
dfe15b2b95 rewrite of get_nodes to allow getting list of files from a file Christopher Usher 2019-05-20 23:58:39 +0100
537be1a8ae bug fixing after testing Christopher Usher 2019-05-20 22:36:28 +0100
eb33711ff8 restreamer: Hack in a path to re-stream "last 20 seconds", for live 'replays' downloader/follow-game Mike Lang 2019-05-19 01:18:24 -0700
e351aff176 downloader: Sloppily restructure main to have dynamic list of channels taken from what game they're playing Mike Lang 2019-05-13 04:33:55 -0700
df66553b38 downloader: Start backdoor later so workers is in locals Mike Lang 2019-05-13 03:06:51 -0700
86da9d9fe8 downloader: Support watching multiple channels Mike Lang 2019-05-13 03:02:58 -0700
d82de174e3 added multiple streams by largely copy and pasting the code from the downloader Christopher Usher 2019-05-13 11:24:19 +0100
b18162135f downloader: Start backdoor later so workers is in locals Mike Lang 2019-05-13 03:06:51 -0700
41152fc1d3 downloader: Support watching multiple channels Mike Lang 2019-05-13 03:02:58 -0700
542e5d97d6 options to change where the node list is coming from Christopher Usher 2019-05-07 13:16:10 +0100
e7338cec5c bug fix in arg list Christopher Usher 2019-05-06 13:44:06 +0100
8e266ce154 more flexability for start time Christopher Usher 2019-04-28 23:26:51 +0100
0c5ad4173f fixed start not propagating to list_hours plus some refactorting Christopher Usher 2019-04-28 22:58:04 +0100
9e1b37071b I should test these changes soon Christopher Usher 2019-04-28 22:15:31 +0100
d21fb56838 error handling I guess Christopher Usher 2019-04-26 03:53:42 +0100
285e1a5c1f fixes and improvements suggested by ekimekim Christopher Usher 2019-04-19 03:27:05 +0100
f0d9aa82c2 Ignore segments that are marked as ads Mike Lang 2019-03-21 05:50:19 -0700
dc9e5c7433 Ignore segments that are marked as ads Mike Lang 2019-03-21 05:50:19 -0700
551e49c579 backfiller working in parallel Christopher Usher 2019-02-26 21:09:32 +0000
4ac2dcae0c hopefully did break anything with this refactor Christopher Usher 2019-02-10 03:25:48 +0000
dc2b939ca2 Bug fixes and logging improvements to the backfiller Christopher Usher 2019-02-07 02:09:30 +0000
b5e4413701 clean up for new gevent based backfiller. Christopher Usher 2019-01-27 21:00:59 +0000
c65eb2c565 added workers and a worker manager Christopher Usher 2019-01-27 20:42:56 +0000
6b7a1e5511 Move the code for calculating hours outside the code that backfills Christopher Usher 2019-01-27 15:23:28 +0000
ef0a78fce3 Updates to database states and columns Mike Lang 2019-01-27 05:32:46 -0800
6b3a0fea9f Add a doc covering how the database is used Mike Lang 2019-01-22 09:01:04 -0800
60f64683a7 Updates to database states and columns Mike Lang 2019-01-27 05:32:46 -0800
de34a64b4a Add a doc covering how the database is used Mike Lang 2019-01-22 09:01:04 -0800
a52daea994 reintroduced a start time for the backfiller; more logging Chris Usher 2019-01-13 13:13:00 +0000
c0f94059aa downloader: Stop retrying in SegmentGetter after a long timeout Mike Lang 2019-01-10 11:15:40 -0800
81aee0ee1e Increase hard timeout for getting segment headers Mike Lang 2019-01-10 10:53:11 -0800
6077f99007 downloader: Stop retrying in SegmentGetter after a long timeout Mike Lang 2019-01-10 11:15:40 -0800
26b60de5e3 Increase hard timeout for getting segment headers Mike Lang 2019-01-10 10:53:11 -0800
787b9002ab restreamer: Use correct name for dateutil Mike Lang 2019-01-09 02:26:15 -0800
3a1e4b0aef restreamer: Fix missing dependency Mike Lang 2019-01-09 02:19:05 -0800
997c1242b2 get_best_segments: Let other things run Mike Lang 2019-01-08 00:49:49 -0800
bf08aa29b8 parse_segment_path: Use datetime.strptime instead of dateutil.parser Mike Lang 2019-01-08 00:24:21 -0800
0445f566d4 get_best_segments: Let other things run Mike Lang 2019-01-08 00:49:49 -0800
ebabda3fb6 parse_segment_path: Use datetime.strptime instead of dateutil.parser Mike Lang 2019-01-08 00:24:21 -0800
bcdb268ce8 Also need to replace locks on the counter float values to prevent deadlocks Mike Lang 2019-01-07 12:39:43 -0800
10cca18922 Fix a deadlock due to signal interactions with prometheus client Mike Lang 2019-01-07 04:12:46 -0800
c9cc8a73a7 generate-flamegraph: Script to create a flamegraph by querying prometheus Mike Lang 2019-01-07 02:29:26 -0800
b75b9a9b00 Add stacksampler to all services Mike Lang 2019-01-07 01:31:30 -0800
b9c2921242 common.stats: Add a stacksampler that records sampled stacks to prometheus Mike Lang 2019-01-07 01:28:10 -0800
8b0ecd6246 Also need to replace locks on the counter float values to prevent deadlocks Mike Lang 2019-01-07 12:39:43 -0800
f11325117c Fix a deadlock due to signal interactions with prometheus client Mike Lang 2019-01-07 04:12:46 -0800
75b9bc195b generate-flamegraph: Script to create a flamegraph by querying prometheus Mike Lang 2019-01-07 02:29:26 -0800
993318b503 Add stacksampler to all services Mike Lang 2019-01-07 01:31:30 -0800
6bb46c582d common.stats: Add a stacksampler that records sampled stacks to prometheus Mike Lang 2019-01-07 01:28:10 -0800
a5213ccb3b downloader: Pool connections when we can Mike Lang 2019-01-08 08:18:41 -0800
5175b099af common: Split segment-related stuff into its own module Mike Lang 2019-01-07 00:15:25 -0800
6f84a23ba6 common: Split stats-related stuff into its own module Mike Lang 2019-01-07 00:15:25 -0800
8fe2fec958 common: convert from module to package Mike Lang 2019-01-07 00:11:13 -0800
96c1566d21

Merge pull request #34 from ekimekim/gunner/restreamer/additional-routes MasterGunner 2019-01-08 19:00:35 -0400
a9569d9e96 Removed unneeded '@has_path_args'. MasterGunner 2019-01-08 18:33:09 -0400
306ac53d08 Added additional routes for listing available streams and variants. MasterGunner 2019-01-08 18:17:46 -0400
25bc29c8c8 downloader: Pool connections when we can mike/downloader/conn-pooling Mike Lang 2019-01-08 08:18:41 -0800
cb929c12b3 common: Split segment-related stuff into its own module mike/common/split-up Mike Lang 2019-01-07 00:15:25 -0800
3edc27cfe6 common: Split stats-related stuff into its own module Mike Lang 2019-01-07 00:15:25 -0800
84b611055b common: convert from module to package Mike Lang 2019-01-07 00:11:13 -0800
901cda4814 Enable backdoor in all services, and add telnet to containers Mike Lang 2019-01-06 22:44:35 -0800
9af7795f34 Add gevent.backdoor as an optional arg to all services Mike Lang 2019-01-06 22:35:30 -0800
47ff92b155 downloader: Fix bug where mark_working wasn't called Mike Lang 2019-01-06 22:15:41 -0800
3042d00516 downloader: Give up on 404 in addition to 403 Mike Lang 2019-01-06 22:02:15 -0800
df73225a5b Enable backdoor in all services, and add telnet to containers mike/backdoor Mike Lang 2019-01-06 22:44:35 -0800
f9aa6ef0e4 Add gevent.backdoor as an optional arg to all services Mike Lang 2019-01-06 22:35:30 -0800
b34caaf208 downloader: Fix bug where mark_working wasn't called mike/downloader/handle-404 Mike Lang 2019-01-06 22:15:41 -0800
80773f130a downloader: Give up on 404 in addition to 403 Mike Lang 2019-01-06 22:02:15 -0800
7f9a1dbe45 downloader: Remove implicit source quality arg Mike Lang 2019-01-06 08:45:43 -0800
89d6b3a6be docker-compose: Add list of peers to backfill from Mike Lang 2019-01-06 06:24:01 -0800
0d627715f3 downloader: Track number of downloaded segments Mike Lang 2019-01-06 05:52:03 -0800
90ccc6d827 backfiller: Track number of successful backfills Mike Lang 2019-01-06 05:43:08 -0800
c59892e148 backfiller: Add ability to set nodes as CLI arg Mike Lang 2019-01-06 05:40:00 -0800
bdcb217d20 docker-compose: Expose metrics ports for other services Mike Lang 2019-01-06 02:14:08 -0800
b4b315b6bc Expose prometheus metrics for backfiller and downloader Mike Lang 2019-01-06 01:55:52 -0800
d90f01b8ce common: Create general function for timing things, and use it to time get_best_segments Mike Lang 2019-01-06 01:50:14 -0800
b0ded641c3 Add a logging handler which counts logs for prometheus stats Mike Lang 2019-01-06 00:14:39 -0800
261c57dc76 downloader: Remove implicit source quality arg mike/non-restreamer-stats Mike Lang 2019-01-06 08:45:43 -0800
00540fac9d docker-compose: Add list of peers to backfill from Mike Lang 2019-01-06 06:24:01 -0800
446befd543 downloader: Track number of downloaded segments Mike Lang 2019-01-06 05:52:03 -0800