Mirrors/continuwuity
1
0
Fork 0
mirror of https://forgejo.ellis.link/continuwuation/continuwuity.git synced 2026-05-26 20:49:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,476 Commits 157 Branches 36 Tags
f02a08de578f1e222edb3d044124208e2a79eddc
Commit Graph

985 Commits

Author SHA1 Message Date
Jason Volk b56e480b3c integrate some std io error kinds with our status code abstraction 
associate rocksdb error kinds with std io error kinds

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk 74eb30c106 add LIFO scheduling for database frontend pool workers 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk 7a6d657558 configurable dynamic stream concurrency scalar 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk b195107053 optimize for multi-queue storage topologies with affinity 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk a3d87be22f enable atomic_flush for database columns 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk 98e6c81e49 offload remaining db iterator initial seeks on cache miss 
consume task budget on cache hit

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk 14341bb906 simplify and improve db iter State init interface 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk 4d46df2af5 abort tasks for non-async pool shudown 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-18 14:16:23 -05:00
Jason Volk 5f7636f177 set dbpool thread name (gated by tokio_unstable) 
Signed-off-by: Jason Volk <jason@zemos.net>
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-18 13:31:41 -05:00
Jason Volk ad8cbcaac1 check cache prior to offloading iterator seek 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-18 13:29:43 -05:00
strawberry 77e0b76408 apply new rustfmt.toml changes, fix some clippy lints 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-15 01:00:41 -05:00
strawberry 0317cc8cc5 rename conduit to conduwuit finally 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-14 22:24:45 -05:00
Jason Volk aba88ccead misc tracing span tweaks 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-10 06:20:30 +00:00
strawberry faf48405aa bump rocksdb to v9.8.4, enable track_and_verify_wals_in_manifest by default 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-09 12:52:06 -05:00
strawberry 61670370ed add rocksdb paranoid_file_checks config option, add some more config checks 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-09 12:28:14 -05:00
Jason Volk ff56ee7413 add back the consume_budget on cache hits 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-08 07:12:27 +00:00
Jason Volk 6aa35260e6 misc database options tweaks 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-08 07:12:27 +00:00
Jason Volk 65a370836c derive specific ReadOptions for iterators 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-08 07:12:27 +00:00
Jason Volk 48703173bc split get_batch from get.rs; add aqry_batch 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-04 00:51:57 +00:00
Jason Volk 3109c0daba perform async shutdown for database pool after services stop 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-04 00:51:57 +00:00
Jason Volk b5006a4c41 offload initial iterator seeks to threadpool 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-03 13:25:33 +00:00
Jason Volk 9a9c071e82 use tokio for threadpool mgmt 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-03 07:39:02 +00:00
Jason Volk 2a9bb1ce11 add configurables for frontend pool options 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-28 07:20:43 +00:00
Jason Volk 3ad6aa59f9 use smallvec for db query buffering 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-28 06:03:33 +00:00
Jason Volk c7ae951676 add frontend threadpool to database 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-27 10:53:44 +00:00
Jason Volk 527494a34b fix oversized tracing span arguments; lints 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-27 06:30:20 +00:00
morguldir 63d1fcf213 add queued transactions rocksdb cf cache 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-11-25 16:08:30 -05:00
Jason Volk 62d560e2fb improve tracing instruments on database::map 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-25 07:00:55 +00:00
Jason Volk 343ec59a8b use arrayvec for integer deserialization buffer 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-25 02:54:29 +00:00
Jason Volk 3789d60b6a refactor to iterator inputs for auth_chain/short batch functions 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-24 21:30:32 +00:00
strawberry 9100af9974 add eventid_pdu database cf cache 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-11-21 23:45:16 -05:00
Jason Volk 7680d1bd5e replace yields point with consume_budget 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-19 08:37:25 +00:00
Jason Volk 90106c4c33 streamline batch insertions 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-19 08:37:25 +00:00
Jason Volk 14e3b242df add database get_batch stream wrapper 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-16 00:33:40 +00:00
Jason Volk 20836cc3db flush=false for database-backup in read-only/secondary modes; improve error 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-16 00:33:40 +00:00
Jason Volk 59834a4b05 add is_read_only()/is_secondary() to Engine 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-16 00:33:40 +00:00
Jason Volk 004be3bf00 prepare utf-8 check bypass for database deserializer 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-13 22:59:28 +00:00
Jason Volk 8742437036 wrap unimplemented ser/de branches with internal macro 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-03 08:03:25 +00:00
Jason Volk 9775694423 inline database stream interface functions lt 64B 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-03 07:32:09 +00:00
Jason Volk ed76797b55 add raw_ overloads for prefix/from counting 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-11-03 07:32:09 +00:00
Jason Volk 354dc9e703 add map accessor to Database; move cork interface 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-28 20:52:52 -04:00
Jason Volk 0426f92ac0 unify database record separator constants 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-27 00:11:50 +00:00
Jason Volk efb28c1a99 add a Map::contains suite to db 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-27 00:09:05 +00:00
Jason Volk c06f560913 add some additional database::de test cases 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-26 18:50:29 -04:00
Jason Volk 8258d16a94 re-scheme naming of stream iterator overloads 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-26 18:50:29 -04:00
Jason Volk 19880ce12b add IgnoreAll directive to deserializer 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-26 18:50:29 -04:00
Jason Volk d3d11356ee add serialized insert interface 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-26 18:50:29 -04:00
Jason Volk 2f24d7117a further develop serializer for insertions 
add JSON delegator to db serializer

consolidate writes through memfun; simplifications

Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-26 18:50:29 -04:00
Jason Volk 814b9e28b6 fix unnecessary re-serializations 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-26 18:50:28 -04:00
Jason Volk c6b7c24e99 consume all bytes for top-level Ignore; add comments/tweaks 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-10-25 00:38:45 -04:00