key-value-store

We create a number of threads in various places in our code, and in most cases we do not give these threads names. It could be helpful to have names that make it easier for us to see what a thread is doing. Some examples include:

1. The network thread created by bindings (some bindings name this thread, others do not)
2. External network threads (name proposed in #6033)
3. Trace logging threa

Currently we don't have any mechanism to limit the maximum number of clients that could be handled simultaneously.

This feature should be designed properly. Here is some clue: https://redis.io/topics/clients#maximum-number-of-clients

Right now, to get an acceptable experience in dtlv, one has to use rlwrap, i.e. launch it like this rlwrap dtlv. It would be nice to integrate with jline3 library to have a better experience natively.

Right now, PebblesDB uses a lot of memory for the TableCache (caching metadata) and for the bloom filters used for each sstable.

We want to add a command line option for PebblesDB which would limit the total amount of memory used by PebblesDB for the TableCache and bloom filters.

When using the specified amount of memory, preference should be given first to the table cache, and then bloom

Problem

Client-rust costs a lot of CPU to copy the structure. And most of this copy and allocation is to copy mutation between TransactionClient and kinds of PlanBuilder.

Solution

I think we can store these Mutation and RegionStore of RegionCache as an Arc Pointer. We only need to clone them before we really call gRPC API to send requests.

There are no external core dependencies other than LZ4 and Snappy which are not used unless compression is configured. So they should be installable.

libraryDependencies += "io.swaydb" %% "lz4" % "version"
//OR 
libraryDependencies += "io.swaydb" %% "snappy" % "version"

For now we have to exclude

It would be better and easier to debug a program if the BytesEncoding and BytesDecoding traits could return any error type.

To do so we need to modify the Error enum and more specifically the Encoding and Decoding variants to wrap a Box<dyn Error>.