You are reading content from Scuttlebutt
@nop
Voted # LSM Tree Design As I am doing some research on modern database design, i
@floppyGee
Subscribed to channel #database
@cel
Voted # LSM Tree Design As I am doing some research on modern database design, i
@hoodownr
Voted # LSM Tree Design As I am doing some research on modern database design, i
@jiangplus

LSM Tree Design

As I am doing some research on modern database design, it is amazing to learn about the new improvements on LSM tree data structure. Here I will share some of them:

@Dominic
Re: %VmYxzi3Qs

I think the api I'd want, is something like,
pass a replicate(copy_db, function (opts) { return source_db.stream(opts) }, cb)

pass in the stream function, handling reconnects etc, so it's possible to use over any pull-stream.

@Dominic
Re: %VmYxzi3Qs

looks good! is index.js ment to be empty?

@Dominic
Re: %7NH8QplyH

If you just wanted to take a replica of the entire log, that would be super easy. You'd just read the current log position, then do log.stream({gt: since}) and append those to the secondary log. you'd need to make sure the records are in the same order, so that all the offsets (i.e. log keys) are all the same.

I'm also thinking about view replication - so an index/view can be replicated to a client - a log copy is basically the same problem.

@bobhaugen
Voted We've been trying it out it as a replacement for Firebase and DynamoDB. It'
@nichoth
Re: %B/udGEbEx

thanks @neftaly. I started trying out rethink last night. It seems like such a good DB, it makes me wonder why it is not hyped more.


Show whole feed
Join Scuttlebutt now