Received-SPF: pass (sog-mx-1.v43.ch3.sourceforge.com: domain of gmail.com
	designates 209.85.214.53 as permitted sender)
	client-ip=209.85.214.53; envelope-from=mh.in.england@gmail.com;
	helo=mail-bk0-f53.google.com; 
MIME-Version: 1.0
Sender: mh.in.england@gmail.com
Date: Tue, 17 Sep 2013 13:00:04 +0200
Message-ID: <CANEZrP1ksdGfB-282giysF-2Lo==NiD-nBdon5FJ9wLBLmX=TA@mail.gmail.com>
From: Mike Hearn <mike@plan99.net>
To: Bitcoin Dev <bitcoin-development@lists.sourceforge.net>
Content-Type: multipart/alternative; boundary=20cf30223b1321abc604e6923924
Subject: [Bitcoin-development] Faster databases than LevelDB
Precedence: list

--20cf30223b1321abc604e6923924
Content-Type: text/plain; charset=UTF-8

LevelDB is fast - very fast if you give it enough CPU time and disk seeks.
But it's not the last word in performance.

HyperLevelDB is a forked LevelDB with some changes, mostly, finer grained
locking and changes to how compaction works:

http://hyperdex.org/performance/leveldb/

However, it comes with a caveat - one of the changes they made is to take
away write throttling if compaction falls behind, the app itself is
expected to do that.

Sophia is a competitor to LevelDB. The website claims that in benchmarks it
completely smokes LevelDB. I have not explored how it does this or tried to
replicate their benchmarks myself:

http://sphia.org/index.html
http://sphia.org/benchmarks.html

It's written in C and BSD licensed.

As an example of the kind of speedup they claim to be capable of, they say
LevelDB could do 167,476 random reads per second on their SSD based
machine. Sophia could do 438,084 reads/sec. Random reads are of course the
most interesting for us because that's what UTXO lookups involve.

They also compare against HyperLevelDB, where the differences are much less
pronounced and actually HyperLevelDB appears to be able to do random writes
faster than Sophia.

--20cf30223b1321abc604e6923924
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">LevelDB is fast - very fast if you give it enough CPU time=
 and disk seeks. But it&#39;s not the last word in performance.<div><br></d=
iv><div>HyperLevelDB is a forked LevelDB with some changes, mostly, finer g=
rained locking and changes to how compaction works:</div>
<div><br></div><div><a href=3D"http://hyperdex.org/performance/leveldb/">ht=
tp://hyperdex.org/performance/leveldb/</a><br></div><div><br></div><div>How=
ever, it comes with a caveat - one of the changes they made is to take away=
 write throttling if compaction falls behind, the app itself is expected to=
 do that.</div>
<div><br></div><div>Sophia is a competitor to LevelDB. The website claims t=
hat in benchmarks it completely smokes LevelDB. I have not explored how it =
does this or tried to replicate their benchmarks myself:</div><div><br>
</div><div><a href=3D"http://sphia.org/index.html">http://sphia.org/index.h=
tml</a><br></div><div><a href=3D"http://sphia.org/benchmarks.html">http://s=
phia.org/benchmarks.html</a><br></div><div><br></div><div>It&#39;s written =
in C and BSD licensed.</div>
<div><br></div><div>As an example of the kind of speedup they claim to be c=
apable of, they say LevelDB could do 167,476 random reads per second on the=
ir SSD based machine. Sophia could do 438,084 reads/sec. Random reads are o=
f course the most interesting for us because that&#39;s what UTXO lookups i=
nvolve.</div>
<div><br></div><div>They also compare against HyperLevelDB, where the diffe=
rences are much less pronounced and actually HyperLevelDB appears to be abl=
e to do random writes faster than Sophia.</div><div><br></div><div><br>
</div></div>

--20cf30223b1321abc604e6923924--