diff options
| author | Mark Friedenbach <mark@monetize.io> | 2013-09-17 10:08:54 -0700 |
|---|---|---|
| committer | bitcoindev <bitcoindev@gnusha.org> | 2013-09-17 17:33:15 +0000 |
| commit | b622f274e71c42a04ed4f11b982003104b1aae9d (patch) | |
| tree | 8a5be90b4f022b09c7b5e6086c4bcbb7534ab930 | |
| parent | 5cebd5fc10708824a9089221bdd8b7182468114d (diff) | |
| download | pi-bitcoindev-b622f274e71c42a04ed4f11b982003104b1aae9d.tar.gz pi-bitcoindev-b622f274e71c42a04ed4f11b982003104b1aae9d.zip | |
Re: [Bitcoin-development] Faster databases than LevelDB
| -rw-r--r-- | 8f/cf2f7591ade9dbddfaade883523d71a3c66bad | 156 |
1 files changed, 156 insertions, 0 deletions
diff --git a/8f/cf2f7591ade9dbddfaade883523d71a3c66bad b/8f/cf2f7591ade9dbddfaade883523d71a3c66bad new file mode 100644 index 000000000..e1d79db6e --- /dev/null +++ b/8f/cf2f7591ade9dbddfaade883523d71a3c66bad @@ -0,0 +1,156 @@ +Received: from sog-mx-1.v43.ch3.sourceforge.com ([172.29.43.191] + helo=mx.sourceforge.net) + by sfs-ml-2.v29.ch3.sourceforge.com with esmtp (Exim 4.76) + (envelope-from <mark@monetize.io>) id 1VLz9H-0003km-RA + for bitcoin-development@lists.sourceforge.net; + Tue, 17 Sep 2013 17:33:15 +0000 +Received: from mail-pd0-f170.google.com ([209.85.192.170]) + by sog-mx-1.v43.ch3.sourceforge.com with esmtps (TLSv1:RC4-SHA:128) + (Exim 4.76) id 1VLz9E-00071e-0S + for bitcoin-development@lists.sourceforge.net; + Tue, 17 Sep 2013 17:33:15 +0000 +Received: by mail-pd0-f170.google.com with SMTP id x10so5920220pdj.15 + for <bitcoin-development@lists.sourceforge.net>; + Tue, 17 Sep 2013 10:33:05 -0700 (PDT) +X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; + d=1e100.net; s=20130820; + h=x-gm-message-state:message-id:date:from:organization:user-agent + :mime-version:to:subject:references:in-reply-to:content-type + :content-transfer-encoding; + bh=FZxvAnP/9LnSMxP49VaMMMkwkpWAEnSFMoWNe/91PRc=; + b=NxsSOYNg4l5pYsl+mM+ANcRCIpPVa7xxwdPA/+GoNiZ3Sv5BbEgKc+pUuP9+qDCq8M + 6B9XY9JOD+Zu1fD1NrhuwW2x71xTlg3z36xnr00t2Oo1t2Futa5VrrJQYrUa4VLUiwE7 + 9WPU2ipsI62erZgu9u2TF8VfAz37rso09pGJtOiOqtaUIWsd9evC4PBw5PRN1iHWKGJF + VACXU5d+gyNS3rD7DVq/vIVidmcDVFUYcsycemQCMfV729+bIc46NW2jrGr800IibDVO + W7/EEiZjWy3jRCbDIxFaRS05prkHuIQic9N7wPlVhL0W5QsUei/4fNtyTfoc7EUNmqHl + kkMQ== +X-Gm-Message-State: ALoCoQn5yGVHlRIC4DBl0MXJON17YuRZ/bQ8hmRpWVBJBGBTsosyhx2n885Ukf8QQFfpYRVGtHDF +X-Received: by 10.68.178.227 with SMTP id db3mr2845577pbc.202.1379437735440; + Tue, 17 Sep 2013 10:08:55 -0700 (PDT) +Received: from phobos.local (50-0-36-150.dsl.dynamic.sonic.net. [50.0.36.150]) + by mx.google.com with ESMTPSA id + pu5sm47329265pac.21.1969.12.31.16.00.00 + (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); + Tue, 17 Sep 2013 10:08:54 -0700 (PDT) +Message-ID: <52388CA6.2050709@monetize.io> +Date: Tue, 17 Sep 2013 10:08:54 -0700 +From: Mark Friedenbach <mark@monetize.io> +Organization: Monetize.io Inc. +User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; + rv:17.0) Gecko/20130801 Thunderbird/17.0.8 +MIME-Version: 1.0 +To: bitcoin-development@lists.sourceforge.net +References: <CANEZrP1ksdGfB-282giysF-2Lo==NiD-nBdon5FJ9wLBLmX=TA@mail.gmail.com> +In-Reply-To: <CANEZrP1ksdGfB-282giysF-2Lo==NiD-nBdon5FJ9wLBLmX=TA@mail.gmail.com> +X-Enigmail-Version: 1.5.2 +Content-Type: text/plain; charset=ISO-8859-1 +Content-Transfer-Encoding: 7bit +X-Spam-Score: 0.0 (/) +X-Spam-Report: Spam Filtering performed by mx.sourceforge.net. + See http://spamassassin.org/tag/ for more details. + -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/, + no trust [209.85.192.170 listed in list.dnswl.org] +X-Headers-End: 1VLz9E-00071e-0S +Subject: Re: [Bitcoin-development] Faster databases than LevelDB +X-BeenThere: bitcoin-development@lists.sourceforge.net +X-Mailman-Version: 2.1.9 +Precedence: list +List-Id: <bitcoin-development.lists.sourceforge.net> +List-Unsubscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>, + <mailto:bitcoin-development-request@lists.sourceforge.net?subject=unsubscribe> +List-Archive: <http://sourceforge.net/mailarchive/forum.php?forum_name=bitcoin-development> +List-Post: <mailto:bitcoin-development@lists.sourceforge.net> +List-Help: <mailto:bitcoin-development-request@lists.sourceforge.net?subject=help> +List-Subscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>, + <mailto:bitcoin-development-request@lists.sourceforge.net?subject=subscribe> +X-List-Received-Date: Tue, 17 Sep 2013 17:33:16 -0000 + +-----BEGIN PGP SIGNED MESSAGE----- +Hash: SHA1 + +Also somewhat related, I have been looking for some time now to +abstract out the UTXO and block databases so that a variety of +key/value stores could be used as a backend, configured by a command +line parameter. In particular, it would be interesting for some server +applications to support HyperDex, which is basically a distributed, +fault-tolerant version of LevelDB: + +http://hyperdex.org/ + +By the same mechanism you could just as easily support a Sophia backend. + +Mark + + +On 9/17/13 4:00 AM, Mike Hearn wrote: +> LevelDB is fast - very fast if you give it enough CPU time and +> disk seeks. But it's not the last word in performance. +> +> HyperLevelDB is a forked LevelDB with some changes, mostly, finer +> grained locking and changes to how compaction works: +> +> http://hyperdex.org/performance/leveldb/ +> +> However, it comes with a caveat - one of the changes they made is +> to take away write throttling if compaction falls behind, the app +> itself is expected to do that. +> +> Sophia is a competitor to LevelDB. The website claims that in +> benchmarks it completely smokes LevelDB. I have not explored how it +> does this or tried to replicate their benchmarks myself: +> +> http://sphia.org/index.html http://sphia.org/benchmarks.html +> +> It's written in C and BSD licensed. +> +> As an example of the kind of speedup they claim to be capable of, +> they say LevelDB could do 167,476 random reads per second on their +> SSD based machine. Sophia could do 438,084 reads/sec. Random reads +> are of course the most interesting for us because that's what UTXO +> lookups involve. +> +> They also compare against HyperLevelDB, where the differences are +> much less pronounced and actually HyperLevelDB appears to be able +> to do random writes faster than Sophia. +> +> +> +> +> ------------------------------------------------------------------------------ +> +> +LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99! +> 1,500+ hours of tutorials including VisualStudio 2012, Windows 8, +> SharePoint 2013, SQL 2012, MVC 4, more. BEST VALUE: New +> Multi-Library Power Pack includes Mobile, Cloud, Java, and UX +> Design. Lowest price ever! Ends 9/20/13. +> http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk +> +> +> +> +> _______________________________________________ Bitcoin-development +> mailing list Bitcoin-development@lists.sourceforge.net +> https://lists.sourceforge.net/lists/listinfo/bitcoin-development +> +-----BEGIN PGP SIGNATURE----- +Version: GnuPG/MacGPG2 v2.0.19 (Darwin) +Comment: GPGTools - http://gpgtools.org +Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ + +iQIcBAEBAgAGBQJSOIymAAoJEAdzVfsmodw4H48QALC+ae4wRLEg3lrg9sgayfOn +ukLM079PXgEbARFPt6WxkLnNGYzEbb7IzT0uvaKH4VIW/rrORy9VqNPmliF+834h +XygUwfAzU04K/oLyCsdWZcOugj2P8aufNeA6whLS5IijDLtHb3Ueu4ORNcfLBGqp +KKfqPj0QHseusiLJ9f3IW+LrdM1vAoT1jryTngpQy2i+qFFDM6CN3THCq4adJvjr +AnYlfLoJSZ0/obz/krwLv6vP1BbwxXzv5CfD0Q2bdoEV/EgWDP3Bd5tUzUCjj53/ +qMmhaACoVlarohh64s3JNSDSkHDFSbHFt65ZgNQbNY1wmSeyilQcd8FGWOF/WRzW +Z/pl2IdhoCm3t86xSggRGivj/EVeBJlD36i7ohpDbVWFPsf6B4e5M6xSdso/2WBp +fr55TwehCaGE+UHa0gITkE/si1txvY4gti0bLNvwFDEcZ3qsXRsz4CyLlZLMBbPX +4aRNGyqv2yJ2AivkEyNOUugo1Q8RKEKZWfWWDecI53DHdebzKX1zu9GLJwlGJqGw +Qzm7Tdb7S8J/D6IIHf4Xq2LDhQ2fnPylmGSmtuVFEMxeDhmdbNqKSr3kqlWQf3T8 +Oa8bm6kUQFJ+11jLEkVEGZJC4e42+faQBxR+CsqvVsTEezDCP1dE7D3QV8ry9YBc +DwXt3299Q03B5LoxpWTq +=KseH +-----END PGP SIGNATURE----- + + |