Return-Path: Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org [172.17.192.35]) by mail.linuxfoundation.org (Postfix) with ESMTPS id 4125C1698 for ; Fri, 18 Sep 2015 20:11:55 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from mail.bluematt.me (mail.bluematt.me [192.241.179.72]) by smtp1.linuxfoundation.org (Postfix) with ESMTPS id 789B8A9 for ; Fri, 18 Sep 2015 20:11:54 +0000 (UTC) Received: from [172.17.0.1] (gw.vpn.bluematt.me [162.243.132.6]) by mail.bluematt.me (Postfix) with ESMTPSA id A8BBE584D5; Fri, 18 Sep 2015 20:11:51 +0000 (UTC) To: Alex Morcos , Patrick Strateman References: <5D55F6EC-801B-4607-882F-B76CF57298B1@gmail.com> <55FC6951.9010704@gmail.com> From: Matt Corallo Message-ID: <55FC6FF5.7090400@mattcorallo.com> Date: Fri, 18 Sep 2015 20:11:33 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.1.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.linux-foundation.org Cc: Bitcoin Dev Subject: Re: [bitcoin-dev] Hash of UTXO set as consensus-critical X-BeenThere: bitcoin-dev@lists.linuxfoundation.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Bitcoin Development Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2015 20:11:55 -0000 I believe the discussion here is on improving initial-sync time by simply skipping initial-sync and getting a committed-to utxo set. This is obviously a new security model in between SPV and full-node (I would call it SPV with future validation). Still, I'm not convinced it buys us anything, we really should just tweak Bitcoin Core to do spv mode at startup and validate backwards in the background. I think this would alleviate most of the concerns raised, given the chain growth is not entirely unreasonable going forward. On 09/18/15 20:07, Alex Morcos via bitcoin-dev wrote: > I guess I always assumed that UTXO set commitments were an alternative > security model (between SPV and full-node), not that they would cause > the existing security model to be deprecated. > > > On Fri, Sep 18, 2015 at 3:43 PM, Patrick Strateman via bitcoin-dev > > wrote: > > Full nodes using UTXO set commitments is a change to the bitcoin > security model. > > Currently an attacker with >50% of the network hashrate can rewrite > history. > > If full nodes rely on UTXO set commitments such an attacker could create > an infinite number of bitcoins (as in many times more than the current > 21 million bitcoin limit). > > Before we consider mechanisms for UTXO set commitments, we should > seriously discuss whether the security model reduction is reasonable. > > On 09/18/2015 12:05 PM, Rune Kjær Svendsen via bitcoin-dev wrote: > > Currently, when a new node wants to join the network, it needs to > retrieve the entire blockchain history, starting from January 2009 > and up until now, in order to derive a UTXO set that it can verify > new blocks/transactions against. With a blockchain size of 40GB and > a UTXO size of around 1GB, the extra bandwidth required is > significant, and will keep increasing indefinitely. If a newly mined > block were to include the UTXO set hash of the chain up until the > previous block — the hash of the UTXO set on top of which this block > builds — then new nodes, who want to know whether a transaction is > valid, would be able to acquire the UTXO set in a trustless manner, > by only verifying proof-of-work headers, and knowing that a block > with an invalid UTXO set hash would be rejected. > > > > I’m not talking about calculating a complicated tree structure > from the UTXO set, which would put further burden on already > burdened Bitcoin Core nodes. We simply include the hash of the > current UTXO set in a newly created block, such that the > transactions in the new block build *on top* of the UTXO set whose > hash is specified. This actually alleviates Bitcoin Core nodes, as > it will now become possible for nodes without the entire blockchain > to answer SPV queries (by retrieving the UTXO set trustlessly and > using this to answer queries). It also saves bandwidth for Bitcore > Core nodes, who only need to send roughly 1GB of data, in order to > synchronise a node, rather than 40GB+. I will continue to run a full > Bitcoin Core node, saving the entire blockchain history, but it > shouldn’t be a requirement to hold the entire transaction history in > order to start verifying new transactions. > > > > As far as I can see, this also forces miners to actually maintain > an UTXO set, rather than just build on top of the chain with the > most proof-of-work. Producing a UTXO set and verifying a block > against a chain is the same thing, so by including the hash of the > UTXO set we force miners to verify the block that they want to build > on top of. > > > > Am I missing something obvious, because as far as I can see, this > solves the problem of quadratic time complexity for initial sync: > http://www.youtube.com/watch?v=TgjrS-BPWDQ&t=2h02m12s > > > > The only added step to verifying a block is to hash the UTXO set. > So it does require additional computation, but most modern CPUs have > a SHA256 throughput of around 500 MB/s, which means it takes only > two seconds to hash the UTXO set. And this can be improved further > (GPUs can do 2-3 GB/s). A small sacrifice for the added ease of > initial syncing, in my opinion. > > > > /Rune > > _______________________________________________ > > bitcoin-dev mailing list > > bitcoin-dev@lists.linuxfoundation.org > > > https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev > > > _______________________________________________ > bitcoin-dev mailing list > bitcoin-dev@lists.linuxfoundation.org > > https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev > > > > > _______________________________________________ > bitcoin-dev mailing list > bitcoin-dev@lists.linuxfoundation.org > https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev >