Received: from sog-mx-2.v43.ch3.sourceforge.com ([172.29.43.192] helo=mx.sourceforge.net) by sfs-ml-2.v29.ch3.sourceforge.com with esmtp (Exim 4.76) (envelope-from ) id 1TJTCM-0005SF-F4 for bitcoin-development@lists.sourceforge.net; Wed, 03 Oct 2012 17:57:30 +0000 Received-SPF: pass (sog-mx-2.v43.ch3.sourceforge.com: domain of gmail.com designates 209.85.216.175 as permitted sender) client-ip=209.85.216.175; envelope-from=imichaelmiers@gmail.com; helo=mail-qc0-f175.google.com; Received: from mail-qc0-f175.google.com ([209.85.216.175]) by sog-mx-2.v43.ch3.sourceforge.com with esmtps (TLSv1:RC4-SHA:128) (Exim 4.76) id 1TJTCL-0005bL-Pq for bitcoin-development@lists.sourceforge.net; Wed, 03 Oct 2012 17:57:30 +0000 Received: by qcsj3 with SMTP id j3so3746043qcs.34 for ; Wed, 03 Oct 2012 10:57:24 -0700 (PDT) Received: by 10.224.138.143 with SMTP id a15mr8607948qau.64.1349287044435; Wed, 03 Oct 2012 10:57:24 -0700 (PDT) MIME-Version: 1.0 Sender: imichaelmiers@gmail.com Received: by 10.49.30.40 with HTTP; Wed, 3 Oct 2012 10:57:04 -0700 (PDT) In-Reply-To: References: From: Ian Miers Date: Wed, 3 Oct 2012 13:57:04 -0400 X-Google-Sender-Auth: Z0dgkRUYo4LjEFLbgMkpQDeIF2Q Message-ID: To: Jeff Garzik Content-Type: multipart/alternative; boundary=20cf3074d77cfbcd9c04cb2b5edb X-Spam-Score: -0.5 (/) X-Spam-Report: Spam Filtering performed by mx.sourceforge.net. See http://spamassassin.org/tag/ for more details. -1.5 SPF_CHECK_PASS SPF reports sender host as permitted sender for sender-domain 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (imichaelmiers[at]gmail.com) -0.0 SPF_PASS SPF: sender matches SPF record 1.0 HTML_MESSAGE BODY: HTML included in message 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Headers-End: 1TJTCL-0005bL-Pq Cc: bitcoin-development@lists.sourceforge.net Subject: Re: [Bitcoin-development] performance testing for bitcoin X-BeenThere: bitcoin-development@lists.sourceforge.net X-Mailman-Version: 2.1.9 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Oct 2012 17:57:30 -0000 --20cf3074d77cfbcd9c04cb2b5edb Content-Type: text/plain; charset=ISO-8859-1 Script evaluation performance was what I was primarily concerned with. I'm fooling around with adding some new instruction types. The tricky part is that to test how that effects performance, you need to be able to intersperse transactions with the new instructions with existing ones. For accuracy, you'd like your simulated traffic to at least approximate the real world traffic. Also, is there any bench-marking / instrumentation in bitcoind ? Ian On Wed, Oct 3, 2012 at 1:43 PM, Jeff Garzik wrote: > On Wed, Oct 3, 2012 at 1:38 PM, Ian Miers wrote: > > Whats the best way to get performance numbers for modifications to > bitcoin ? > > Profiling it while running on testnet might work, but that would take a > > rather long time to get data. > > Is there anyway to speed this up if we only needed to provide relative > > performance between tests. (in a sense a fast performance regression > test). > > You have to be specific about what you're measuring, because > "performance" is vague. > > You can measure many aspects of blockchain performance by importing > blocks via -loadblock=FILE. > > Other performance measurements like "how fast does a block relay > through the network" cannot be as easily measured. > > -- > Jeff Garzik > exMULTI, Inc. > jgarzik@exmulti.com > --20cf3074d77cfbcd9c04cb2b5edb Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Script evaluation performance was what I was=A0primarily=A0concerned with. = =A0I'm fooling around with adding some new instruction types.
The t= ricky part is that to test how that effects performance, you need to be abl= e to=A0intersperse=A0transactions=A0with the new instructions with existing= ones. =A0For accuracy, you'd like your simulated traffic to at least a= pproximate the real world traffic.


Also, is there any=A0bench-marking=A0/ i= nstrumentation in bitcoind ?=A0

Ian
On Wed, Oct 3, 2= 012 at 1:43 PM, Jeff Garzik <jgarzik@exmulti.com> wrote:
On Wed, Oct 3, 2012 at 1:38 PM, Ian Miers <imiers1@jhu.edu> wrote:
> Whats the best way to get performance numbers for modifications to bit= coin ?
> Profiling it while running on testnet might work, but that would take = a
> rather long time to get data.
> Is there anyway to speed this up =A0if we only needed to provide =A0re= lative
> performance between tests. (in a sense a fast performance regression t= est).

You have to be specific about what you're measuring, because
"performance" is vague.

You can measure many aspects of blockchain performance by importing
blocks via -loadblock=3DFILE.

Other performance measurements like "how fast does a block relay
through the network" cannot be as easily measured.

--
Jeff Garzik
exMULTI, Inc.
jgarzik@exmulti.co= m

--20cf3074d77cfbcd9c04cb2b5edb--