1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
|
Return-Path: <byron@mirror.co>
Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org
[172.17.192.35])
by mail.linuxfoundation.org (Postfix) with ESMTPS id 6F1B71E9E
for <bitcoin-dev@lists.linuxfoundation.org>;
Fri, 9 Oct 2015 17:12:00 +0000 (UTC)
X-Greylist: whitelisted by SQLgrey-1.7.6
Received: from mail-yk0-f181.google.com (mail-yk0-f181.google.com
[209.85.160.181])
by smtp1.linuxfoundation.org (Postfix) with ESMTPS id 7A38E63
for <bitcoin-dev@lists.linuxfoundation.org>;
Fri, 9 Oct 2015 17:11:59 +0000 (UTC)
Received: by ykec126 with SMTP id c126so47118796yke.2
for <bitcoin-dev@lists.linuxfoundation.org>;
Fri, 09 Oct 2015 10:11:58 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20130820;
h=x-gm-message-state:mime-version:in-reply-to:references:date
:message-id:subject:from:to:cc:content-type;
bh=UyPaqFuzLdj/BTeHgEel5pwcI0VXHM6uSnRe5StbB0c=;
b=TnSX+uWr8TSqu1pD4oF/NwHp6FgnzrnyqLphS0jjI8Qa4cu0sf+cX9FLXo/OKeSuaT
mTvrRPy1Nlayvxh8D9zAH7fuq/GZb2uFc/tGx+RSmjSffOdkHUHz2WgY3bc4/n+DyqdM
wxffK2Ke07tW2W4nNgkjt6D/I5dLmRfSkvjyu63WZF9T27LXyN9KsHO6PgCHCmRG4MFe
w1TKimiRVBOISz/N8i5+opaKGzk60CegLzOxWjtFl89o7CrkLixESNgV9dNNasYQdRx8
CSI1zIyKKpF7daAMtDnc+btc4pw2RVvJtGtEo7LVl3LKMev/u3xzjSxhR/yPesSZa4wR
tGdA==
X-Gm-Message-State: ALoCoQlrAnwV26MOkYWYZFnvxgzJiItAsoVWsQZ5xQ/Ia4xHKTgK17ITUUY8U0JZZLf8jI1UipoG
MIME-Version: 1.0
X-Received: by 10.129.155.67 with SMTP id s64mr10011080ywg.178.1444410718761;
Fri, 09 Oct 2015 10:11:58 -0700 (PDT)
Received: by 10.37.203.205 with HTTP; Fri, 9 Oct 2015 10:11:58 -0700 (PDT)
Received: by 10.37.203.205 with HTTP; Fri, 9 Oct 2015 10:11:58 -0700 (PDT)
In-Reply-To: <CAF7tpEyPqMVXBmbNcSKKywo=sstWxca+4h6_-Tp3-5t_vofbWA@mail.gmail.com>
References: <CAOVG1oNimYpzSnB7NUuugagufbD1JnZmAWsuXhMjq45dEF=w-g@mail.gmail.com>
<E8AC44C1-310F-44AE-AB5E-63064A3DE1BE@gmail.com>
<CAF7tpEyPqMVXBmbNcSKKywo=sstWxca+4h6_-Tp3-5t_vofbWA@mail.gmail.com>
Date: Fri, 9 Oct 2015 10:11:58 -0700
Message-ID: <CAOVG1oOAUKhzYKfYEd20nXSqy0wcn01cO86oxBRutJJpUj9TjQ@mail.gmail.com>
From: Byron Gibson <byron@mirror.co>
To: Andrew Miller <amiller@cs.umd.edu>
Content-Type: multipart/alternative; boundary=94eb2c0b8fbccd6d780521af1300
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,HTML_MESSAGE,
RCVD_IN_DNSWL_LOW autolearn=ham version=3.3.1
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on
smtp1.linux-foundation.org
Cc: bitcoin-dev@lists.linuxfoundation.org
Subject: Re: [bitcoin-dev] Bitcoin network simulation testing?
X-BeenThere: bitcoin-dev@lists.linuxfoundation.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Bitcoin Development Discussion <bitcoin-dev.lists.linuxfoundation.org>
List-Unsubscribe: <https://lists.linuxfoundation.org/mailman/options/bitcoin-dev>,
<mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=unsubscribe>
List-Archive: <http://lists.linuxfoundation.org/pipermail/bitcoin-dev/>
List-Post: <mailto:bitcoin-dev@lists.linuxfoundation.org>
List-Help: <mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=help>
List-Subscribe: <https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev>,
<mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=subscribe>
X-List-Received-Date: Fri, 09 Oct 2015 17:12:00 -0000
--94eb2c0b8fbccd6d780521af1300
Content-Type: text/plain; charset=UTF-8
Thanks Nina and Andrew, I may have the capability to run a simulator large
scale on many nodes on AWS/GCE, but am looking to optimize the ROI by
selecting categories of experiments that benefit from a more controlled
environment, rather than be invalidated by its divergence/s from livenet.
But wondering if anyone else has already been doing this, would be nice to
collaborate.
Byron Gibson
CoS | http://mirrorx.com/
https://onename.io/bgibson
https://keybase.io/byrongibson
On Oct 6, 2015 14:00, "Andrew Miller" <amiller@cs.umd.edu> wrote:
> Shadow uses virtual time, entirely decoupled from real time. So while it
> may slow down your machine, this would not affect the stats collected
>
> (although it does make shadow somewhat unpleasant to run, unless you have
> a fast machine, compared to abstract simulators that avoid running the
> actual Bitcoin code).
> Hi Byron,
>
> I've been using shadow a bit-- I think these simulators are important for
> testing, but Shadow, at least, certainly seems to have limitations, in some
> crucial respects. Running shadow w Tor (which is only logical, because
> many BCT transactions transpire over Tor) is not as 'light' as presented
> and slows my own box down quite a bit, so the stats can't possibly be
> accurate... I don't know if this answers any questions or if you've had
> this experience at all -- perhaps it is negligible on a more powerful
> machine than my own-- or perhaps there is an adjustment still unaccounted?
>
> Regards,
> Nina K
>
> Sent from my iPhone
>
> On Oct 4, 2015, at 2:04 PM, Byron Gibson via bitcoin-dev <
> bitcoin-dev@lists.linuxfoundation.org> wrote:
>
> Hi all, is anyone using simulators like Shadow (https://shadow.github.io),
> BTCSim (https://github.com/btcsuite/btcsim), etc. to test proposed
> changes to Bitcoin? I have a few questions about their capabilities and
> limitations.
>
> Byron Gibson
> http://mirror.co/
> https://keybase.io/byrongibson
>
>
>
> _______________________________________________
> bitcoin-dev mailing list
> bitcoin-dev@lists.linuxfoundation.org
> https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev
>
>
> _______________________________________________
> bitcoin-dev mailing list
> bitcoin-dev@lists.linuxfoundation.org
> https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev
>
>
--94eb2c0b8fbccd6d780521af1300
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<p dir=3D"ltr">Thanks Nina and Andrew, I may have the capability to run a s=
imulator large scale on many nodes on AWS/GCE, but am looking to optimize t=
he ROI by selecting categories of experiments that benefit from a more cont=
rolled environment, rather than be invalidated by its divergence/s from liv=
enet.=C2=A0 But wondering if anyone else has already been doing this, would=
be nice to collaborate.<br></p>
<p dir=3D"ltr">Byron Gibson<br>
CoS |=C2=A0<a href=3D"http://mirrorx.com/">http://mirrorx.com/</a><br>
<a href=3D"https://onename.io/bgibson">https://onename.io/bgibson</a><br>
<a href=3D"https://keybase.io/byrongibson">https://keybase.io/byrongibson</=
a></p>
<p dir=3D"ltr">=C2=A0=C2=A0=C2=A0</p>
<div class=3D"gmail_quote">On Oct 6, 2015 14:00, "Andrew Miller" =
<<a href=3D"mailto:amiller@cs.umd.edu">amiller@cs.umd.edu</a>> wrote:=
<br type=3D"attribution"><blockquote class=3D"gmail_quote" style=3D"margin:=
0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir=3D"ltr">Shad=
ow uses virtual time, entirely decoupled from real time. So while it may sl=
ow down your machine, this would not affect the stats collected</p>
<p dir=3D"ltr"> (although it does make shadow somewhat unpleasant to run, u=
nless you have a fast machine,=C2=A0 compared to abstract simulators that a=
void running the actual Bitcoin code).</p>
<div style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex=
"><div dir=3D"auto"><div>Hi Byron,=C2=A0</div><div><br></div><div>I've =
been using shadow a bit-- I think these simulators are important for testin=
g, but Shadow, at least, certainly seems to have limitations, in some cruci=
al respects.=C2=A0 Running shadow w Tor (which is only logical, because man=
y BCT transactions transpire over Tor) is not as 'light' as present=
ed and slows my own box down quite a bit, so the stats can't possibly b=
e accurate... I don't know if this answers any questions or if you'=
ve had this experience at all -- perhaps it is negligible on a more powerfu=
l machine than my own-- or perhaps there is an adjustment still unaccounted=
?</div><div><br></div><div>Regards,</div><div>Nina K</div><div><br>Sent fro=
m my iPhone</div><div><br>On Oct 4, 2015, at 2:04 PM, Byron Gibson via bitc=
oin-dev <<a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.org" target=
=3D"_blank">bitcoin-dev@lists.linuxfoundation.org</a>> wrote:<br><br></d=
iv><blockquote type=3D"cite"><div><p dir=3D"ltr">Hi all, is anyone using si=
mulators like Shadow (<a href=3D"https://shadow.github.io" target=3D"_blank=
">https://shadow.github.io</a>), BTCSim (<a href=3D"https://github.com/btcs=
uite/btcsim" target=3D"_blank">https://github.com/btcsuite/btcsim</a>), etc=
. to test proposed changes to Bitcoin?=C2=A0 I have a few questions about t=
heir capabilities and limitations.<br></p>
<p dir=3D"ltr">Byron Gibson<br>
<a href=3D"http://mirror.co/" target=3D"_blank">http://mirror.co/</a><br>
<a href=3D"https://keybase.io/byrongibson" target=3D"_blank">https://keybas=
e.io/byrongibson</a><br></p>
<p dir=3D"ltr">=C2=A0=C2=A0=C2=A0 </p>
</div></blockquote><blockquote type=3D"cite"><div><span>___________________=
____________________________</span><br><span>bitcoin-dev mailing list</span=
><br><span><a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.org" target=
=3D"_blank">bitcoin-dev@lists.linuxfoundation.org</a></span><br><span><a hr=
ef=3D"https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev" targe=
t=3D"_blank">https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev=
</a></span><br></div></blockquote></div><br>_______________________________=
________________<br>
bitcoin-dev mailing list<br>
<a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.org" target=3D"_blank">=
bitcoin-dev@lists.linuxfoundation.org</a><br>
<a href=3D"https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev" =
rel=3D"noreferrer" target=3D"_blank">https://lists.linuxfoundation.org/mail=
man/listinfo/bitcoin-dev</a><br>
<br></div>
</blockquote></div>
--94eb2c0b8fbccd6d780521af1300--
|
