1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
|
Received: from sog-mx-1.v43.ch3.sourceforge.com ([172.29.43.191]
helo=mx.sourceforge.net)
by sfs-ml-1.v29.ch3.sourceforge.com with esmtp (Exim 4.76)
(envelope-from <kiwigb@yahoo.com>) id 1YsHkl-0006oy-6N
for bitcoin-development@lists.sourceforge.net;
Tue, 12 May 2015 21:30:15 +0000
Received-SPF: pass (sog-mx-1.v43.ch3.sourceforge.com: domain of yahoo.com
designates 98.139.213.74 as permitted sender)
client-ip=98.139.213.74; envelope-from=kiwigb@yahoo.com;
helo=nm26-vm0.bullet.mail.bf1.yahoo.com;
Received: from nm26-vm0.bullet.mail.bf1.yahoo.com ([98.139.213.74])
by sog-mx-1.v43.ch3.sourceforge.com with esmtps (TLSv1:RC4-SHA:128)
(Exim 4.76) id 1YsHkj-0004Ix-Fa
for bitcoin-development@lists.sourceforge.net;
Tue, 12 May 2015 21:30:15 +0000
Received: from [98.139.215.143] by nm26.bullet.mail.bf1.yahoo.com with NNFMP;
12 May 2015 21:30:08 -0000
Received: from [68.142.230.75] by tm14.bullet.mail.bf1.yahoo.com with NNFMP;
12 May 2015 21:30:07 -0000
Received: from [127.0.0.1] by smtp232.mail.bf1.yahoo.com with NNFMP;
12 May 2015 21:30:07 -0000
X-Yahoo-Newman-Id: 924011.49175.bm@smtp232.mail.bf1.yahoo.com
X-Yahoo-Newman-Property: ymail-3
X-YMail-OSG: yJtsQgsVM1muPkifaVs0_caKbH5iUWBSxvCwJbuOzhNOcQm
Gp5xHe3oGod_djTdivhcHQsYhYBH4P.V.O39QNrsw3Q1HvUwhXpih9oNKAZy
DVdu3H.wyAr.CxdgY9_G4_sJ7KmawOGm4LeDQA8KOiVKPxvnDAHIKz4ormJJ
NdSWJaip2hNHGx7AgQgv1p8M1HVvaBNh1ThE2kwEtLQ8dpV4o.TxEYkIQMka
tbwOVTSA.SvxC5SNL_MHDdRkoIpz2xH0.pRNXoOZ46q.tRNilONIl5LA6opY
ohsLaxm.Sgr.XQYezkm6hESBdKYERCbqHDMUMO8NCquqaTY8uHUoi1eHV7Vx
vFPtK8Fm8qPqlBOGx3vF6vdPmaH4rvSknWcuPEiWDJcIhbLiVr.0qggWHCgR
jHfkVyqSNddlZmyErbwYXliEat.EpZ70qI_Xv1Yl3kcJFVHdQ.2vrH01Rr9R
7Uo3iHRPStpJZucAF3AQ928CRjM6OUidmMnJRhqzCfSsivDvvwl5sessV4H7
QwlVyHL7sQRKhJxtTzv_1StAcl_NLkRpi9g6ssw--
X-Yahoo-SMTP: kMAkG6uswBCBwEfDAoIbXivsMA--
Message-ID: <1431466203.2049.15.camel@yahoo.com>
From: gb <kiwigb@yahoo.com>
To: gabe appleton <gappleto97@gmail.com>
Date: Wed, 13 May 2015 09:30:03 +1200
In-Reply-To: <CANJO25JqoidjKEmi1wv-ACBm6eB-B=g3r5kurLK5O0Gx5orJmA@mail.gmail.com>
References: <CANJO25J1WRHtfQLVXUB2s_sjj39pTPWmixAcXNJ3t-5os8RPmQ@mail.gmail.com>
<CANJO25JTtfmfsOQYOzJeksJn3CoKE3W8iLGsRko-_xd4XhB3ZA@mail.gmail.com>
<CAJHLa0O5OxaX5g3u=dnCY6Lz_gK3QZgQEPNcWNVRD4JziwAmvg@mail.gmail.com>
<20150512171640.GA32606@savin.petertodd.org>
<CAE-z3OV3VdSoiTSfASwYHr1CjZSqio303sqGq_1Y9yaYgov2sw@mail.gmail.com>
<CAAS2fgRzGkcJbWbJmFN2-NSJGUcLdPKp0q7FjM0x7WDvHoRq=g@mail.gmail.com>
<CANJO25+qURmDzsMgnm7+tsw7icFO--gWhmKmQPuNQCoh_R2big@mail.gmail.com>
<CAJHLa0PDbxuqRHuGNhsyvLpAaDq=ZHSg_u-Sb7FqNVnYrhFkFg@mail.gmail.com>
<CANJO25JqoidjKEmi1wv-ACBm6eB-B=g3r5kurLK5O0Gx5orJmA@mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"
X-Mailer: Evolution 3.12.11 (3.12.11-1.fc21)
Mime-Version: 1.0
Content-Transfer-Encoding: 7bit
X-Spam-Score: -1.6 (-)
X-Spam-Report: Spam Filtering performed by mx.sourceforge.net.
See http://spamassassin.org/tag/ for more details.
-1.5 SPF_CHECK_PASS SPF reports sender host as permitted sender for
sender-domain
0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider
(kiwigb[at]yahoo.com)
-0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/,
no trust [98.139.213.74 listed in list.dnswl.org]
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-0.0 SPF_PASS SPF: sender matches SPF record
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from
author's domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature,
not necessarily valid
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature
X-Headers-End: 1YsHkj-0004Ix-Fa
Cc: Bitcoin Dev <bitcoin-development@lists.sourceforge.net>
Subject: Re: [Bitcoin-development] [Bulk] Re: Proposed additional options
for pruned nodes
X-BeenThere: bitcoin-development@lists.sourceforge.net
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: <bitcoin-development.lists.sourceforge.net>
List-Unsubscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>,
<mailto:bitcoin-development-request@lists.sourceforge.net?subject=unsubscribe>
List-Archive: <http://sourceforge.net/mailarchive/forum.php?forum_name=bitcoin-development>
List-Post: <mailto:bitcoin-development@lists.sourceforge.net>
List-Help: <mailto:bitcoin-development-request@lists.sourceforge.net?subject=help>
List-Subscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>,
<mailto:bitcoin-development-request@lists.sourceforge.net?subject=subscribe>
X-List-Received-Date: Tue, 12 May 2015 21:30:15 -0000
This seems like a good place to add in an idea I had about
partially-connected nodes that are able to throttle bandwidth demands.
While we will be having partial-blockchain nodes with a spectrum of
storage options the requirement to be connected is somewhat binary, I
think many users manually throttle by turning nodes on/off already with
a minimum to just keep the chain up to date. A throttling option would
leverage on bitcoin's asychronous design to reduce bandwidth demands for
weaker nodes.
So throttling to allow for a spectrum of bandwidth connectivity:
1) an option for the user -throttle=XXX that would allow the user to
specify a desirable total bandwidth XXX in Gbytes/day the bitcoin client
can use.
2) the client reduces the number of continuous connections, transaction
or block relaying to achieve the desired throttling rate
3) it could do this by being partially connected throughout the duty
cycle or cycling the node on/off for a percentage of a 24(?) hr period
4) have an auto setting where some smart traffic management 'just takes
care of it' and manual settings that can be user configured
5) reduces minimum requirement for any 24(?) hr period it has received a
full copy of all blocks to remain fully-validating
Not sure if anyone has bought such an idea forward or if there are
obvious holes, so pre-emptive apologies for time-wasting if so.
On Tue, 2015-05-12 at 15:43 -0400, gabe appleton wrote:
> Yet this holds true in our current assumptions of the network as well:
> that it will become a collection of pruned nodes with a few storage
> nodes.
>
> A hybrid option makes this better, because it spreads the risk, rather
> than concentrating it in full nodes.
>
> On May 12, 2015 3:38 PM, "Jeff Garzik" <jgarzik@bitpay.com> wrote:
> One general problem is that security is weakened when an
> attacker can DoS a small part of the chain by DoS'ing a small
> number of nodes - yet the impact is a network-wide DoS because
> nobody can complete a sync.
>
>
>
> On Tue, May 12, 2015 at 12:24 PM, gabe appleton
> <gappleto97@gmail.com> wrote:
> 0, 1, 3, 4, 5, 6 can be solved by looking at chunks
> chronologically. Ie, give the signed (by sender) hash
> of the first and last block in your range. This is
> less data dense than the idea above, but it might work
> better.
>
> That said, this is likely a less secure way to do it.
> To improve upon that, a node could request a block of
> random height within that range and verify it, but
> that violates point 2. And the scheme in itself
> definitely violates point 7.
>
> On May 12, 2015 3:07 PM, "Gregory Maxwell"
> <gmaxwell@gmail.com> wrote:
> It's a little frustrating to see this just
> repeated without even
> paying attention to the desirable
> characteristics from the prior
> discussions.
>
> Summarizing from memory:
>
> (0) Block coverage should have locality;
> historical blocks are
> (almost) always needed in contiguous ranges.
> Having random peers
> with totally random blocks would be horrific
> for performance; as you'd
> have to hunt down a working peer and make a
> connection for each block
> with high probability.
>
> (1) Block storage on nodes with a fraction of
> the history should not
> depend on believing random peers; because
> listening to peers can
> easily create attacks (e.g. someone could
> break the network; by
> convincing nodes to become unbalanced) and not
> useful-- it's not like
> the blockchain is substantially different for
> anyone; if you're to the
> point of needing to know coverage to fill then
> something is wrong.
> Gaps would be handled by archive nodes, so
> there is no reason to
> increase vulnerability by doing anything but
> behaving uniformly.
>
> (2) The decision to contact a node should need
> O(1) communications,
> not just because of the delay of chasing
> around just to find who has
> someone; but because that chasing process
> usually makes the process
> _highly_ sybil vulnerable.
>
> (3) The expression of what blocks a node has
> should be compact (e.g.
> not a dense list of blocks) so it can be
> rumored efficiently.
>
> (4) Figuring out what block (ranges) a peer
> has given should be
> computationally efficient.
>
> (5) The communication about what blocks a node
> has should be compact.
>
> (6) The coverage created by the network should
> be uniform, and should
> remain uniform as the blockchain grows;
> ideally it you shouldn't need
> to update your state to know what blocks a
> peer will store in the
> future, assuming that it doesn't change the
> amount of data its
> planning to use. (What Tier Nolan proposes
> sounds like it fails this
> point)
>
> (7) Growth of the blockchain shouldn't cause
> much (or any) need to
> refetch old blocks.
>
> I've previously proposed schemes which come
> close but fail one of the above.
>
> (e.g. a scheme based on reservoir sampling
> that gives uniform
> selection of contiguous ranges, communicating
> only 64 bits of data to
> know what blocks a node claims to have,
> remaining totally uniform as
> the chain grows, without any need to refetch
> -- but needs O(height)
> work to figure out what blocks a peer has from
> the data it
> communicated.; or another scheme based on
> consistent hashes that has
> log(height) computation; but sometimes may
> result in a node needing to
> go refetch an old block range it previously
> didn't store-- creating
> re-balancing traffic.)
>
> So far something that meets all those criteria
> (and/or whatever ones
> I'm not remembering) has not been discovered;
> but I don't really think
> much time has been spent on it. I think its
> very likely possible.
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications
> across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with
> 50+ applications
> Performance metrics, stats and reports that
> give you Actionable Insights
> Deep dive visibility with transaction tracing
> using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Bitcoin-development mailing list
> Bitcoin-development@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bitcoin-development
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across
> Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+
> applications
> Performance metrics, stats and reports that give you
> Actionable Insights
> Deep dive visibility with transaction tracing using
> APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Bitcoin-development mailing list
> Bitcoin-development@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bitcoin-development
>
>
>
>
>
> --
> Jeff Garzik
> Bitcoin core developer and open source evangelist
> BitPay, Inc. https://bitpay.com/
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________ Bitcoin-development mailing list Bitcoin-development@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bitcoin-development
|
