summaryrefslogtreecommitdiff
path: root/a6/f1b12c3ed9006d970c78e9049b96a9be3d3140
blob: 9579b4bc626c81b8dde7c0d4b4e1026d9ad02bcb (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
Received: from sog-mx-4.v43.ch3.sourceforge.com ([172.29.43.194]
	helo=mx.sourceforge.net)
	by sfs-ml-3.v29.ch3.sourceforge.com with esmtp (Exim 4.76)
	(envelope-from <g.rowe.froot@gmail.com>) id 1Swx0B-0003bo-Fl
	for bitcoin-development@lists.sourceforge.net;
	Thu, 02 Aug 2012 15:07:51 +0000
Received-SPF: pass (sog-mx-4.v43.ch3.sourceforge.com: domain of gmail.com
	designates 209.85.220.175 as permitted sender)
	client-ip=209.85.220.175; envelope-from=g.rowe.froot@gmail.com;
	helo=mail-vc0-f175.google.com; 
Received: from mail-vc0-f175.google.com ([209.85.220.175])
	by sog-mx-4.v43.ch3.sourceforge.com with esmtps (TLSv1:RC4-SHA:128)
	(Exim 4.76) id 1Swx07-0003TU-0I
	for bitcoin-development@lists.sourceforge.net;
	Thu, 02 Aug 2012 15:07:51 +0000
Received: by vcbfy27 with SMTP id fy27so8625665vcb.34
	for <bitcoin-development@lists.sourceforge.net>;
	Thu, 02 Aug 2012 08:07:41 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.59.1.193 with SMTP id bi1mr9370930ved.57.1343920061445; Thu,
	02 Aug 2012 08:07:41 -0700 (PDT)
Sender: g.rowe.froot@gmail.com
Received: by 10.58.22.234 with HTTP; Thu, 2 Aug 2012 08:07:41 -0700 (PDT)
In-Reply-To: <5019153B.3090001@mistfpga.net>
References: <5019153B.3090001@mistfpga.net>
Date: Thu, 2 Aug 2012 16:07:41 +0100
X-Google-Sender-Auth: tyGl9Te9lLDGVMj1orn_vFL0Qjo
Message-ID: <CAKm8k+2X8Tode5foBSmVGjbvtL8rkRKqNXKLTnmdnbS6FQxyOg@mail.gmail.com>
From: Gary Rowe <g.rowe@froot.co.uk>
To: Bitcoin Development List <bitcoin-development@lists.sourceforge.net>
Content-Type: multipart/alternative; boundary=047d7bdc9b6ade74e104c649c575
X-Spam-Score: -0.5 (/)
X-Spam-Report: Spam Filtering performed by mx.sourceforge.net.
	See http://spamassassin.org/tag/ for more details.
	-1.5 SPF_CHECK_PASS SPF reports sender host as permitted sender for
	sender-domain
	0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider
	(g.rowe.froot[at]gmail.com)
	-0.0 SPF_PASS               SPF: sender matches SPF record
	1.0 HTML_MESSAGE           BODY: HTML included in message
	0.1 DKIM_SIGNED            Message has a DKIM or DK signature,
	not necessarily valid
	-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature
X-Headers-End: 1Swx07-0003TU-0I
Subject: Re: [Bitcoin-development] The Bitcoin Testing Project
X-BeenThere: bitcoin-development@lists.sourceforge.net
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: <bitcoin-development.lists.sourceforge.net>
List-Unsubscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>,
	<mailto:bitcoin-development-request@lists.sourceforge.net?subject=unsubscribe>
List-Archive: <http://sourceforge.net/mailarchive/forum.php?forum_name=bitcoin-development>
List-Post: <mailto:bitcoin-development@lists.sourceforge.net>
List-Help: <mailto:bitcoin-development-request@lists.sourceforge.net?subject=help>
List-Subscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>,
	<mailto:bitcoin-development-request@lists.sourceforge.net?subject=subscribe>
X-List-Received-Date: Thu, 02 Aug 2012 15:07:51 -0000

--047d7bdc9b6ade74e104c649c575
Content-Type: text/plain; charset=UTF-8

Hi Steve,

This looks like a good idea to me. The test suites could act similarly to
the 100% Pure Java approach that successfully fended off a lot of
corrupting influences to Java over the years.

Maybe it's worth putting together a small starter suite of tests and
showing them to the community then providing a suitable process, perhaps
through BIPs, to allow tests to be created, reviewed and updated before
getting incorporated into a reference. I imagine a BIP would cover an
aspect of the blockchain rather than a single test or test suite since
having that many BIPs would get onerous fast.

Kind regards,

Gary

On 1 August 2012 12:38, steve <steve@mistfpga.net> wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi all,
>
> I know most of you have more important things to do, and not enough
> time as it is, but I would really like your feedback on the testing
> project.
>
> Bettermeans seemed ideal, it allowed for leaderless leadership with
> people being able to dip in and out of what they wanted to do.
> however it seems that bettermeans is in no way a finished product and
> is rotting fast.
>
> I would like to move away from bettermeans - whilst retaining the
> voting and sub workstream style of working.  I would like to set
> something up around MantisBT (Mantis Bug Tracker) - this is an
> exceptionally versatile bit of software with plugins and interaction
> with other testing products (everything from test setups and plans to
> test runs and results) I would go as far as saying it is industry
> standard (yeah, i know about bugzilla, etc. mantis beats them all
> hands down.) obviously we would need a wiki and other software - this
> is not a problem.
>
> I am happpy to pay for the VPS' to host this stuff and set it all up.
>
> I have quite a bit of experience with mantis and other opensource
> testing stuff.
>
> I see the testing of bitcoin to be very similar to the testing process
> in the games industry.  for those that do not know how this works it
> is like this:-
>
> A company comes up with a device (xbox/ps),
> They then publish a set of dos and donts for this device (TRC for sony
> and TCRs for microsoft.  - I wrote quite a few of the MS TCR's for the
> original xbox.)
> They (ms/sony) then test your game against these rules and depending
> on how many you pass/fail your game can be released or not.
>
> I see this as mapping to bitcoin very well, the device is the
> blockchain, and the TRC/TCR _tests_ are published so third party
> developers can see how they fair [look at gavins recent blockchain
> edge cases for an example] (ms/sony do not publish their testcases
> only the requirements)
>
> I believe that this will allow the bitcoin testing project to be able
> to cope with the stable builds, bleeding edge builds and 3rd party
> implementations all at the same time.
>
> It doesnt matter what the app is, it is its interaction with the
> blockchain, the safe guarding of the blockchain and compatibility with
> the previous/future versions that are tested.
>
> [for the bitcoin dev list]
> A little about me:-
> The below is more or less a cut and paste of some of the stuff I sent
> gavin in my initial email about wanting to be in on the project.
>
> I can back all of this up with references. I can go into more detail if
> needed.
>
> I was heavily involved with setting up the microsoft xbox european cert
> department
> I set up qa department for europes largest independant games developer
> (although they are no longer)
>
> worked for microsoft secure science designing security automation tools
>
> setup the internal pentest for thales e-security (now TITS [Thales
> Information Technology Solutions (or Trotters Independant Traders ;),
> on thier datacryptors (fpga, crypto and product) - have done full test
> cycles on hsm 8000, payshield 9000, dc2k and thier latest line of
> military spec comms equipment.
>
> Setup and pentested Thales and nCiphers credit control software (to
> fips level 4 standard - This shit bitcoin exchanges need!! I know bank
> is a dirty word in the bitcoin world, but we should be at least as
> secure as them)
>
> I currently find exploits in stuff like office, quicktime, ie, ff, etc
> and sell them to companies like ZDI (3com) iDefense (verisgn) and some
> pentest companies that require zero day exploits.
>
> however I would like to ditch this and get my bitcoin related stuff
> off the ground - with the BTP being top of the list.
>
> my spelling is rubbish, and sometimes i forget to spellcheck before i
> hit send. sorry about that.
>
> any feedback would be really appreciated. please! I feel that this has
> stagnated enough and I want to get my work out there and I want it to
> be useful. (I lost 60 or so testcases because Kev left himself logged
> into bettermeans and I added them under his account... none appeared
> on the wiki, none appeared anywhere...)
>
> There is already lots of stuff on the wiki that outlines how i see
> things holding together - but you cant see who posted what because of
> a bug that has appeared recently [meta info is just displayed as its
> meta tag, {name} on {date} wrote.]
>
> as apposed to Mistfpga on 30/8/2012 wrote...
>
> so the tl;dr
> 1 - I want to use something other than bettermeans
> 2 - I can admin opensource software to do the same
> 3 - I want to take the voting/hiearachy style from bettermeans and
> apply it to mantis and test workflow.
> 4 - I want to get some testing done asap.
> 5 - I have a full msdn and technet licence
> 6 - I have a vast array of machines [nearly 100 cores] that I can use
> to automate testing and to test different setups.
> 7 - been mining for 18 months or so.
>
> cheers,
>
> steve
>
> I do not belive this to be related, but I am not ashamed and feel no
> stigma. I have posted this on a public forum. I suffer from fast
> cycling (withing a day) type two bipolar disorder.  This has been and
> is being managed very well by my meds (300mg quetiapine fumerate and
> 30mg mirtrazipine at night) I have been well for over a year now. [and
> yes, even with these mental health problems I still hold SCE clearance]
>
> - --
> my PGP public key is at pgp.mit.edu id: 0x5016FB50
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.17 (MingW32)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iQEcBAEBAgAGBQJQGRU7AAoJEFvEB9dQFvtQY9oH/RiNBeWDs+tz0NQgkgtXmxcs
> tDtlLWB91gRtmxvXv+yYHE0WXS/qQ5gwaor8Vek61Cvnhij4AQBf7JVYLj03/7fy
> cMAFJ5k7ZQmH9URo8Jx8xzQ2tLgZ5BqLbP6fTzDstpExNGJlkZvsC6hTx9OFCubU
> bzWuWmcIRzBiMhdz7DPoskOgie5sQRzzO0zrK7NvS1P2hyEhM3eFYFcYecpS8jq9
> SbkH77qnc5pZD2JULq38htVwtI16vxmg/s4GIs3OpEPaMk5xtVc5XHf6gwBZQtYw
> fErwZpNDEAmGidRCB4LAqdSx1Xi0ix7GOyvTxBLWTnfB7wIAQNQpBHB9zN8diiA=
> =am8B
> -----END PGP SIGNATURE-----
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Bitcoin-development mailing list
> Bitcoin-development@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bitcoin-development
>

--047d7bdc9b6ade74e104c649c575
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Steve,<br><br>This looks like a good idea to me. The test suites could a=
ct similarly to the 100% Pure Java approach that successfully fended off a =
lot of corrupting influences to Java over the years.<br><br>Maybe it&#39;s =
worth putting together a small starter suite of tests and showing them to t=
he community then providing a suitable process, perhaps through BIPs, to al=
low tests to be created, reviewed and updated before getting incorporated i=
nto a reference. I imagine a BIP would cover an aspect of the blockchain ra=
ther than a single test or test suite since having that many BIPs would get=
 onerous fast.<br>
<br>Kind regards,<br><br>Gary<br><br><div class=3D"gmail_quote">On 1 August=
 2012 12:38, steve <span dir=3D"ltr">&lt;<a href=3D"mailto:steve@mistfpga.n=
et" target=3D"_blank">steve@mistfpga.net</a>&gt;</span> wrote:<br><blockquo=
te class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc so=
lid;padding-left:1ex">
-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA1<br>
<br>
Hi all,<br>
<br>
I know most of you have more important things to do, and not enough<br>
time as it is, but I would really like your feedback on the testing<br>
project.<br>
<br>
Bettermeans seemed ideal, it allowed for leaderless leadership with<br>
people being able to dip in and out of what they wanted to do.<br>
however it seems that bettermeans is in no way a finished product and<br>
is rotting fast.<br>
<br>
I would like to move away from bettermeans - whilst retaining the<br>
voting and sub workstream style of working. =C2=A0I would like to set<br>
something up around MantisBT (Mantis Bug Tracker) - this is an<br>
exceptionally versatile bit of software with plugins and interaction<br>
with other testing products (everything from test setups and plans to<br>
test runs and results) I would go as far as saying it is industry<br>
standard (yeah, i know about bugzilla, etc. mantis beats them all<br>
hands down.) obviously we would need a wiki and other software - this<br>
is not a problem.<br>
<br>
I am happpy to pay for the VPS&#39; to host this stuff and set it all up.<b=
r>
<br>
I have quite a bit of experience with mantis and other opensource<br>
testing stuff.<br>
<br>
I see the testing of bitcoin to be very similar to the testing process<br>
in the games industry. =C2=A0for those that do not know how this works it<b=
r>
is like this:-<br>
<br>
A company comes up with a device (xbox/ps),<br>
They then publish a set of dos and donts for this device (TRC for sony<br>
and TCRs for microsoft. =C2=A0- I wrote quite a few of the MS TCR&#39;s for=
 the<br>
original xbox.)<br>
They (ms/sony) then test your game against these rules and depending<br>
on how many you pass/fail your game can be released or not.<br>
<br>
I see this as mapping to bitcoin very well, the device is the<br>
blockchain, and the TRC/TCR _tests_ are published so third party<br>
developers can see how they fair [look at gavins recent blockchain<br>
edge cases for an example] (ms/sony do not publish their testcases<br>
only the requirements)<br>
<br>
I believe that this will allow the bitcoin testing project to be able<br>
to cope with the stable builds, bleeding edge builds and 3rd party<br>
implementations all at the same time.<br>
<br>
It doesnt matter what the app is, it is its interaction with the<br>
blockchain, the safe guarding of the blockchain and compatibility with<br>
the previous/future versions that are tested.<br>
<br>
[for the bitcoin dev list]<br>
A little about me:-<br>
The below is more or less a cut and paste of some of the stuff I sent<br>
gavin in my initial email about wanting to be in on the project.<br>
<br>
I can back all of this up with references. I can go into more detail if<br>
needed.<br>
<br>
I was heavily involved with setting up the microsoft xbox european cert<br>
department<br>
I set up qa department for europes largest independant games developer<br>
(although they are no longer)<br>
<br>
worked for microsoft secure science designing security automation tools<br>
<br>
setup the internal pentest for thales e-security (now TITS [Thales<br>
Information Technology Solutions (or Trotters Independant Traders ;),<br>
on thier datacryptors (fpga, crypto and product) - have done full test<br>
cycles on hsm 8000, payshield 9000, dc2k and thier latest line of<br>
military spec comms equipment.<br>
<br>
Setup and pentested Thales and nCiphers credit control software (to<br>
fips level 4 standard - This shit bitcoin exchanges need!! I know bank<br>
is a dirty word in the bitcoin world, but we should be at least as<br>
secure as them)<br>
<br>
I currently find exploits in stuff like office, quicktime, ie, ff, etc<br>
and sell them to companies like ZDI (3com) iDefense (verisgn) and some<br>
pentest companies that require zero day exploits.<br>
<br>
however I would like to ditch this and get my bitcoin related stuff<br>
off the ground - with the BTP being top of the list.<br>
<br>
my spelling is rubbish, and sometimes i forget to spellcheck before i<br>
hit send. sorry about that.<br>
<br>
any feedback would be really appreciated. please! I feel that this has<br>
stagnated enough and I want to get my work out there and I want it to<br>
be useful. (I lost 60 or so testcases because Kev left himself logged<br>
into bettermeans and I added them under his account... none appeared<br>
on the wiki, none appeared anywhere...)<br>
<br>
There is already lots of stuff on the wiki that outlines how i see<br>
things holding together - but you cant see who posted what because of<br>
a bug that has appeared recently [meta info is just displayed as its<br>
meta tag, {name} on {date} wrote.]<br>
<br>
as apposed to Mistfpga on 30/8/2012 wrote...<br>
<br>
so the tl;dr<br>
1 - I want to use something other than bettermeans<br>
2 - I can admin opensource software to do the same<br>
3 - I want to take the voting/hiearachy style from bettermeans and<br>
apply it to mantis and test workflow.<br>
4 - I want to get some testing done asap.<br>
5 - I have a full msdn and technet licence<br>
6 - I have a vast array of machines [nearly 100 cores] that I can use<br>
to automate testing and to test different setups.<br>
7 - been mining for 18 months or so.<br>
<br>
cheers,<br>
<br>
steve<br>
<br>
I do not belive this to be related, but I am not ashamed and feel no<br>
stigma. I have posted this on a public forum. I suffer from fast<br>
cycling (withing a day) type two bipolar disorder. =C2=A0This has been and<=
br>
is being managed very well by my meds (300mg quetiapine fumerate and<br>
30mg mirtrazipine at night) I have been well for over a year now. [and<br>
yes, even with these mental health problems I still hold SCE clearance]<br>
<br>
- --<br>
my PGP public key is at <a href=3D"http://pgp.mit.edu" target=3D"_blank">pg=
p.mit.edu</a> id: 0x5016FB50<br>
<br>
-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG v2.0.17 (MingW32)<br>
Comment: Using GnuPG with Mozilla - <a href=3D"http://enigmail.mozdev.org/"=
 target=3D"_blank">http://enigmail.mozdev.org/</a><br>
<br>
iQEcBAEBAgAGBQJQGRU7AAoJEFvEB9dQFvtQY9oH/RiNBeWDs+tz0NQgkgtXmxcs<br>
tDtlLWB91gRtmxvXv+yYHE0WXS/qQ5gwaor8Vek61Cvnhij4AQBf7JVYLj03/7fy<br>
cMAFJ5k7ZQmH9URo8Jx8xzQ2tLgZ5BqLbP6fTzDstpExNGJlkZvsC6hTx9OFCubU<br>
bzWuWmcIRzBiMhdz7DPoskOgie5sQRzzO0zrK7NvS1P2hyEhM3eFYFcYecpS8jq9<br>
SbkH77qnc5pZD2JULq38htVwtI16vxmg/s4GIs3OpEPaMk5xtVc5XHf6gwBZQtYw<br>
fErwZpNDEAmGidRCB4LAqdSx1Xi0ix7GOyvTxBLWTnfB7wIAQNQpBHB9zN8diiA=3D<br>
=3Dam8B<br>
-----END PGP SIGNATURE-----<br>
<br>
---------------------------------------------------------------------------=
---<br>
Live Security Virtual Conference<br>
Exclusive live event will cover all the ways today&#39;s security and<br>
threat landscape has changed and how IT managers can respond. Discussions<b=
r>
will include endpoint security, mobile security and the latest in malware<b=
r>
threats. <a href=3D"http://www.accelacomm.com/jaw/sfrnl04242012/114/5012226=
3/" target=3D"_blank">http://www.accelacomm.com/jaw/sfrnl04242012/114/50122=
263/</a><br>
_______________________________________________<br>
Bitcoin-development mailing list<br>
<a href=3D"mailto:Bitcoin-development@lists.sourceforge.net">Bitcoin-develo=
pment@lists.sourceforge.net</a><br>
<a href=3D"https://lists.sourceforge.net/lists/listinfo/bitcoin-development=
" target=3D"_blank">https://lists.sourceforge.net/lists/listinfo/bitcoin-de=
velopment</a><br>
</blockquote></div><br>

--047d7bdc9b6ade74e104c649c575--