path: root/ca/04a9e11c1f5c004543cf8db19ea79a880398eb

Received: from sog-mx-2.v43.ch3.sourceforge.com ([172.29.43.192]
	helo=mx.sourceforge.net)
	by sfs-ml-3.v29.ch3.sourceforge.com with esmtp (Exim 4.76)
	(envelope-from <cshrem@gmail.com>) id 1Wi8Ux-0001Hr-MW
	for bitcoin-development@lists.sourceforge.net;
	Wed, 07 May 2014 20:31:27 +0000
Received-SPF: pass (sog-mx-2.v43.ch3.sourceforge.com: domain of gmail.com
	designates 209.85.192.42 as permitted sender)
	client-ip=209.85.192.42; envelope-from=cshrem@gmail.com;
	helo=mail-qg0-f42.google.com; 
Received: from mail-qg0-f42.google.com ([209.85.192.42])
	by sog-mx-2.v43.ch3.sourceforge.com with esmtps (TLSv1:RC4-SHA:128)
	(Exim 4.76) id 1Wi8Uw-00054G-GY
	for bitcoin-development@lists.sourceforge.net;
	Wed, 07 May 2014 20:31:27 +0000
Received: by mail-qg0-f42.google.com with SMTP id q107so1732314qgd.15
	for <bitcoin-development@lists.sourceforge.net>;
	Wed, 07 May 2014 13:31:21 -0700 (PDT)
X-Received: by 10.224.69.130 with SMTP id z2mr69914860qai.87.1399494680991;
	Wed, 07 May 2014 13:31:20 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.96.116.198 with HTTP; Wed, 7 May 2014 13:31:04 -0700 (PDT)
In-Reply-To: <CANEZrP2aUBFkwx0s_xcS_e4gv1Ao1240NVNNFR3bFUBf9hHqsA@mail.gmail.com>
References: <536A8592.8010009@gmail.com>
	<CA+s+GJASND3OU2e+YxUeLmSOW6pTkMwuzHCHeJnnihg6xK9Caw@mail.gmail.com>
	<536A902C.6080602@gmail.com>
	<CA+s+GJCaUX3ErgVean0e91CBorPc6RNKgYs08fOOsqNYtbd6RA@mail.gmail.com>
	<CANEZrP2aUBFkwx0s_xcS_e4gv1Ao1240NVNNFR3bFUBf9hHqsA@mail.gmail.com>
From: "Charlie 'Charles' Shrem" <cshrem@gmail.com>
Date: Wed, 7 May 2014 16:31:04 -0400
Message-ID: <CAC787aNHX+5UOdiKNY1P4xPXMttRt=th72czaMop7hzjyYTAog@mail.gmail.com>
To: Mike Hearn <mike@plan99.net>
Content-Type: multipart/alternative; boundary=001a11c2c166535da704f8d53f6a
X-Spam-Score: -0.6 (/)
X-Spam-Report: Spam Filtering performed by mx.sourceforge.net.
	See http://spamassassin.org/tag/ for more details.
	-0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/,
	no trust [209.85.192.42 listed in list.dnswl.org]
	-1.5 SPF_CHECK_PASS SPF reports sender host as permitted sender for
	sender-domain
	0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider
	(cshrem[at]gmail.com)
	-0.0 SPF_PASS               SPF: sender matches SPF record
	0.0 NORMAL_HTTP_TO_IP URI: Uses a dotted-decimal IP address in URL
	1.0 HTML_MESSAGE           BODY: HTML included in message
	-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from
	author's domain
	0.1 DKIM_SIGNED            Message has a DKIM or DK signature,
	not necessarily valid
	-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature
X-Headers-End: 1Wi8Uw-00054G-GY
Cc: "bitcoin-development@lists.sourceforge.net"
	<bitcoin-development@lists.sourceforge.net>
Subject: Re: [Bitcoin-development] Announcing the Statoshi fork
X-BeenThere: bitcoin-development@lists.sourceforge.net
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: <bitcoin-development.lists.sourceforge.net>
List-Unsubscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>,
	<mailto:bitcoin-development-request@lists.sourceforge.net?subject=unsubscribe>
List-Archive: <http://sourceforge.net/mailarchive/forum.php?forum_name=bitcoin-development>
List-Post: <mailto:bitcoin-development@lists.sourceforge.net>
List-Help: <mailto:bitcoin-development-request@lists.sourceforge.net?subject=help>
List-Subscribe: <https://lists.sourceforge.net/lists/listinfo/bitcoin-development>,
	<mailto:bitcoin-development-request@lists.sourceforge.net?subject=subscribe>
X-List-Received-Date: Wed, 07 May 2014 20:31:27 -0000

--001a11c2c166535da704f8d53f6a
Content-Type: text/plain; charset=ISO-8859-1

I'm going to install this now on my full node, looks really cool!

This is my node page: http://199.58.210.124/



Thanks,

Charlie

CharlieShrem.com | *Please **encrypt messages with my PGP key
<http://charlieshrem.com/contact/>*


On Wed, May 7, 2014 at 4:25 PM, Mike Hearn <mike@plan99.net> wrote:

> I think there a few different possible ways to go here.
>
> One is to try and simplify the setup of all the components so it all gets
> installed together. That might be feasible in some quite restricted setups
> but the installation instructions for Graphite look kind of terrifying.
>
> Another is to export stats over regular TCP and make them public so
> literally anyone can listen to the stats feed for any node. Then people who
> dig stats and graphs could work on stats aggregators that give global
> network visibility independently, effectively crawling the p2p network for
> data. It'd have the advantage of having zero setup for the node operators
> and not require much in the way of resources.
>
> For what it's worth, although the environment is a bit different inside
> Google the latter approach is used. Monitoring servers locate servers of
> interest via a discovery service, connect to them and start streaming stats
> data into a database service that can then be queried later to get graphs.
>
> The stats are also run through various rules to obtain alerts about
> problematic conditions. For example, if a subset of the network splits it
> might be hard to notice that if the node operators aren't paying attention
> and Matt's fork alert/emailing code isn't set up. But if there was a site
> crawling nodes and aggregating chain heights by version, that could trigger
> an alert to people who *are* paying attention.
>
> I know from practical experience that monitoring and analysis tends to
> appeal more to certain types of people than others. So I quite like the
> "let anyone monitor" approach. However, it may not be appropriate in a P2P
> network, I did not think about it much.
>
> Obviously I'm assuming none of the stats expose privacy sensitive data.
>
>
>
> On Wed, May 7, 2014 at 10:18 PM, Wladimir <laanwj@gmail.com> wrote:
>
>> On Wed, May 7, 2014 at 9:57 PM, Jameson Lopp <jameson.lopp@gmail.com>
>> wrote:
>> > -----BEGIN PGP SIGNED MESSAGE-----
>> > Hash: SHA1
>> >
>> > I agree that it would be awesome to offer these types of stats with the
>> installer; unfortunately the route I've taken has dependencies on several
>> other other pieces of software to do all the heavy lifting of stats
>> aggregation and chart rendering. I'm assuming that you would not want to
>> build any of that processing into Bitcoin Core itself; would you be opposed
>> to packaging other software along with the installer?
>>
>> Depends on just how much stuff it is. The idea is primarily to have an
>> installer for running a (wallet-less) node as an OS background
>> service.
>>
>> Having some statistics available would be worth some extra download
>> size, otherwise it would be pretty much invisible.
>>
>> We'd already decided that we would need something like Python for the
>> stats service. Implementing things like web services in C++ is just
>> not realistic given the time constraints and the great already-written
>> code that is out there. As an optional tool it should be external, not
>> part of bitcoind itself.
>>
>> I suppose the chart rendering happens client-side? In that case the
>> web service just has to collect and provide the data, and serve static
>> html/js files.
>>
>> Wladimir
>>
>>
>> ------------------------------------------------------------------------------
>> Is your legacy SCM system holding you back? Join Perforce May 7 to find
>> out:
>> &#149; 3 signs your SCM is hindering your productivity
>> &#149; Requirements for releasing software faster
>> &#149; Expert tips and advice for migrating your SCM now
>> http://p.sf.net/sfu/perforce
>> _______________________________________________
>> Bitcoin-development mailing list
>> Bitcoin-development@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bitcoin-development
>>
>
>
>
> ------------------------------------------------------------------------------
> Is your legacy SCM system holding you back? Join Perforce May 7 to find
> out:
> &#149; 3 signs your SCM is hindering your productivity
> &#149; Requirements for releasing software faster
> &#149; Expert tips and advice for migrating your SCM now
> http://p.sf.net/sfu/perforce
> _______________________________________________
> Bitcoin-development mailing list
> Bitcoin-development@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bitcoin-development
>
>

--001a11c2c166535da704f8d53f6a
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:arial,he=
lvetica,sans-serif;font-size:small;color:rgb(102,102,102)">I&#39;m going to=
 install this now on my full node, looks really cool!<br></div><div class=
=3D"gmail_default" style=3D"font-family:arial,helvetica,sans-serif;font-siz=
e:small;color:rgb(102,102,102)">

<br></div><div class=3D"gmail_default" style=3D"font-family:arial,helvetica=
,sans-serif;font-size:small;color:rgb(102,102,102)">This is my node page:=
=A0<a href=3D"http://199.58.210.124/">http://199.58.210.124/</a></div><div =
class=3D"gmail_default" style=3D"font-family:arial,helvetica,sans-serif;fon=
t-size:small;color:rgb(102,102,102)">

<br></div><div class=3D"gmail_default" style=3D"font-family:arial,helvetica=
,sans-serif;font-size:small;color:rgb(102,102,102)"><br></div></div><div cl=
ass=3D"gmail_extra"><br clear=3D"all"><div><div dir=3D"ltr"><div><span styl=
e=3D"color:rgb(102,102,102);font-family:arial,helvetica,sans-serif;font-siz=
e:13px;background-color:rgb(255,255,255)">Thanks,=A0</span><br>

</div><div><span style=3D"color:rgb(102,102,102);font-family:arial,helvetic=
a,sans-serif;font-size:13px;background-color:rgb(255,255,255)"><br></span><=
/div><div><span style=3D"color:rgb(102,102,102);font-family:arial,helvetica=
,sans-serif;font-size:13px;background-color:rgb(255,255,255)">Charlie</span=
></div>

<div><span style=3D"color:rgb(102,102,102);font-family:arial,helvetica,sans=
-serif;font-size:13px;background-color:rgb(255,255,255)"><br></span></div><=
div><span style=3D"color:rgb(102,102,102);font-family:arial,helvetica,sans-=
serif"><a href=3D"http://CharlieShrem.com" target=3D"_blank">CharlieShrem.c=
om</a> |=A0</span><font color=3D"#666666" face=3D"arial, helvetica, sans-se=
rif"><i>Please=A0</i></font><i><span style=3D"color:rgb(102,102,102);font-f=
amily:arial,helvetica,sans-serif">encrypt messages with=A0</span><a href=3D=
"http://charlieshrem.com/contact/" style=3D"font-family:arial,helvetica,san=
s-serif" target=3D"_blank">my PGP key</a></i></div>

</div></div>
<br><br><div class=3D"gmail_quote">On Wed, May 7, 2014 at 4:25 PM, Mike Hea=
rn <span dir=3D"ltr">&lt;<a href=3D"mailto:mike@plan99.net" target=3D"_blan=
k">mike@plan99.net</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quot=
e" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div dir=3D"ltr">I think there a few different possible ways to go here.<di=
v><br></div><div>One is to try and simplify the setup of all the components=
 so it all gets installed together. That might be feasible in some quite re=
stricted setups but the installation instructions for Graphite look kind of=
 terrifying.</div>


<div><br></div><div>Another is to export stats over regular TCP and make th=
em public so literally anyone can listen to the stats feed for any node. Th=
en people who dig stats and graphs could work on stats aggregators that giv=
e global network visibility independently, effectively crawling the p2p net=
work for data. It&#39;d have the advantage of having zero setup for the nod=
e operators and not require much in the way of resources.</div>


<div><br></div><div>For what it&#39;s worth, although the environment is a =
bit different inside Google the latter approach is used. Monitoring servers=
 locate servers of interest via a discovery service, connect to them and st=
art streaming stats data into a database service that can then be queried l=
ater to get graphs.=A0</div>


<div><br></div><div>The stats are also run through various rules to obtain =
alerts about problematic conditions. For example, if a subset of the networ=
k splits it might be hard to notice that if the node operators aren&#39;t p=
aying attention and Matt&#39;s fork alert/emailing code isn&#39;t set up. B=
ut if there was a site crawling nodes and aggregating chain heights by vers=
ion, that could trigger an alert to people who <i>are</i>=A0paying attentio=
n.</div>


<div><br></div><div>I know from practical experience that monitoring and an=
alysis tends to appeal more to certain types of people than others. So I qu=
ite like the &quot;let anyone monitor&quot; approach. However, it may not b=
e appropriate in a P2P network, I did not think about it much.</div>


<div><br></div><div>Obviously I&#39;m assuming none of the stats expose pri=
vacy sensitive data.</div><div><br></div></div><div class=3D"HOEnZb"><div c=
lass=3D"h5"><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">O=
n Wed, May 7, 2014 at 10:18 PM, Wladimir <span dir=3D"ltr">&lt;<a href=3D"m=
ailto:laanwj@gmail.com" target=3D"_blank">laanwj@gmail.com</a>&gt;</span> w=
rote:<br>


<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div>On Wed, May 7, 2014 at 9:57 PM, Jameson=
 Lopp &lt;<a href=3D"mailto:jameson.lopp@gmail.com" target=3D"_blank">james=
on.lopp@gmail.com</a>&gt; wrote:<br>



&gt; -----BEGIN PGP SIGNED MESSAGE-----<br>
&gt; Hash: SHA1<br>
&gt;<br>
</div><div>&gt; I agree that it would be awesome to offer these types of st=
ats with the installer; unfortunately the route I&#39;ve taken has dependen=
cies on several other other pieces of software to do all the heavy lifting =
of stats aggregation and chart rendering. I&#39;m assuming that you would n=
ot want to build any of that processing into Bitcoin Core itself; would you=
 be opposed to packaging other software along with the installer?<br>



<br>
</div>Depends on just how much stuff it is. The idea is primarily to have a=
n<br>
installer for running a (wallet-less) node as an OS background<br>
service.<br>
<br>
Having some statistics available would be worth some extra download<br>
size, otherwise it would be pretty much invisible.<br>
<br>
We&#39;d already decided that we would need something like Python for the<b=
r>
stats service. Implementing things like web services in C++ is just<br>
not realistic given the time constraints and the great already-written<br>
code that is out there. As an optional tool it should be external, not<br>
part of bitcoind itself.<br>
<br>
I suppose the chart rendering happens client-side? In that case the<br>
web service just has to collect and provide the data, and serve static<br>
html/js files.<br>
<span><font color=3D"#888888"><br>
Wladimir<br>
</font></span><div><div><br>
---------------------------------------------------------------------------=
---<br>
Is your legacy SCM system holding you back? Join Perforce May 7 to find out=
:<br>
&amp;#149; 3 signs your SCM is hindering your productivity<br>
&amp;#149; Requirements for releasing software faster<br>
&amp;#149; Expert tips and advice for migrating your SCM now<br>
<a href=3D"http://p.sf.net/sfu/perforce" target=3D"_blank">http://p.sf.net/=
sfu/perforce</a><br>
_______________________________________________<br>
Bitcoin-development mailing list<br>
<a href=3D"mailto:Bitcoin-development@lists.sourceforge.net" target=3D"_bla=
nk">Bitcoin-development@lists.sourceforge.net</a><br>
<a href=3D"https://lists.sourceforge.net/lists/listinfo/bitcoin-development=
" target=3D"_blank">https://lists.sourceforge.net/lists/listinfo/bitcoin-de=
velopment</a><br>
</div></div></blockquote></div><br></div>
</div></div><br>-----------------------------------------------------------=
-------------------<br>
Is your legacy SCM system holding you back? Join Perforce May 7 to find out=
:<br>
&amp;#149; 3 signs your SCM is hindering your productivity<br>
&amp;#149; Requirements for releasing software faster<br>
&amp;#149; Expert tips and advice for migrating your SCM now<br>
<a href=3D"http://p.sf.net/sfu/perforce" target=3D"_blank">http://p.sf.net/=
sfu/perforce</a><br>_______________________________________________<br>
Bitcoin-development mailing list<br>
<a href=3D"mailto:Bitcoin-development@lists.sourceforge.net">Bitcoin-develo=
pment@lists.sourceforge.net</a><br>
<a href=3D"https://lists.sourceforge.net/lists/listinfo/bitcoin-development=
" target=3D"_blank">https://lists.sourceforge.net/lists/listinfo/bitcoin-de=
velopment</a><br>
<br></blockquote></div><br></div>

--001a11c2c166535da704f8d53f6a--