Received-SPF: pass (sog-mx-4.v43.ch3.sourceforge.com: domain of bitpay.com
	designates 74.125.82.54 as permitted sender)
	client-ip=74.125.82.54; envelope-from=jgarzik@bitpay.com;
	helo=mail-wg0-f54.google.com; 
MIME-Version: 1.0
In-Reply-To: <5279D89D.5000609@bluematt.me>
References: <5279D89D.5000609@bluematt.me>
Date: Wed, 6 Nov 2013 06:42:01 -0500
Message-ID: <CAJHLa0NkjvBB3-J39O0O=yf+xaFQm7C6qnDKdLMzDE3TO4STDQ@mail.gmail.com>
From: Jeff Garzik <jgarzik@bitpay.com>
To: Matt Corallo <bitcoin-list@bluematt.me>
Content-Type: multipart/alternative; boundary=047d7b624e2a2d2e7b04ea80a33a
Cc: bitcoin-development@lists.sourceforge.net
Subject: Re: [Bitcoin-development] [ANN] High-speed Bitcoin Relay Network
Precedence: list

--047d7b624e2a2d2e7b04ea80a33a
Content-Type: text/plain; charset=ISO-8859-1

Good stuff.  I have been pushing for private peering agreeents and a
"backbone" for years. Even had a paltry effort going with exmulti.net + a
few manually connected parties.

I hope parties in the bitcoin space take it upon themselves to network with
major sites - miners, payment processors, exchanges, popular sites, etc.
 On Nov 6, 2013 12:50 AM, "Matt Corallo" <bitcoin-list@bluematt.me> wrote:

> Recently, there has been a reasonable amount of discussion about the
> continued fragility of the public Bitcoin network on IRC and elsewhere
> (1). To this extent, I'm organizing a system of peering between nodes in
> the network by creating a system of high-speed relay nodes for miners
> and merchants/exchanges. This system will a) act as a fallback in the
> case that the public Bitcoin network encounters issues and b) decrease
> block propagation times between miners.
> It is NOT designed to in any way replace or decrease the need for the
> public Bitcoin P2P network. It is NOT any kind of attempt at
> centralization, and I still encourage interested parties to establish
> their own private peering agreements with large miners as needed.
>
> Currently the network consists of one specially-designed relay node, but
> I hope to bring more online in the coming days.
>
> This network is open to everyone via a few public relay nodes, but also
> will have nodes which are made available only to large miners and
> merchants/exchanges to mitigate the ability of malicious parties to DoS
> the network.
>
> To peer with the public relay nodes, simply select the closest region
> out of us-west (West Coast US), us-east (East Coast US), eu (Western
> Europe), au (Australia), or jpy (Japan) and add
> public.REGION.relay.mattcorallo.com to your addnode list. Note that
> since all of the relay nodes will relay between each other, you gain no
> latency advantage by peering with more than the closest node to you (and
> currently all the regions map to one node, so there they're redundant
> anyway).
>
> For each relay node, you can connect to either port 8334 or 8335.
> Connecting on port 8334 will relay only blocks, and port 8335 will relay
> both blocks and transactions. The relay nodes will request any
> transactions which appear in your invs no matter which port you connect to.
>
> Relay node details:
>  * The relay nodes do some data verification to prevent DoS, but in
> order to keep relay fast, they do not fully verify the data they are
> relaying, thus YOU SHOULD NEVER mine a block building on top of a
> relayed block without fully checking it with your own bitcoin validator
> (as you would any other block relayed from the P2P network).
>  * The relay nodes do not follow the standard inv-getdata-tx/block flow,
> but instead relay transactions/blocks immediately after they have done
> their cursory verification. They do keep some track of whether or not
> your nodes claim to have seen the transactions/blocks before relaying,
> but you may see transactions/blocks being sent which you already have
> and have not requested, if this is a problem for you due to bandwith
> issues, you should reconsider your bandwith constraints and/or are
> peering with too many nodes.
>  * The relay nodes will all relay among themselves very quickly, so
> there is no advantage to peering with as many relay nodes as you can
> find, in fact, the increased incoming bandwidth during block relay
> spikes may result in higher latency for your nodes.
>  * The relay nodes are NOT designed to ensure that you never miss data,
> and may fail to relay some transactions. Additionally, because the relay
> nodes do not respond to standard getdata requests, if you miss a relay
> and then reconnect, that data will not be sent again by the relay nodes.
> The relay nodes are NOT a replacement for having peers on the standard
> P2P network, they are only there to augment the existing P2P network.
>
> If you are a merchant/exchange/large miner/other important node operator
> and wish to gain access to additional domain names which map to relay
> nodes with fewer peers, please fill out the form at
>
> https://docs.google.com/forms/d/1UL82QdcXXEhZwSHJAK04Sk_cWg4zLOu8a216nO7Mt8c/viewform
>
> You can find the source for the relay nodes at
> https://github.com/TheBlueMatt/RelayNode
>
> If you have any comments/concerns/suggestions, please do not hesitate to
> email bitcoin-peering@mattcorallo.com
>
> Thanks,
> Matt
>
>
> (1) There has been extended discussion on #bitcoin-wizards as well as
> #bitcoin-dev of the very small number of active, listening nodes.
> Additionally, because many of those nodes are versions prior to 0.8.4,
> it seems very likely that maliciously creating network splits or at
> least drastically reducing the number of peers for most nodes would not
> be particularly challenging in the current network. Also,
>
> http://www.tik.ee.ethz.ch/file/49318d3f56c1d525aabf7fda78b23fc0/P2P2013_041.pdf
> noted that they were able to single-handledly decrease the network-wide
> orphan rate by around 50% by improving network peering. Finally, you've
> all seen the recent discussion on malicious mining algorithms. Though
> those are not entirely prevented by reducing block propagation times,
> they can be significantly limited compared to the current, rather
> disjoint, network.
>
>
> ------------------------------------------------------------------------------
> November Webinars for C, C++, Fortran Developers
> Accelerate application performance with scalable programming models.
> Explore
> techniques for threading, error checking, porting, and tuning. Get the most
> from the latest Intel processors and coprocessors. See abstracts and
> register
> http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk
> _______________________________________________
> Bitcoin-development mailing list
> Bitcoin-development@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bitcoin-development
>

--047d7b624e2a2d2e7b04ea80a33a
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<p>Good stuff.=A0 I have been pushing for private peering agreeents and a &=
quot;backbone&quot; for years. Even had a paltry effort going with <a href=
=3D"http://exmulti.net">exmulti.net</a> + a few manually connected parties.=
</p>

<p>I hope parties in the bitcoin space take it upon themselves to network w=
ith major sites - miners, payment processors, exchanges, popular sites, etc=
.<br>
 </p>
<div class=3D"gmail_quote">On Nov 6, 2013 12:50 AM, &quot;Matt Corallo&quot=
; &lt;<a href=3D"mailto:bitcoin-list@bluematt.me">bitcoin-list@bluematt.me<=
/a>&gt; wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quote" st=
yle=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Recently, there has been a reasonable amount of discussion about the<br>
continued fragility of the public Bitcoin network on IRC and elsewhere<br>
(1). To this extent, I&#39;m organizing a system of peering between nodes i=
n<br>
the network by creating a system of high-speed relay nodes for miners<br>
and merchants/exchanges. This system will a) act as a fallback in the<br>
case that the public Bitcoin network encounters issues and b) decrease<br>
block propagation times between miners.<br>
It is NOT designed to in any way replace or decrease the need for the<br>
public Bitcoin P2P network. It is NOT any kind of attempt at<br>
centralization, and I still encourage interested parties to establish<br>
their own private peering agreements with large miners as needed.<br>
<br>
Currently the network consists of one specially-designed relay node, but<br=
>
I hope to bring more online in the coming days.<br>
<br>
This network is open to everyone via a few public relay nodes, but also<br>
will have nodes which are made available only to large miners and<br>
merchants/exchanges to mitigate the ability of malicious parties to DoS<br>
the network.<br>
<br>
To peer with the public relay nodes, simply select the closest region<br>
out of us-west (West Coast US), us-east (East Coast US), eu (Western<br>
Europe), au (Australia), or jpy (Japan) and add<br>
<a href=3D"http://public.REGION.relay.mattcorallo.com" target=3D"_blank">pu=
blic.REGION.relay.mattcorallo.com</a> to your addnode list. Note that<br>
since all of the relay nodes will relay between each other, you gain no<br>
latency advantage by peering with more than the closest node to you (and<br=
>
currently all the regions map to one node, so there they&#39;re redundant<b=
r>
anyway).<br>
<br>
For each relay node, you can connect to either port 8334 or 8335.<br>
Connecting on port 8334 will relay only blocks, and port 8335 will relay<br=
>
both blocks and transactions. The relay nodes will request any<br>
transactions which appear in your invs no matter which port you connect to.=
<br>
<br>
Relay node details:<br>
=A0* The relay nodes do some data verification to prevent DoS, but in<br>
order to keep relay fast, they do not fully verify the data they are<br>
relaying, thus YOU SHOULD NEVER mine a block building on top of a<br>
relayed block without fully checking it with your own bitcoin validator<br>
(as you would any other block relayed from the P2P network).<br>
=A0* The relay nodes do not follow the standard inv-getdata-tx/block flow,<=
br>
but instead relay transactions/blocks immediately after they have done<br>
their cursory verification. They do keep some track of whether or not<br>
your nodes claim to have seen the transactions/blocks before relaying,<br>
but you may see transactions/blocks being sent which you already have<br>
and have not requested, if this is a problem for you due to bandwith<br>
issues, you should reconsider your bandwith constraints and/or are<br>
peering with too many nodes.<br>
=A0* The relay nodes will all relay among themselves very quickly, so<br>
there is no advantage to peering with as many relay nodes as you can<br>
find, in fact, the increased incoming bandwidth during block relay<br>
spikes may result in higher latency for your nodes.<br>
=A0* The relay nodes are NOT designed to ensure that you never miss data,<b=
r>
and may fail to relay some transactions. Additionally, because the relay<br=
>
nodes do not respond to standard getdata requests, if you miss a relay<br>
and then reconnect, that data will not be sent again by the relay nodes.<br=
>
The relay nodes are NOT a replacement for having peers on the standard<br>
P2P network, they are only there to augment the existing P2P network.<br>
<br>
If you are a merchant/exchange/large miner/other important node operator<br=
>
and wish to gain access to additional domain names which map to relay<br>
nodes with fewer peers, please fill out the form at<br>
<a href=3D"https://docs.google.com/forms/d/1UL82QdcXXEhZwSHJAK04Sk_cWg4zLOu=
8a216nO7Mt8c/viewform" target=3D"_blank">https://docs.google.com/forms/d/1U=
L82QdcXXEhZwSHJAK04Sk_cWg4zLOu8a216nO7Mt8c/viewform</a><br>
<br>
You can find the source for the relay nodes at<br>
<a href=3D"https://github.com/TheBlueMatt/RelayNode" target=3D"_blank">http=
s://github.com/TheBlueMatt/RelayNode</a><br>
<br>
If you have any comments/concerns/suggestions, please do not hesitate to<br=
>
email <a href=3D"mailto:bitcoin-peering@mattcorallo.com">bitcoin-peering@ma=
ttcorallo.com</a><br>
<br>
Thanks,<br>
Matt<br>
<br>
<br>
(1) There has been extended discussion on #bitcoin-wizards as well as<br>
#bitcoin-dev of the very small number of active, listening nodes.<br>
Additionally, because many of those nodes are versions prior to 0.8.4,<br>
it seems very likely that maliciously creating network splits or at<br>
least drastically reducing the number of peers for most nodes would not<br>
be particularly challenging in the current network. Also,<br>
<a href=3D"http://www.tik.ee.ethz.ch/file/49318d3f56c1d525aabf7fda78b23fc0/=
P2P2013_041.pdf" target=3D"_blank">http://www.tik.ee.ethz.ch/file/49318d3f5=
6c1d525aabf7fda78b23fc0/P2P2013_041.pdf</a><br>
noted that they were able to single-handledly decrease the network-wide<br>
orphan rate by around 50% by improving network peering. Finally, you&#39;ve=
<br>
all seen the recent discussion on malicious mining algorithms. Though<br>
those are not entirely prevented by reducing block propagation times,<br>
they can be significantly limited compared to the current, rather<br>
disjoint, network.<br>
<br>
---------------------------------------------------------------------------=
---<br>
November Webinars for C, C++, Fortran Developers<br>
Accelerate application performance with scalable programming models. Explor=
e<br>
techniques for threading, error checking, porting, and tuning. Get the most=
<br>
from the latest Intel processors and coprocessors. See abstracts and regist=
er<br>
<a href=3D"http://pubads.g.doubleclick.net/gampad/clk?id=3D60136231&amp;iu=
=3D/4140/ostg.clktrk" target=3D"_blank">http://pubads.g.doubleclick.net/gam=
pad/clk?id=3D60136231&amp;iu=3D/4140/ostg.clktrk</a><br>
_______________________________________________<br>
Bitcoin-development mailing list<br>
<a href=3D"mailto:Bitcoin-development@lists.sourceforge.net">Bitcoin-develo=
pment@lists.sourceforge.net</a><br>
<a href=3D"https://lists.sourceforge.net/lists/listinfo/bitcoin-development=
" target=3D"_blank">https://lists.sourceforge.net/lists/listinfo/bitcoin-de=
velopment</a><br>
</blockquote></div>

--047d7b624e2a2d2e7b04ea80a33a--