summaryrefslogtreecommitdiff
path: root/b3/43dfa6cf2ca5c50faa8cb0d739f38d9e59db87
blob: 1afad4e8021397d7964649e72674976bbb710a9e (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
Return-Path: <antoine.riard@gmail.com>
Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133])
 by lists.linuxfoundation.org (Postfix) with ESMTP id 5C0FFC000B
 for <bitcoin-dev@lists.linuxfoundation.org>;
 Thu, 17 Mar 2022 02:02:47 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by smtp2.osuosl.org (Postfix) with ESMTP id 28FD840ADF
 for <bitcoin-dev@lists.linuxfoundation.org>;
 Thu, 17 Mar 2022 02:02:47 +0000 (UTC)
X-Virus-Scanned: amavisd-new at osuosl.org
X-Spam-Flag: NO
X-Spam-Score: -2.098
X-Spam-Level: 
X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5
 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1,
 DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: smtp2.osuosl.org (amavisd-new);
 dkim=pass (2048-bit key) header.d=gmail.com
Received: from smtp2.osuosl.org ([127.0.0.1])
 by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 2DGKWgYA1zDC
 for <bitcoin-dev@lists.linuxfoundation.org>;
 Thu, 17 Mar 2022 02:02:44 +0000 (UTC)
X-Greylist: whitelisted by SQLgrey-1.8.0
Received: from mail-yb1-xb33.google.com (mail-yb1-xb33.google.com
 [IPv6:2607:f8b0:4864:20::b33])
 by smtp2.osuosl.org (Postfix) with ESMTPS id 49C8240111
 for <bitcoin-dev@lists.linuxfoundation.org>;
 Thu, 17 Mar 2022 02:02:44 +0000 (UTC)
Received: by mail-yb1-xb33.google.com with SMTP id u3so7731694ybh.5
 for <bitcoin-dev@lists.linuxfoundation.org>;
 Wed, 16 Mar 2022 19:02:44 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to
 :cc; bh=JN3l1Qltb55L28SFMrh4+Vd/n67UNC1IbILOmzxI4pc=;
 b=h5gU3wVXkPlGgsguSQm2Fe9PBlpqI8wIO/OCgT1q+MoWQxzWJXzxhAvBc9oE+zZhpy
 4ouZ8NM84MdYAGd8CKSEy8KZA+yNosXcDDL3T1hdsMIll3jZCGNgfGGR1E5m92tyAMkI
 R44M7XVRtC5oHdgzZ4U9tuwug1ccGDiDnXe75muPvD50S/o0Lri3vhZnHKytT8Dd7Ugu
 SzRnEDcyy/G+zP1m6FibFOEsEmxy68uBbyKm0CpG+xYZYy+WexWD6MG8rjxNwLrWrwiE
 BVwDx+VGH0qJjh8zxDCIaioe7dAqJ9k0u4vniL9X8+8Cq6bgyG/taRCd5jeZwPpgmJ23
 aMpg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to:cc;
 bh=JN3l1Qltb55L28SFMrh4+Vd/n67UNC1IbILOmzxI4pc=;
 b=sh1ubx1WMb75DQwhRFVce7pSNgII3bL0iP6Qiu7tamvrhH5til7INs9orNtYTPfYHg
 DH426wUpUpxaoEgvjkPfFs0iROw4OynVkFpr0k4E946zzmTQ6ah9zehA2/BmMdIyOo2S
 KOlmaJKFQn0VAcfbwgKBF0uxw2LmO3YqyXYLNEqT3xXXVUVoHewnGTAe/2K/XIF48R8H
 RYKqsEImYHFJMGkqJ/dkZV1GIyt6LLc7r6Pxz8vk5dD968eQOiG2BLeU4JMGrrm/1rJj
 pAHygWJCrAK9OHtqdio7EzZpRcr3mdKl/1T8F+kRAVv+cz3taa/LMuZhK1D2abxm45n6
 +bng==
X-Gm-Message-State: AOAM533BbCmjivC48J+RGSNiUvcZwRux8PbMSksei2UDFFrIYvqmgqnm
 p9vroZ4y5fgmMUNER1YffST6z0P3zNZPCJ+5Jgs=
X-Google-Smtp-Source: ABdhPJxbgUCvC+3quhq6UKfbWyNmXmVgoj3BRGqHVhmR9k6xd+Fv0rBBXM5lyJ8EoJNLoOj479dhAeXk7y4WQ1TIazY=
X-Received: by 2002:a05:6902:2d0:b0:625:2a16:2469 with SMTP id
 w16-20020a05690202d000b006252a162469mr3064549ybh.386.1647482563093; Wed, 16
 Mar 2022 19:02:43 -0700 (PDT)
MIME-Version: 1.0
References: <CAFXO6=LGbaur6XQrE+6a6mAAHXduOCXoWPTgPosxAG59ZkK6Gg@mail.gmail.com>
 <CALZpt+EjqKbhnN_5jy3kvYpMvjN8=iwRzMLSM7yS8_j-WzLrBQ@mail.gmail.com>
 <CACdvm3P1co1HDFKNxpHRe_JX_UPNw_P5qgL5cHCM=Qs+kR=B_A@mail.gmail.com>
 <GlEfqW7mh2W3uHkxDxwb5RSj-O_zbTUi4wa67oRz3erHRM1ykxT0BrcJrqulCOqrRLVJ4Bp8KVSOj0yJGB7rwcFGlZDyMrTsndPFO89hAQc=@protonmail.com>
 <CACdvm3P_-1DPxcWkd1J-PckPF1oRTtVB5zz5e3+VQ0Mko1T=hQ@mail.gmail.com>
 <CAFXO6=+WFUueqDh21NTZzA5EcSQjX2owFn0+dr0ua_BRLfV4QQ@mail.gmail.com>
 <20220208045850.GA6538@erisian.com.au>
 <CAFXO6=KMveswFvYdFCjsvt7a-Af+act4K3p8UrJXGyBO8E1o+w@mail.gmail.com>
In-Reply-To: <CAFXO6=KMveswFvYdFCjsvt7a-Af+act4K3p8UrJXGyBO8E1o+w@mail.gmail.com>
From: Antoine Riard <antoine.riard@gmail.com>
Date: Wed, 16 Mar 2022 22:02:30 -0400
Message-ID: <CALZpt+EOJW_Dmq_+2oNhmQF3x4KJ-qaM7=XGEYnt0JkWsPjh7g@mail.gmail.com>
To: Gloria Zhao <gloriajzhao@gmail.com>, 
 Bitcoin Protocol Discussion <bitcoin-dev@lists.linuxfoundation.org>
Content-Type: multipart/alternative; boundary="000000000000f2698e05da606c25"
X-Mailman-Approved-At: Thu, 17 Mar 2022 09:32:33 +0000
Cc: Anthony Towns <aj@erisian.com.au>
Subject: Re: [bitcoin-dev] Improving RBF Policy
X-BeenThere: bitcoin-dev@lists.linuxfoundation.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: Bitcoin Protocol Discussion <bitcoin-dev.lists.linuxfoundation.org>
List-Unsubscribe: <https://lists.linuxfoundation.org/mailman/options/bitcoin-dev>, 
 <mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=unsubscribe>
List-Archive: <http://lists.linuxfoundation.org/pipermail/bitcoin-dev/>
List-Post: <mailto:bitcoin-dev@lists.linuxfoundation.org>
List-Help: <mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=help>
List-Subscribe: <https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev>, 
 <mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=subscribe>
X-List-Received-Date: Thu, 17 Mar 2022 02:02:47 -0000

--000000000000f2698e05da606c25
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi Mempoololic Anonymous fellow,

> 2. Staggered broadcast of replacement transactions: within some time
> interval, maybe accept multiple replacements for the same prevout, but
only
> relay the original transaction.

If the goal of replacement staggering is to save on bandwidth, I'm not sure
it's going to be effective if you consider replacement done from a
shared-utxo. E.g, Alice broadcasts a package to confirm her commitment,
relay is staggered until T. At the same time, Bob broadcasts a package to
confirm his version of the commitment at a slightly better feerate, relay
is staggered until T.

At T, package A gradually floods from Alice's peers and package B does the
same from Bob's peers. When there is an intersection. B overrides A and
starts to replace package A in the network mempools nearest to Alice. I
think those peers won't have bandwidth saving from adopting a replacement
staggering strategy.

Or maybe that's something completely different if you have in mind ? I
think it's worth more staggering detail to guess if it's robust against all
the replacement propagations patterns.

Though if we aim to save on replacement bandwidth I wonder if a "diff-only"
strategy, assuming some new p2p mechanism, would be more interesting (as
discussed in the recent "Thoughts on fee bumping thread").

> A lingering concern that I have about this idea is it would then be
> possible to impact the propagation of another person=E2=80=99s transactio=
n, i.e.,
> an attacker can censor somebody=E2=80=99s transaction from ever being ann=
ounced by
> a node if they send enough transactions to fill up the rate limit.
> Obviously this would be expensive since they're spending a lot on fees,
but
> I imagine it could be profitable in some situations to spend a few
thousand
> dollars to prevent anyone from hearing about a transaction for a few
hours.
> This might be a non-issue in practice if the rate limit is generous and
> traffic isn=E2=80=99t horrendous, but is this a problem?

I think I share the concern too about an attacker exhausting a node
transaction relay ressources to prevent another person's transaction to
propagate, especially if the transaction targeted is a L2's time-sensitive
one. In that latter context, an attacker would aim to delay the relay of a
time-sensitive transaction (e.g a HTLC-success) to the miners, until the
timelock expires. The malicious delay period should swallow the go-to-chain
HTLC deadline ("the deadline for received HTLCs this node fulfilled" in
bolt 2 parlance), in that current example 18 blocks.

Let's say we allocate 10 MB of bandwidth per-block period. Once the 10 MB
are exhausted, there is no more bandwidth allocated until the next block is
issued. If the top mempool feerate is 1 sat/vb, such naive design would
allow an attacker to buy all the p2p network bandwidth period for 0.1 BTC.
If an attacker aims to jam a HTLC transaction for the 18 blocks period, the
cost is of 1,8 BTC. If the attacker is a LN counterparty to a HTLC worth
more than 1.8 BTC, the attack sounds economically profitable.

Worst, the p2p network bandwidth is a public resource while a HTLC is a
private, off-chain contract. An attacker could be counterparty to many
HTLCs, where each HTLC individual value is far inferior to the global p2p
bandwidth cost but the sum, only known to the attacker, is superior to.
Therefore, it sounds to me that p2p network bandwidth might be attractive
if the stealing are batched.

Is the attacker scenario described credible ? Are the numbers sketched out
realistic ?

If yes, I think one design insight for eventual transaction relay rate
limiting would be to make them "dynamic", and not naively fixed for a
period. By making them dynamic, an attacker would have to compete with the
effective feerate proposed by the victim transaction. E.g, if the
HTLC-success feerate is of 10 sat/vb, an attacker would have to propose a
stream of malicious transaction of more than 10 sat/vb during the whole
HTLC deadline period for the transaction-relay jamming to be effective.

Further, the attack might be invisible from the victim standpoint, the
malicious flow of feerate competitive transactions can be hard to
dissociate from an honest one. Thus, you can expect the
HTLC transaction issuer to only slowly increase the feerate at each block,
and those moves to be anticipated by the attacker. Even if the transaction
issuer adopts a scorched-earth approach for the latest blocks of the
deadline, the absolute value of the HTLC burnt in fees might still be less
than the transaction relay bandwidth exhaustion paid by the attacker
because the attack is batched by the attacker.

I'm not sure if this reasoning is correct. Though if yes, the issue sounds
really similar to "flood&loot" attack affecting LN previously researched on
[0]. What worries me more with this "exhaust&loot" is that if we introduce
bounded transaction relay rate limiting, it sounds a cheaper public
ressource to buy than the mempool..

[0] https://arxiv.org/pdf/2006.08513.pdf

Anyway, I would say it's worthy to investigate more transaction relay rate
limiting designs and especially carefully weigh the implications for L2s.
Those ones might have to adjust their fee-bumping and transaction
rebroadcast strategies in consequence.

> Suhas and Matt [proposed][0] adding a policy rule allowing users to
specify
> descendant limits on their transactions. For example, some nth bit of
> nSequence with nVersion 3 means "this transaction won't have more than X
> vbytes of descendants" where X =3D max(1000, vsizeof(tx)) or something. I=
t
> solves the pinning problem with package RBF where the attacker's package
> contains a very large and high-fee descendant.

Hey, what if the pinning transaction has a parent with a junk feerate ?

Let's say you have commitment tx for a HTLC of value 500000 sats, with top
mempool feerate of 50 sat/vbyte. The commitment tx is pinned by a malicious
tx of size 1000 vbytes, matching top mempool feerate. This malicious tx has
a second unconfirmed parent (in addition to the commitment) of size
MAX_STANDARD_TX_WEIGHT offering a 1 sat/vb. I think the pinning transaction
ancestor score would be less than 2 sat/vb and thus considered irrelevant
for block template inclusion ? At the same time, as the pinning transaction
is attached with a top mempool feerate, the honest user wouldn't be able to
replace it with a better-feerate proposal ? Unless adopting a
scorched-earth approach,  although economically I don't think this
fee-bumping strategy is safe in case of batch-pinning.

It might be fixable if we make one additional requirement "The child
transaction subject to the user-elected descendant limit must have only one
unconfirmed parent" (here the commitment
transaction) ? Though I'm not even sure of the robustness of this fix. The
commitment transaction itself could be used as a junk parent to downgrade
the pinning transaction ancestor score. E.g, using a revoked commitment
transaction with `max_accepted_htlcs` on both sides, pre-signed with a
feerate of 1 sat/vb. We might restrict the maximum number of pending HTLCs
network-wise to make the worst commitment transaction size reasonable,
though not sure if my LN colleagues are going to like the idea..

Is that reasoning correct and conform to our Ancestor Set Based algorithm
approach ? Maybe more details are needed.

> Also, coming back to the idea of "we can't just use {individual, ancestor=
}
> feerate," I'm interested in soliciting feedback on adding a =E2=80=9Cmini=
ng score=E2=80=9D
> calculator. I've implemented one [here][2] which takes the transaction in
> question, grabs all of the connected mempool transactions (including
> siblings, coparents, etc., as they wouldn=E2=80=99t be in the ancestor no=
r
> descendant sets), and builds a =E2=80=9Cblock template=E2=80=9D using our=
 current mining
> algorithm. The mining score of a transaction is the ancestor feerate at
> which it is included.

I don't have a strong opinion there yet, though if we make this "block
template" construction the default one, I would be really conservative to
avoid malicious child attachment on multi-party transactions downgrading
the block inclusion efficiency.

Antoine

Le mer. 9 mars 2022 =C3=A0 10:37, Gloria Zhao via bitcoin-dev <
bitcoin-dev@lists.linuxfoundation.org> a =C3=A9crit :

> Hi RBF friends,
>
> Posting a summary of RBF discussions at coredev (mostly on transaction
> relay rate-limiting), user-elected descendant limit as a short term
> solution to unblock package RBF, and mining score, all open for feedback:
>
> One big concept discussed was baking DoS protection into the p2p level
> rather than policy level. TLDR: The fees are not paid to the node operato=
r,
> but to the miner. While we can use fees to reason about the cost of an
> attack, if we're ultimately interested in preventing resource exhaustion,
> maybe we want to "stop the bleeding" when it happens and bound the amount
> of resources used in general. There were two main ideas:
>
> 1. Transaction relay rate limiting (i.e. the one you proposed above or
> some variation) with a feerate-based priority queue
> 2. Staggered broadcast of replacement transactions: within some time
> interval, maybe accept multiple replacements for the same prevout, but on=
ly
> relay the original transaction.
>
> Looking to solicit feedback on these ideas and the concept in general. Is
> it a good idea (separate from RBF) to add rate-limiting in transaction
> relay? And is it the right direction to think about RBF DoS protection th=
is
> way?
>
> A lingering concern that I have about this idea is it would then be
> possible to impact the propagation of another person=E2=80=99s transactio=
n, i.e.,
> an attacker can censor somebody=E2=80=99s transaction from ever being ann=
ounced by
> a node if they send enough transactions to fill up the rate limit.
> Obviously this would be expensive since they're spending a lot on fees, b=
ut
> I imagine it could be profitable in some situations to spend a few thousa=
nd
> dollars to prevent anyone from hearing about a transaction for a few hour=
s.
> This might be a non-issue in practice if the rate limit is generous and
> traffic isn=E2=80=99t horrendous, but is this a problem?
>
> And if we don't require an increase in (i.e. addition of "new") absolute
> fees, users are essentially allowed to =E2=80=9Crecycle=E2=80=9D fees. In=
 the scenario
> where we prioritize relay based on feerate, users could potentially be
> placed higher in the queue, ahead of other users=E2=80=99 transactions, m=
ultiple
> times, without ever adding more fees to the transaction. Again, maybe thi=
s
> isn=E2=80=99t a huge deal in practice if we set the parameters right, but=
 it seems=E2=80=A6
> not great, in principle.
>
> ---------
>
> It's probably also a good idea to point out that there's been some
> discussion happening on the gist containing my original post on this thre=
ad
> (https://gist.github.com/glozow/25d9662c52453bd08b4b4b1d3783b9ff).
>
> Suhas and Matt [proposed][0] adding a policy rule allowing users to
> specify descendant limits on their transactions. For example, some nth bi=
t
> of nSequence with nVersion 3 means "this transaction won't have more than=
 X
> vbytes of descendants" where X =3D max(1000, vsizeof(tx)) or something. I=
t
> solves the pinning problem with package RBF where the attacker's package
> contains a very large and high-fee descendant.
>
> We could add this policy and deploy it with package RBF/package relay so
> that LN can use it by setting the user-elected descendant limit flag on
> commitment transactions. (Otherwise package RBF is blocked until we find =
a
> more comprehensive solution to the pinning attack).
>
> It's simple to [implement][1] as a mempool policy, but adds some
> complexity for wallets that use it, since it limits their use of UTXOs fr=
om
> transactions with this bit set.
>
> ---------
>
> Also, coming back to the idea of "we can't just use {individual, ancestor=
}
> feerate," I'm interested in soliciting feedback on adding a =E2=80=9Cmini=
ng score=E2=80=9D
> calculator. I've implemented one [here][2] which takes the transaction in
> question, grabs all of the connected mempool transactions (including
> siblings, coparents, etc., as they wouldn=E2=80=99t be in the ancestor no=
r
> descendant sets), and builds a =E2=80=9Cblock template=E2=80=9D using our=
 current mining
> algorithm. The mining score of a transaction is the ancestor feerate at
> which it is included.
>
> This would be helpful for something like ancestor-aware funding and
> fee-bumping in the wallet: [3], [4]. I think if we did the rate-limited
> priority queue for transaction relay, we'd want to use something like thi=
s
> as the priority value. And for RBF, we probably want to require that a
> replacement have a higher mining score than the original transactions. Th=
is
> could be computationally expensive to do all the time; it could be good t=
o
> cache it but that could make mempool bookkeeping more complicated. Also, =
if
> we end up trying to switch to a candidate set-based algorithm for mining,
> we'd of course need a new calculator.
>
> [0]:
> https://gist.github.com/glozow/25d9662c52453bd08b4b4b1d3783b9ff?permalink=
_comment_id=3D4058140#gistcomment-4058140
> [1]: https://github.com/glozow/bitcoin/tree/2022-02-user-desclimit
> [2] https://github.com/glozow/bitcoin/tree/2022-02-mining-score
> [3]: https://github.com/bitcoin/bitcoin/issues/9645
> [4]: https://github.com/bitcoin/bitcoin/issues/15553
>
> Best,
> Gloria
>
> On Tue, Feb 8, 2022 at 4:58 AM Anthony Towns <aj@erisian.com.au> wrote:
>
>> On Mon, Feb 07, 2022 at 11:16:26AM +0000, Gloria Zhao wrote:
>> > @aj:
>> > > I wonder sometimes if it could be sufficient to just have a relay ra=
te
>> > > limit and prioritise by ancestor feerate though. Maybe something lik=
e:
>> > > - instead of adding txs to each peers setInventoryTxToSend
>> immediately,
>> > >   set a mempool flag "relayed=3Dfalse"
>> > > - on a time delay, add the top N (by fee rate) "relayed=3Dfalse" txs=
 to
>> > >   each peer's setInventoryTxToSend and mark them as "relayed=3Dtrue"=
;
>> > >   calculate how much kB those txs were, and do this again after
>> > >   SIZE/RATELIMIT seconds
>>
>> > > - don't include "relayed=3Dfalse" txs when building blocks?
>>
>> The "?" was me not being sure that point is a good suggestion...
>>
>> Miners might reasonably decide to have no rate limit, and always relay,
>> and never exclude txs -- but the question then becomes is whether they
>> hear about the tx at all, so rate limiting behaviour could still be a
>> potential problem for whoever made the tx.
>>
>> > Wow cool! I think outbound tx relay size-based rate-limiting and
>> > prioritizing tx relay by feerate are great ideas for preventing spamme=
rs
>> > from wasting bandwidth network-wide. I agree, this would slow the low
>> > feerate spam down, preventing a huge network-wide bandwidth spike. And
>> it
>> > would allow high feerate transactions to propagate as they should,
>> > regardless of how busy traffic is. Combined with inbound tx request
>> > rate-limiting, might this be sufficient to prevent DoS regardless of t=
he
>> > fee-based replacement policies?
>>
>> I think you only want to do outbound rate limits, ie, how often you send
>> INV, GETDATA and TX messages? Once you receive any of those, I think
>> you have to immediately process / ignore it, you can't really sensibly
>> defer it (beyond the existing queues we have that just build up while
>> we're busy processing other things first)?
>>
>> > One point that I'm not 100% clear on: is it ok to prioritize the
>> > transactions by ancestor feerate in this scheme? As I described in the
>> > original post, this can be quite different from the actual feerate we
>> would
>> > consider a transaction in a block for. The transaction could have a hi=
gh
>> > feerate sibling bumping its ancestor.
>> > For example, A (1sat/vB) has 2 children: B (49sat/vB) and C (5sat/vB).
>> If
>> > we just received C, it would be incorrect to give it a priority equal =
to
>> > its ancestor feerate (3sat/vB) because if we constructed a block
>> template
>> > now, B would bump A, and C's new ancestor feerate is 5sat/vB.
>> > Then, if we imagine that top N is >5sat/vB, we're not relaying C. If w=
e
>> > also exclude C when building blocks, we're missing out on good fees.
>>
>> I think you're right that this would be ugly. It's something of a
>> special case:
>>
>>  a) you really care about C getting into the next block; but
>>  b) you're trusting B not being replaced by a higher fee tx that
>>     doesn't have A as a parent; and
>>  c) there's a lot of txs bidding the floor of the next block up to a
>>     level in-between the ancestor fee rate of 3sat/vB and the tx fee
>>     rate of 5sat/vB
>>
>> Without (a), maybe you don't care about it getting to a miner quickly.
>> If your trust in (b) was misplaced, then your tx's effective fee rate
>> will drop and (because of (c)), you'll lose anyway. And if the spam ends
>> up outside of (c)'s range, either the rate limiting won't take effect
>> (spam's too cheap) and you'll be fine, or you'll miss out on the block
>> anyway (spam's paying more than your tx rate) and you never had any hope
>> of making it in.
>>
>> Note that we already rate limit via INVENTORY_BROADCAST_MAX /
>> *_INVENTORY_BROADCAST_INTERVAL; which gets to something like 10,500 txs
>> per 10 minutes for outbound connections. This would be a weight based
>> rate limit instead-of/in-addition-to that, I guess.
>>
>> As far as a non-ugly approach goes, I think you'd have to be smarter abo=
ut
>> tracking the "effective fee rate" than the ancestor fee rate manages;
>> maybe that's something that could fall out of Murch and Clara's candidat=
e
>> set blockbuilding ideas [0] ?
>>
>> Perhaps that same work would also make it possible to come up with
>> a better answer to "do I care that this replacement would invalidate
>> these descendents?"
>>
>> [0] https://github.com/Xekyo/blockbuilding
>>
>> > > - keep high-feerate evicted txs around for a while in case they get
>> > >   mined by someone else to improve compact block relay, a la the
>> > >   orphan pool?
>> > Replaced transactions are already added to vExtraTxnForCompact :D
>>
>> I guess I was thinking that it's just a 100 tx LRU cache, which might
>> not be good enough?
>>
>> Maybe it would be more on point to have a rate limit apply only to
>> replacement transactions?
>>
>> > For wallets, AJ's "All you need is for there to be *a* path that follo=
ws
>> > the new relay rules and gets from your node/wallet to perhaps 10% of
>> > hashpower" makes sense to me (which would be the former).
>>
>> Perhaps a corollarly of that is that it's *better* to have the mempool
>> acceptance rule only consider economic incentives, and have the spam
>> prevention only be about "shall I tell my peers about this?"
>>
>> If you don't have that split; then the anti-spam rules can prevent you
>> from getting the tx in the mempool at all; whereas if you do have the
>> split, then even if the bitcoind anti-spam rules are blocking you at
>> every turn, you can still send your tx to miners by some other route,
>> and then they can add it to their mempool directly without any hassle.
>>
>> Cheers,
>> aj
>>
>> _______________________________________________
> bitcoin-dev mailing list
> bitcoin-dev@lists.linuxfoundation.org
> https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev
>

--000000000000f2698e05da606c25
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hi Mempoololic Anonymous fellow,<br><br>&gt; 2. Stagg=
ered broadcast of replacement transactions: within some time<br>&gt; interv=
al, maybe accept multiple replacements for the same prevout, but only<br>&g=
t; relay the original transaction.<br><br>If the goal of replacement stagge=
ring is to save on bandwidth, I&#39;m not sure it&#39;s going to be effecti=
ve if you consider replacement done from a shared-utxo. E.g, Alice broadcas=
ts a package to confirm her commitment, relay is staggered until T. At the =
same time, Bob broadcasts a package to confirm his version of the commitmen=
t at a slightly better feerate, relay is staggered until T.<br><br>At T, pa=
ckage A gradually floods from Alice&#39;s peers and package B does the same=
 from Bob&#39;s peers. When there is an intersection. B overrides A and sta=
rts to replace package A in the network mempools nearest to Alice. I think =
those peers won&#39;t have bandwidth saving from adopting a replacement sta=
ggering strategy.<br><br>Or maybe that&#39;s something completely different=
 if you have in mind ? I think it&#39;s worth more staggering detail to gue=
ss if it&#39;s robust against all the replacement propagations patterns.<br=
><br>Though if we aim to save on replacement bandwidth I wonder if a &quot;=
diff-only&quot; strategy, assuming some new p2p mechanism, would be more in=
teresting (as discussed in the recent &quot;Thoughts on fee bumping thread&=
quot;).<br><br>&gt; A lingering concern that I have about this idea is it w=
ould then be<br>&gt; possible to impact the propagation of another person=
=E2=80=99s transaction, i.e.,<br>&gt; an attacker can censor somebody=E2=80=
=99s transaction from ever being announced by<br>&gt; a node if they send e=
nough transactions to fill up the rate limit.<br>&gt; Obviously this would =
be expensive since they&#39;re spending a lot on fees, but<br>&gt; I imagin=
e it could be profitable in some situations to spend a few thousand<br>&gt;=
 dollars to prevent anyone from hearing about a transaction for a few hours=
.<br>&gt; This might be a non-issue in practice if the rate limit is genero=
us and<br>&gt; traffic isn=E2=80=99t horrendous, but is this a problem?<br>=
<br>I think I share the concern too about an attacker exhausting a node tra=
nsaction relay ressources to prevent another person&#39;s transaction to pr=
opagate, especially if the transaction targeted is a L2&#39;s time-sensitiv=
e one. In that latter context, an attacker would aim to delay the relay of =
a time-sensitive transaction (e.g a HTLC-success) to the miners, until the =
timelock expires. The malicious delay period should swallow the go-to-chain=
 HTLC deadline (&quot;the deadline for received HTLCs this node fulfilled&q=
uot; in bolt 2 parlance), in that current example 18 blocks.<br><br>Let&#39=
;s say we allocate 10 MB of bandwidth per-block period. Once the 10 MB are =
exhausted, there is no more bandwidth allocated until the next block is iss=
ued. If the top mempool feerate is 1 sat/vb, such naive design would allow =
an attacker to buy all the p2p network bandwidth period for 0.1 BTC. If an =
attacker aims to jam a HTLC transaction for the 18 blocks period, the cost =
is of 1,8 BTC. If the attacker is a LN counterparty to a HTLC worth more th=
an 1.8 BTC, the attack sounds economically profitable.<br><br>Worst, the p2=
p network bandwidth is a public resource while a HTLC is a private, off-cha=
in contract. An attacker could be counterparty to many HTLCs, where each HT=
LC individual value is far inferior to the global p2p bandwidth cost but th=
e sum, only known to the attacker, is superior to. Therefore, it sounds to =
me that p2p network bandwidth might be attractive if the stealing are batch=
ed.<br><br>Is the attacker scenario described credible ? Are the numbers sk=
etched out realistic ?<br><br>If yes, I think one design insight for eventu=
al transaction relay rate limiting would be to make them &quot;dynamic&quot=
;, and not naively fixed for a period. By making them dynamic, an attacker =
would have to compete with the effective feerate proposed by the victim tra=
nsaction. E.g, if the HTLC-success feerate is of 10 sat/vb, an attacker wou=
ld have to propose a stream of malicious transaction of more than 10 sat/vb=
 during the whole HTLC deadline period for the transaction-relay jamming to=
 be effective.<br><br>Further, the attack might be invisible from the victi=
m standpoint, the malicious flow of feerate competitive transactions can be=
 hard to dissociate from an honest one. Thus, you can expect the<br>HTLC tr=
ansaction issuer to only slowly increase the feerate at each block, and tho=
se moves to be anticipated by the attacker. Even if the transaction issuer =
adopts a scorched-earth approach for the latest blocks of the deadline, the=
 absolute value of the HTLC burnt in fees might still be less than the tran=
saction relay bandwidth exhaustion paid by the attacker because the attack =
is batched by the attacker.<br><br>I&#39;m not sure if this reasoning is co=
rrect. Though if yes, the issue sounds really similar to &quot;flood&amp;lo=
ot&quot; attack affecting LN previously researched on [0]. What worries me =
more with this &quot;exhaust&amp;loot&quot; is that if we introduce bounded=
 transaction relay rate limiting, it sounds a cheaper public ressource to b=
uy than the mempool..<br><br>[0] <a href=3D"https://arxiv.org/pdf/2006.0851=
3.pdf">https://arxiv.org/pdf/2006.08513.pdf</a><br><br>Anyway, I would say =
it&#39;s worthy to investigate more transaction relay rate limiting designs=
 and especially carefully weigh the implications for L2s. Those ones might =
have to adjust their fee-bumping and transaction rebroadcast strategies in =
consequence.<br><br>&gt; Suhas and Matt [proposed][0] adding a policy rule =
allowing users to specify<br>&gt; descendant limits on their transactions. =
For example, some nth bit of<br>&gt; nSequence with nVersion 3 means &quot;=
this transaction won&#39;t have more than X<br>&gt; vbytes of descendants&q=
uot; where X =3D max(1000, vsizeof(tx)) or something. It<br>&gt; solves the=
 pinning problem with package RBF where the attacker&#39;s package<br>&gt; =
contains a very large and high-fee descendant.<br><br>Hey, what if the pinn=
ing transaction has a parent with a junk feerate ? <br><br>Let&#39;s say yo=
u have commitment tx for a HTLC of value 500000 sats, with top mempool feer=
ate of 50 sat/vbyte. The commitment tx is pinned by a malicious tx of size =
1000 vbytes, matching top mempool feerate. This malicious tx has a second u=
nconfirmed parent (in addition to the commitment) of size MAX_STANDARD_TX_W=
EIGHT offering a 1 sat/vb. I think the pinning transaction ancestor score w=
ould be less than 2 sat/vb and thus considered irrelevant for block templat=
e inclusion ? At the same time, as the pinning transaction is attached with=
 a top mempool feerate, the honest user wouldn&#39;t be able to replace it =
with a better-feerate proposal ? Unless adopting a scorched-earth approach,=
=C2=A0 although economically I don&#39;t think this fee-bumping strategy is=
 safe in case of batch-pinning.<br><br>It might be fixable if we make one a=
dditional requirement &quot;The child transaction subject to the user-elect=
ed descendant limit must have only one unconfirmed parent&quot; (here the c=
ommitment<br>transaction) ? Though I&#39;m not even sure of the robustness =
of this fix. The commitment transaction itself could be used as a junk pare=
nt to downgrade the pinning transaction ancestor score. E.g, using a revoke=
d commitment transaction with `max_accepted_htlcs` on both sides, pre-signe=
d with a feerate of 1 sat/vb. We might restrict the maximum number of pendi=
ng HTLCs network-wise to make the worst commitment transaction size reasona=
ble, though not sure if my LN colleagues are going to like the idea..<br><b=
r>Is that reasoning correct and conform to our Ancestor Set Based algorithm=
 approach ? Maybe more details are needed.<br><br>&gt; Also, coming back to=
 the idea of &quot;we can&#39;t just use {individual, ancestor}<br>&gt; fee=
rate,&quot; I&#39;m interested in soliciting feedback on adding a =E2=80=9C=
mining score=E2=80=9D<br>&gt; calculator. I&#39;ve implemented one [here][2=
] which takes the transaction in<br>&gt; question, grabs all of the connect=
ed mempool transactions (including<br>&gt; siblings, coparents, etc., as th=
ey wouldn=E2=80=99t be in the ancestor nor<br>&gt; descendant sets), and bu=
ilds a =E2=80=9Cblock template=E2=80=9D using our current mining<br>&gt; al=
gorithm. The mining score of a transaction is the ancestor feerate at<br>&g=
t; which it is included.<br><br>I don&#39;t have a strong opinion there yet=
, though if we make this &quot;block template&quot; construction the defaul=
t one, I would be really conservative to avoid malicious child attachment o=
n multi-party transactions downgrading the block inclusion efficiency.<br><=
br></div>Antoine<br></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" c=
lass=3D"gmail_attr">Le=C2=A0mer. 9 mars 2022 =C3=A0=C2=A010:37, Gloria Zhao=
 via bitcoin-dev &lt;<a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.or=
g">bitcoin-dev@lists.linuxfoundation.org</a>&gt; a =C3=A9crit=C2=A0:<br></d=
iv><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bord=
er-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div>=
Hi RBF friends,<br></div><div><br></div><div>Posting a summary of RBF discu=
ssions at coredev (mostly on transaction relay rate-limiting), user-elected=
 descendant limit as a short term solution to unblock package RBF, and mini=
ng score, all open for feedback:<br><br>One big concept discussed was bakin=
g DoS protection into the p2p level rather than policy level. TLDR: The fee=
s are not paid to the node operator, but to the miner. While we can use fee=
s to reason about the cost of an attack, if we&#39;re ultimately interested=
 in preventing resource exhaustion, maybe we want to &quot;stop the bleedin=
g&quot; when it happens and bound the amount of resources used in general. =
There were two main ideas:<br><br>1. Transaction relay rate limiting (i.e. =
the one you proposed above or some variation) with a feerate-based priority=
 queue<br>2. Staggered broadcast of replacement transactions: within some t=
ime interval, maybe accept multiple replacements for the same prevout, but =
only relay the original transaction.<br><br>Looking to solicit feedback on =
these ideas and the concept in general. Is it a good idea (separate from RB=
F) to add rate-limiting in transaction relay? And is it the right direction=
 to think about RBF DoS protection this way?<br><br>A lingering concern tha=
t I have about this idea is it would then be possible to impact the propaga=
tion of another person=E2=80=99s transaction, i.e., an attacker can censor =
somebody=E2=80=99s transaction from ever being announced by a node if they =
send enough transactions to fill up the rate limit. Obviously this would be=
 expensive since they&#39;re spending a lot on fees, but I imagine it could=
 be profitable in some situations to spend a few thousand dollars to preven=
t anyone from hearing about a transaction for a few hours. This might be a =
non-issue in practice if the rate limit is generous and traffic isn=E2=80=
=99t horrendous, but is this a problem?<br><br>And if we don&#39;t require =
an increase in (i.e. addition of &quot;new&quot;) absolute fees, users are =
essentially allowed to =E2=80=9Crecycle=E2=80=9D fees. In the scenario wher=
e we prioritize relay based on feerate, users could potentially be placed h=
igher in the queue, ahead of other users=E2=80=99 transactions, multiple ti=
mes, without ever adding more fees to the transaction. Again, maybe this is=
n=E2=80=99t a huge deal in practice if we set the parameters right, but it =
seems=E2=80=A6 not great, in principle.<br></div><div><br></div><div>------=
---<br></div><div><br></div><div>It&#39;s probably also a good idea to poin=
t out that there&#39;s been some discussion happening on the gist containin=
g my original post on this thread (<a href=3D"https://gist.github.com/glozo=
w/25d9662c52453bd08b4b4b1d3783b9ff" target=3D"_blank">https://gist.github.c=
om/glozow/25d9662c52453bd08b4b4b1d3783b9ff</a>).</div><div><br></div><div>S=
uhas and Matt [proposed][0] adding a policy rule allowing users to specify =
descendant limits on their transactions. For example, some nth bit of nSequ=
ence with nVersion 3 means &quot;this transaction won&#39;t have more than =
X vbytes of descendants&quot; where X =3D max(1000, vsizeof(tx)) or somethi=
ng. It solves the pinning problem with package RBF where the attacker&#39;s=
 package contains a very large and high-fee descendant.</div><div><br></div=
><div>We could add this policy and deploy it with package RBF/package relay=
 so that LN can use it by setting the user-elected descendant limit flag on=
 commitment transactions. (Otherwise package RBF is blocked until we find a=
 more comprehensive solution to the pinning attack).</div><div><br></div><d=
iv>It&#39;s simple to [implement][1] as a mempool policy, but adds some com=
plexity for wallets that use it, since it limits their use of UTXOs from tr=
ansactions with this bit set.<br></div><div><br></div><div>---------</div><=
div><br></div><div>Also, coming back to the idea of &quot;we can&#39;t just=
 use {individual, ancestor} feerate,&quot; I&#39;m interested in soliciting=
 feedback on adding a =E2=80=9Cmining score=E2=80=9D calculator. I&#39;ve i=
mplemented one [here][2] which takes the transaction in question, grabs all=
 of the connected mempool transactions (including siblings, coparents, etc.=
, as they wouldn=E2=80=99t be in the ancestor nor descendant sets), and bui=
lds a =E2=80=9Cblock template=E2=80=9D using our current mining algorithm. =
The mining score of a transaction is the ancestor feerate at which it is in=
cluded.<br></div><div><br></div><div>This would be helpful for something li=
ke ancestor-aware funding and fee-bumping in the wallet: [3], [4]. I think =
if we did the rate-limited priority queue for transaction relay, we&#39;d w=
ant to use something like this as the priority value. And for RBF, we proba=
bly want to require that a replacement have a higher mining score than the =
original transactions. This could be computationally expensive to do all th=
e time; it could be good to cache it but that could make mempool bookkeepin=
g more complicated. Also, if we end up trying to switch to a candidate set-=
based algorithm for mining, we&#39;d of course need a new calculator.<br></=
div><div><br></div><div>[0]: <a href=3D"https://gist.github.com/glozow/25d9=
662c52453bd08b4b4b1d3783b9ff?permalink_comment_id=3D4058140#gistcomment-405=
8140" target=3D"_blank">https://gist.github.com/glozow/25d9662c52453bd08b4b=
4b1d3783b9ff?permalink_comment_id=3D4058140#gistcomment-4058140</a><br>[1]:=
 <a href=3D"https://github.com/glozow/bitcoin/tree/2022-02-user-desclimit" =
target=3D"_blank">https://github.com/glozow/bitcoin/tree/2022-02-user-descl=
imit</a></div><div>[2] <a href=3D"https://github.com/glozow/bitcoin/tree/20=
22-02-mining-score" target=3D"_blank">https://github.com/glozow/bitcoin/tre=
e/2022-02-mining-score</a><br>[3]: <a href=3D"https://github.com/bitcoin/bi=
tcoin/issues/9645" target=3D"_blank">https://github.com/bitcoin/bitcoin/iss=
ues/9645</a><br>[4]: <a href=3D"https://github.com/bitcoin/bitcoin/issues/1=
5553" target=3D"_blank">https://github.com/bitcoin/bitcoin/issues/15553</a>=
<br></div><br><div>Best,</div><div>Gloria<br></div></div><br><div class=3D"=
gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Tue, Feb 8, 2022 at 4=
:58 AM Anthony Towns &lt;<a href=3D"mailto:aj@erisian.com.au" target=3D"_bl=
ank">aj@erisian.com.au</a>&gt; wrote:<br></div><blockquote class=3D"gmail_q=
uote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,2=
04);padding-left:1ex">On Mon, Feb 07, 2022 at 11:16:26AM +0000, Gloria Zhao=
 wrote:<br>
&gt; @aj:<br>
&gt; &gt; I wonder sometimes if it could be sufficient to just have a relay=
 rate<br>
&gt; &gt; limit and prioritise by ancestor feerate though. Maybe something =
like:<br>
&gt; &gt; - instead of adding txs to each peers setInventoryTxToSend immedi=
ately,<br>
&gt; &gt;=C2=A0 =C2=A0set a mempool flag &quot;relayed=3Dfalse&quot;<br>
&gt; &gt; - on a time delay, add the top N (by fee rate) &quot;relayed=3Dfa=
lse&quot; txs to<br>
&gt; &gt;=C2=A0 =C2=A0each peer&#39;s setInventoryTxToSend and mark them as=
 &quot;relayed=3Dtrue&quot;;<br>
&gt; &gt;=C2=A0 =C2=A0calculate how much kB those txs were, and do this aga=
in after<br>
&gt; &gt;=C2=A0 =C2=A0SIZE/RATELIMIT seconds<br>
<br>
&gt; &gt; - don&#39;t include &quot;relayed=3Dfalse&quot; txs when building=
 blocks?<br>
<br>
The &quot;?&quot; was me not being sure that point is a good suggestion...<=
br>
<br>
Miners might reasonably decide to have no rate limit, and always relay,<br>
and never exclude txs -- but the question then becomes is whether they<br>
hear about the tx at all, so rate limiting behaviour could still be a<br>
potential problem for whoever made the tx.<br>
<br>
&gt; Wow cool! I think outbound tx relay size-based rate-limiting and<br>
&gt; prioritizing tx relay by feerate are great ideas for preventing spamme=
rs<br>
&gt; from wasting bandwidth network-wide. I agree, this would slow the low<=
br>
&gt; feerate spam down, preventing a huge network-wide bandwidth spike. And=
 it<br>
&gt; would allow high feerate transactions to propagate as they should,<br>
&gt; regardless of how busy traffic is. Combined with inbound tx request<br=
>
&gt; rate-limiting, might this be sufficient to prevent DoS regardless of t=
he<br>
&gt; fee-based replacement policies?<br>
<br>
I think you only want to do outbound rate limits, ie, how often you send<br=
>
INV, GETDATA and TX messages? Once you receive any of those, I think<br>
you have to immediately process / ignore it, you can&#39;t really sensibly<=
br>
defer it (beyond the existing queues we have that just build up while<br>
we&#39;re busy processing other things first)?<br>
<br>
&gt; One point that I&#39;m not 100% clear on: is it ok to prioritize the<b=
r>
&gt; transactions by ancestor feerate in this scheme? As I described in the=
<br>
&gt; original post, this can be quite different from the actual feerate we =
would<br>
&gt; consider a transaction in a block for. The transaction could have a hi=
gh<br>
&gt; feerate sibling bumping its ancestor.<br>
&gt; For example, A (1sat/vB) has 2 children: B (49sat/vB) and C (5sat/vB).=
 If<br>
&gt; we just received C, it would be incorrect to give it a priority equal =
to<br>
&gt; its ancestor feerate (3sat/vB) because if we constructed a block templ=
ate<br>
&gt; now, B would bump A, and C&#39;s new ancestor feerate is 5sat/vB.<br>
&gt; Then, if we imagine that top N is &gt;5sat/vB, we&#39;re not relaying =
C. If we<br>
&gt; also exclude C when building blocks, we&#39;re missing out on good fee=
s.<br>
<br>
I think you&#39;re right that this would be ugly. It&#39;s something of a<b=
r>
special case:<br>
<br>
=C2=A0a) you really care about C getting into the next block; but<br>
=C2=A0b) you&#39;re trusting B not being replaced by a higher fee tx that<b=
r>
=C2=A0 =C2=A0 doesn&#39;t have A as a parent; and<br>
=C2=A0c) there&#39;s a lot of txs bidding the floor of the next block up to=
 a<br>
=C2=A0 =C2=A0 level in-between the ancestor fee rate of 3sat/vB and the tx =
fee<br>
=C2=A0 =C2=A0 rate of 5sat/vB<br>
<br>
Without (a), maybe you don&#39;t care about it getting to a miner quickly.<=
br>
If your trust in (b) was misplaced, then your tx&#39;s effective fee rate<b=
r>
will drop and (because of (c)), you&#39;ll lose anyway. And if the spam end=
s<br>
up outside of (c)&#39;s range, either the rate limiting won&#39;t take effe=
ct<br>
(spam&#39;s too cheap) and you&#39;ll be fine, or you&#39;ll miss out on th=
e block<br>
anyway (spam&#39;s paying more than your tx rate) and you never had any hop=
e<br>
of making it in.<br>
<br>
Note that we already rate limit via INVENTORY_BROADCAST_MAX /<br>
*_INVENTORY_BROADCAST_INTERVAL; which gets to something like 10,500 txs<br>
per 10 minutes for outbound connections. This would be a weight based<br>
rate limit instead-of/in-addition-to that, I guess.<br>
<br>
As far as a non-ugly approach goes, I think you&#39;d have to be smarter ab=
out<br>
tracking the &quot;effective fee rate&quot; than the ancestor fee rate mana=
ges;<br>
maybe that&#39;s something that could fall out of Murch and Clara&#39;s can=
didate<br>
set blockbuilding ideas [0] ?<br>
<br>
Perhaps that same work would also make it possible to come up with<br>
a better answer to &quot;do I care that this replacement would invalidate<b=
r>
these descendents?&quot;<br>
<br>
[0] <a href=3D"https://github.com/Xekyo/blockbuilding" rel=3D"noreferrer" t=
arget=3D"_blank">https://github.com/Xekyo/blockbuilding</a><br>
<br>
&gt; &gt; - keep high-feerate evicted txs around for a while in case they g=
et<br>
&gt; &gt;=C2=A0 =C2=A0mined by someone else to improve compact block relay,=
 a la the<br>
&gt; &gt;=C2=A0 =C2=A0orphan pool?<br>
&gt; Replaced transactions are already added to vExtraTxnForCompact :D<br>
<br>
I guess I was thinking that it&#39;s just a 100 tx LRU cache, which might<b=
r>
not be good enough?<br>
<br>
Maybe it would be more on point to have a rate limit apply only to<br>
replacement transactions?<br>
<br>
&gt; For wallets, AJ&#39;s &quot;All you need is for there to be *a* path t=
hat follows<br>
&gt; the new relay rules and gets from your node/wallet to perhaps 10% of<b=
r>
&gt; hashpower&quot; makes sense to me (which would be the former).<br>
<br>
Perhaps a corollarly of that is that it&#39;s *better* to have the mempool<=
br>
acceptance rule only consider economic incentives, and have the spam<br>
prevention only be about &quot;shall I tell my peers about this?&quot;<br>
<br>
If you don&#39;t have that split; then the anti-spam rules can prevent you<=
br>
from getting the tx in the mempool at all; whereas if you do have the<br>
split, then even if the bitcoind anti-spam rules are blocking you at<br>
every turn, you can still send your tx to miners by some other route,<br>
and then they can add it to their mempool directly without any hassle.<br>
<br>
Cheers,<br>
aj<br>
<br>
</blockquote></div>
_______________________________________________<br>
bitcoin-dev mailing list<br>
<a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.org" target=3D"_blank">=
bitcoin-dev@lists.linuxfoundation.org</a><br>
<a href=3D"https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev" =
rel=3D"noreferrer" target=3D"_blank">https://lists.linuxfoundation.org/mail=
man/listinfo/bitcoin-dev</a><br>
</blockquote></div>

--000000000000f2698e05da606c25--