Return-Path: Received: from smtp4.osuosl.org (smtp4.osuosl.org [IPv6:2605:bc80:3010::137]) by lists.linuxfoundation.org (Postfix) with ESMTP id F06B6C0012 for ; Wed, 15 Dec 2021 17:25:29 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp4.osuosl.org (Postfix) with ESMTP id DF8DD41516 for ; Wed, 15 Dec 2021 17:25:29 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org X-Spam-Flag: NO X-Spam-Score: -2.098 X-Spam-Level: X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Authentication-Results: smtp4.osuosl.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from smtp4.osuosl.org ([127.0.0.1]) by localhost (smtp4.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5T9etoB2WO_R for ; Wed, 15 Dec 2021 17:25:28 +0000 (UTC) X-Greylist: whitelisted by SQLgrey-1.8.0 Received: from mail-pl1-x632.google.com (mail-pl1-x632.google.com [IPv6:2607:f8b0:4864:20::632]) by smtp4.osuosl.org (Postfix) with ESMTPS id A30AE410DC for ; Wed, 15 Dec 2021 17:25:28 +0000 (UTC) Received: by mail-pl1-x632.google.com with SMTP id u17so17032100plg.9 for ; Wed, 15 Dec 2021 09:25:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=IBadulXxG82TwaAXtKbkp0mDhr2GlH5to/Xj6/hL8rU=; b=OYdHLC/2z2U4MJF8eKd3ljlWBGDngxu9QHJbUMZaJjLt8yOypV/EjHAO7H0D2Uy9ho qyUA2VWyCZ4ESN8R6aAO+Ljpqd177rNFsyeG8N3uSTLPdb8tc4rhlE5D5496fkzJiZCB W/ksPH52PrpzhL8xumeT09XXTx4CNC9grKdGnmWvIg8rGyIC1cdQi4ZvllZBAfmDSs8e QWlHGLL2Eb9jWrQTF/Vu24lS3qWN3uojnpfLGEcvyPcR4eTCcVJD2jr08tlpwwO9Ub7r PyM0RhmQAQBX6io527yLNRLDlbAcW1+JoU9M8pTOU/XEKtWIkZGgEl99RuyErIXSoCV7 gHSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=IBadulXxG82TwaAXtKbkp0mDhr2GlH5to/Xj6/hL8rU=; b=vMDL2ZafhZzdIS8jW1s2K+mESfYk92Tv8RRdFGlvOx/JdUuUUrtWDoMOVTEM+Yckig 0oyAKPuNgKFbNnaqVUd96odCT/PlEAivI61SU07TXbG4z3C7KSBKPRrFRz8OCEgVDQ+2 sGoDKs2pOjZ0rnbIPpI66lR4xLne5b8RGBDq+38dzxfTojrZiL3puWkhzBZi3JYr3IeM AheQRgePQWf5frF7Li2+MgNlgjuqAHoLG9J5pbBDJBBIdxlD6rpkTdJqn0RjoU1Zj8IG UpkpsoNgouRgGBE2qrfC49GtFb6ngM1iF7O7HcAPjAeDLc21n8+I1ERyA7vONK+sKL1h R6Ug== X-Gm-Message-State: AOAM531m07GVenzXRNmvNn8Eiyc1PCcJ931cmXwat+9k5X8MWB2oyD+i wBPScnUYmpbI85dESBC4nGsh+BLa4aulo3EbFF9kcHG8 X-Google-Smtp-Source: ABdhPJxTWmXX/v7fly3xZdSa8byXBS7ufQEtj5yWye3RFLy/FjmVV3WyUxWgW977b4TqwncHh2ILLRo4T8TB5QD1IZw= X-Received: by 2002:a17:902:7b88:b0:148:91ab:be83 with SMTP id w8-20020a1709027b8800b0014891abbe83mr9769118pll.88.1639589127902; Wed, 15 Dec 2021 09:25:27 -0800 (PST) MIME-Version: 1.0 References: <20211214190524.GA30559@mcelrath.org> <20211215001200.GA35108@mcelrath.org> In-Reply-To: <20211215001200.GA35108@mcelrath.org> From: Billy Tetrud Date: Wed, 15 Dec 2021 09:25:15 -0800 Message-ID: To: Bob McElrath , Bitcoin Protocol Discussion Content-Type: multipart/alternative; boundary="0000000000008bda6905d33297b8" X-Mailman-Approved-At: Wed, 15 Dec 2021 18:00:29 +0000 Subject: Re: [bitcoin-dev] [Bitcoin Advent Calendar] Decentralized Coordination Free Mining Pools X-BeenThere: bitcoin-dev@lists.linuxfoundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Bitcoin Protocol Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Dec 2021 17:25:30 -0000 --0000000000008bda6905d33297b8 Content-Type: text/plain; charset="UTF-8" Looks like an interesting proposal, but it doesn't seem to quite match the goals you mentioned. As you do mention, this mining pool coordination doesn't get rid of the need for mining pools in the first place. So it doesn't satisfy item 1 on your goal list afaict. The primary benefits over what we have today that I can see are: 1. increased payout regularity, which lowers the viable size of mining pools, and 2. Lower on chain footprint through combining pay outs from multiple pools. Am I missing some? These are interesting benefits, but it would be nice if your post was clearer on that, since the goals list is not the same as the list of potential benefits of this kind of design. As far as enabling solo mining, what if this concept were used off chain? Have a public network of solo miners who publish "weak blocks" to that network, and the next 100 (or 1000 etc) nice miners pay you out as long as you're also being nice by following the protocol? All the nice optimizations you mentioned about eg combined taproot payouts would apply i think. The only goals this wouldn't satisfy are 3 and 5 since an extra network is needed, but to be fair, your proposal requires pools which all need their own extra network anyways. The missing piece here would be an ordering of weak blocks to make the window possible. Or at least a way to determine what blocks should definitely be part of a particular block's pay out. I could see this being done by a separate ephemeral blockchain (which starts fresh after each Bitcoin block) that keeps track of which weak blocks have been submitted, potentially using the pow already in each block to secure it. Granted that piece is a bit half baked, but it seems quite solvable. Wdyt? One thing that jumped out at me as not safe is throwing block rewards into a channel and being able to spend them immediately. There's a reason block rewards aren't spendable for a while, and channels don't solve that problem, do they? Why not simply reduce the on chain wait time for spending block rewards at that point? Seems like the consequences would be the same. On Tue, Dec 14, 2021, 16:12 Bob McElrath via bitcoin-dev < bitcoin-dev@lists.linuxfoundation.org> wrote: > You are hand waving. Attempting to redefine terms to justify your argument > is > intellectually dishonest. Bitcoin pools have *always* been about variance > reduction. Your window function fundamentally CANNOT be used to hedge > hashrate. > Various suggestions below introduce dangerous new games that might be > played by > miners. > > The fact is that the half-baked design you posted is less than useless, and > doesn't do anything that anyone wants. > > You are trying to justify CTV by making it be all things to all people. > "When > all you have is a hammer, every problem looks like a nail". Instead I > humbly > suggest that you pick ONE problem for which CTV is demonstrably the right > and > best solution, instead of snowing us with a ton of half-baked things that > *could* be done, and often don't even require CTV, and some (like this one) > fundamentally don't work. I do like some of your ideas, but if you had to > pick > just one "use case", which would it be? > > Jeremy [jlrubin@mit.edu] wrote: > > Bitcoin didn't invent the concept of pooling: > https://en.wikipedia.org/wiki/ > > Pooling_(resource_management). This is a Bitcoin Mining Pool, although > it may > > not be your favorite kind, which is fixated on specific properties of > computing > > contributions before finding a block. Pooling is just a general > technique for > > aggregating resources to accomplish something. If you have another name > like > > pooling that is in common use for this type of activity I would be more > than > > happy to adopt it. > > > > This sort of pool can hedge not only against fee rates but also against > > increases in hashrate since your historical rate 'carries' into the > future as a > > function of the window. Further, windows and reward functions can be > defined in > > a myriad of ways that could, e.g., pay less to blocks found in more rapid > > succession, contributing to the smoothing functionality. > > > > With respect to sub-block pooling, as described in the article, this > sort of > > design also helps with micro-pools being able to split resources > > non-custodially in every block as a part of the higher order DCFMP. The > point > > is not, as noted, to enable solo mining an S9, but to decrease the size > of the > > minimum viable pool. It's also possible to add, without much validation > or > > data, some 'uncle block' type mechanism in an incentive compatible way > (e.g., > > add 10 pow-heavy headers on the last block for cost 48 bytes header + 32 > bytes > > payout key) such that there's an incentive to include the heaviest ones > you've > > seen, not just your own, that are worth further study and consideration > > (particularly because it's non-consensus, only for opt-in participation > in the > > pool). > > > > With respect to space usage, it seems you wholly reject the viability of > a > > payment pool mechanism to cut-through chain space. Is this a critique > that > > holds for all Payment Pools, or just in the context of mining? Is there a > > particular reason why you think it infeasible that "strongly online" > > counterparties would be able to coordinate more efficiently? Is it > preferable > > for miners, the nexus of decentralization for Bitcoin, to prefer to use > > custodial services for pooling (which may require KYC/AM) over bearing a > cost > > of some extra potential chainload? > > > > Lastly, with respect to complexity, the proposal is actually incredibly > simple > > when you take it in a broader context. Non Interactive Channels and > Payment > > Pools are useful by themselves, so are the operations to merge them and > swap > > balance across them. Therefore most of the complexity in this proposal is > > relying on tools we'll likely see in everyday use in any case, DCFMP or > no. > > > > Jeremy > > !DSPAM:61b8f2f5321461582627336! > -- > Cheers, Bob McElrath > > "For every complex problem, there is a solution that is simple, neat, and > wrong." > -- H. L. Mencken > > _______________________________________________ > bitcoin-dev mailing list > bitcoin-dev@lists.linuxfoundation.org > https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev > --0000000000008bda6905d33297b8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Looks like an interesting proposal, but it doesn't se= em to quite match the goals you mentioned. As you do mention, this mining p= ool coordination doesn't get rid of the need for mining pools in the fi= rst place. So it doesn't satisfy item 1 on your goal list afaict.=C2=A0=

The primary benefits over wha= t we have today that I can see are:
1. increased pay= out regularity, which lowers the viable size of mining pools, and
2. Lower on chain footprint through combining pay outs from m= ultiple pools.

Am I miss= ing some?

These are inte= resting benefits, but it would be nice if your post was clearer on that, si= nce the goals list is not the same as the list of potential benefits of thi= s kind of design.

As far= as enabling solo mining, what if this concept were used off chain? Have a = public network of solo miners who publish "weak blocks" to that n= etwork, and the next 100 (or 1000 etc) nice miners pay you out as long as y= ou're also being nice by following the protocol? All the nice optimizat= ions you mentioned about eg combined taproot payouts would apply i think. T= he only goals this wouldn't satisfy are 3 and 5 since an extra network = is needed, but to be fair, your proposal requires pools which all need thei= r own extra network anyways.=C2=A0

The missing piece here would be an ordering of weak blocks to ma= ke the window possible. Or at least a way to determine what blocks should d= efinitely be part of a particular block's pay out. I could see this bei= ng done by a separate ephemeral blockchain (which starts fresh after each B= itcoin block) that keeps track of which weak blocks have been submitted, po= tentially using the pow already in each block to secure it. Granted that pi= ece is a bit half baked, but it seems quite solvable. Wdyt?

One thing that jumped out at me as no= t safe is throwing block rewards into a channel and being able to spend the= m immediately. There's a reason block rewards aren't spendable for = a while, and channels don't solve that problem, do they? Why not simply= reduce the on chain wait time for spending block rewards at that point? Se= ems like the consequences would be the same.

On Tue, Dec 14, 2021, 16:= 12 Bob McElrath via bitcoin-dev <bitcoin-dev@lists.li= nuxfoundation.org> wrote:
Yo= u are hand waving. Attempting to redefine terms to justify your argument is=
intellectually dishonest. Bitcoin pools have *always* been about variance reduction. Your window function fundamentally CANNOT be used to hedge hashr= ate.
Various suggestions below introduce dangerous new games that might be playe= d by
miners.

The fact is that the half-baked design you posted is less than useless, and=
doesn't do anything that anyone wants.

You are trying to justify CTV by making it be all things to all people. &qu= ot;When
all you have is a hammer, every problem looks like a nail".=C2=A0 Inst= ead I humbly
suggest that you pick ONE problem for which CTV is demonstrably the right a= nd
best solution, instead of snowing us with a ton of half-baked things that *could* be done, and often don't even require CTV, and some (like this = one)
fundamentally don't work. I do like some of your ideas, but if you had = to pick
just one "use case", which would it be?

Jeremy [jlrubin@mit.edu] wrote:
> Bitcoin didn't invent the concept of pooling: https://en.wikipedia.org/wiki/
> Pooling_(resource_management). This is a Bitcoin Mining Pool, although= it may
> not be your favorite kind, which is fixated on specific properties of = computing
> contributions before finding a block. Pooling is just a general techni= que for
> aggregating resources to accomplish something. If you have another nam= e like
> pooling that is in common use for this type of activity I would be mor= e than
> happy to adopt it.
>
> This sort of pool can hedge not only against fee rates but also agains= t
> increases in hashrate since your historical rate 'carries' int= o the future as a
> function of the window. Further, windows and reward functions can be d= efined in
> a myriad of ways that could, e.g., pay less to blocks found in more ra= pid
> succession, contributing to the smoothing functionality.
>
> With respect to sub-block pooling, as described in the article, this s= ort of
> design also helps with micro-pools being able to split resources
> non-custodially in every block as a part of the higher order DCFMP. Th= e point
> is not, as noted, to enable solo mining an S9, but to decrease the siz= e of the
> minimum viable pool. It's also possible to add, without much valid= ation or
> data, some 'uncle block' type mechanism in an incentive compat= ible way (e.g.,
> add 10 pow-heavy headers on the last block for cost 48 bytes header + = 32 bytes
> payout key) such that there's an incentive to include the heaviest= ones you've
> seen, not just your own, that are worth further study and consideratio= n
> (particularly because it's non-consensus, only for opt-in particip= ation in the
> pool).
>
> With respect to space usage, it seems you wholly reject the viability = of a
> payment pool mechanism to cut-through chain space. Is this a critique = that
> holds for all Payment Pools, or just in the context of mining? Is ther= e a
> particular reason why you think it infeasible that "strongly onli= ne"
> counterparties would be able to coordinate more efficiently? Is it pre= ferable
> for miners, the nexus of decentralization for Bitcoin, to prefer to us= e
> custodial services for pooling (which may require KYC/AM) over bearing= a cost
> of some extra potential chainload?
>
> Lastly, with respect to complexity, the proposal is actually incredibl= y simple
> when you take it in a broader context. Non Interactive Channels and Pa= yment
> Pools are useful=C2=A0by themselves, so are the operations to merge th= em and swap
> balance across them. Therefore most of the complexity in this proposal= is
> relying on tools we'll likely see in everyday use in any case, DCF= MP or no.
>
> Jeremy
> !DSPAM:61b8f2f5321461582627336!
--
Cheers, Bob McElrath

"For every complex problem, there is a solution that is simple, neat, = and wrong."
=C2=A0 =C2=A0 -- H. L. Mencken

_______________________________________________
bitcoin-dev mailing list
bitcoin-dev@lists.linuxfoundation.org
https://lists.li= nuxfoundation.org/mailman/listinfo/bitcoin-dev
--0000000000008bda6905d33297b8--