Return-Path: Received: from smtp3.osuosl.org (smtp3.osuosl.org [140.211.166.136]) by lists.linuxfoundation.org (Postfix) with ESMTP id 65CDCC000B for ; Sat, 24 Apr 2021 11:02:34 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id 47357607C6 for ; Sat, 24 Apr 2021 11:02:34 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org X-Spam-Flag: NO X-Spam-Score: 0.001 X-Spam-Level: X-Spam-Status: No, score=0.001 tagged_above=-999 required=5 tests=[BAYES_50=0.8, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, MIME_HTML_ONLY=0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Authentication-Results: smtp3.osuosl.org (amavisd-new); dkim=pass (1024-bit key) header.d=mail.com Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mq8hvz6AKSBr for ; Sat, 24 Apr 2021 11:02:33 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from mout.gmx.com (mout.gmx.com [74.208.4.200]) by smtp3.osuosl.org (Postfix) with ESMTPS id 2B1B6607A2 for ; Sat, 24 Apr 2021 11:02:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=mail.com; s=dbd5af2cbaf7; t=1619262151; bh=d1T61OI4K5qlFEcNyUmtBfLObBgcMJgGf0pi+uxOL+Q=; h=X-UI-Sender-Class:From:To:Subject:Date; b=P+y7gVSmCif0yRQOkBFiDy7eUxtd8Br77ZKEwyt2PMAz6INmISMzZvgL7WAPl/ZlU AGSAaMJiPwn835bpyk8AWQfxYSRJ2mAXTwxWaeBnFZIHahTZP6MwlxhZcrJLBEZ/MO DbImOeq8znwkzUN9cllDBp34H35/sH6qs8eNKs/Q= X-UI-Sender-Class: 214d933f-fd2f-45c7-a636-f5d79ae31a79 Received: from [219.88.71.3] ([219.88.71.3]) by web-mail.mail.com (3c-app-mailcom-lxa11.server.lan [10.76.45.12]) (via HTTP); Sat, 24 Apr 2021 13:02:31 +0200 MIME-Version: 1.0 Message-ID: From: NITSOPOULOS KONSTANTINOS To: bitcoin-dev@lists.linuxfoundation.org Content-Type: text/html; charset=UTF-8 Date: Sat, 24 Apr 2021 13:02:31 +0200 Importance: normal Sensitivity: Normal X-Priority: 3 X-Provags-ID: V03:K1:6mBVsq+wHjgQlth/qjkmiShtuim+RZ0/hB42XOKUSaC/6ntc8WPzwgsDIpHA3J2dZ646H qKHqsdk6Tds752iVrVL6S1yNBFAleBJW+ZEE9ykGWY2P3CzNfRiMaktBy7SEhnnqmJlgc4CosrGP houBN/id3VxceHAuhTmP17nz7LiPCtrSTYcEqGRdsanVVABwCrNuRtrlpmdugcLR+R04Bp4ygjC8 4dfVWtD6VFYpJOTVyetPkAGYKi9PD4Dgk0j1wKhzXoIGWNLImy31meH9h53xhYV7UGnDaJNzokAU y0= X-UI-Out-Filterresults: notjunk:1;V03:K0:GW+nsA+JfrU=:SAbS9VZka2W1+r753VDbyw zYmRGCeOsKR1nnzLjeEqgsZBZw+nFHB/BQ8THxAZdCD5Dg43NfLUqAXDVlLG5F40USi4+zVqN CZrpE540Rc13Sjrhbn2yhUDGbHpU540APzfb5DTQp7nDH6RglxE7SMCQNF6IKyK05XyeInNZ1 0x5zKUbxJFdlHObgO0KYabbOT5bajRQQPxut6ak7sSOKAOADdOqmJDfU+pWyz3lPZnbZlBCMm yIUvb5QnGPhVclHPv83Nn9j76wLt0Qa0DySlgo++cNdABegdaTQTzKvggaWZQ6n8b1hTdES1H RCtvDSM5t9wEjdXZSLnQIU2AC/P31nXJCu72bk8ASi9ZyQoPV8y/8R/l0NMSxT3rN9ZiQ5Sg+ nPtazCbtQeoAlXuZrVy+Xw6fXwfoBQa4rb97fr3bc6aVc3PxP3pTgKPBd8qu3vcNblmolfE64 cNfizPDJMBLNvjKemRdtjWN8DvS4IiIlAB3b7YIASovxkjWgZalcw9rLFDzSPrU/DpkdOe2sP +2ok/5gHnl1jrm/upj6nKl2yrdn7O3rSPcmEQgrvs+LWwWyqmy/vQOJSLdT3WC4CwdsGnIqtH xtn4S7hAjZzbj19BzLlgeMp2gcpriLocnzYV/qTTchQGONiq4WdI2peSoMhBv0bJlwNPBnx9V 6AfhKrVyjf9O3HEWqBdNI0VknMTN3xVyhRBOvGg5sqJVRu5C3v6EuGegYIbaPeG80xANb48jq pafEfadzLN8kGl/yieM8byzi3VPlxOaK6EW49MWqvA02mPVWFxmB5ejE6224/q5nKQx0R8oJ3 KdqxOzx34RPj120dCYmupdvTkQYs/ENkQCCcO6VKP7jssYOeQiysTtrcY0IziYZ8YF61xv6h0 8C3JG93OrubsWS6ELHjTzL3BAHpKPYQYpOFfZz8PB/MXoZEqY54bckr30Z+yAl X-Mailman-Approved-At: Sat, 24 Apr 2021 18:12:11 +0000 Subject: [bitcoin-dev] 7z block compression, 18% X-BeenThere: bitcoin-dev@lists.linuxfoundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Bitcoin Protocol Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Apr 2021 11:02:34 -0000
Hi, I can compress new blocks by up to 18% using the 7z file type. I use wxHexEditor to dump a block's raw hex onto my disk, and then compress that with 7-Zip. I'd like to see 7z built into Bitcoin Core, for block compression (storage & propagation). The entire blockchain could be under 290GB if it's converted into a 7z archive-chain ("7z-chain"). I can compress some recent example blocks (hex -> less hex) if anyone wants. A future BIP could try increase the block Weight Units limit by up to 21% if 7z blocks are smaller & quick.
 
Programming compression seems too difficult for me, so I'm hoping somebody else does it!
 
Eventually I think transactions can be compressed by replacing addresses (& public keys) and coins, wherever possible, with just their own unique sequential index. TX amounts can also be compressed if they contain only a decimal digit or two, e.g. 00000000.10000000 XBT. A TX of 0.1 XBT between two existing addresses could be somehow compressed to half or maybe a quarter of its current size!
 
-Tinos