1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
|
Delivery-date: Tue, 12 Nov 2024 11:56:05 -0800
Received: from mail-vk1-f191.google.com ([209.85.221.191])
by mail.fairlystable.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
(Exim 4.94.2)
(envelope-from <bitcoindev+bncBDOYBLGOTUDRBTHFZ24QMGQE3R5ESOY@googlegroups.com>)
id 1tAwzc-0002eC-Nw
for bitcoindev@gnusha.org; Tue, 12 Nov 2024 11:56:05 -0800
Received: by mail-vk1-f191.google.com with SMTP id 71dfb90a1353d-50d32dc6574sf2761854e0c.3
for <bitcoindev@gnusha.org>; Tue, 12 Nov 2024 11:56:04 -0800 (PST)
ARC-Seal: i=2; a=rsa-sha256; t=1731441358; cv=pass;
d=google.com; s=arc-20240605;
b=DSBNiZcm+4kosPDNpRvDQg9mOF7Y2njlJ6DrSRqh3QfeyrqmmQoXN9x72LrJ6W4Lml
E4zk/x/llkoHnmg8kgadEKNwDsOWqzOWWDKzOabKt6T6zI6iFJE2hVwcp3JQp6raHSjo
g+KExUhp/Nsg7pLDCpRFVvp5Nuk9+u38kHnqb/Yt5Sb+NGWCLnM63u3Lya+sjrCjik2c
ftOGESijDJo26FxNnYZ1pmlLs/txrcNQYZDW2ggsSqGkELPTctzoX5In3p1irCnPIcQA
9u3gKcgLyEqIFW51P/GoA2PlMan7slEh5aVrhMCkVa2JyrEIs7BsdzkUmFiJdUAlwHd9
99XQ==
ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605;
h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post
:list-id:mailing-list:precedence:cc:to:subject:message-id:date:from
:mime-version:sender:dkim-signature:dkim-signature;
bh=RaDmXe3BfbEdmyJxvtDeKplonmlLLJckTs6Vi/hTzWs=;
fh=UcAy9B0Mk7rFHP+DVFUvUllrfEN+n6dGX4c3PcG4gJ8=;
b=NoHfSKSd9mFKOFmstYXEFnSfXxXsGYABariJBhtYLhdUbFmDOpPrLXoDixfJRn0pLa
vHCYXn/z1NKbqKxqx4pdU+Xr0Pjt2B87h81RkKzkxzUKE0RZUQ06A31pVnztogG1/Rzh
JVCCwd51l541eK4i4xG9tpqQn02+dSnxDCLNiVPzElHVpa4z8WSC8UzqDpupbPH3F4t4
XFCqs+AGvBD0bzvPj8vJ9865RcQOHiPKFGwam7AQtP55e+3CPhsokHfh59pRgEDgd6FB
3V5mqV4ZJJlqjXGVs/UyZBzse/ubiGKo5BpkkUzCUOsIqwy+okQjmNlw1A66WR7MeZhK
8aWg==;
darn=gnusha.org
ARC-Authentication-Results: i=2; gmr-mx.google.com;
dkim=pass header.i=@gmail.com header.s=20230601 header.b="mzO6d/kZ";
spf=pass (google.com: domain of kanzure@gmail.com designates 2a00:1450:4864:20::530 as permitted sender) smtp.mailfrom=kanzure@gmail.com;
dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com;
dara=pass header.i=@googlegroups.com
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=googlegroups.com; s=20230601; t=1731441358; x=1732046158; darn=gnusha.org;
h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post
:list-id:mailing-list:precedence:x-original-authentication-results
:x-original-sender:cc:to:subject:message-id:date:from:mime-version
:sender:from:to:cc:subject:date:message-id:reply-to;
bh=RaDmXe3BfbEdmyJxvtDeKplonmlLLJckTs6Vi/hTzWs=;
b=JrAihntqyDWW/qIy/NVM4fKMhHZJ7ETFXZT/sCF+IBnqUgnlxLvnCJ5i7xLp6AKVZZ
/gm5qny/OP4ZvCwy95EfyWOQbqOdDJJZ3ELFa0lwG5SMMk1NyPkiL6ZpQINSShuksKH9
RO/nncpV69jaVJLI54y3FSrnx5dkCW8wT7F3ym+QtULDojFqYB3AHI27Qt/qbRnyZddr
QozZHqnLXxHGUjNiLmGJHW6C7PkaAhIpYNoUK3f9OtKYMEG60t5IdtU1pNAhRfsBOp3c
IeLeoUDlqgM95Fu6txeQiX85N/MciFPqwEdDMZ8rnLE7iitkM/1A42QRvNxbj2g8smdd
quvg==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20230601; t=1731441358; x=1732046158; darn=gnusha.org;
h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post
:list-id:mailing-list:precedence:x-original-authentication-results
:x-original-sender:cc:to:subject:message-id:date:from:mime-version
:from:to:cc:subject:date:message-id:reply-to;
bh=RaDmXe3BfbEdmyJxvtDeKplonmlLLJckTs6Vi/hTzWs=;
b=jvc+Aac+VKbWjxOOev6AdZ73NQ8ZaWP5To7wBAvbV+vKRywP1JMMcCIa3MAgr4IIzO
3rACsNQgCGeYD7PMemJfBs+w418SUZZtZO3wXEh9bMua/eRJFldWSX8/lBpyGE8Vh4WU
RK4qeIJyE32HpzB3eMsjlUsqkW2RSsbV7B5CN1ub0aIzyek2ydT6Rs5S5HydlT4doWyy
5AjyRngG349AePXjkGcOHJUV/Nv8W91DG1/lh0XrHNFw6q1bHXbvtS/gne+rLgJiz4bM
/5QXJEMfCkVh5SFJXvV2e8D3o3IAi38VwKlK+S/6NExJdKL9Pfr8mHPav1xCx2npuUah
uqwg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1731441358; x=1732046158;
h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post
:list-id:mailing-list:precedence:x-original-authentication-results
:x-original-sender:cc:to:subject:message-id:date:from:mime-version
:x-beenthere:x-gm-message-state:sender:from:to:cc:subject:date
:message-id:reply-to;
bh=RaDmXe3BfbEdmyJxvtDeKplonmlLLJckTs6Vi/hTzWs=;
b=vEGxTjjzl222eH4cONJ2iaDoafJkMGitX7+eraqnLCkIjgZAQHdcz2U6nv3SOE/CtW
rLhnN0EpSneEbPMqghzabs5qcvpnIHKHIOFsBvHlYc5ublroyMdz0N6m6ive0R1zXic+
tgSo68IgXVjDUbF+38DT91zslhFm/rE/1hzDA9qLPj1Zut+3Op4Q0KtgZXXrs14YVZ1w
cptQfjgufluIvGlRz7tQmvpH98hfJDH7UaNGAesr2JmXrOn6e+YAeWlXi09jB3sb6CEo
dTlPt/uzqQuhXZzm9LrZt0ZTGiVC+evgkp3AazXWSGm5wLEE/gSeZLCFXIW8C0/VgJ05
5DWw==
Sender: bitcoindev@googlegroups.com
X-Forwarded-Encrypted: i=2; AJvYcCVinNx4sx3Fx1uy92ApO6tHQODCKtKL/gZSBn7C1gKwEK9GoBJarp/CzKxd0aQTCwNa/H3++g5M64gv@gnusha.org
X-Gm-Message-State: AOJu0Yw3yUat6yMDfaWIXowEi1Tg4/RcDBD5gqdhGL82K91LHbGvI8SL
NZ7I6+X91C/xmg99x+mPCXekjJvA9nPK/RPIyOcJUmN8HabDIhGH
X-Google-Smtp-Source: AGHT+IHCP3mmaMkjFQsXG+KcB2q3Fr7xTatphm65OGz0FFZGm8QtNm4QvkJt7q26WZNcgViTWyul8w==
X-Received: by 2002:a05:6102:50ac:b0:4a7:49ca:4ba4 with SMTP id ada2fe7eead31-4aae16acd04mr14099811137.27.1731441358338;
Tue, 12 Nov 2024 11:55:58 -0800 (PST)
X-BeenThere: bitcoindev@googlegroups.com
Received: by 2002:a05:622a:93:b0:458:2e21:e400 with SMTP id
d75a77b69052e-462fb133cf4ls99956761cf.0.-pod-prod-04-us; Tue, 12 Nov 2024
11:55:55 -0800 (PST)
X-Received: by 2002:a05:620a:24d5:b0:7b1:43e2:712e with SMTP id af79cd13be357-7b331eaaeeemr2244777885a.17.1731441355776;
Tue, 12 Nov 2024 11:55:55 -0800 (PST)
Received: by 2002:a05:620a:30c:b0:7b1:4744:32d3 with SMTP id af79cd13be357-7b34c3c33ebms85a;
Tue, 12 Nov 2024 11:55:04 -0800 (PST)
X-Received: by 2002:a05:600c:3c99:b0:42c:ba83:3f00 with SMTP id 5b1f17b1804b1-432b74febf4mr193541385e9.1.1731441302104;
Tue, 12 Nov 2024 11:55:02 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; t=1731441302; cv=none;
d=google.com; s=arc-20240605;
b=Bj2TBe0tgRMa5rvI69zI8pWIw0WkYcRrBIljwhXuK5eLvJtcNR71JjQrDkz14mfLqL
K9TCdaw3HJL3Fnu67RRiu8GJP3C4+JJMapJ+NROTqb03xPvWwAtfwMhGsv3Om1Z3sXtB
YCvzPoWnI40XaQ2Gn4kh7cD0QOR4vjETwqiLWfFUl38KF2Bgm3M+j+jSP9N4b79MziRf
t5+/nUxdPecr4x2wuhxBx29OcJLBxNPu0QsL0QgZzv+uwl3sBrNNyCSamlL2zEuSeGVM
vwMtjsPsLu66Xn92nY7iNQ8fZduN6EaTgBUuclPBYTtzbpfuDSSU7aT1OeQieib0m+Kd
t38g==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605;
h=cc:to:subject:message-id:date:from:mime-version:dkim-signature;
bh=1K3p7Q0ivNUm8CHRgtP957M/sQsEGmeDPYKdkg/oHT0=;
fh=J4aR1+1k9nQ9J+xtTlCA8yR//0DGKxczo4HNGfDNblg=;
b=AgedrmelogNMfIpIRItCBzsEKZ8s/91n1ipqw+iVXCBZ+feBTx57U+bOEbnB7pqvpi
2Xcb6G8YSBIMZznib+5P+88RybiUmu7Ph6UL9cG4cxjso27Js27fC8IpWoh2ibfETBNA
HbZlEZKxEo5MMsguf7OzXoXMUtx7/kVNAJPWmt8P4U1E5sAW3WayS7yCHU+MtV6JHiNK
JatN2ddNylYnTltNXo4urBObxyAlOasCwOX5J0waWAJz9aSvu2kRivK0I4OawlzC3d5V
iZCOgi8jVp78tq3bG9krDpvZJdqeNyBoITgDKsFOwkKK0Cdb1TUlKafEtIVzniGiB7mp
IRmA==;
dara=google.com
ARC-Authentication-Results: i=1; gmr-mx.google.com;
dkim=pass header.i=@gmail.com header.s=20230601 header.b="mzO6d/kZ";
spf=pass (google.com: domain of kanzure@gmail.com designates 2a00:1450:4864:20::530 as permitted sender) smtp.mailfrom=kanzure@gmail.com;
dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com;
dara=pass header.i=@googlegroups.com
Received: from mail-ed1-x530.google.com (mail-ed1-x530.google.com. [2a00:1450:4864:20::530])
by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-432d477271esi307705e9.0.2024.11.12.11.55.02
for <bitcoindev@googlegroups.com>
(version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);
Tue, 12 Nov 2024 11:55:02 -0800 (PST)
Received-SPF: pass (google.com: domain of kanzure@gmail.com designates 2a00:1450:4864:20::530 as permitted sender) client-ip=2a00:1450:4864:20::530;
Received: by mail-ed1-x530.google.com with SMTP id 4fb4d7f45d1cf-5cf0810f5f9so3933123a12.0
for <bitcoindev@googlegroups.com>; Tue, 12 Nov 2024 11:55:02 -0800 (PST)
X-Received: by 2002:a05:6402:5241:b0:5c9:4b8c:b92e with SMTP id
4fb4d7f45d1cf-5cf0a43f0b7mr23813786a12.26.1731441300714; Tue, 12 Nov 2024
11:55:00 -0800 (PST)
MIME-Version: 1.0
From: Bryan Bishop <kanzure@gmail.com>
Date: Tue, 12 Nov 2024 13:54:48 -0600
Message-ID: <CABaSBaz13bUoHCupXYhmX+yS0dn89f80yx8ZD3uO5-1RiLZJCQ@mail.gmail.com>
Subject: [bitcoindev] Broken links to the previous mailing list archive
To: bitcoindev@googlegroups.com
Cc: Bryan Bishop <kanzure@gmail.com>
Content-Type: text/plain; charset="UTF-8"
X-Original-Sender: kanzure@gmail.com
X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass
header.i=@gmail.com header.s=20230601 header.b="mzO6d/kZ"; spf=pass
(google.com: domain of kanzure@gmail.com designates 2a00:1450:4864:20::530 as
permitted sender) smtp.mailfrom=kanzure@gmail.com; dmarc=pass (p=NONE
sp=QUARANTINE dis=NONE) header.from=gmail.com; dara=pass header.i=@googlegroups.com
Precedence: list
Mailing-list: list bitcoindev@googlegroups.com; contact bitcoindev+owners@googlegroups.com
List-ID: <bitcoindev.googlegroups.com>
X-Google-Group-Id: 786775582512
List-Post: <https://groups.google.com/group/bitcoindev/post>, <mailto:bitcoindev@googlegroups.com>
List-Help: <https://groups.google.com/support/>, <mailto:bitcoindev+help@googlegroups.com>
List-Archive: <https://groups.google.com/group/bitcoindev
List-Subscribe: <https://groups.google.com/group/bitcoindev/subscribe>, <mailto:bitcoindev+subscribe@googlegroups.com>
List-Unsubscribe: <mailto:googlegroups-manage+786775582512+unsubscribe@googlegroups.com>,
<https://groups.google.com/group/bitcoindev/subscribe>
X-Spam-Score: -0.5 (/)
Hi,
lists.linuxfoundation.org is no longer hosting the static HTML email
archives for bitcoin-dev or any other mailing list. We knew that this
might happen and prepared months ago with the mailing list migration
and also with various backups:
https://gnusha.org/pi/bitcoindev/CABaSBaxDjj6ySBx4v+rmpfrw4pE9b=JZJPzPQj_ZUiBg1HGFyA@mail.gmail.com/
However, many thousands of links around the web are still pointing to
the old archive. This is really unfortunate as there is a wealth of
content in the archive and these links were considered canonical. This
is a general plea to update any broken links that you might be able to
fix.
What you can do, options
========================
There are a few options for actions that effected content providers can take:
1) Use `gnusha.org/url`. Explained below.
2) Replace lists.linuxfoundation.org urls with resolved urls to a new
location for mailing list archives. More on this below.
3) Do nothing. Wait and see. It is possible that we can plead our case
to Linux Foundation and get them to host static archives indefinitely,
or at least host redirects.
4) Replace broken links with Wayback Machine urls. Someone told me
apparently their archive is incomplete? I don't recommend this one
because I am concerned about stress and strain on the Internet Archive
Wayback Machine service beyond the additional activity that these
links would incur. Besides, Wayback is already a highly centralized
point for internet archival activity and therefore some
decenteralization is warranted here.
gnusha.org/url redirect service
===============================
This is a redirect service I made that takes a URL parameter and
redirects. To use it, get a previous url like:
`https://lists.linuxfoundation.org/pipermail/bitcoin-dev/2017-June/014472.html`
your new url will be:
`https://gnusha.org/url/https://lists.linuxfoundation.org/pipermail/bitcoin-dev/2017-June/014472.html`
and it will redirect to a current mailing list archive location for
that message:
`https://gnusha.org/pi/bitcoindev/ogoa6o$o4s$1@blaine.gmane.org/`
It uses a mapping file based on the mailing list archives. I have
published scripts to make this mapping here:
https://gist.github.com/kanzure/4e7bcc58344ceaa1a668e65a434adb2b
See https://gnusha.org/url for more information. Thank you to Jonas
Schnelli for suggesting the creation of this redirect service.
Manual resolution
=================
How to "manually" resolve "without" the gnusha.org/url redirect
service. Use resolver.py here:
https://gist.github.com/kanzure/4e7bcc58344ceaa1a668e65a434adb2b#file-resolver-py
and set RESOLVER_HOST to `https://gnusha.org/url`, also set `resolver
= resolve_locally` to `resolver = resolve_remotely`.
This will convert urls from the old LF format to resolved urls like:
`https://gnusha.org/pi/bitcoindev/CABaSBaxDjj6ySBx4v+rmpfrw4pE9b=JZJPzPQj_ZUiBg1HGFyA@mail.gmail.com/`
or
`https://mailing-list.bitcoindevs.xyz/bitcoindev/CABaSBaxDjj6ySBx4v+rmpfrw4pE9b=JZJPzPQj_ZUiBg1HGFyA@mail.gmail.com/`
depending on which public-inbox mirror you choose to use.
Why resolve or not
==================
I'll elaborate on `gnusha.org/url` vs `gnusha.org/pi/bitcoindev` style urls.
It is nice and simple to use a find-and-replace with `gnusha.org/url/`
because anyone can easily repeat that exercise and verify the git diff
before merging the pull request. However, the actual routing is not
something that is verified by just checking that the `git diff` looks
sane.
If I was to provide my mapping (I haven't uploaded this yet, but I did
publish the scripts I used to make it, hopefully someone will
re-generate it to verify my work), then someone could write a script
and/or cross-verify that all of the replacements are valid according
to the mapping, if we were to use the destination urls instead of the
redirect service for this pull request. Then someone would be able to
verify that kind of pull request.
There are other further issues though, like content malleability,
wrong redirect link injection, service provider compromise... instead
of referencing by Message-ID maybe in the future we can reference by
email hash.... But now I'm dreaming.
- Bryan
https://x.com/kanzure
--
You received this message because you are subscribed to the Google Groups "Bitcoin Development Mailing List" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bitcoindev+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/bitcoindev/CABaSBaz13bUoHCupXYhmX%2ByS0dn89f80yx8ZD3uO5-1RiLZJCQ%40mail.gmail.com.
|
