summaryrefslogtreecommitdiff
path: root/81/1c318926066e1ff792e43706e394c2617cf9a2
blob: 25502ff4078240269d6047b6919049348b7a6947 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
Return-Path: <j@toom.im>
Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org
	[172.17.192.35])
	by mail.linuxfoundation.org (Postfix) with ESMTPS id 40760412
	for <bitcoin-dev@lists.linuxfoundation.org>;
	Thu, 22 Oct 2015 16:28:06 +0000 (UTC)
X-Greylist: from auto-whitelisted by SQLgrey-1.7.6
Received: from c.mail.sonic.net (c.mail.sonic.net [64.142.111.80])
	by smtp1.linuxfoundation.org (Postfix) with ESMTPS id B93EC63
	for <bitcoin-dev@lists.linuxfoundation.org>;
	Thu, 22 Oct 2015 16:28:05 +0000 (UTC)
Received: from [192.168.1.190] (63.135.62.197.nwinternet.com [63.135.62.197]
	(may be forged)) (authenticated bits=0)
	by c.mail.sonic.net (8.15.1/8.15.1) with ESMTPSA id t9MGS1VX029230
	(version=TLSv1 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT);
	Thu, 22 Oct 2015 09:28:02 -0700
Content-Type: multipart/signed;
	boundary="Apple-Mail=_78BD18D0-A3E3-445C-BACC-743321EC42DD";
	protocol="application/pgp-signature"; micalg=pgp-sha512
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\))
X-Pgp-Agent: GPGMail 2.5.2
From: Jonathan Toomim <j@toom.im>
In-Reply-To: <CAP3QyG+QnZ+51w=z_eM1+gQsWEO+Aj5FztyLNid8ym6duabesQ@mail.gmail.com>
Date: Thu, 22 Oct 2015 09:27:59 -0700
Message-Id: <EE15A8BE-0606-4610-B5A8-0C3C1BC5017E@toom.im>
References: <99C42DE7-814A-48F8-AB28-A5ADD77A9FD9@toom.im>
	<1FE17DEB-8F77-4A60-A644-46A4F97D0E24@toom.im>
	<984D5FD5-9871-43FC-BD44-5F2E6EFD0671@toom.im>
	<1445414983.m7gvNPDAo8@garp>
	<CAP3QyG+QnZ+51w=z_eM1+gQsWEO+Aj5FztyLNid8ym6duabesQ@mail.gmail.com>
To: bitcoin-xt <bitcoin-xt@googlegroups.com>,
	Bitcoin Dev <bitcoin-dev@lists.linuxfoundation.org>
X-Mailer: Apple Mail (2.1878.6)
X-Sonic-CAuth: UmFuZG9tSVbQmh0VkKxa32A9yqazeu9fbSyl7/vsrMW4zQez/qz0QvCSzrh8OVRcXMdOcuxlbAnySaWsMuIs7PXnR44Cf/gA
X-Sonic-ID: C;xvy33Nl45RGC9L0U9jFv0A== M;4Gd93dl45RGC9L0U9jFv0A==
X-Sonic-Spam-Details: 0.0/5.0 by cerberusd
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,HTML_MESSAGE,
	RCVD_IN_DNSWL_LOW autolearn=ham version=3.3.1
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on
	smtp1.linux-foundation.org
X-Mailman-Approved-At: Thu, 22 Oct 2015 16:36:37 +0000
Subject: Re: [bitcoin-dev] Memory leaks?
X-BeenThere: bitcoin-dev@lists.linuxfoundation.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Bitcoin Development Discussion <bitcoin-dev.lists.linuxfoundation.org>
List-Unsubscribe: <https://lists.linuxfoundation.org/mailman/options/bitcoin-dev>,
	<mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=unsubscribe>
List-Archive: <http://lists.linuxfoundation.org/pipermail/bitcoin-dev/>
List-Post: <mailto:bitcoin-dev@lists.linuxfoundation.org>
List-Help: <mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=help>
List-Subscribe: <https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev>,
	<mailto:bitcoin-dev-request@lists.linuxfoundation.org?subject=subscribe>
X-List-Received-Date: Thu, 22 Oct 2015 16:28:06 -0000


--Apple-Mail=_78BD18D0-A3E3-445C-BACC-743321EC42DD
Content-Type: multipart/alternative;
	boundary="Apple-Mail=_2F109C19-DFA6-409E-BAAF-43B8511106FC"


--Apple-Mail=_2F109C19-DFA6-409E-BAAF-43B8511106FC
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

You may want to add a cron job to restart bitcoind every day or two as a =
damage control mechanism until we figure this out.

On Oct 22, 2015, at 9:06 AM, Multipool Admin <admin@multipool.us> wrote:

> This is a real issue.  The bitcoind process is getting killed every =
few days when it reaches around 55gb of usage on my server.
>=20
> On Oct 21, 2015 12:29 AM, "Tom Zander via bitcoin-dev" =
<bitcoin-dev@lists.linuxfoundation.org> wrote:
> On Tuesday 20 Oct 2015 20:01:16 Jonathan Toomim wrote:
> >  claimed that he had this memory usage issue on Linux, but not on =
Mac OS X,
> > under a GBT workload in both situations. If this is true, that would
> > suggest this might be a fragmentation issue due to poor memory =
allocation.
>=20
> Please make sure you measure your memory usage correctly on Linux, it =
is
> notoriously easy to get misleading info from tools like top.
>=20
> I use this one on Linux.
>=20
> $cat ~/bin/showmemusage
> #!/bin/sh
> if test -z "$1"; then
>     echo "need a pid"
>     exit
> fi
>=20
> mem=3D`echo 0 $(cat /proc/$1/smaps | grep Pss | awk '{print $2}' | \
> sed 's#^#+#' ) | bc`
> echo "$mem KB"
>=20
> _______________________________________________
> bitcoin-dev mailing list
> bitcoin-dev@lists.linuxfoundation.org
> https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev
>=20
>=20
> --
> You received this message because you are subscribed to the Google =
Groups "bitcoin-xt" group.
> To unsubscribe from this group and stop receiving emails from it, send =
an email to bitcoin-xt+unsubscribe@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.


--Apple-Mail=_2F109C19-DFA6-409E-BAAF-43B8511106FC
Content-Transfer-Encoding: 7bit
Content-Type: text/html;
	charset=us-ascii

<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div>You may want to add a cron job to restart bitcoind every day or two as a damage control mechanism until we figure this out.</div><br><div><div>On Oct 22, 2015, at 9:06 AM, Multipool Admin &lt;<a href="mailto:admin@multipool.us">admin@multipool.us</a>&gt; wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><p dir="ltr">This is a real issue.&nbsp; The bitcoind process is getting killed every few days when it reaches around 55gb of usage on my server.</p>
<div class="gmail_quote">On Oct 21, 2015 12:29 AM, "Tom Zander via bitcoin-dev" &lt;<a href="mailto:bitcoin-dev@lists.linuxfoundation.org">bitcoin-dev@lists.linuxfoundation.org</a>&gt; wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Tuesday 20 Oct 2015 20:01:16 Jonathan Toomim wrote:<br>
&gt;&nbsp; claimed that he had this memory usage issue on Linux, but not on Mac OS X,<br>
&gt; under a GBT workload in both situations. If this is true, that would<br>
&gt; suggest this might be a fragmentation issue due to poor memory allocation.<br>
<br>
Please make sure you measure your memory usage correctly on Linux, it is<br>
notoriously easy to get misleading info from tools like top.<br>
<br>
I use this one on Linux.<br>
<br>
$cat ~/bin/showmemusage<br>
#!/bin/sh<br>
if test -z "$1"; then<br>
&nbsp; &nbsp; echo "need a pid"<br>
&nbsp; &nbsp; exit<br>
fi<br>
<br>
mem=`echo 0 $(cat /proc/$1/smaps | grep Pss | awk '{print $2}' | \<br>
sed 's#^#+#' ) | bc`<br>
echo "$mem KB"<br>
<br>_______________________________________________<br>
bitcoin-dev mailing list<br>
<a href="mailto:bitcoin-dev@lists.linuxfoundation.org">bitcoin-dev@lists.linuxfoundation.org</a><br>
<a href="https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev" rel="noreferrer" target="_blank">https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev</a><br>
<br></blockquote></div><div><br class="webkit-block-placeholder"></div>

-- <br>
You received this message because you are subscribed to the Google Groups "bitcoin-xt" group.<br>
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:bitcoin-xt+unsubscribe@googlegroups.com">bitcoin-xt+unsubscribe@googlegroups.com</a>.<br>
For more options, visit <a href="https://groups.google.com/d/optout">https://groups.google.com/d/optout</a>.<br>
</blockquote></div><br></body></html>
--Apple-Mail=_2F109C19-DFA6-409E-BAAF-43B8511106FC--

--Apple-Mail=_78BD18D0-A3E3-445C-BACC-743321EC42DD
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQEcBAEBCgAGBQJWKQ6QAAoJEIEuMk4MG0P1hiEH/0+PA/VbIYfcbSS14LoRziEB
W/8KWnNnJTarNcJsejdorTz2Km6Z9Xit0OyZExrk9jc+xglqoLzHsMmTWO8l6kpz
4UukgoeMIC5nYPg8OYGStkFeoWRceGqvo1GtaJmxAI48fcg3tS7tH8r3OvKjhmRJ
BOgBCXYGvpT1Nax9mF3OjoT0oPFC7r1Tl/BlfO7lpJE70C5EeUGFhA+wT5kSVans
XVu6hNibJRruL0JWT2oSCdfF/YIMF515kNu76TZc5BHLYLz6QtO23FrFVN3hgv/9
TiRu1QAUtBk29jRfdpHplfdlvFLF+HXbdq6IA2G3SdN/tuse6uaukkRVytsXnfY=
=ZiNb
-----END PGP SIGNATURE-----

--Apple-Mail=_78BD18D0-A3E3-445C-BACC-743321EC42DD--