Slow status page load, php-fpm uses 100% CPU

Bugs in eFa 4
Post Reply
Marcell
Posts: 3
Joined: 13 Nov 2018 09:02

Slow status page load, php-fpm uses 100% CPU

Post by Marcell »

Hello,

I have an EFA-4.0.2 installation, that recently started to load the status page very slowly. Top shows php-fpm with 100% CPU utilization. The "rendering" pauses at the first badmail line, after loading it, everything is back to normal. The hw requriements are met. Any ideas?

Update: now its not even loading the status page. Php log:

Code: Select all

15-Jun-2020 10:24:30] NOTICE: systemd monitor interval set to 10000ms
[15-Jun-2020 10:56:32] WARNING: [pool www] child 1302 exited with code 124 after 1921.881321 seconds from start
[15-Jun-2020 10:56:32] NOTICE: [pool www] child 22296 started
[15-Jun-2020 10:58:14] WARNING: [pool www] child 4338 exited with code 124 after 2002.944559 seconds from start
[15-Jun-2020 10:58:14] NOTICE: [pool www] child 23307 started
[15-Jun-2020 10:59:22] WARNING: [pool www] child 1300 exited with code 124 after 2091.572042 seconds from start
[15-Jun-2020 10:59:22] NOTICE: [pool www] child 23916 started
[15-Jun-2020 11:00:02] WARNING: [pool www] child 5909 exited with code 124 after 2101.984471 seconds from start
[15-Jun-2020 11:00:02] NOTICE: [pool www] child 24333 started
[15-Jun-2020 11:01:10] WARNING: [pool www] child 22296 exited with code 124 after 277.744895 seconds from start
[15-Jun-2020 11:01:10] NOTICE: [pool www] child 25036 started
[15-Jun-2020 11:02:17] WARNING: [pool www] child 3253 exited with code 124 after 2260.086874 seconds from start
[15-Jun-2020 11:02:17] NOTICE: [pool www] child 25648 started
[15-Jun-2020 11:03:06] WARNING: [pool www] child 1304 exited with code 124 after 2315.527034 seconds from start
[15-Jun-2020 11:03:06] NOTICE: [pool www] child 26102 started
[15-Jun-2020 11:03:25] WARNING: [pool www] child 3318 exited with code 124 after 2327.335060 seconds from start
[15-Jun-2020 11:03:25] NOTICE: [pool www] child 26222 started
[15-Jun-2020 11:07:27] WARNING: [pool www] child 25648 exited with code 124 after 309.658500 seconds from start
[15-Jun-2020 11:07:27] NOTICE: [pool www] child 29365 started
[15-Jun-2020 11:09:05] WARNING: [pool www] child 26222 exited with code 124 after 339.657924 seconds from start
[15-Jun-2020 11:09:05] NOTICE: [pool www] child 30258 started
[15-Jun-2020 11:15:16] WARNING: [pool www] child 1301 exited with code 124 after 3045.859540 seconds from start
[15-Jun-2020 11:15:16] NOTICE: [pool www] child 35320 started
[15-Jun-2020 11:16:48] WARNING: [pool www] child 23916 exited with code 124 after 1046.749013 seconds from start
[15-Jun-2020 11:16:48] NOTICE: [pool www] child 36123 started
[15-Jun-2020 11:32:47] WARNING: [pool www] child 25036 exited with code 124 after 1897.370847 seconds from start
[15-Jun-2020 11:32:47] NOTICE: [pool www] child 45159 started

Marcell
Posts: 3
Joined: 13 Nov 2018 09:02

Re: Slow status page load, php-fpm uses 100% CPU

Post by Marcell »

Update: I narrowed down the issue to one problematic mail - that had "bad content" ( .jar-s as attachement). As soon as I try to display a page that is listing this mail, I get the timeout. The message is not in the

Code: Select all

/var/spool/MailScanner/quaratine
folder. If I generate a report, that does not contain this message, everything is ok.

So my question is, how to remove the message in question? (from the EFA web interface and from the host os)
User avatar
pdwalker
Posts: 1553
Joined: 18 Mar 2015 09:16

Re: Slow status page load, php-fpm uses 100% CPU

Post by pdwalker »

shawniverson,

This is a problem that has come up a couple of times now.

Is there an "approved" way of removing a troublesome message from the system without breaking things?
Marcell
Posts: 3
Joined: 13 Nov 2018 09:02

Re: Slow status page load, php-fpm uses 100% CPU

Post by Marcell »

pdwalker wrote: 15 Jun 2020 11:35 shawniverson,

This is a problem that has come up a couple of times now.

Is there an "approved" way of removing a troublesome message from the system without breaking things?
For now I would be very happy with an unapproved solution as well.
User avatar
pdwalker
Posts: 1553
Joined: 18 Mar 2015 09:16

Re: Slow status page load, php-fpm uses 100% CPU

Post by pdwalker »

That depends on what the real problem is.

If it were my system, and I wasn't afraid of digging in and possibly restoring everything from backups after I've screwed things up accidently, I'd try the following:

1/ is it the actual message?

If so, where is the message stored? quarantine? spam? nonspam? Could I copy the a "good" message (send yourself one) into the location with the bad message

backup the bad message first in case it's actually a message that is really good and really should be received by the recipient.

2/ is it the database entry in the maillog table? If so, delete it, and then delete the message (assuming you don't want to keep it) from the file system

test to see if your problem is resolved.

If not, investigate and try to find out where the system is hanging up.
arazim1284
Posts: 12
Joined: 09 Mar 2015 12:21

Re: Slow status page load, php-fpm uses 100% CPU

Post by arazim1284 »

I probably had a similar problem. viewtopic.php?f=19&t=4363
Something is probably stored in the DB and that makes a problem.

The problem will solve itself. Until the email expires from quarantine :-)
User avatar
shawniverson
Posts: 3644
Joined: 13 Jan 2014 23:30
Location: Indianapolis, Indiana USA
Contact:

Re: Slow status page load, php-fpm uses 100% CPU

Post by shawniverson »

pdwalker wrote: 15 Jun 2020 11:35 shawniverson,

This is a problem that has come up a couple of times now.

Is there an "approved" way of removing a troublesome message from the system without breaking things?
The best way is probably to remove the row from the maillog table.

This could be really easy with a little script that prompts for the message id. I wonder if this might be helpful for these situations?
User avatar
pdwalker
Posts: 1553
Joined: 18 Mar 2015 09:16

Re: Slow status page load, php-fpm uses 100% CPU

Post by pdwalker »

I'll write one up for you then.
Post Reply