Long Lists loading in MailWatch web interface

[maxkmv]

Hi Experts!

Is there a way to speed up Lists loading in Mailwatch web interface? In my web browser (Google Chrome) it takes almost 1 min to load lists.. a month ago it didn't do it - it was very quick.. Already tried rebooting the VM, either Chrome has updated or EFA updated itself and now I have this problem. Everything else works fine..

[darky83]

Do you have a whole lot of white/black list items?

If you look at the bottom of the page you will see an entry like:

Code: Select all

Page generated in 0.388177 seconds

Is the generating of the page also taking a long time or is it just displaying the page?

[maxkmv]

Its a big list, fair enough.. may be a thousand entries or so..

It says at the bottom:

Page generated in 19.221441 seconds

Is that normal for a big list?

[darky83]

I will start some tests, my lists don't exceed 100 lines

[shawniverson]

Any chance this EFA had a problem recently that may have caused a lot of entries into the database (mail scan loop?)

[maxkmv]

All entries that I have were added by me. So not likely EFA's fault.. Its just that I had a thousand entries before and it was loading very fast, except a few days ago it started to take so long to display those lists..

[darky83]

I'm now up to about 3000 items in my list just for testing and.. well still fast (less than 2 sec)

Is it possible to provide me with an export of your lists config (from mysql) ?
(over PM/mail) maybe there is an entry in the list that is causing problems but will need the raw data to find out.

Just to clarify, the other parts of mailwatch are operating at normal speed? (so opening history mail etc..)

[maxkmv]

For some reason I can't even logon to MYSQL Server (I am logged in as root via webinterface to port 10000). How else can I export those lists?

Other parts of Mailwatch including previewing history and emails are opening fast.

Also tried viewing lists from different web browsers and lists are always opening slow, so definitely some server issue

[darky83]

as root on the console run:

Code: Select all

mysqldump --user=root --password=`grep MYSQLROOTPWD /etc/EFA-Config | sed 's/.*://'` --add-drop-table --events mailscanner > /root/mailscanner.dump

This will create a dump file (/root/mailscanner.dump)
Don't publicly post the output here but send it using an PM to me.

[maxkmv]

Thank you, that's very kind of you to assist, now I have another problem. Sorry I am a total newb! How do I copy the memory.dump file from EFA to my local PC? I tried to use WinSCP but it always says wrong password when connecting as root, even though the password is definitely correct.. I suppose its a setting somewhere that blocks root login using SSH? (By the way in case you are wondering how I can even connect now without SSH, I am using Vmware vsphere client and Console tab in it).

[darky83]

Move the file to the home directory of your normal user and use winscp to download the file to your local PC.

So if your normal user is for example maxkmv:

Code: Select all

mv /root/mailscanner.dump /home/maxkmv
chown maxkmv /home/maxkmv/mailscanner.dump

[maxkmv]

Yes that worked, however.. the file is 800 Mb. I used VI to check its contents - it seems to have the entire history of emails for the last 3 days (the maximum number of days I keep emails for)...

I thought the MySQL command was only supposed to make a copy of lists not the history of all messages?

[darky83]

Oh forgot to add the tables to the command:

Code: Select all

mysqldump --user=root --password=`grep MYSQLROOTPWD /etc/EFA-Config | sed 's/.*://'` --add-drop-table --events mailscanner blacklist whitelist> /root/mailscanner.dump

[maxkmv]

Ok thanks very much - I sent it to you as PM

[mortimer]

Hi everyone

I have the same problem since I update to 3.0.0.8 with a few thousand of blacklist domain. With the 3.0.0.7 the page load in 1 or 2 second, now :

Page generated in 24.079931 seconds

It's not a big deal but.....send dump in PM

[darky83]

Got the dumps, testing with it.

[darky83]

Testing confirms, older versions of Mailwatch load the same list in a few sec, newer versions are slow.
Contacting mailwatch devs.

[darky83]

https://github.com/mailwatch/1.2.0/issues/204

Issue is confirmed, mailwatch devs will look at it for the next version.

[maxkmv]

Great! So I am not the only one with this issue!

Thank you ever so much for looking into it!

[mortimer]

Hi

I apply correction in mailscanner php folder https://github.com/mailwatch/1.2.0/comm ... f2c10ab477

All good now Thank's endelwar to fix it, you deserve your vacation

Page generated in 0.245995 seconds

PS:
in mailscanner/lists.php

change at line 251 is :
echo ' <td style="background-color: ' . $bgcolor . '; "><a href="lists.php?submit=Delete&id=' . $row[0] . '&to=' . $row[2] . '&list=' . $list . '">Delete</a><td>' . "\n";

[fbessone]

Hello,
i think i have the same / similar problem
I updated to EFA-3.0.0.8 and now all pages are extremely slow, as ....

TOOLS/Links Page generated in 39.339463 seconds
Recent Messages Page generated in 40.092452 seconds

When i click on those menu items i then take a look to a TOP shell command:

Code: Select all

top - 16:07:25 up  1:10,  1 user,  load average: 0.70, 0.67, 0.64
Tasks: 181 total,   1 running, 180 sleeping,   0 stopped,   0 zombie
Cpu0  : 35.9%us, 12.9%sy,  0.0%ni, 14.6%id, 36.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu1  :  8.1%us,  4.4%sy,  0.0%ni, 79.5%id,  8.1%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu2  :  0.0%us,  2.3%sy,  0.0%ni, 97.7%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu3  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   1921980k total,  1846704k used,    75276k free,     2088k buffers
Swap:        0k total,        0k used,        0k free,   599392k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 1506 mysql     20   0  754m  38m 1988 S 54.8  2.1  15:36.50 mysqld
   59 root      20   0     0    0    0 S  1.7  0.0   0:40.38 kswapd0
 5675 root      20   0 15036  904  532 R  0.7  0.0   0:00.19 top

Seems to me that MySQL works a lot ...

I made the change outlined upon (lists.php) but it didnt help in any page.

Any suggestion ?

[darky83]

This will be fixed in the next release, the developers of mailwatch will have the issues fixed in the next version of mailwatch, we will include this in E.F.A. 3.0.0.9

[fbessone]

Hello Darky Very FAST !

Lets hope they will be smart in fixing it, nearly unusable by now !

Cheers

[maxkmv]

Agree with mortimer above - just a small change in one PHP file makes all the difference! Great fix!!