Page 1 of 1
Long Lists loading in MailWatch web interface
Posted: 17 Jun 2015 14:09
by maxkmv
Hi Experts!
Is there a way to speed up Lists loading in Mailwatch web interface? In my web browser (Google Chrome) it takes almost 1 min to load lists.. a month ago it didn't do it - it was very quick.. Already tried rebooting the VM, either Chrome has updated or EFA updated itself and now I have this problem. Everything else works fine..
Re: Long Lists loading in MailWatch web interface
Posted: 17 Jun 2015 16:18
by darky83
Do you have a whole lot of white/black list items?
If you look at the bottom of the page you will see an entry like:
Code: Select all
Page generated in 0.388177 seconds
Is the generating of the page also taking a long time or is it just displaying the page?
Re: Long Lists loading in MailWatch web interface
Posted: 17 Jun 2015 18:43
by maxkmv
Its a big list, fair enough.. may be a thousand entries or so..
It says at the bottom:
Page generated in 19.221441 seconds
Is that normal for a big list?
Re: Long Lists loading in MailWatch web interface
Posted: 17 Jun 2015 18:54
by darky83
I will start some tests, my lists don't exceed 100 lines
Re: Long Lists loading in MailWatch web interface
Posted: 17 Jun 2015 19:18
by shawniverson
Any chance this EFA had a problem recently that may have caused a lot of entries into the database (mail scan loop?)
Re: Long Lists loading in MailWatch web interface
Posted: 17 Jun 2015 19:38
by maxkmv
All entries that I have were added by me. So not likely EFA's fault.. Its just that I had a thousand entries before and it was loading very fast, except a few days ago it started to take so long to display those lists..
Re: Long Lists loading in MailWatch web interface
Posted: 18 Jun 2015 19:14
by darky83
I'm now up to about 3000 items in my list just for testing and.. well still fast (less than 2 sec)
Is it possible to provide me with an export of your lists config (from mysql) ?
(over PM/mail) maybe there is an entry in the list that is causing problems but will need the raw data to find out.
Just to clarify, the other parts of mailwatch are operating at normal speed? (so opening history mail etc..)
Re: Long Lists loading in MailWatch web interface
Posted: 19 Jun 2015 10:11
by maxkmv
For some reason I can't even logon to MYSQL Server (I am logged in as root via webinterface to port 10000). How else can I export those lists?
Other parts of Mailwatch including previewing history and emails are opening fast.
Also tried viewing lists from different web browsers and lists are always opening slow, so definitely some server issue
Re: Long Lists loading in MailWatch web interface
Posted: 19 Jun 2015 16:55
by darky83
as root on the console run:
Code: Select all
mysqldump --user=root --password=`grep MYSQLROOTPWD /etc/EFA-Config | sed 's/.*://'` --add-drop-table --events mailscanner > /root/mailscanner.dump
This will create a dump file (/root/mailscanner.dump)
Don't publicly post the output here but send it using an PM to me.
Re: Long Lists loading in MailWatch web interface
Posted: 21 Jun 2015 10:59
by maxkmv
Thank you, that's very kind of you to assist, now I have another problem. Sorry I am a total newb! How do I copy the memory.dump file from EFA to my local PC? I tried to use WinSCP but it always says wrong password when connecting as root, even though the password is definitely correct.. I suppose its a setting somewhere that blocks root login using SSH? (By the way in case you are wondering how I can even connect now without SSH, I am using Vmware vsphere client and Console tab in it).
Re: Long Lists loading in MailWatch web interface
Posted: 21 Jun 2015 11:29
by darky83
Move the file to the home directory of your normal user and use winscp to download the file to your local PC.
So if your normal user is for example
maxkmv:
Code: Select all
mv /root/mailscanner.dump /home/maxkmv
chown maxkmv /home/maxkmv/mailscanner.dump
Re: Long Lists loading in MailWatch web interface
Posted: 22 Jun 2015 07:33
by maxkmv
Yes that worked, however.. the file is 800 Mb. I used VI to check its contents - it seems to have the entire history of emails for the last 3 days (the maximum number of days I keep emails for)...
I thought the MySQL command was only supposed to make a copy of lists not the history of all messages?
Re: Long Lists loading in MailWatch web interface
Posted: 22 Jun 2015 17:16
by darky83
Oh forgot to add the tables to the command:
Code: Select all
mysqldump --user=root --password=`grep MYSQLROOTPWD /etc/EFA-Config | sed 's/.*://'` --add-drop-table --events mailscanner blacklist whitelist> /root/mailscanner.dump
Re: Long Lists loading in MailWatch web interface
Posted: 23 Jun 2015 10:18
by maxkmv
Ok thanks very much - I sent it to you as PM
Re: Long Lists loading in MailWatch web interface
Posted: 25 Jun 2015 13:10
by mortimer
Hi everyone
I have the same problem since I update to 3.0.0.8 with a few thousand of blacklist domain. With the 3.0.0.7 the page load in 1 or 2 second, now :
Page generated in 24.079931 seconds
It's not a big deal but.....send dump in PM
Re: Long Lists loading in MailWatch web interface
Posted: 25 Jun 2015 18:32
by darky83
Got the dumps, testing with it.
Re: Long Lists loading in MailWatch web interface
Posted: 25 Jun 2015 18:52
by darky83
Testing confirms, older versions of Mailwatch load the same list in a few sec, newer versions are slow.
Contacting mailwatch devs.
Re: Long Lists loading in MailWatch web interface
Posted: 26 Jun 2015 06:53
by darky83
https://github.com/mailwatch/1.2.0/issues/204
Issue is confirmed, mailwatch devs will look at it for the next version.
Re: Long Lists loading in MailWatch web interface
Posted: 26 Jun 2015 19:41
by maxkmv
Great! So I am not the only one with this issue!
Thank you ever so much for looking into it!
Re: Long Lists loading in MailWatch web interface
Posted: 26 Jun 2015 20:50
by mortimer
Hi
I apply correction in mailscanner php folder
https://github.com/mailwatch/1.2.0/comm ... f2c10ab477
All good now Thank's endelwar to fix it, you deserve your vacation
Page generated in 0.245995 seconds
PS:
in mailscanner/lists.php
change at line 251 is :
echo ' <td style="background-color: ' . $bgcolor . '; "><a href="lists.php?submit=Delete&id=' . $row[0] . '&to=' . $row[2] . '&list=' . $list . '">Delete</a><td>' . "\n";
Re: Long Lists loading in MailWatch web interface
Posted: 16 Jul 2015 14:16
by fbessone
Hello,
i think i have the same / similar problem
I updated to EFA-3.0.0.8 and now all pages are extremely slow, as ....
TOOLS/Links Page generated in 39.339463 seconds
Recent Messages Page generated in 40.092452 seconds
When i click on those menu items i then take a look to a TOP shell command:
Code: Select all
top - 16:07:25 up 1:10, 1 user, load average: 0.70, 0.67, 0.64
Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie
Cpu0 : 35.9%us, 12.9%sy, 0.0%ni, 14.6%id, 36.6%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu1 : 8.1%us, 4.4%sy, 0.0%ni, 79.5%id, 8.1%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu2 : 0.0%us, 2.3%sy, 0.0%ni, 97.7%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu3 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 1921980k total, 1846704k used, 75276k free, 2088k buffers
Swap: 0k total, 0k used, 0k free, 599392k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1506 mysql 20 0 754m 38m 1988 S 54.8 2.1 15:36.50 mysqld
59 root 20 0 0 0 0 S 1.7 0.0 0:40.38 kswapd0
5675 root 20 0 15036 904 532 R 0.7 0.0 0:00.19 top
Seems to me that MySQL works a lot ...
I made the change outlined upon (lists.php) but it didnt help in any page.
Any suggestion ?
Re: Long Lists loading in MailWatch web interface
Posted: 16 Jul 2015 14:34
by darky83
This will be fixed in the next release, the developers of mailwatch will have the issues fixed in the next version of mailwatch, we will include this in E.F.A. 3.0.0.9
Re: Long Lists loading in MailWatch web interface
Posted: 16 Jul 2015 14:42
by fbessone
Hello Darky
Very FAST !
Lets hope they will be smart in fixing it, nearly unusable by now !
Cheers
Re: Long Lists loading in MailWatch web interface
Posted: 18 Jul 2015 00:25
by maxkmv
Agree with mortimer above - just a small change in one PHP file makes all the difference! Great fix!!