efa-project.org

Do this first cat /etc/EFA-Config |grep SQL|grep MAILWATCHSQLPWD You should get one line back that looks like this: MAILWATCHSQLPWD:XXX...XXX where XXX...XXX is your mysql password. If you do, type in mysql -umailwatch -pXXX...XXX mailscanner it will succeed or fail. if it fails, do this cat /etc/EF...

and running some of the dd speed timings above gives you...? (use the ssd one - let's focus on that since that machine/vm combo should be absolutely smoking)

none and preallocated raw. I got better performance with raw over qcow2 when I tested the vm performance 2 years ago. Not tested it since. Underlying file system is ext4 over lvm which does reduce my overall performance. Using the deadline (host) / noop (vms) schedulers reduced the disk io contentio...

Nope, already using the virtio drivers and have the scheduler set. That's not it.

Also, you're better off using the deadline scheduler on the host, and the noop scheduler in the vm.

You guys sure do know how to make a guy feel inadequate. Thanks!

As for the original poster, Toddh, what version of the hypervisor are you running?

Yeah, it seems to be an issue in KVM that's been known about for years. It's fine if the disk io is not to high, but when it does get high, the vm bogs down. Here are the results from the efa vm itself [itsupport@efa tmp]$ dd if=/dev/zero of=1000MB.bin bs=1M count=1024 1024+0 records in 1024+0 recor...

eh, I was tired and perhaps not thinking clearly.

Maybe apache has only bound to the ip of one of the network cards?

Cpoole, what does "sudo netstat -plutn" show you?

No, that's not it. You'll probably have to define ServerName and ServerAlias in your /etc/httpd/conf/httpd.conf to allow apache to accept multiple host names. That'll mean setting up an Apache Virtual host to accept the second domain name. http://httpd.apache.org/docs/2.2/mod/core.html#serveralias E...

I'm going to call it a day on this one. Summary:* the efa kvm suffers from some disk performance issues, especially as processes spend a lot of time waiting for i/o, even when the host is not busy. Searching returns quite a lot on this issue over the years, but I could find no concrete solutions. us...

can you access http://hostname.externaldomain.net/ from an external address/location? do you see the same page as when you access http://hostname.internaldomain.local/ ?

ok, I've gone from 1/7 the speed to 1/2 the speed (vm vs physical machine mysql performance). I have two arrays in the vm host, a 2 drive raid1 array and a 6 drive raid6 array. The raid6 array has a faster readwrite performance than the raid1 array. The raw vm image for efa was on the slower raid1 a...

I've used sysbench to do some performance testing on mysql. Short version: - MySQL performance inside my efa kvm is 1/7th the speed of the mysql performance on another older physical machine. - io wait % in the physical machine (and vm host machine) is very low. - io wait % inside the vm is very hig...

times without and with --no-sync # su - apache -bash-4.1$ time /usr/local/bin/sa-learn -p /etc/MailScanner/spam.assassin.prefs.conf --ham --file /var/spool/MailScanner/quarantine/20150402/nonspam/07A1B181E17.A009C Learned tokens from 1 message(s) (1 message(s) examined) real 1m7.466s user 0m2.987s s...

I made the following change in /var/www/html/mailscanner/functions.php just to get an idea of how long the UI was taking to train diff -c functions.php functions.php.org *** functions.php    2015-04-02 15:59:20.040362566 +0800 --- functions.php.org    2015-04-02 16:00:15.688371543 +0800 ************...

[edit: ignore this]
Is there an address I can send the results to? A lot of this information cannot be posted in public form, and there is too much to sanitize.

shawniverson wrote:You can add a spamassassin rule to local.cf to override this score...

being pendantic; the file is in:

/etc/mail/spamassassin/local.cf

Question: do we need to restart spamassassin after changing the rules?

shawniverson wrote:Try running sa-learn with --no-sync and report back please.

like so?

Agreed it is too slow. Don't know why. Still working on it.

You're seeing the same thing I am. While the system is running sa-learn, the rest of the system grinds to a halt, or becomes very slow and unresponsive. It is like the whole system waits until sa-learn completes. It seems to take about 30 seconds per message for sa-learn to run. It's not an SQL tabl...

The UI is called "mailwatch" ( https://sourceforge.net/projects/mailwatch/ ) and does not appear to be terribly active at the moment. It might be worth giving the author a prod over there.

added to the wiki

First, edit your post and remove the password.

What was the load average during that time? And was top showing iowait during that time?

If so, we're both experiencing the same thing.

I'm still looking.

Can you run the following command a couple of times and tell me what kind of queries to which database you are seeing? mysqladmin -uroot -p<EFA mysql root password from /etc/EFA-Config> processlist run it 5 or 10 times. what ones in the "db" column show active queries? ("Command"...

todd,

Do you get a lot of non English language mail into your system?

Shawn, I expect if he does as you say, the load will drop to near 0.

I'm now almost certain that the problem is because of an unoptimal mysql configuration. I'm playing with the configurations now to see if I can improve the performance without making too many changes.