Page 1 of 2

Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 10:05
by CABIT
Hi,

we have the appliance 3.0.0.9 running.

And all works fine.

But we see some clean messages in the Quarantine the mails are delivered and marked as no spam.

Is this a bug in the new Version 3.0.0.9?

The mails with clean mark are in

/var/spool/MailScanner/quarantine/20160322/

And the spam mails are in

/var/spool/MailScanner/quarantine/20160322/spam

Is this a new feature which does not work ?

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 10:13
by pdwalker
you'll need to provide some details if there is to be any chance of diagnosing your problem

is there any pattern to the messages that are quarentined?

how about the message headers? can you show us any message headers?

what about the log files? Do the log files show any information about the messages that were quarantined?

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 10:36
by CABIT
Received on: 22/03/16 10:30:40
Received by:
Received from:
*********** [Add to Whitelist | Add to Blacklist]
Received Via:
IP Address Hostname Country RBL Spam Virus All
******* (GeoIP Lookup Failed) [ ] [ ] [ ] [ ]

ID: ************
Message Headers: X-Greylist: from auto-whitelisted by SQLgrey-1.8.0
Received: from *(*)
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by ******* (Postfix) with ESMTPS
for <@*****>; Tue, 22 Mar 2016 10:30:31 +0100 (CET)
X-MSFBL:
Received: from [] ([] helo=...)
by (envelope-from <>)
(ecelerity 3.6.8.47404 r(Core:3.6.8.0)) with ESMTP
id 34/B4-45586-F6F01F65; Tue, 22 Mar 2016 04:25:03 -0500
DKIM-Signature:
Date: Tue, 22 Mar 2016 04:25:03 -0500 (CDT)
From: <reply>
Reply-To: reply-to@
To: @*****
Message-ID: <*****@.....>
Subject: ..........
MIME-Version: 1.0
Content-Type: multipart/alternative;
boundary="----=_Part_-65279481_2129536560.1458638703486"
X-Binding: bg-abd-171
X-MarketoID: 144-NCB-030:15752:5835:16012:0:5491:7:2502424
X-MktArchive: false
List-Unsubscribe: <mailto:..........@......>
X-Mailfrom: ...............@.....
X-MSYS-API: {"options":{"open_tracking":false,"click_tracking":false}}
X-MktMailDKIM: true
From:
@.... [Add to Whitelist | Add to Blacklist]
To: .....@...............
Subject: .............
Size: 89.2Kb
Anti-Virus/Dangerous Content Protection
Virus: N
Blocked File: N
Other Infection: N
SpamAssassin
Spam: N Action(s): deliver, header, "X-Spam-Status:No"
High Score Spam: N
SpamAssassin Spam: N
Listed in RBL: N
SPAM Whitelisted: N
SPAM Blacklisted: N
Spamassassin Autolearn: N
Spamassassin Score: 2.71
Spam Report:
Score Matching Rule Description
1.10 DCC_CHECK
0.10 DKIM_SIGNED
-0.10 DKIM_VALID
-0.10 DKIM_VALID_AU
0.00 HEADER_FROM_DIFFERENT_DOMAINS
0.00 HTML_FONT_LOW_CONTRAST
0.00 HTML_MESSAGE
0.00 KAM_FROM_MARKETINGBL_PCCC
1.00 KAM_MARKETINGBL_PCCC
0.00 MIME_HTML_MOSTLY
0.72 MPART_ALT_DIFF
-0.00 RCVD_IN_DNSWL_NONE
-0.01 RCVD_IN_MSPIKE_H4
-0.01 RCVD_IN_MSPIKE_WL
-0.00 SPF_HELO_PASS
-0.00 SPF_PASS

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 11:04
by CABIT
The mails which are clean are stored in

/var/spool/MailScanner/quarantine/DATE/

as folders..

And the Spam marked are stored in

/var/spool/MailScanner/quarantine/DATE/spam

there is another folder
/var/spool/MailScanner/quarantine/DATE/nonspam

after reconfigure with EFA-Configure

9 spam settings
1 non spam settings

Do you want to DISABLE storing non spam ? y

the nonspam is not filed but the non spams get in the folder

/var/spool/MailScanner/quarantine/DATE/



Some Logs tell me

Content Checks: Detected and have disarmed phishing tags in HTML message in

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 11:23
by shawniverson
Ok,

So if I follow you, if I turn off storing of non-spam, it is landing in quarantine anyway above the nonspam directory?

I'm running some tests now...

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 11:35
by CABIT
Yes thats it they are stored as folders and in it is a file message
The folder is named like the Quarantine ID

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 11:40
by shawniverson
So far, this isn't happening on my systems...I'll keep watching.

Also, what are the directory permissions on your DATE directories?

They should be rwxrwx--- (770)

Owner/group:
postfix:apache

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 11:47
by CABIT
Is it possible that this occurs only for mails which are disarmed?

Because the normal mails aren't in the quarantine.
But in the log i see the content check messaged

Detected and have disarmed phishing tags
Detected and have disarmed web bug

only this one are stored after disabling store non spam

the permissions are correct like you said above.

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 11:49
by shawniverson
Let's find out :D

Crafting an email to be disarmed....

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 12:21
by shawniverson
Still unable to reproduce...

Can you share one of those emails (complete source with header) with me in a pastebin?

I would like to run it through my system.

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 13:37
by CABIT
Sorry thats not possible.
But here are some screenshots.


Content Checks: Detected and have disarmed phishing tags in HTML message in F369D12031B.A2B76

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 13:40
by shawniverson
Since I cannot reproduce the issue, and you cannot share the contents of those files, I am afraid our options for troubleshooting here are limited...

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 13:45
by CABIT
How can we Exchange the file?

I will try to find a not Critical mail.

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 13:49
by shawniverson
I can set up an SCP connection for you. Would this work?

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 14:36
by shawniverson
Ok, I put a new envelope on the message and ran it through my system...

Mar 22 10:26:41 efa MailScanner[30319]: Content Checks: Detected and have disarmed phishing tags in HTML message in 6E08D1202D1.A0B41 from spammy@example.com
Mar 22 10:26:41 efa MailScanner[30319]: Requeue: 6E08D1202D1.A0B41 to 2152E1202D2
Mar 22 10:26:41 efa postfix/qmgr[30316]: 2152E1202D2: from=<spammy@example.com>, size=34096, nrcpt=1 (queue active)
Mar 22 10:26:41 efa MailScanner[30319]: Uninfected: Delivered 1 messages

/var/spool/MailScanner/quarantine still looks normal.

So, that means my 3.0.0.9 is somehow different from yours, and I suspect that MailScanner is having trouble cleaning up after itself on your system for some reason when it disarms phishing tags.

Are you using a system updated from 3.0.0.8, or are you using the downloadable 3.0.0.9 VMware or HyperV build?

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 14:38
by CABIT
We are using a System Updatet from 3.0.0.8 to 3.0.0.9.

We have set this up with 3.0.0.8 and Upgraded when the new version was released.

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 14:49
by shawniverson
Ok. Let's compare some notes...

I am assuming MailScanner has not changed on your system. I am curious how your MailScanner config may differ from mine...

Code: Select all

grep "^[^#]" /etc/MailSCanner/MailScanner.conf
Here's a dump of my /etc/MailScanner/MailScanner.conf for comparison (with sensitive parts removed):

http://pastebin.com/wq3SJpvw

Please review and let me know anything that might be different (and hopefully significant) to this problem.

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 14:52
by shawniverson
Also, let's check perl modules, as MailScanner uses them extensively...

Code: Select all

rpm -qa | grep perl
Here's mine:

http://pastebin.com/rxrxpEHg

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 14:59
by shawniverson
Also, make sure this isn't turned on in postfix:

enable_long_queue_ids

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 15:17
by CABIT
compared

Scan Messages = %rules-dir%/scan.messages.rules
Maximum Archive Depth = 2
Virus Scanners = esets clamd
Spam-Virus Header = X-%org-name%-MailScanner-SpamVirus-Report:
Allow Password-Protected Archives = yes
Find Phishing Fraud = no
Also Find Numeric Phishing = no
Use Stricter Phishing Net = no
Highlight Phishing Fraud = no
Allow WebBugs = yes
Filename Rules = %rules-dir%/filename.rules
Filetype Rules = %rules-dir%/filetype.rules
Quarantine Infections = yes
Mail Header = X-%org-name%-MailScanner:
Spam Header = X-%org-name%-MailScanner-SpamCheck:
Spam Score Header = X-%org-name%-MailScanner-SpamScore:
Information Header = X-%org-name%-MailScanner-Information:
Envelope From Header = X-%org-name%-MailScanner-From:
Envelope To Header = X-%org-name%-MailScanner-To:
Envelope To Header = X-%org-name%-MailScanner-To:
ID Header = X-%org-name%-MailScanner-ID:
IP Protocol Version Header = # X-%org-name%-MailScanner-IP-Protocol:
Watermark Header = X-%org-name%-MailScanner-Watermark:
Non Spam Actions = deliver header "X-Spam-Status:No"
MCP Header = X-%org-name%-MailScanner-MCPCheck:

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 15:20
by CABIT
Perl Modules which you have and my installation not:

perl-Authen-SASL-2.13-3.el6.noarch
perl-Convert-ASN1-0.22-1.el6.noarch
perl-Curses-1.28-1.el6.rf.x86_64
perl-GSSAPI-0.26-6.el6.x86_64
perl-IO-Tty-1.08-4.el6.x86_64
perl-LDAP-0.40-1.el6.noarch
perl-POE-1.354-1.el6.noarch
perl-POE-Component-Client-LDAP-0.04-1.el6.rf.noarch
perl-POE-Test-Loops-1.035-1.el6.noarch
perl-TermReadKey-2.30-13.el6.x86_64
perl-Text-Iconv-1.7-6.el6.x86_64
perl-XML-Filter-BufferText-1.01-8.el6.noarch
perl-XML-SAX-Writer-0.50-8.el6.noarch


enable_long_queue_ids not in main.cf..

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 15:22
by shawniverson
Thanks! Working through these settings...

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 15:31
by shawniverson
Do you have this on, by chance?

Code: Select all

# Do you want to store copies of messages which have been disarmed by
# having their HTML modified at all?
# This can also be the filename of a ruleset.
Quarantine Modified Body = yes
When I turn this on, I get the exact problem you are having.

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 15:33
by CABIT
Yes this is activated.

Re: Some Mails get listed under quarantine but are marked as clean 3.0.0.9

Posted: 22 Mar 2016 15:34
by shawniverson
Disable it, then, and you should be good.