Build from scratch

Questions and answers about how to do stuff
User avatar
shawniverson
Posts: 3644
Joined: 13 Jan 2014 23:30
Location: Indianapolis, Indiana USA
Contact:

Re: Build from scratch

Post by shawniverson »

I regret to say your system did not build properly. You are missing SpamAssassin.
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

ok thanks...
2 questions:
How do I fix it?
Why is it detecting SPAM for one domain if Spam Assassin is missing?
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

I am getting headers in the emails:
X-Spam-Status: No
Does this suggest that SA is installed?
User avatar
shawniverson
Posts: 3644
Joined: 13 Jan 2014 23:30
Location: Indianapolis, Indiana USA
Contact:

Re: Build from scratch

Post by shawniverson »

I think you need to rebuild.

Certain kinds of spam can still be detected with MailScanner itself...
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

How do I fix it?
Can't I/somone fix SA without doing a full rebuild as I don't know why it failed first time so it may fail again...?

Thanks
User avatar
shawniverson
Posts: 3644
Joined: 13 Jan 2014 23:30
Location: Indianapolis, Indiana USA
Contact:

Re: Build from scratch

Post by shawniverson »

The problem is that other things may be broken as well. We can try, but I will make no promises.

Log in to mailwatch, run a Mailscanner Lint Test, and post the results please.
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

I think I have managed to install SA and updated the paths in /var/www/html/mailscanner/conf.php to the correct location from '/usr/local/bin/ to '/usr/bin'

There is no mail currently proxying via this box, perhaps these errors below are related to the mail that was handled by this server?
The SA LINT test gives this:
-------------------------
Trying to setlogsock(unix) 0
Reading configuration file /etc/MailScanner/MailScanner.conf 0.08661
Reading configuration file /etc/MailScanner/conf.d/README 0.00778
Could not read file /etc/MailScanner/reports/enW/deleted.content.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00495
Error in line 1333, file "/etc/MailScanner/reports/enW/deleted.content.message.txt" for deletedcontentmessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00019
Could not read file /etc/MailScanner/reports/enW/deleted.filename.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00015
Error in line 1334, file "/etc/MailScanner/reports/enW/deleted.filename.message.txt" for deletedfilenamemessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00021
Could not read file /etc/MailScanner/reports/enW/deleted.size.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00017
Error in line 1336, file "/etc/MailScanner/reports/enW/deleted.size.message.txt" for deletedsizemessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00015
Could not read file /etc/MailScanner/reports/enW/deleted.virus.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00015
Error in line 1335, file "/etc/MailScanner/reports/enW/deleted.virus.message.txt" for deletedvirusmessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00016
Could not read file /etc/MailScanner/reports/enW/disinfected.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00024
Error in line 1349, file "/etc/MailScanner/reports/enW/disinfected.report.txt" for disinfectedreporttext does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/inline.warning.html at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00038
Error in line 1371, file "/etc/MailScanner/reports/enW/inline.warning.html" for inlinehtmlwarning does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/inline.spam.warning.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00016
Error in line 2612, file "/etc/MailScanner/reports/enW/inline.spam.warning.txt" for inlinespamwarning does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/inline.warning.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00033
Error in line 1372, file "/etc/MailScanner/reports/enW/inline.warning.txt" for inlinetextwarning does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/languages.conf at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00014
Error in line 1324, file "/etc/MailScanner/reports/enW/languages.conf" for languagestrings does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00017
Could not read file /etc/MailScanner/reports/enW/recipient.mcp.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00014
Error in line 2915, file "/etc/MailScanner/reports/enW/recipient.mcp.report.txt" for recipientmcpreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/recipient.spam.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00013
Error in line 2617, file "/etc/MailScanner/reports/enW/recipient.spam.report.txt" for recipientspamreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/rejection.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00015
Error in line 1328, file "/etc/MailScanner/reports/enW/rejection.report.txt" for rejectionreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00013
Could not read file /etc/MailScanner/reports/enW/sender.content.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00016
Error in line 1378, file "/etc/MailScanner/reports/enW/sender.content.report.txt" for sendercontentreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/sender.error.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00014
Error in line 1379, file "/etc/MailScanner/reports/enW/sender.error.report.txt" for sendererrorreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00013
Could not read file /etc/MailScanner/reports/enW/sender.filename.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00014
Error in line 1380, file "/etc/MailScanner/reports/enW/sender.filename.report.txt" for senderfilenamereport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00013
Could not read file /etc/MailScanner/reports/enW/sender.spam.rbl.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00014
Error in line 2606, file "/etc/MailScanner/reports/enW/sender.spam.rbl.report.txt" for senderrblspamreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00015
Could not read file /etc/MailScanner/reports/enW/sender.spam.sa.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00014
Error in line 2607, file "/etc/MailScanner/reports/enW/sender.spam.sa.report.txt" for sendersaspamreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00014
Could not read file /etc/MailScanner/reports/enW/sender.mcp.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.00013
Error in line 2916, file "/etc/MailScanner/reports/enW/sender.mcp.report.txt" for sendersamcpreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 0.00013
Could not read file /etc/MailScanner/reports/enW/sender.size.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 0.06064
Error in line 1382, file "/etc/MailScanner/reports/enW/sender.size.report.txt" for sendersizereport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 4.0E-5
Could not read file /etc/MailScanner/reports/enW/sender.spam.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 1.0E-5
Error in line 2605, file "/etc/MailScanner/reports/enW/sender.spam.report.txt" for senderbothspamreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 1.0E-5
Could not read file /etc/MailScanner/reports/enW/sender.virus.report.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 1.0E-5
Error in line 1381, file "/etc/MailScanner/reports/enW/sender.virus.report.txt" for sendervirusreport does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 1.0E-5
Could not read file /etc/MailScanner/reports/enW/stored.content.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 1.0E-5
Error in line 1341, file "/etc/MailScanner/reports/enW/stored.content.message.txt" for storedcontentmessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 1.0E-5
Could not read file /etc/MailScanner/reports/enW/stored.filename.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 1.0E-5
Error in line 1342, file "/etc/MailScanner/reports/enW/stored.filename.message.txt" for storedfilenamemessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 1.0E-5
Could not read file /etc/MailScanner/reports/enW/stored.size.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 1.0E-5
Error in line 1344, file "/etc/MailScanner/reports/enW/stored.size.message.txt" for storedsizemessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 1.0E-5
Could not read file /etc/MailScanner/reports/enW/stored.virus.message.txt at /usr/lib/MailScanner/MailScanner/Config.pm line 2864 1.0E-5
Error in line 1343, file "/etc/MailScanner/reports/enW/stored.virus.message.txt" for storedvirusmessage does not exist (or can not be read) at /usr/lib/MailScanner/MailScanner/Config.pm line 3066 1.0E-5
Read 875 hostnames from the phishing whitelist 2.0E-5
Read 3780 hostnames from the phishing blacklists 1.0E-5
Config: calling custom init function SQLBlacklist 1.0E-5
Starting up SQL Blacklist 1.0E-5
Read 0 blacklist entries 1.0E-5
Config: calling custom init function MailWatchLogging 1.0E-5
Started SQL Logging child 0.00485
Config: calling custom init function SQLWhitelist 4.0E-5
Starting up SQL Whitelist 1.0E-5
Read 2 whitelist entries 0.00261
Checking version numbers... 5.0E-5
Version number in MailScanner.conf (4.84.6) is correct. 1.0E-5
Your envelope_sender_header in spam.assassin.prefs.conf is correct. 1.0E-5
MailScanner setting GID to (89) 1.0E-5
MailScanner setting UID to (89) 3.0E-5
Checking for SpamAssassin errors (if you use it)... 2.0E-5
Using SpamAssassin results cache 0.1057
Connected to SpamAssassin cache database 0.00095
SpamAssassin reported no errors. 1.95953
Connected to Processing Attempts Database 0.0007
Created Processing Attempts Database successfully 0.00043
There are 0 messages in the Processing Attempts Database 0.00017
Using locktype = posix 0.0005
MailScanner.conf says "Virus Scanners = clamd" 0.00016
Found these virus scanners installed: clamavmodule 0.10677
=========================================================================== 9.0E-5
Looked up unknown string mailscanner in language translation file at /usr/lib/MailScanner/MailScanner/Config.pm line 1372 0.00147
Looked up unknown string unreadablearchive in language translation file at /usr/lib/MailScanner/MailScanner/Config.pm line 1372 0.00436
Looked up unknown string passwordedarchive in language translation file at /usr/lib/MailScanner/MailScanner/Config.pm line 1372 0.00016
Looked up unknown string nonpasswordedarchive in language translation file at /usr/lib/MailScanner/MailScanner/Config.pm line 1372 0.00013
Looked up unknown string archivetoodeep in language translation file at /usr/lib/MailScanner/MailScanner/Config.pm line 1372 0.00013
Filename Checks: Windows/DOS Executable (1 eicar.com) 0.0028
Other Checks: Found 1 problems 0.00592
Virus and Content Scanning: Starting 4.0E-5
Cannot find Socket (/var/run/clamav/clamd.sock) Exiting! at /usr/lib/MailScanner/MailScanner/SweepViruses.pm line 3838 0.02338
Virus Scanning: No virus scanners worked, so message batch was abandoned and re-tried! at /usr/lib/MailScanner/MailScanner/SweepViruses.pm line 778 0.02284
Virus Scanning: Found 1 viruses 10.00121
=========================================================================== 5.0E-5
If any of your virus scanners (clamavmodule) 2.0E-5
are not listed there, you should check that they are installed correctly 1.0E-5
and that MailScanner is finding them correctly via its virus.scanners.conf. 1.0E-5
Config: calling custom end function SQLBlacklist 1.0E-5
Closing down by-domain spam blacklist 1.0E-5
Config: calling custom end function MailWatchLogging 1.0E-5
Config: calling custom end function SQLWhitelist 0.00345
Closing down by-domain spam whitelist 3.0E-5
Finish - Total Time
-------------------------
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

I just updated my test domain MX and seems something isn't right, looks like some sort of mail loop of the same email appears numerous times in the 'recent messages' list....
Looks like I need to start again.... :cry:
User avatar
shawniverson
Posts: 3644
Joined: 13 Jan 2014 23:30
Location: Indianapolis, Indiana USA
Contact:

Re: Build from scratch

Post by shawniverson »

Yeah, I agree.
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

during the rebuild (from scratch) I got this:
-----------------------
Setting a soft-link from spam.assassin.prefs.conf into the SpamAssassin
site rules directory.
spam.assassin.prefs.conf is read directly by the SpamAssassin startup
code, so make sure you have a link from the site_rules directory to
this file in your MailScanner/etc directory.
Perl could not find your SpamAssassin installation.
Strange, I just installed it.
-----------------------

Whats going on?
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

and the build.bash quits with:
---------------------------
Stopping mysqld: [ OK ]
Stopping Webmin server in /usr/libexec/webmin
Loaded plugins: fastestmirror, security
Cleaning repos: base epel extras rpmforge updates
Cleaning up Everything
Cleaning up list of fastest mirrors
dd: writing `/filler': No space left on device
49280791+0 records in
49280790+0 records out
49280790528 bytes (49 GB) copied, 140.303 s, 351 MB/s
dd: writing `/tmp/filler': No space left on device
49280783+0 records in
49280782+0 records out
49280782336 bytes (49 GB) copied, 140.695 s, 350 MB/s
dd: writing `/boot/filler': No space left on device
468161+0 records in
468160+0 records out
468160512 bytes (468 MB) copied, 1.59983 s, 293 MB/s
dd: writing `/var/filler': No space left on device
49280787+0 records in
49280786+0 records out
49280786432 bytes (49 GB) copied, 134.392 s, 367 MB/s
[root@655859 /]#
---------------------------

Is this a problem?
Loads of space on the disk....
User avatar
darky83
Site Admin
Posts: 540
Joined: 30 Sep 2012 11:03
Location: eFa
Contact:

Re: Build from scratch

Post by darky83 »

That is supposed to happen, it fills up the disk at the end of the install.

This is usefull if creating an vm image (all bits are set to zero so the image size get smaller)..

For the issue you have,
Can you check if you have /usr/local/sbin/EFA-Configure in place?


I'm suspecting some sort of networking issue preventing file downloads.

Make sure when you start the build the system has unrestricted access to the internet (or at least outgoing dns, port 80 and port 443)
Version eFa 4.x now available!
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

yup, /usr/local/sbin/EFA-Configure is there.
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

Mailcsanner Lint:
--------------------------
Checking for SpamAssassin errors (if you use it)... 2.0E-5
You want to use SpamAssassin but have not installed it. at /usr/lib/MailScanner/MailScanner/SA.pm line 177 0.00034
Please download http://www.sng.ecs.soton.ac.uk/mailscan ... -SA.tar.gz and unpack it and run ./install.sh to install it, then restart MailScanner. at /usr/lib/MailScanner/MailScanner/SA.pm line 178 0.00012
I will run without SpamAssassin for now, you will not detect much spam until you install SpamAssassin. at /usr/lib/MailScanner/MailScanner/SA.pm line 179
--------------------------

http://www.sng.ecs.soton.ac.uk/mailscan ... -SA.tar.gz - this is an invalid URL
Uk Bloke
Posts: 37
Joined: 07 Mar 2013 14:56

Re: Build from scratch

Post by Uk Bloke »

I have spent so much time on this, can someone do this for me and I'll send over some paypal beers?? :)
User avatar
shawniverson
Posts: 3644
Joined: 13 Jan 2014 23:30
Location: Indianapolis, Indiana USA
Contact:

Re: Build from scratch

Post by shawniverson »

I can help. ;)

PM me with the details and I'll get started.
User avatar
shawniverson
Posts: 3644
Joined: 13 Jan 2014 23:30
Location: Indianapolis, Indiana USA
Contact:

Re: Build from scratch

Post by shawniverson »

Build issues resolved. This was a good exercise on a remote system. I was able to implement some build enhancements that will help others successfully build manually :dance:
Post Reply