Koozali.org: home of the SME Server

[ANNOUNCE]: New Spam Filter Server Manager Module

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #75 on: September 11, 2004, 07:53:13 PM »
Actually the rewrite_subject command has been changed in 3.0 to:

rewrite_header Subject [SPAM _SCORE_ of _REQD_]

RayG

[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #76 on: September 11, 2004, 10:33:39 PM »
Quote from: "Knuddi"
Actually the rewrite_subject command has been changed in 3.0 to:

rewrite_header Subject [SPAM _SCORE_ of _REQD_]


I just read that in the 3.0 rc 4 release notes. So I'm wondering where rewrite_subject is coming from on a fresh SME 6 and spamassassin 3.0 install ?

I've deleted the local.cf file in the custom template directory and the rewrite_subject command is still showing up when I hit the save button in the user panel. I'm having some difficulty finding the template fragments that local.cf is built from. A clue here would be most helpfull.

RayG

[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #77 on: September 11, 2004, 11:01:58 PM »
Ok. The "rewrite_subject" with no value seems to be coming from /home/e-smith/spamassassin_V3. What is used to create that file ?

[EDIT]
I did /sbin/e-smith/db spamassassin_V3 delprop conf.global rewrite_subject
and rewrite_subject is removed from the database file. But something is putting it back when I push the "save" button in the spamfilter panel.

[EDIT]
I found the offending line in the spamfilter server manager panel function and commented it out. I delproped rewrite_subject from the spamassassin_V3 database again and then tried the save button in the server manager panel. Rewrite subject is no longer showing up in the database or the local.cf file. Spamassassin --lint comes back clean now. Looks like the problem is solved.

Jesper, would it be appropriate to remove this line for future releases of your fine Spamfilter contrib ?

Am I the only person who --lint's new rules or am I just the only one worrying about the warning that pops up ?

mbachmann

[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #78 on: September 13, 2004, 02:33:01 PM »
Server is still encountering a few -pyzor <defunct> subprocesses sometimes (issue ps -A -H on commandline) but i do not see when and why they are triggered. The big bugger is: spamd eats up all the memory and restarting spamd takes a good 5-10 minutes.

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #79 on: September 13, 2004, 02:55:05 PM »
Ray,

You are right the SpamFilter does actually write this in the local.cf file. I had removed it when I did a --lint but ?!?"?!? I will release a new version within days that will remove this via the templates (to ensure that all old installations benefit as well).

Thanks,
Jesper

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #80 on: September 13, 2004, 10:05:14 PM »
All,

I have now released an updated version of the spam-filter that should remove most (if not all) of the issues noticed in this thread.

See the revision history for details on:

http://sme.swerts-knudsen.dk/howtos/howto_29.htm

for details.

Thanks all of you for your valuable feedback.

Offline sgt-spam

  • ****
  • 84
  • +0/-0
[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #81 on: September 14, 2004, 01:08:09 AM »
I started another thread as well in this forum, but wanted to ask for those following here:

Is anyone using MRTG to graph RBL statistics?  I'd like to do that, but am unsure where the RBL stats live, and how to make MRTG read them.


Thanks.

Offline edb

  • *
  • 548
  • +0/-0
[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #82 on: September 14, 2004, 04:22:08 PM »
Anyone know why my Spam filter statistics read: RBL Rejected : 0 (0.00%) yet I have all the suggested RBL sites blocked. Any ideas?

Period Beginning : Mon Sep 13 00:00:01 2004
Period Ending    : Tue Sep 14 00:00:01 2004

Reporting Period : 24.00 hrs
--------------------------------------------------

Total spam rejected   :      407 (  14.68%)
       RBL rejected   :        0 (   0.00%)
Total ham accepted    :     2366 (  85.32%)
                        -------------------
Total emails processed:     2773 (  116/hr)

Average spam threshold :        5.00
Average spam score     :       12.82
Average ham score      :       -0.01
......

bjennings

server error
« Reply #83 on: September 15, 2004, 05:02:37 AM »
I am getting an internal server error 500 whenever I try to save/restart the spamfilter panel.  Can someone give me a suggestion on where to look for the problem.  I was running dungog's spamassasin rpm....but I don't know if that has anything to do with it or not.  Any help is appreciated.  Thanks

Rogue

[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #84 on: September 15, 2004, 06:31:26 AM »
I have noticed that the daily email summary doesn't seem to distribute the emails across the hours properly.

Period Beginning : Tue Sep 14 15:00:04 2004
Period Ending    : Wed Sep 15 15:00:04 2004

Reporting Period : 24.00 hrs
--------------------------------------------------

Total spam rejected   :      187 (  84.62%)
       RBL rejected   :        0 (   0.00%)
Total ham accepted    :       34 (  15.38%)
                        -------------------
Total emails processed:      221 (    9/hr)

Average spam threshold :        8.00
Average spam score     :       18.79
Average ham score      :        1.40


Statistics by Hour
-------------------------------------
Hour                 Spam         Ham
-------------    --------    --------
2004-09-14, 15            14           3
2004-09-14, 16            21           3
2004-09-14, 17            19           4
2004-09-14, 18            27           9
2004-09-14, 19            28           2
2004-09-14, 20            20           5
2004-09-14, 21            24           5
2004-09-14, 22            14           0
2004-09-14, 23            20           3
2004-09-15, 00             0           0
2004-09-15, 01             0           0
2004-09-15, 02             0           0
2004-09-15, 03             0           0
2004-09-15, 04             0           0
2004-09-15, 05             0           0
2004-09-15, 06             0           0
2004-09-15, 07             0           0
2004-09-15, 08             0           0
2004-09-15, 09             0           0
2004-09-15, 10             0           0
2004-09-15, 11             0           0
2004-09-15, 12             0           0
2004-09-15, 13             0           0
2004-09-15, 14             0           0
2004-09-15, 15             0           0

As you can see from teh above email, apparently I only receive email after 3pm, despite my mail server bhaving to the contrary  :-P

Could this have something to do with my timezone (GMT +10 - Sydney, Australia) or some other factor with my setup?

Offline okepc

  • ****
  • 118
  • +0/-0
    • http://www.okepc.nl
Re: server error
« Reply #85 on: September 20, 2004, 10:30:23 AM »
Quote from: "bjennings"
I am getting an internal server error 500 whenever I try to save/restart the spamfilter panel.  Can someone give me a suggestion on where to look for the problem.  I was running dungog's spamassasin rpm....but I don't know if that has anything to do with it or not.  Any help is appreciated.  Thanks


Im having this problem too...
Still havent figured out why.
It seems to happen to the user-manager panel too.
Maybe they are written in the same way?
Lots of updates installed offcourse.
Any idea knuddie?

admin_error_log
[Mon Sep 20 04:23:14 2004] spamfilter: Insecure dependency in eval while running with -T switch at /usr/lib/perl5/vendor_perl/5.6.1/Text/Template.pm line 319.
[Mon Sep 20 04:23:14 2004] [error] [client 127.0.0.1] malformed header from script. Bad header=<pre>Insecure dependency in ev: /etc/e-smith/web/panels/manager/cgi-bin/spamfilter

Offline okepc

  • ****
  • 118
  • +0/-0
    • http://www.okepc.nl
[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #86 on: September 20, 2004, 11:46:03 AM »
Removed -T switch
Changed -w to -W

Next error is:

[Mon Sep 20 05:44:33 2004] spamfilter: The DB is open read-only at /etc/e-smith/web/panels/manager/cgi-bin/spamfilter line 479
[Mon Sep 20 05:44:33 2004] [error] [client 127.0.0.1] malformed header from script. Bad header=<pre>The DB is open read-only : /etc/e-smith/web/panels/manager/cgi-bin/spamfilter

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
[ANNOUNCE]: New Spam Filter Server Manager Module
« Reply #87 on: September 24, 2004, 12:47:26 PM »
I do not understand why the stats are not distributed across all hours. I scan the /var/log/maillog file and use the dates listed there. Check the distribution of hours by doing a:

cat /var/log/maillog | grep spamd

with respect to the line 479 error then I am trying to determine who you want to download spamassassin updated via the USA script. I do not understand why the file should be read-only (/home/e-smith/altiplano)

Generally, then SpamAssassin V3 has been officially released and the install script will now install the final release. If you haven't updated the sme-spamfilter RPM to 1.0.4 then I would recommend you do so:

# rpm -Uvh http://sme.swerts-knudsen.dk/downloads/SpamFilter/sme-spamfilter-1.0.4-1.noarch.rpm

Have fun,
Jesper

egerards

fetchmail / spamassassin
« Reply #88 on: September 30, 2004, 11:22:39 AM »
I was browsing this topic on my search for a solution for the problem that emails retrieved with fetchmail, were not scanned by Spamassassin (nor Amavis antivirus). I saw I was not the only one and that a solution had not been found yet.

I seem to have found a solution: together with Spamassassin I also have the antivirus panel from knudsen installed. I was 'playing' with the 'Scan incoming / outgoing email' settings and eventually noticed that emails retrieved with fetchmail are only scanned by Spamassassin / Amavis if 'Scan outgoing email' is set to Yes.

The only drawback of this solution is that every outgoing email is scanned, which takes some extra time. But I can live with this...  :-)

josht

Problem with sorting after install
« Reply #89 on: October 02, 2004, 06:25:04 AM »
After rebuilding my server from scratch (I'd upgraded it more times than I'd like to remember, and finally decided to start fresh and clean up things - particularly the email folder structure), I downloaded the current release of the SpamFilter and built it per Jesper's instructions.  I also ran the commands to stop double bounce messages.  Otherwise this is a stock 6.01 from the ISO image.

Anyhow, the error I get is this, as shown in my maillog:

Oct  2 00:03:23 booboo spamd[2650]: connection from localhost [127.0.0.1] at port 32860
Oct  2 00:03:23 booboo spamd[2650]: info: setuid to qmaild succeeded
Oct  2 00:03:23 booboo spamd[2650]: Creating default_prefs [/var/qmail/.spamassassin/user_prefs]
Oct  2 00:03:23 booboo spamd[2650]: Cannot write to /var/qmail/.spamassassin/user_prefs: Permission denied
Oct  2 00:03:23 booboo spamd[2650]: Couldn't create readable default_prefs for [/var/qmail/.spamassassin/user_prefs]
Oct  2 00:03:23 booboo spamd[2650]: processing message <RNZIE8fDQf7ucVQ@moose-mail.com> for qmaild:401.
Oct  2 00:03:26 booboo dccproc[2707]: open(/var/dcc/map): Permission denied
Oct  2 00:03:26 booboo spamd[2650]: identified spam (8.6/5.0) for qmaild:401 in 2.7 seconds, 2660 bytes.
Oct  2 00:03:26 booboo spamd[2650]: result: Y  8 - BIZ_TLD,FRONTPAGE,MISSING_SUBJECT,NO_REAL_NAME,RAZOR2_CF_RANGE_51_100,RAZOR2_CHECK,RCVD_BY_IP,RCVD_DOUBLE_IP_SPAM scantime=2.7,size=2660,mid=<RNZIE8fDQf7ucVQ@moose-mail.com>,autolearn=no

This was from a sample spam - and what happens is the spam is identified but not sorted to junkmail like it should be.  I'm assuming I need to fix permissions in the locations specified, but I'm not sure what they will need to be, or if that'll even fix the problem.  Any pointers?
[/quote]