Koozali.org: home of the SME Server

Sme-unjunkmgr

Offline edform

  • *
  • 178
  • +0/-0
    • http://www.workgroupsolutions.co.uk
Sme-unjunkmgr
« on: March 12, 2011, 11:11:24 AM »
I used this clever contribution in SME 7x with great success but it doesn't seem to work properly in SME 8b6.

Before I installed the contribution  had 9900-odd junk emails in the last 60 days, all still stored in the junkmail folder, so I bulk deleted them with the facility in Horde-email-folders. Then I installed the contribution, following the instructions very carefully and adding the Bayesian filters and the extra ClamAV signatures. With the exception of a failed dependency during the install of the contribution itself, which I solved by installing it separately, everything installed perfectly.

The spam and av statistics seem to be valid and display properly but no emails are sent to users and no mail appears in the junkmail folder.

If I run the command to force the generation of unjunkmgr email I get...

[root@mini-itx ~]# /usr/local/unjunkmgr/spamreminder.pl
Can't locate Email/Date/Format.pm in @INC (@INC contains: /usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.8 /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.8 /usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.8 /usr/lib/perl5/site_perl /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.8 /usr/lib/perl5/vendor_perl/5.8.5 /usr/lib/perl5/vendor_perl /usr/lib/perl5/5.8.8/i386-linux-thread-multi /usr/lib/perl5/5.8.8 .) at /usr/lib/perl5/vendor_perl/5.8.5/MIME/Lite.pm line 1097, <CSS> line 242.

I have seen some mention of problems with this contribution in SME 8 but no follow-up to tell me the state of play. Have I just stumbled on a continuing fault that will be dealt with or is this a new bug behaviour to be added to Bugzilla? I've checked Bugzilla and there doesn't seem to be anything open on this subject.

Ed Form

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: Sme-unjunkmgr
« Reply #1 on: March 12, 2011, 03:57:16 PM »
Hi Ed,

Saw your email but thought I would anwers here for the benefit of others:

It seems that SME8 lacks a a package which is included in SME7.

Suggest a:

yum update perl-Email-Date-Format

This might require access to another repository.

I do not have a SME8 so I cannot verify.

/Jesper

Offline edform

  • *
  • 178
  • +0/-0
    • http://www.workgroupsolutions.co.uk
Re: Sme-unjunkmgr
« Reply #2 on: March 12, 2011, 05:38:38 PM »
Hi Ed,

Saw your email but thought I would anwers here for the benefit of others:

It seems that SME8 lacks a a package which is included in SME7.

Suggest a:

yum update perl-Email-Date-Format

This might require access to another repository.

I do not have a SME8 so I cannot verify.

/Jesper

It goes further than that: when I tried to load the most recent version of the package you suggested, it had a missing dependency...

Error: Missing Dependency: perl(:MODULE_COMPAT_5.12.3) is needed by package perl-Email-Date-Format-1.002-9.fc15.noarch (/perl-Email-Date-Format-1.002-9.fc15.noarch)

Which looks like the whole of the perl programming language. Should this be raised as a bug on SME 8?

Ed Form

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: Sme-unjunkmgr
« Reply #3 on: March 12, 2011, 07:46:16 PM »
It could also be that you found the wrong perl package. Did you add any --enablerepo=xxx to the yum update command? I see the FC15 in the filename and perfer to see el5 or something similar. Found this one:
perl-Email-Date-Format-1.002-1.el5.rf.noarch.rpm

/Jesper

Offline edform

  • *
  • 178
  • +0/-0
    • http://www.workgroupsolutions.co.uk
Re: Sme-unjunkmgr
« Reply #4 on: March 12, 2011, 11:16:29 PM »
It could also be that you found the wrong perl package. Did you add any --enablerepo=xxx to the yum update command? I see the FC15 in the filename and perfer to see el5 or something similar. Found this one:
perl-Email-Date-Format-1.002-1.el5.rf.noarch.rpm

/Jesper

It dawned on me that the required stuff was probably in the SME7 contribs repository and as I had already modified the repo information on my server to use that I ran...

yum install perl-Email-Date-Format --enablerepo=sme7contribs

...and it worked perfectly. Note that I could not run yum update because the package was not installed.

I then ran /usr/local/unjunkmgr/spamreminder.pl and an email came through with 8 junked mails listed, one of which I unjunked and that also worked perfectly.

There is still something I don't understand: my SPAm statistics for the last hour show 65 rejects and the last day shows 683, there were also 2 virus rejects in the last 24 hours. These figures are typical of the level of SPAM my server has to deal with, so why are there only 8 mails in my junk folder? I deleted the junkmail by hand in Horde mid-morning yesterday so I expected to see around 6-700 junkmails.

When I ran the contribution in SME 7 I'd get notification mails each friday with hundreds of junkmails listed but I did not use the Bayes filters or the extra AV signatures. Having followed your instructions to the letter this time is the system deleting SPAM that it's absolutely sure about, or is there some other explanation for the difference between the statistics and the size of my junk folder.

Ed Form

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: Sme-unjunkmgr
« Reply #5 on: March 13, 2011, 08:27:42 AM »
The junkmail folder is meant for the email in the greyzone - above tag level and below reject level. You should not see that many email in this region.

You might have had the reject level set very high in the past and hence all rejected emails ended up in junkmail.

The levels you see now are fine according to me.


Offline edform

  • *
  • 178
  • +0/-0
    • http://www.workgroupsolutions.co.uk
Re: Sme-unjunkmgr
« Reply #6 on: March 13, 2011, 11:40:24 AM »
The junkmail folder is meant for the email in the greyzone - above tag level and below reject level. You should not see that many email in this region.

You might have had the reject level set very high in the past and hence all rejected emails ended up in junkmail.

The levels you see now are fine according to me.

Now I understand. Thank you Jesper, and congratulations on a very finely crafted contribution.

Ed Form

Offline edform

  • *
  • 178
  • +0/-0
    • http://www.workgroupsolutions.co.uk
Re: Sme-unjunkmgr
« Reply #7 on: April 16, 2011, 11:43:09 AM »
Now that is annoying!

I've reinstalled my 8.0b6 server to allow for changed hardware and the Sme-unjunkmgr contribution is not sending junk messages again. When I try to do it by hand, I get the same error message...

[root@mini-itx ~]# /usr/local/unjunkmgr/spamreminder.pl
Can't locate Email/Date.pm in @INC (@INC contains: /usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.8 /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.8 /usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.8 /usr/lib/perl5/site_perl /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.8 /usr/lib/perl5/vendor_perl /usr/lib/perl5/5.8.8/i386-linux-thread-multi /usr/lib/perl5/5.8.8 .) at /usr/lib/perl5/vendor_perl/5.8.8/MIME/Lite.pm line 1097, <CSS> line 242.
[root@mini-itx ~]#

This time, however, perl-Email-Date-Format is installed...

[root@mini-itx ~]# rpm -qa | grep perl
perl-Socket6-0.23-1.el5.rf
perl-NetAddr-IP-4.027-1.el5.rf
perl-Encode-Detect-1.01-1.el5.rf
perl-Mail-RFC822-Address-0.3-1.fc6
perl-Archive-Tar-1.39.1-1.el5_5.2
perl-DateManip-5.44-1.2.1
perl-Net-Server-0.97-1.el5.rf
perl-File-MMagic-1.27-2.el5
perl-HTML-Parser-3.64-1.el5.rf
perl-Convert-BinHex-1.119-5.el5
perl-MailTools-1.77-1.el5.centos
perl-Razor-Agent-2.84-1.el5.rf
perl-Crypt-Cracklib-1.4-1.el5.rf
perl-Authen-PAM-0.16-8.el5
perl-Crypt-OpenSSL-Bignum-0.04-1.el5.rf
perl-IO-Socket-SSL-1.31-2.el5.rf
mod_perl-2.0.4-6.el5
perl-Digest-SHA-5.48-1.el5.rf
perl-Quota-1.6.3-1.el5.rf
perl-Compress-Raw-Zlib-2.024-1.el5.rf
perl-Digest-SHA1-2.11-1.2.1
perl-Text-Iconv-1.7-1.el5.rf
perl-BSD-Resource-1.28-1.fc6.1
perl-URI-1.35-3
perl-IO-stringy-2.110-8.0.el5
perl-IO-Socket-INET6-2.57-1.el5.rf
perl-Test-Inline-0.16-1.el5.sme
perl-Text-Template-1.45-1.el5.rf
perl-Net-Ident-1.20-1.2.el5.rf
perl-IO-Zlib-1.10-1.el5.rf
perl-Compress-Zlib-2.015-1.el5.rf
perl-HTML-Tabulate-0.35-1.el5.rf
perl-Time-TAI64-2.11-1.el5.rf
perl-I18N-AcceptLanguage-1.04-1.el5.rf
perl-Class-ParamParser-1.041-1.el5.rf
perl-Convert-ASN1-0.22-1.el5.rf
perl-CGI-Persistent-1.11-1.el5.rf
perl-XML-NamespaceSupport-1.09-1.2.1
perl-HTML-Tagset-3.20-1.el5.rf
perl-libwww-perl-5.805-1.1.1
perl-Net-IP-1.25-2.fc6
perl-Geography-Countries-2009041301-1.el5.rf
perl-TimeDate-1.16-5.el5
perl-MIME-tools-5.420-3.el5
perl-Error-0.17010-1.el5
perl-Net-DNS-0.66-1.el5.rf
perl-XML-Parser-2.34-6.1.2.2.1
perl-Mail-SPF-2.006-1.el5.rf
perl-DBD-MySQL-3.0007-2.el5
perl-Net-SSLeay-1.30-4.fc6
perl-Crypt-OpenSSL-RSA-0.25-1.el5.rf
perl-Mail-DKIM-0.37-1.el5.rf
perl-Net-SMTP-SSL-1.01-4.el5
perl-Email-Date-Format-1.002-4.el5
perl-Authen-SASL-2.13-1.el5.rf
perl-RPM2-0.67-7.el5
perl-suidperl-5.8.8-32.el5_5.2
perl-CGI-FormMagick-0.92-21.el5.sme
perl-Locale-gettext-1.05-1.el5.rf
perl-Clone-0.31-1.el5.rf
perl-version-0.7203-1.el5
uuid-perl-1.5.1-3.el5
perl-DBI-1.611-1.el5.rf
perl-Digest-HMAC-1.01-15
perl-Net-IPv4Addr-0.10-3.el5
perl-IO-Compress-Base-2.015-1.el5.rf
perl-IO-Compress-Zlib-2.015-1.el5.rf
perl-Unix-ConfigFile-0.06-1.el5.rf
perl-Object-Persistence-0.92-4.el5.sme
perl-XML-SAX-0.14-8
perl-WWW-Automate-0.21-1.2.el5.rf
perl-IP-Country-2.27-1.el5.rf
perl-Convert-TNEF-0.17-7.el5
perl-LDAP-0.33-3.fc6
perl-5.8.8-32.el5_5.2
perl-MIME-Lite-3.020-1.el5.rf
[root@mini-itx ~]#

What have I done wrong now?

Ed Form