Koozali.org: home of the SME Server

Obsolete Releases => SME Server 7.x => Topic started by: kryptos on July 19, 2007, 06:08:15 AM

Title: japanese email treated as spam
Post by: kryptos on July 19, 2007, 06:08:15 AM

Hi All

Why do japanese mails treated as spam? Below are the portion of the email header.

X-Spam-Status: Yes, hits=7.4 required=5.0
      tests=BAYES_50,HTML_MESSAGE,PYZOR_CHECK,SARE_RAND_2,SARE_SUB_ENC_ISO2022JP,SARE_SUB_PCT_LETTER


How can i prevent this from happening? We have a lot japanese user using our email.


Regards,
Rocel

Title: japanese email treated as spam
Post by: mmccarn on July 19, 2007, 11:36:30 AM

SARE_SUB_ENC_ISO2022JP and SARE_SUB_PCT_LETTER look like they come from the SpamAssassin Rules Emporium: http://www.rulesemporium.com

I can't find any evidence of these rules (or any other 'SARE_' rules) on my almost-virgin-7.1.3-updated-to-7.2 SME server...

Are you certain this header was added by your SME server, and if so have you loaded any spamassassin customizations on your server?

Title: japanese email treated as spam
Post by: kryptos on July 20, 2007, 04:23:57 AM

Hi,

I just follow this link:

http://www.sonoracomm.com/index.php?option=com_content&task=view&id=49&Itemid=32

I've install also smeserver-spamassassin-features-0.0.2-0.noarch.rpm

Would you were can i disable this thing?

Regards,
Rocel

Title: japanese email treated as spam
Post by: kryptos on July 20, 2007, 06:55:19 AM

I think all japanese emails are getting detected with this SARE_SUB_ENC_ISO2022JP. How can i just disable that rule? where i can find it spamassasin configuration? I don't know much about spamassassin configs files i just follow everything from that howto i mentioned.


Thanks!
Rocel

Title: japanese email treated as spam
Post by: chris burnat on July 23, 2007, 11:42:23 AM

Kryptos,

Quote

I just follow this link:
http://www.sonoracomm.com/index.php?option=com_content&task=view&id=49&Itemid=32

This link is dead, can you check if you copied it OK?
Thanks

Title: japanese email treated as spam
Post by: Reinhold on July 23, 2007, 11:51:22 AM

burnat,

... http://www.sonoracomm.com/     is completely dead ...
...and the Rules Emporium Forums are offline...

Seems hard to help at the moment...
unless
SOMEONE (Rocel?) PLEASE POST THE SONORACOMM INFO verbatim here

Regards
Reinhold

Title: japanese email treated as spam
Post by: kryptos on July 24, 2007, 02:53:00 AM

Hi all,

the link were cached by google. if search for the link and click on cache it still there

Regards,
Rocel

Title: japanese email treated as spam
Post by: chris burnat on July 24, 2007, 03:13:24 AM

Thanks, Kryptos I should have thought about this....
chris

Title: japanese email treated as spam
Post by: kryptos on July 24, 2007, 06:27:25 AM

I have found similar problem with this link

http://www.mail-archive.com/users@spamassassin.apache.org/msg16486.html

Regards,
Rocel

Title: japanese email treated as spam
Post by: kryptos on July 25, 2007, 11:18:55 AM

i have read further about this and I think the rules are from sa-update script.  Checking on this directory /var/lib/spamassassin i have found the rules. But i don't know how to if i can edit this directly without breaking anything. Hope some can help me with this.

Regards,
Rocel

Title: japanese email treated as spam
Post by: chris burnat on July 25, 2007, 12:12:04 PM

I may be out of order here, but in my experience, there is no need to add anything to the spamassassin package selected by the Devs for the SME server.  I have a number of Japanese users, and stock SME appears to be doing the job nicely, this being especially true for Version 7.2 just released.  For example, on a server receiving over 2000 spams a day at the front end, under 7.1.3, I used to get say 20-50 stay spams for all of my users a day, asnd another 5-10 false positive (yahoo mostly...)  Having upgraded to 7.2 over the past 48 hours ago, I note that this had been reduced to around 5-10 stray spams per day.  Very very nifty.

I suggest you upgrade to 7.2 and remove any additions to SA, - and see.  
Then worry about customisation if required and justified.

Title: japanese email treated as spam
Post by: kryptos on July 26, 2007, 04:59:18 AM

hi,

I can't upgrade as i am afraid for any problem that will arise during the upgrade as many depends on these server and has to be up 24x7. As for the rules in sa-updates i just wanna ask could this be disabled manually? or i could remove it?

regards,
rocel

Title: japanese email treated as spam
Post by: chris burnat on July 26, 2007, 05:34:48 AM

I assume you have installed:

Quote

smeserver-spamassassin-features-0.0.2-0.noarch.rpm

according to the instruction provided in the Howto you refer to in your post.  

Quote

rpm -Uvh \
http://mirror.contribs.org/smeserver/contribs/\
michaelw/sme7/smeserver-spamassassin-features-0.0.2-0.noarch.rpm

I do not know your level of expertise, and can only make suggestion.  The first thing would be to insure that this rpm is actuall installed, do:

Quote

rpm -qa | grep smeserver-spamassassin-features

This should return the exact version of the rpm and confirm it has been installed.

The next step would be to remove this rpm if you are confident that a component installed by this rpm creates issue with Japanese content:

Quote

rpm -e smeserver-spamassassin-features-0.0.2-0

and for good measure, do a reconfiguration of the server:

Quote

/sbin/e-smith/signal-event post-upgrade
/sbin/e-smith/signal-event reboot

Note that this will reboot your server, pick a suitable time.
No warranty, someone may have a better idea....

Title: japanese email treated as spam
Post by: kryptos on July 26, 2007, 07:29:24 AM

hi,

That's what i have thought before. But as i have search more about my problem. It was from the new sa-update that included  SARE rules to its updates. Now problem is how can get rid of this as it created new rules on this folder /var/lib/spamassassin. As what i have read spamassassin directly look for this folder for any rules if there are no rules found it will not use rules at all.I don't wanna completely disable spamfiltering and want to use the default rules. Any ideas? I hope Brian(the one who created this sa-update script) can give some infos about this.


Regards,
rocel

Title: japanese email treated as spam
Post by: kryptos on July 26, 2007, 07:33:39 AM

here is the script i've mention

#
# bjr - last editted 26th May 2007 (brianr@bjsystems.co.uk)
#
# Run SA-Update which will download new rules for SA when they become available - SME7.x
# sends an email of the logs if it happens and restarts SA, silent otherwise
# 26th may 2007 - Add Openprotect channel
#
rm -f /tmp/channels ; touch /tmp/channels
echo saupdates.openprotect.com >> /tmp/channels
echo updates.spamassassin.org >> /tmp/channels
(sa-update --debug --nogpg --channelfile /tmp/channels 2>/tmp/sa-update.log && (cat /tmp/sa-update.log | mail admin -s "SA rules updated ";/command/svc -t /service/spamd))


----And this the installation procedure ----

SA-Update Script
----------------

Last Updated  - Jun 2007

1. Drop into /etc/cron.daily
2. chmod +x /etc/cron.daily/sa-update


This program requires some extra perl libs which are not installed normally, although after any sort of yum update
they seem to get installed.  So if you are trying to run this on a new install of 7.1, then you need to have done the
following:

yum install perl-Archive-Tar perl-IO perl-Compress-Zlib perl-IO-Zlib


Runs sa-update every night, restarts SA if new rules are downloaded
Runs in debug mode - remove the -D parameter if you want it to be completly silent

Changes
-------

3Jan07 - Make it silent unlesss an update is detected
Jun2007 - Add the SAR Rules Du Jour


Regards,
Rocel