Koozali.org: home of the SME Server

japanese email treated as spam

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« on: July 19, 2007, 06:08:15 AM »
Hi All

Why do japanese mails treated as spam? Below are the portion of the email header.

X-Spam-Status: Yes, hits=7.4 required=5.0
      tests=BAYES_50,HTML_MESSAGE,PYZOR_CHECK,SARE_RAND_2,SARE_SUB_ENC_ISO2022JP,SARE_SUB_PCT_LETTER


How can i prevent this from happening? We have a lot japanese user using our email.


Regards,
Rocel

Online mmccarn

  • *
  • 2,657
  • +10/-0
japanese email treated as spam
« Reply #1 on: July 19, 2007, 11:36:30 AM »
SARE_SUB_ENC_ISO2022JP and SARE_SUB_PCT_LETTER look like they come from the SpamAssassin Rules Emporium: http://www.rulesemporium.com

I can't find any evidence of these rules (or any other 'SARE_' rules) on my almost-virgin-7.1.3-updated-to-7.2 SME server...

Are you certain this header was added by your SME server, and if so have you loaded any spamassassin customizations on your server?

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #2 on: July 20, 2007, 04:23:57 AM »
Hi,

I just follow this link:

http://www.sonoracomm.com/index.php?option=com_content&task=view&id=49&Itemid=32

I've install also smeserver-spamassassin-features-0.0.2-0.noarch.rpm

Would you were can i disable this thing?

Regards,
Rocel

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #3 on: July 20, 2007, 06:55:19 AM »
I think all japanese emails are getting detected with this SARE_SUB_ENC_ISO2022JP. How can i just disable that rule? where i can find it spamassasin configuration? I don't know much about spamassassin configs files i just follow everything from that howto i mentioned.


Thanks!
Rocel

Offline chris burnat

  • *****
  • 1,135
  • +2/-0
    • http://www.burnat.com
japanese email treated as spam
« Reply #4 on: July 23, 2007, 11:42:23 AM »
Kryptos,

Quote
I just follow this link:
http://www.sonoracomm.com/index.php?option=com_content&task=view&id=49&Itemid=32


This link is dead, can you check if you copied it OK?
Thanks
- chris
If it does not work out of the box, please fill in a Bug Report @ Bugzilla (http://bugs.contribs.org)  - check: http://wiki.contribs.org/Bugzilla_Help .  Thanks.

Offline Reinhold

  • *
  • 517
  • +0/-0
    • http://127.0.0.1
japanese email treated as spam
« Reply #5 on: July 23, 2007, 11:51:22 AM »
burnat,

... http://www.sonoracomm.com/     is completely dead ...
...and the Rules Emporium Forums are offline...

Seems hard to help at the moment...
unless
SOMEONE (Rocel?) PLEASE POST THE SONORACOMM INFO verbatim here

Regards
Reinhold
............

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #6 on: July 24, 2007, 02:53:00 AM »
Hi all,

the link were cached by google. if search for the link and click on cache it still there

Regards,
Rocel

Offline chris burnat

  • *****
  • 1,135
  • +2/-0
    • http://www.burnat.com
japanese email treated as spam
« Reply #7 on: July 24, 2007, 03:13:24 AM »
Thanks, Kryptos I should have thought about this....
chris
- chris
If it does not work out of the box, please fill in a Bug Report @ Bugzilla (http://bugs.contribs.org)  - check: http://wiki.contribs.org/Bugzilla_Help .  Thanks.

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #8 on: July 24, 2007, 06:27:25 AM »
I have found similar problem with this link

http://www.mail-archive.com/users@spamassassin.apache.org/msg16486.html

Regards,
Rocel

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #9 on: July 25, 2007, 11:18:55 AM »
i have read further about this and I think the rules are from sa-update script.  Checking on this directory /var/lib/spamassassin i have found the rules. But i don't know how to if i can edit this directly without breaking anything. Hope some can help me with this.

Regards,
Rocel

Offline chris burnat

  • *****
  • 1,135
  • +2/-0
    • http://www.burnat.com
japanese email treated as spam
« Reply #10 on: July 25, 2007, 12:12:04 PM »
I may be out of order here, but in my experience, there is no need to add anything to the spamassassin package selected by the Devs for the SME server.  I have a number of Japanese users, and stock SME appears to be doing the job nicely, this being especially true for Version 7.2 just released.  For example, on a server receiving over 2000 spams a day at the front end, under 7.1.3, I used to get say 20-50 stay spams for all of my users a day, asnd another 5-10 false positive (yahoo mostly...)  Having upgraded to 7.2 over the past 48 hours ago, I note that this had been reduced to around 5-10 stray spams per day.  Very very nifty.

I suggest you upgrade to 7.2 and remove any additions to SA, - and see.  
Then worry about customisation if required and justified.
- chris
If it does not work out of the box, please fill in a Bug Report @ Bugzilla (http://bugs.contribs.org)  - check: http://wiki.contribs.org/Bugzilla_Help .  Thanks.

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #11 on: July 26, 2007, 04:59:18 AM »
hi,

I can't upgrade as i am afraid for any problem that will arise during the upgrade as many depends on these server and has to be up 24x7. As for the rules in sa-updates i just wanna ask could this be disabled manually? or i could remove it?

regards,
rocel

Offline chris burnat

  • *****
  • 1,135
  • +2/-0
    • http://www.burnat.com
japanese email treated as spam
« Reply #12 on: July 26, 2007, 05:34:48 AM »
I assume you have installed:
Quote
smeserver-spamassassin-features-0.0.2-0.noarch.rpm

according to the instruction provided in the Howto you refer to in your post.  
Quote
rpm -Uvh \
http://mirror.contribs.org/smeserver/contribs/\
michaelw/sme7/smeserver-spamassassin-features-0.0.2-0.noarch.rpm

I do not know your level of expertise, and can only make suggestion.  The first thing would be to insure that this rpm is actuall installed, do:
Quote
rpm -qa | grep smeserver-spamassassin-features

This should return the exact version of the rpm and confirm it has been installed.

The next step would be to remove this rpm if you are confident that a component installed by this rpm creates issue with Japanese content:

Quote
rpm -e smeserver-spamassassin-features-0.0.2-0

and for good measure, do a reconfiguration of the server:
Quote
/sbin/e-smith/signal-event post-upgrade
/sbin/e-smith/signal-event reboot

Note that this will reboot your server, pick a suitable time.
No warranty, someone may have a better idea....
- chris
If it does not work out of the box, please fill in a Bug Report @ Bugzilla (http://bugs.contribs.org)  - check: http://wiki.contribs.org/Bugzilla_Help .  Thanks.

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #13 on: July 26, 2007, 07:29:24 AM »
hi,

That's what i have thought before. But as i have search more about my problem. It was from the new sa-update that included  SARE rules to its updates. Now problem is how can get rid of this as it created new rules on this folder /var/lib/spamassassin. As what i have read spamassassin directly look for this folder for any rules if there are no rules found it will not use rules at all.I don't wanna completely disable spamfiltering and want to use the default rules. Any ideas? I hope Brian(the one who created this sa-update script) can give some infos about this.


Regards,
rocel

Offline kryptos

  • *****
  • 245
  • +0/-0
japanese email treated as spam
« Reply #14 on: July 26, 2007, 07:33:39 AM »
here is the script i've mention

#
# bjr - last editted 26th May 2007 (brianr@bjsystems.co.uk)
#
# Run SA-Update which will download new rules for SA when they become available - SME7.x
# sends an email of the logs if it happens and restarts SA, silent otherwise
# 26th may 2007 - Add Openprotect channel
#
rm -f /tmp/channels ; touch /tmp/channels
echo saupdates.openprotect.com >> /tmp/channels
echo updates.spamassassin.org >> /tmp/channels
(sa-update --debug --nogpg --channelfile /tmp/channels 2>/tmp/sa-update.log && (cat /tmp/sa-update.log | mail admin -s "SA rules updated ";/command/svc -t /service/spamd))


----And this the installation procedure ----

SA-Update Script
----------------

Last Updated  - Jun 2007

1. Drop into /etc/cron.daily
2. chmod +x /etc/cron.daily/sa-update


This program requires some extra perl libs which are not installed normally, although after any sort of yum update
they seem to get installed.  So if you are trying to run this on a new install of 7.1, then you need to have done the
following:

yum install perl-Archive-Tar perl-IO perl-Compress-Zlib perl-IO-Zlib


Runs sa-update every night, restarts SA if new rules are downloaded
Runs in debug mode - remove the -D parameter if you want it to be completly silent

Changes
-------

3Jan07 - Make it silent unlesss an update is detected
Jun2007 - Add the SAR Rules Du Jour


Regards,
Rocel