Koozali.org: home of the SME Server

Spam filtering

Offline MSmith

  • *
  • 675
  • +0/-0
Spam filtering
« on: July 26, 2011, 09:18:02 PM »
Seems like the boards are kind of quiet on this subject ... anything new and exciting in this area?  Has anyone succeeded in getting TMDA or another challenge/response system implemented in SME 7 or 8?
...

Offline cactus

  • *
  • 4,880
  • +3/-0
    • http://www.snetram.nl
Re: Spam filtering
« Reply #1 on: July 27, 2011, 07:15:14 AM »
Seems like the boards are kind of quiet on this subject ... anything new and exciting in this area?  Has anyone succeeded in getting TMDA or another challenge/response system implemented in SME 7 or 8?
IMHO a challenge response system is a bad thing, I prefer a little SPAM over having people having to send a second mail to get their mail delivered.
In my situation DNSBL and Bayes filtering works very good, I receive very little unsolicited or SPAM mail.
DNSBL seems to block the most SPAM in my case as around 50% of mail delivered to my server is prevented by that, compared to other plugins like clamav, spamassassin, check_earlytalker and the like preventing about 15% of SPAM in my e-mail.

You can also implement RHSBL, but I do not use that anymore.
Be careful whose advice you buy, but be patient with those who supply it. Advice is a form of nostalgia, dispensing it is a way of fishing the past from the disposal, wiping it off, painting over the ugly parts and recycling it for more than its worth ~ Baz Luhrmann - Everybody's Free (To Wear Sunscreen)

Offline MSmith

  • *
  • 675
  • +0/-0
Re: Spam filtering
« Reply #2 on: July 27, 2011, 04:29:12 PM »
Your opinion on challenge/response is noted, Cactus, but I didn't ask if it was a bad thing, I asked if anyone had done it.  My SME machine is rejecting 95% or better of spam emails, with DNSBL stopping the bulk of them.

So, anybody have any new techniques or variations on old techniques to add?
...

Offline CharlieBrady

  • *
  • 6,918
  • +3/-0
Re: Spam filtering
« Reply #3 on: July 30, 2011, 12:31:40 AM »
Your opinion on challenge/response is noted, Cactus, but I didn't ask if it was a bad thing, I asked if anyone had done it.

Gordon Rowell once had an e-smith-qconfirm contrib. However the backscatter generated was so bad that we unpublished the contrib as best he could.

Challenge/response systems are irresponsible. They transfer the burden of your spam onto the innocent forged "senders" of your spam. I agree with Cactus - don't go there.

Offline MSmith

  • *
  • 675
  • +0/-0
Re: Spam filtering
« Reply #4 on: August 03, 2011, 09:50:45 PM »
So it would seem that the actual *answers* to the questions I actually *asked* are "No" and "No."  Spam volumes overall may be down, but I'm getting hammered by hundreds per day that *are* getting through, despite DNSBL and RHSBL blocking and SpamAssassin filtering cranked down so it tags at 8 and rejects at 5.  (Yes, thousands more are blocked before my Inbox sees them.)

I haven't implemented Bayesian filtering with LearnAsHam and LearnAsSpam yet but that will probably be next. 
...

Offline piran

  • *****
  • 502
  • +0/-0
Re: Spam filtering
« Reply #5 on: August 04, 2011, 01:31:05 AM »
...I'm getting hammered by hundreds per day that *are* getting through,
despite DNSBL and RHSBL blocking and SpamAssassin filtering cranked
down so it tags at 8 and rejects at 5.

WAS: "implement earlytalker filtering"
NOW: "adjust existing earlytalker filtering timeout"

[set up the template if not done already]
mkdir -p /etc/e-smith/templates-custom/var/service/qpsmtpd/config/peers/0

[edit template]
cd /etc/e-smith/templates-custom/var/service/qpsmtpd/config/peers/0
nano -w 10check_earlytalker
edit contents to show "check_earlytalker wait 50"
Ctrl-X exit/save etc

[restart template]
signal-event email-update

Probably get most if not all of them... job done.

PostEdit: as requested
« Last Edit: August 04, 2011, 02:22:39 PM by piran »

Offline CharlieBrady

  • *
  • 6,918
  • +3/-0
Re: Spam filtering
« Reply #6 on: August 04, 2011, 05:15:32 AM »
implement earlytalker filtering

I believe that earlytalker filtering is enabled by default. If it is not working correctly (or as well as you expect), you should open a bug report.

Offline piran

  • *****
  • 502
  • +0/-0
Re: Spam filtering
« Reply #7 on: August 04, 2011, 12:22:31 PM »
I believe that earlytalker filtering is enabled by default.
I didn't say enable it. I said implement it and followed that
advice by the change I recommended. How does your
input above help the OP?

If it is not working correctly (or as well as you expect), you should open a bug report.
I didn't say it was working incorrectly or in any way
not to expectation or actually needed adjusting in
normal circumstances. If I ever did find anything
otherwise I would open a bug report without any
hesitation. I haven't so I won't file a bug report
as it would be a waste of time for you and I.
How does your input above help the OP?


Offline Stefano

  • *
  • 10,894
  • +3/-0
Re: Spam filtering
« Reply #8 on: August 04, 2011, 12:28:14 PM »
I didn't say enable it. I said implement it and followed that
advice by the change I recommended.

I think your suggestion is wrong.. earlytalker is enabled and implemented by default AFAIK, so there's no need to implement it again

Quote
How does your input above help the OP?

sincerely I don't understand this attitude, but maybe it's a problem of mine..

Offline piran

  • *****
  • 502
  • +0/-0
Re: Spam filtering
« Reply #9 on: August 04, 2011, 12:31:21 PM »
...moment I was typing it up.

Offline piran

  • *****
  • 502
  • +0/-0
Re: Spam filtering
« Reply #10 on: August 04, 2011, 12:35:27 PM »
...before my Inbox sees them
The criminals who seem to have taken over Rustock's mantle
appear to be using MTAs under their Command & Control
configured for a 40sec (roughly) timeout on the SMTP
greetings banner. Rustock in its time seemed to favour
20sec MTAs. I don't know why or how it's just what I
observed from the myriad of rubbish they sent my way.
The current lot seem prepared to accept up to 40sec of
delay (before timing out and attempting to blurt their
spam load). Setting the earlytalker timer, by the
template above, to a setting of 50sec would be quite
sufficient to address the matter. Some assumptions
made of course. If it does not help then simply delete
the template, restart email and try another way.

PostEdit: typos
« Last Edit: August 04, 2011, 12:38:29 PM by piran »

Offline piran

  • *****
  • 502
  • +0/-0
Re: Spam filtering
« Reply #11 on: August 04, 2011, 12:43:50 PM »
I think your suggestion is wrong.. earlytalker is enabled and implemented by default AFAIK, so there's no need to implement it again
I don't understand you, please explain your assertion.
The technique works. Have you tried it? The OP was
asking for technique suggestions new or amended old.

sincerely I don't understand this attitude, but maybe it's a problem of mine..
I agree, occasionally I don't understand this attitude,
maybe we all have a problem of our own.

Offline Stefano

  • *
  • 10,894
  • +3/-0
Re: Spam filtering
« Reply #12 on: August 04, 2011, 12:57:54 PM »
I don't understand you, please explain your assertion.
The technique works. Have you tried it? The OP was
asking for technique suggestions new or amended old.

I meant: earlytalker plugin is already installed, configured and enabled by default on each SME installation.. I have it working on each server and I'm sure that I haven't enabled/configured/implemented it..
I suggest OP to modify his DNSBL and RHSBL setup.. mine is working fine with

Code: [Select]
    RBLList=bl.spamcop.net:combined.njabl.org:dnsbl.ahbl.org:list.dsbl.org:multihop.dsbl.org:zen.spamhaus.org
    RHSBL=enabled
    RequireResolvableFromHost=yes
    SBLList=bogusmx.rfc-ignorant.org:multi.surbl.org:black.uribl.com:rhsbl.sorbs.net:bulk.rhs.mailpolice.com:fraud.rhs.mailpolice.com:porn.rhs.mailpolice.com:adult.rhs.mailpolice.com:ex.dnsbl.org

Offline piran

  • *****
  • 502
  • +0/-0
Re: Spam filtering
« Reply #13 on: August 04, 2011, 01:14:06 PM »
I meant: earlytalker plugin is already installed, configured and enabled by default on each SME installation.
Understood. Would you and Charlie prefer that I...
PostEdit "implement earlytalker filtering" to
PostEdit "adjust existing earlytalker filtering timeout"?

The OP was enquiring about new (I read alternative)
techniques to address his incoming spam load.

Your RBL and SBL Lists are interesting. It's been a
very long time since I needed to edit mine and you
use some of which I have no knowledge at all.

Offline Stefano

  • *
  • 10,894
  • +3/-0
Re: Spam filtering
« Reply #14 on: August 04, 2011, 02:14:08 PM »
Understood. Would you and Charlie prefer that I...
PostEdit "implement earlytalker filtering" to
PostEdit "adjust existing earlytalker filtering timeout"?

yes, IMHO it would be better..