Need someone to lead product management at your software company? I create software for people that create software and I'm looking for my next opportunity. Check out my resume and get in touch.

This is the blog of Adam Kalsey. Unusual depth and complexity. Rich, full body with a hint of nutty earthiness.

Security & Privacy

Is this the end?

Freshness Warning
This blog post is over 21 years old. It's possible that the information you read below isn't current and the links no longer work.

For months, I’ve laughed in the face of spam. I’ve bared my email address in public, daring the spammers to come and find me. "Let the spam flow," I cried, for I was prepared. I had SpamAssassin on my side.

In the last 5 months, SpamAssassin has caught over 60MB of spam wih nary a false positive or spam slipping through. But now chinks have appeared in my armor. In the last half-hour, four spams have slipped through. Each one was scored just under the five points required in order for a message to be tagged as spam.

Comments

Johan Svensson
January 23, 2003 4:44 AM

Personally, I run SpamProbe (spamprobe.sf.net), that uses bayesian logic. For all the recent hype about the Bayes formula, it's damn good. Unfortunately (heh) I don't get any spam at all to my domain, so I had to import a bunch of hotmail spam to train the filter. Sure, after about 300 messages from hotmail, it picked up every piece of spam originating from my hotmail account and nuked it. Though of course, many spams there tend to be repeated messages. Paul Graham's latest paper sounds promising, and adds a new layer to the previously completely naive filter; his suggestion is to differ between different headers, the body and URLs in the message. Personally, I think a system based on bayesian logic is the way to go. It's not the Be All, End All of spam preventing, but it's so incredibly effective that it's a bad idea not to have it among your filters. I've noticed that some of the hotmail spam I've gotten recently have changed style -- it's a short sentence with non-spammy words followed by a URL. That's certainly not much for SpamAssassin to chew on.

Adam Kalsey
January 24, 2003 12:39 PM

The latest SpamAssassin (2.5) has Bayesian filtering built in. I'm still running 2.43, though, because I wnat to make sure that the new release is stable before updating my servers.

andersja
January 24, 2003 3:15 PM

... it's the classig problem of filtering systems with feedback mechanisms... It seems the only way to keep up is to install new versions of SA before the spammers do... Despite the odd slip-through, I couldn't imagine living without it... It catches 1000+ messages for me a month... There are commercial products available that I can't imagine being nearly as thorough as SA and bing sold for massive sums... See also: http://www.jacobsen.no/anders/blog/archives/2002/08/23/is_spamassassin_helping_the_spammers_too_much.html http://www.jacobsen.no/anders/blog/archives/2002/08/28/to_filter_or_not_to_filter.html http://www.jacobsen.no/anders/blog/archives/2002/10/16/spam_hype_and_spamassassin.html

Johan Svensson
January 24, 2003 5:51 PM

It's not that I don't like spamassassin - I used it before switching to spamprobe. It's just that spamassassin is a bit resource hungry and takes longer time due to hostname lookups and such. That's stuff I can live without -- spamprobe includes the headers and server names when analyzing the mail anyway. though of course, I used to run spamassassin on an old Cyrix 100MHz laptop with a whopping 16 megs of RAM. :-)

This discussion has been closed.

Recently Written

Micromanaging and competence (Jul 2)
Providing feedback or instruction can be seen as micromanagement unless you provide context.
My productivity operating system (Jun 24)
A framework for super-charging productivity on the things that matter.
Great product managers own the outcomes (May 14)
Being a product manager means never having to say, "that's not my job."
Too Big To Fail (Apr 9)
When a company piles resources on a new product idea, it doesn't have room to fail. That keeps it from succeeding.
Go small (Apr 4)
The strengths of a large organization are the opposite of what makes innovation work. Starting something new requires that you start with a small team.
Start with a Belief (Apr 1)
You can't use data to build products unless you start with a hypothesis.
Mastery doesn’t come from perfect planning (Dec 21)
In a ceramics class, one group focused on a single perfect dish, while another made many with no quality focus. The result? A lesson in the value of practice over perfection.
The Dark Side of Input Metrics (Nov 27)
Using input metrics in the wrong way can cause unexpected behaviors, stifled creativity, and micromanagement.

Older...

What I'm Reading