0

Wall Street Journal - Real Message About Spam


06/18/2008


I read an interesting article from Lee Gomes of the Wall Street Journal. He looked at his company's internal spam policies and was not happy with the result:


"...Inboxes were suddenly free of offers for prescription medicines, mortgage refinances, crude erotica and all the other mainstays of the spam economy. Regular email life could resume--spam-free. It looked like another victory for technology in the hands of the good guys... [However] the antispam system had been so effective because it had labeled as spam just about everything that was even remotely suspect... Naturally, a huge percentage of the emails weren't spam at all. Our freedom from spam had come at a stiff price -- a very high false-positive rate.

How bad was it?

I took a good long look at a few days' worth of messages in my spam bucket. There were 192 in all. Sorting them by hand into "real mail" and "actual spam," I figured that some 46% were legitimate messages that had been flagged as spam. Of these, most were news releases from companies, including VMWare, Dell and Hewlett-Packard. Notices from Purdue University, the Semiconductor Industry Association and Forbes Magazine also were blocked."

See full Wednesday, June 18, 2008 Wall Street Journal article

What Lee really needs is more of a self-service handling of his spam volume, and he mentions later in the article that his software does have a sensitivity setting. But with spam volume increasing more and more, one of the biggest challenges of spam filtering technology is finding false positives among the spam. Users need an easy way to peruse the spam that has been filtered. Users receiving hundreds of spam daily have a tough time finding good mail among the blocked messages.

Filters that score spam can, for example, only show the lowest scored spam to the users for examination, reducing the number of messages that need attention. SpamSentinel rates spam as categories "B" (Bulk, which would include Lee's news releases), "C" (Confirmed) and "D" (Delete). The "D" (Delete) category comprises 80% of all spam we receive, and does not contain any false positives. That is how we designed the "D" category, and 3 billion messages have confirmed no false positives in this category.

I prefer to have my low scored spam (category "B") sent to my Junk Mail folder in my Lotus Notes email, so I can check it once a day and release any false positives, newsletters or other bulk messages. I can also whitelist a sender, which only impacts me, with a single click. And I never have to call any IT staff to ask for help.




( domino-web.maysoft.com )