DSPAM? Why not in gentoo? Something bad about it?

tweakt · Posted: Sun May 09, 2004 2:08 pm Post subject:

Watch this space for updates:
https://bugs.gentoo.org/show_bug.cgi?id=26744

I've still got a few things to finish up before submitting my ebuild. (Create users, set some permissions correctly, etc).

n0cturne · n00b Joined: 28 Dec 2002 Posts: 14 Location: NE, USA

Not meaning to be obnoxious, but what's the status of this DSPAM ebuild? I visit the link above at bugs.gentoo.org and see the last message there from tweakt (I assume), but nothing more. What's the next step?

I threw together an OpenBSD box to act as a spam gateway using DSPAM, and I was blown away by the accuracy and speed. Very nice indeed! But I am a Linux user at heart and I would dearly love to have DSPAM running on my Gentoo box.
_________________
/\/octurne

w00kie · n00b Joined: 16 Jun 2002 Posts: 18 Location: Paris, France

I'm also very much looking forward to this ebuild
all my attempts at installing dSpam with Postfix and Procmail having miserably failed

jeffk · l33t Joined: 13 Sep 2003 Posts: 671

I couldn't agree more, DSPAM is the most important server program I can't yet run on Gentoo. The spammers have found our individual employee email addresses, the avalanche has begun.

FWIW, DSPAM recently released 3.0.0 beta 3. Perhaps version 3 has configuration features that will make gentoo integration easier. I wish I knew enough about it myself to make any headway.

http://www.nuclearelephant.com/projects/dspam/

Xaignar · Posted: Tue May 25, 2004 3:28 pm Post subject:

It's also possible to run this as a single user. There's a guide at the dSpam site. I didn't use a ebuild for installing, but instead manually installed the binaries to ~/.dspam/bin and ~/.dspam/lib.

Styles · Tux's lil' helper Joined: 04 Jun 2002 Posts: 82

Well it looks like DSPAM walks all over SA... I will be implementing a Postfix + Amavis/ClamAV + DSPAM, Mailfilter Gateway here at work to forward to our Exchange server. I did find a howto for Gentoo do this but it is not in English but you can still make out what to do.

here is the URL for it is a slow site so I used google cached link http://216.239.57.104/search?q=cache:OciBOJYRP_4J:cakraweb.postfix.or.id/docs/cecep/mailfiltering_postfix_amavis_dspam.html+DSPAM+mailfilter+relay&hl=en

Styles · Tux's lil' helper Joined: 04 Jun 2002 Posts: 82

Update: found a translation web site for Indonesian to English translation for the above HOWTO.

http://www.toggletext.com/kataku_trial.php

Orginal link to the howto

http://cakraweb.postfix.or.id/docs/cecep/mailfiltering_postfix_amavis_dspam.html

This also might help some people as well, an alternative to the Exchange 5.5 method of exporting valid users on an Exchange server, then processing the output and copying to a Postfix server.

http://www.plusone.com/gaptuning/postfix/

Cheers,

kyler · n00b Joined: 27 Jun 2003 Posts: 10

I knocked out a quick and dirty translation to english for the rest of you shpam lovers.... now we just need to shut down hotmail.com and we'll knock out half of these bad guys

---
http://devnull.com/kyler/dspam.20040512.html

I will link to updated translations from the above page... I haven't actually run through a test setup yet, so I can assure you there will probably be issues if you run through my translation word for word.

Enjoy!

Kyler M. Klein

jeffk · l33t Joined: 13 Sep 2003 Posts: 671

That is one fantastic bit of documentation.

Regarding the DSPAM ebuild, the new version is at RC2, perhaps the 3.0.0 version has many convenience features that have been holding up the existing DSPAM ebuild. With its new monitoring web app, it will probably need to integrate with the webapp-config package now, the details of which I have no clue.
http://www.nuclearelephant.com/projects/dspam/

At any rate, thanks to all involved in the DSPAM integration, I'm looking forward to it. Gentoo needs this package desperately.

tweakt · Posted: Sun Jun 06, 2004 4:02 pm Post subject:

I'm still around, have no fear. Yeah, I've slacked on this for a bit, sorry!

I will do my best to get something available, maybe others can help polish it up and maintain it, because my time is limited currently.

In regards to the web app, yes, it's nice and it was actually available with the 2.10.x release as well, I'm using it now to monitor my spam quarantine. I haven't yet tried the new one, but it makes sense to skip 2.10.x and make an ebuild for 3.0 now. Many folks are using it and it seems stable, also accuracy has been improved slightly.

There's a hack with the webapp and authenticating against shadow passwords. I've made an ebuild for mod_auth_pam to facilitate this but I'm not thrilled with how it works. Also I could use input into how this my be made to fit a wider variety of configs.

Look for something in a week, promise! And definately feel free to contact me directly via email!

Styles · Tux's lil' helper Joined: 04 Jun 2002 Posts: 82

kyler · n00b Joined: 27 Jun 2003 Posts: 10

I've added some new links to my original english translation at -
http://devnull.com/kyler/dspam.20040512.html

I was in the middle of my 1st build based on this translation when I noticed the original author posted a new indonesian version at http://comlabs.itb.ac.id/~cecep/HOWTO/mailfiltering_postfix_amavis_dspam.html

My latest rev is up here, and includes some notes for DSPAM 3.x -
http://devnull.com/kyler/dspam.20040609.html

I'll translate the author's updated version, specifically for DSPAM 3.x here (still in indonesian for now) -
http://devnull.com/kyler/dspam.20040605.html

Enjoy folks... this junk mail problem has got to stop!!

Styles · Tux's lil' helper Joined: 04 Jun 2002 Posts: 82

Great work Kyler, I just got the hard drives in for my server and will be doing a clean install on them hopfully this week if I can find the time.

As soon as you get a final draft you should post it in the Document tips and tricks section of the forum.

Cheers,
Eric

kyler · n00b Joined: 27 Jun 2003 Posts: 10

Just a heads up for anyone attempting to follow this article...
I'm close to getting this setup working, but dspam does not seem to classify anything as spam (YET), but it's adding the !DSPAM tag to the end of the email, so I think I'm on the right track... if i try to forward a spam to kyler@spam.devnull.com i see an error in my log, so i probably have a bad dspam command line arg in my setup somewhere unless that's a normal error... not too sure since this is my 1st dspam attempt. I'll keep trying at it if I have any free time this weekend... If anyone else has any luck with this setup, please pass any useful info my way =) Thanks...
----
Jun 12 01:46:46 localhost dspam[11814]: process_message returned error -5. delivering message.
Jun 12 01:46:46 localhost postfix/pipe[11806]: 78C4B17A309: to=<kyler@spam.devnull.com>, relay=dspam-add, delay=0, status=sent (devnull.com)

cecep_mr · Posted: Sat Jun 12, 2004 12:25 pm Post subject: dspam 3.x has some bugs

EDIT 15 June 2004: this is not bugs

with new config master.cf, everything work fine.

Looks here: http://comlabs.itb.ac.id/~cecep/HOWTO/mailfiltering_postfix_amavis_dspam.html

My dspam has upgraded to 3.0.0 stable (and without quarantine spam like i want) and it works great!

=====================================
I think dspam 3.x is good, such as with this version we can setup per user preferences, and new cgi client has improved (and add some new feature).

New cgi client screenshot
http://comlabs.itb.ac.id/~cecep/archives/images/2004-06-12/dspam_cgi.png

After upgrade to 3.x, every user can choose which preferences is right for their purpose. Like quarantine spam, or sent spam with subject tagging (add [SPAM] prefix). Or, set training mode TOE, or TEFT (which in version 2.10.x apply globally).

Everything work fine, but it has bugs in training spam message (report spam_miss) with user preferences, Tag the subject header as spam or Deliver the message, and I'll sort it out (using X-DSPAM-Result). DSPAM make training loop with this setup.

* first sent spam miss to addspam account
* dspam processing spam_miss
* dspam classified this mail as spam, and try to deliver spam. but dspam deliver spam mail to addspam account (cecep@addspam.domain.tld), not to user account (cecep@domain.tld). and looping is begin.

With user preferences set to Quarantine the message training spam_miss is work fine.

And now, i have downgrade to dspam 2.10.6 to avoid this issue (i don't want quarantine spam, just sent all spam/ham to my mail account).

Cecep.

cecep_mr · Posted: Sat Jun 12, 2004 12:47 pm Post subject: Re: problems with dspam 3.x

Styles · Tux's lil' helper Joined: 04 Jun 2002 Posts: 82

Thanx Cecep for the information and the heads up!

Just an FHI Cecep is the original author.. for the howto.

tweakt · Posted: Sat Jun 12, 2004 11:45 pm Post subject: More progress

Ok. I'm taking some time today work on this, and I'll be posting a link to my dspam-3.0.0-rc2 ebuild sometime this weekend.

I'd like to take an informal poll.

How many think that having a seperate ebuild for the quarantine webapp would make sense?

Untill now I've focused on creating one masterful automated ebuild trying to handle all possibilities. But it occurs to me the best way to handle this is having the quarantine cgi optional, because now it's loads easier to configure dspam to deliver spam, some may prefer to configure that way. Also, as mentioned earlier, in 3.0.x a lot of the options that control behavior of dspam were moved to the command line instead of ./configure, making life MUCH simpler for writing ebuilds.

That just leaves integration with an MTA. This part needs to be done manually anyhow because such configuration changes can't be automated. I've got postfix taken care of... I'll let others tackle sendmail, qmail, etc.

DAWG98 · n00b Joined: 16 May 2004 Posts: 34

I used the guide to install a mailserver for my home network. I am also using cyrus. Dspam works like a champ. I can receive emails (save the pesky spam mails ;) However, I cannot send any mail using my Netscape mail client. It's pointed at port 25 on the server. When I check the logs it seems that mail just runs through the regular incoming process and then is bounced since there is not mailbox to deliver to (makese sense, since it was sent to someone on the outside).

If I use sendmail from a shell I can send mail.

Can someone tell me what I am doing wrong.

Thanks.

cecep_mr · Posted: Sun Jun 13, 2004 9:19 am Post subject:

DAWG98 · n00b Joined: 16 May 2004 Posts: 34

Ok here is the main.cf

cecep_mr · Posted: Mon Jun 14, 2004 1:47 pm Post subject:

change your configure options:

jeffk · l33t Joined: 13 Sep 2003 Posts: 671

FYI, DSPAM 3.0.0 has been released.

DAWG98 · n00b Joined: 16 May 2004 Posts: 34

jeffk

I tried dspam 3.0.0 (stable) but I cannot configure. It gives me errors; i.e., the program does not appear to disget with-delivery-agent = ; prefix= ; with-dspam-home.

Cecep_mr,

no go on the recompile. I think my issue is that when sending mail to outside recipients postifx(or cyrus?) cannot understand to forward to ouside people, but rather the email runs through cyrus/dspam again and the programs attempt to deliver to a local mailbox. OF course that does not work, since there is no such mailbox.

Accordingly, I need to determine (hopefully with some help ;) how to make postifx/cyrus forward mail to the outside instead of looping it back to me.

Sounds like main/master.cf config issue.

DAWG

cecep_mr · Posted: Mon Jun 14, 2004 7:36 pm Post subject: dspam 3.0.0 STABLE, it works

My doc has update to dspam 3.0.0 STABLE (yup, in Indonesian

).
http://comlabs.itb.ac.id/~cecep/HOWTO/mailfiltering_postfix_amavis_dspam.html

Change from previous doc:

Configure options: