Heh. I always do this. Go and ask for help, then find out the answer myself. Maybe I should have gone looking for help earlier, I might have fixed it faster...
Anywho, the problem lay with RAV antivirus which I installed 2 weeks ago. It stopped working (it couldn't update itself) and so my email server stopped picking up emails. I uninstalled Rav, and bam, bucket loads of messages (plus one for every 5 minutes e-smith failed to connect)
Case closed, and time to look for McAfee and amavis, I think...