I'v seen this strange business before too. When it happened to me, it turned out that the SME Server was downloading messages from my ISP, and kept getting stuck on one single, rather large (20MB) message. Then it would juts drop the connection, without deleting the messages off the ISP, then try again.
Good luck!
Matt