what realtek nics are you using? realtek 8169? several users have complained about driver & performance issues. Have you tried 3com, intel or any other major vendor? I also use realtek nics, realtek 8139s. I have issues like you stated only when the nics are going bad.
HTH