I assume you have not enabled the RBL or DNSBL settings which are, by default, turned off on PR1? If you have, revert them to off and see how it behaves.
Do a search, there is some noise about this issue and how non-compliant servers can result in delays, etc in certain circumstances.
In my instance I see very little delay.
regards,
patrick