My home server, PII w/192 megs RAM (was 128, but I threw in 64 more for just this experiment) pretty much always is at 85-98% RAM usage. I've never seen it get into swap space, though, and it's fairly heavily customized and gets lots of use, from caching DNS server to the home LAN to outside hits for Gallery and Zoë.
Just my 2¢ ...