I do something like that, even though I have the sever(s) at home, and then I use my Windows laptop as client from anywhere.
The home server is not only one server but a number of virtual servers running as equired under Centos 64 / Wmware.
I use a virtual Windows 2000 running Windows 2000 as "remote control unit" on the "virtual server farm" via logmein. The Windows 2000 desktop can be braught up from anywhere and allow all kind of remote control.
Then I also use putty and winscp for logon to, and for file transfere to and from virtual servers. For this I ue tcp 443 which is usually open out on most networks. I also use some other alernate ports.
For remote logon to the virtual Asterisk server I use Zoiper using IAX2 via udp 53 that is also normally open direction out on most networks.
I also use puty for tunnelling to the "vitual network" as required.
With a few simple remote tools most things can be done as one were there: logmein.com, putty and winscp, and eventually for iptelephony using Zoiper.
Except for some delay, allmost anything can be done "as you were there" even though you were on the other side of the earth,
There should not be any big risk for the network you are doing the remote access from, and also no big risk for your home network that eventually has open tcp 443 and udp 53. Like the way I do it I can also close all ports, and open them for one and one connection via logmein/windows200/Smoothwall.
It might sonun complicated, but it's not, and this arrangement have now runned with zero errors for appox one year now.
I used a few hours to find out how to do these things, but it is quite easy, and quite stable, when it works. Could supply with some more info if any interest.