Oh, one other thing I had to do.
After changing the port on the default website, then stopping it. It would not start back up. Warned the port was in use.
The Kerberos service listens on port 88, if its running.
I disabled the Kerberos service since its not used, and the default website started right up.
Anyone actually using Kerberos would need to pick another port for the website.