I was not really passing anything, just setting up to rsync some files. That is when I notice it was failing.
After I made the connection, I sent a ctrl-d to disconnect. when I tried to connect again it just hangs there.
I did not have vpn running at that point, but was able to connect. I used sme9admin, and stopped and started sshd, but that made no difference.
I am not using fail2ban on this server.
I just attempted to log in via ssh with another user name, and I rejected. Then it was frozen up again.
I am trying to do all this to use an old dungog contrib for rsync backup which is working flawlessly with other servers I am backing up.