Yes, it should matter. Port 110 is port 110, and the public/private setting controls access to (among other things) port 110. Port 110 is user access, period--mail delivery would happen on port 25. If you're not getting mail from the outside world, your problem has nothing to do with port 110; most likely, your ISP is blocking port 25.