Using a default-constructed IPAddress gives an invalid address, but this address is also the UDP broadcast address. That's why you can reach everyone on your local network when using such an address, but not outside (broadcast messages are blocked by the router).
If you want to use a public IP address, make sure that the router doesn't block the corresponding port.