Can’t access umbrel.local when using Ubuntu

Simple fix: add in that umbrel machine hosts file the IP of your node, like
192.168.1.55 umbrel.local
Done.
Yes, you can access it on LAN using IP, is just fine.

Also take in consideration to set a static IP on your node