OK this commands seem to have fixed the problem:
sudo systemctl stop umbrel-startup && sudo rm -rf ~/umbrel/electrs/!(electrs.toml) && sudo systemctl start umbrel-startup
After about 10 minutes umbrel finally caught up with syncing the blocks. Hopefully it stays like that.