I have the same issue, turns out it Tor is way too slow here for me, so I’m just not using Electrs anymore. My only case for the Electrs was to connect Sparrow, but I can do that directly in Bitcoin Core, even so, doing this via Tor wasn’t work nice, takes a long time to just connect and sometimes not even connects, so I allowed local connections in the Bitcoin Core, and things went really fast and smooth.
After that I decided to take Fulcrum for a spin (installed on my desktop using initially the Bitcoin Core in my desktop too) and it is awesome, very fast, reliable and eficient. To sync took about 8 hours with some fine tunigs in the process, and when I connected Sparrow took only 2 secs to sync my wallet. After that I transfered the database files to a HD (the sync was made in a NVMe) and connected Fulcrum to Bitcoin Core in the Umbrel. All went fine.
So, maybe the nice guys from Umbrel may delivery Fulcrum in the next version, so we will have an option, Fulcrum even showed up in the Umbrel 0.5.0 announcement blog post. Who knows…
Another advantage (at least for me) is that I will just copy the already sync database to Umbrel and skip all the sync time consuming step just like I did with the blockchain.