I have the same problem to try to boot with arm64 or even armhf version with Pi4
but I have make the ubuntu server re-packed image for everyone to download
try to view my topic
(I have only make the armhf for it as RealVNC Server only support the armhf version, so if you need more support you can try to repacket the ubuntu-server for pi4 and make it better.)