I notice this as well, although I remember this issue with pretty much every file manager... I haven't used anything other than Caja in a few years, so I don't know if it has been fixed elsewhere, but the USB Drive/ SD Card writing is bad...
On the other hand, Ubuntu-Mate does a great job telling you that the card is still being written to if you tell it to eject the card while it's "writing in the background".