I agree this is a usability bug. Definitely one to report unless it's already been addressed by the developers somewhere.
The alternate is to right click the file and select Open parent location.
MATE 1.14 (which includes Caja) hasn't been tested for 16.04 yet, keep an eye here: