You might want to double check caja-rename is enabled, as it's an extra (optional) piece of functionality.
Edit → Preferences → Extensions tab
I just noticed there's two "Rename" options in the context menu... one is provided by the extension:
2 Likes