I don’t think the Connect to Server option in Caja where you choose FTP (with login) actually uses FTP/SSL. So probably not, at least not by just using Caja.
You can however, use the package curlftpfs to mount an ftp host as a local directory
http://curlftpfs.sourceforge.net/
Create the mount point i.e. folder /mnt/host first, of course…
um@um:~$ curlftpfs -o ssl,utf8 ftp://yourserver.net /mnt/host
Then it would show up in Caja as a mounted location under “Network”. And you could always set it to mount automatically at startup as the curlftpfs link explains above.