Via SSH ofcourse 
You don't want or need a desktop to manage a server.
You can use a terminal to remote login (via SSH) and do the job.
If you really must have a desktop (which I advise against) you might use 'rdp' and if want to use an unsafe protocol like VNC, try to wrap that protocol in ssh.