Lightweight desktop environment for ubuntu server

This was my first thought also.

@torbuk from a terminal you can run apt-cache showpkg ubuntu-mate-core to see what ubuntu-mate-core consist of. My virtual ubuntu-mini reports it would add 1223 new files, download 691 MB of archives, and 2,445 MB of space taken after install. Although as @Bill_MI stated, Firefox is the only heavy hitter in the list of dependencies.