Making a Unix server graphic based

Usually GUI is not pre-installed in Server edition of Ubuntu. You have to install it manually. This can be done by downloading a desktop package from the command line, or any other ways?