[Hampshire] Ubuntu LTS server problems

OK not so much problems but more of how do I do it

I have just installed Ubuntu 10.04 LTS Server onto a new server, it boots to
CLI, I then sudo"user" startx to get a gui interface (yes I know gui and server
are not everybody cup of tea but for me it is).

But as the server won't be next to me I need to access it remotely, now if the
server is up and running (and X is running) I can run TightVNC and access the
server. But if the server goes down (reboot or powercut, I can get somebody to
push the button on the front on the server to start it for me), I can then ssh
into the server and login as me, but if I try to startX from ssh it won't I
think it is trying to run X just to the ssh client I have open and not start X
globally on the server. How can I start X globally on the server from an ssh
session?

Tim