There are plenty of ways gain a remote desktop access to a Linux running board but how secure are those protocol is a question. In addition to that have a port open and exposed just for the purpose of remote access while ssh does the similar thing is redundant. Then I found the X2Go project. X2Go is an open source remote desktop software for Linux that uses the NX technology protocol. X2Go gives remote access to both Linux and Windows Desktops. The X2go clients available for Linux, Windows and Mac. It uses ssh connection to encrypt the connection and hence does not need a seperate port to be opened.
The X2Go client is available part of the ubuntu repository and can be installed as follows.
sudo apt-get install x2goclient
I am trying to get the X2Go server running on Orange pi running an Armbian image. If you want to know how to install Armbian in Orange Pi Zero then refer here. Firstly I installed the LXDE to get a proper desktop
apt-get install lxde
Since the X2go server was not available part of the Orange Pi Armbian repository it needs to be added
sudo add-apt-repository ppa:x2go/stable sudo apt-get update
Then installed X2go server like this
sudo apt-get install x2goserver x2goserver-xsession
Now rest is all about configruing and connecting to the Pi.