Accessing Files

From Molecular Modeling Wiki

Revision as of 13:28, 23 January 2014

Problem

Data in the cluster home directories usually need some processing after they are produced. Frequently, some visualization of data (inputs, results) is required and programs like molden, VMD', and others are often run on the cluster servers to display images on the user's workstation through the X-Window system. Howvere, this method has disadvantages - it is slow, as a huge amount of graphical data is transferred through the network (especially when the object consisting of many atoms moves and rotates), and it sometimes does not waork at all (mostly because of incompatible versions of OpenGL libraries on the cluster server and user's workstation). There is a better solution, though.

Idea

If the mountain won't come to Muhammad then Muhammad must go to the mountain. Or translated to our case: If you cannot run the graphical program on the remote server to let it work with the local data, make the data local on your workstation and run the program there. In other words - install visualization programs on your workstation where they will be fast and configured exactly for your system and make the data appear as if it is local too. For this, you do not need to copy data from server to your workstation - it is enough just to embed your remote home directory to your local file system. Read on for instructions.

Sshfs

One of the systems which allow to mount the remote directory to local filesystem is called sshfs. On Ubuntu, you can follow these instructions (see also this howto):

• First, add yourself to the fuse group

sudo gpasswd -a $USER fuse

This has to be done only once. Once you have added yourself to the fuse group, you should log out and log back in again for the change to take effect.

• For every filesystem you want to mount or connect, do

cd ~
mkdir -p mnt/_SERVERNAME_
sshfs -o idmap=user _USERNAME_@_SERVERNAME_:/home/_USERNAME_ ~/mnt/_SERVERNAME_

replacing _SERVERNAME_ with the name of remote server (cluster) and _USERNAME_ with you login name on this server (cluster) for example

cd ~
mkdir -p mnt/zinc
sshfs -o idmap=user novak@zinc:/home/novak ~/mnt/zinc

To unmount (disconnect) the remote directory from your local filesystem call

fusermount -u ~/mnt/_SERVERNAME_

Once the remote directory is mounted, you can use it as if it was local, so, for example, you can call your local installation of VMD and open a remote file in it browsing to ~/mnt/zinc/...

Notes

This method can also be used to mount cluster $HOME directory to your home computer. For this, however, opening the firewall with knock is neede before calling sshfs.