Skip to content
cuchac edited this page Nov 4, 2010 · 17 revisions

Welcome to the GCFS Wiki!

Installation

You needs the following prerequisites:

Linux

Cmake and FUSE are part of distribution packages. You need also development versions of these packages.

SAGA is mainly available in form of source code, there are no official packages. For Gento users I've created rough Saga ebuilds. If you have to compile manually, download saga-core and saga-adaptor-condor package, then run ./configure;make;make install on both packages. Don't forget to tweak Saga adaptor for Condor.

Packages for Condor is bit hard to find. You can use precompiled official packages of Condor (sort of registration required).

Gentoo users can use "science" overlay. There is fetch restriction, so you have to manually download source package to /usr/portage/distfiles and run

 layman -a science
 emerge -vat sys-cluster/condor

MAC OS X

You should install package manager for MAC OS X, for example Homebrew. FUSE, Cmake and Saga are supported by Homebrew. After installing Homebrew and Xcode, just run

 brew install fuse
 brew install cmake
 brew install saga

Please make sure you are installing Saga version 1.5.2 or newer, otherwise run brew update to get new version.

Than you have to download saga-adaptor-condor from Saga download page and install it using "Holy Unix Trinity". Don't forget to tweak Saga adaptor for Condor.

 ./configure
 make
 make install

If your compilation fail because of one missing header, download and extract the missing header from Saga-core source package.

For Condor you can use official precompiled packages. After extracting tar.gzip archive, run ./condor_install --prefix=/usr/local to install Condor. Then you have to modify Condor global and local configuration files. You can start Condor by running condor_master.

Configuring

Default config file is automatically created during first execution in ~/.config/gcfs (this will change to standard config file lookup chain ~/.config and then /etc with no automatic creation. This is only for easier testing).

Following is example configuration for GCFS with Condor running under non-root account and you want allow other users to access GCFS.

[Global]
## Path where temporary files will be stored
dataPath = /tmp/gcfs

#### Services definitions ####
[Condor]
## Driver defines the backend to use
driver = saga
## Url of running Condor
url = condor://localhost

dataPath folder has to be writable for user running gcfs. Don't forget to tweak Saga adaptor for Condor.

Running

The only required parameter is directory where to mount GCFS.

Access for other users

If you want to allow also other users to submit jobs using GCFS, you have to specify -o allow_other FUSE option. However to set this option you have to either be root or it has to be allowed (disabled by default) in /etc/fuse.conf file.

Grant access of grid software to your data files

By default GCFS temporary folder is in ~/.local/gcfs. If your grid software is running under different user it has not access to this folder. Therefore you have to move data folder into place accessible by grid software - for example /tmp/gcfs/.

Used Grids

Using SAGA backend we can support all the grids SAGA has adaptor for. Following grids were tested and should be working.

Condor

Status: Working

Web: http://www.cs.wisc.edu/condor/

Note: The Saga backend needs some configuration tweaks.