cluster:Interactive/3

From Dgiref

Introduction

The developer/user/administrator interaction can be done by using the specially configured Node. This node, named interactive, use the identical hardware/software configuration as the Worker Nodes.

The current D-Grid reference installation is combined together the login server with the interactive node on one server.

The Login Server provides an site-wide Single Sign-On (SSO) mechanism that enables access for the D-Grid users into the D-Grid site.
Interactive nodes provide an entry point to the system for users to be able to manage their workload and is NOT an User Interface for Job submission.

That allow the connection and access from the User Interface into the D-Grid reference installation site and to work with the grid applications and also to compile and test jobs using local libraries.

Package:    GSI-OpenSSH 4.3 / OpenSSH 4.7p1
os:             Scientific Linux version 5.6 64 bit
server:        dgiref-login.fzk.de
manuals: login server / Worker Node
monitoring: monitoring page

Archive links

interactive node for 2009.2

Information links

Download links

Please open a NGI-DE ticket if you experience any Installation or Configuration problem.

Login server

Prepare

Operating system: Scientific Linux version 5.6 64 bit

Optimizing the configuration: 

Use minimal operating system installation without firewall.
To verify installed packages use the command 
rpm -qa | grep package_name
Install the following additional packages:
yum -y install wget yum rpm make gcc gcc-c++ tar sed zlib openssl
After the installation is complete, turn off any unnecessary services (like gpm, sendmail, cups, haldaemon, messagebus, pcmcia, anacron, atd) with the following command: 
chkconfig <SERVICE> off

Configure the following settings for the server:

Additional software

java SDK >=1.6.0 (java-1_6_0-sun or java-1_6_0-ibm)
Perl version >= 5.8.8 (with XML::PARSER)
UMD repo
Host certificate
Worker node packages

administrator's script: prepare.sh

```
 
```
```
# install umd
```
```
#clean old
```

rm /etc/yum.repos.d/UMD* /etc/yum.repos.d/epel*

wget http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm

wget http://repository.egi.eu/sw/production/umd/1/sl5/x86_64/updates/umd-release-1.0.2-1.el5.noarch.rpm

rm -f epel-release-5-4.noarch.rpm umd-release-1.0.2-1.el5.noarch.rpm

```
yum install epel-release-5-4.noarch.rpm
```
```
yum install yum-priorities
```

yum install umd-release-1.0.2-1.el5.noarch.rpm

sed -i -e "s/priority=.*/priority=5/g" /etc/yum.repos.d/UMD-1-base.repo

sed -i -e "s/priority=.*/priority=4/g" /etc/yum.repos.d/UMD-1-updates.repo

```
 
```
```
mkdir -p /etc/grid-security/
```
```
#
```

Install

Install server component gsi-openssh.x86_64 and client component ige-meta-globus-gsissh with yum from UMD repo

administrator's script: install.sh

```
 
```
```
#!/bin/bash
```
```
# install interactive node
```
```
yum -y install gsi-openssh.x86_64
```
```
yum -y install ige-meta-globus-gsissh
```

Configure

Please check the grid certificates allocation before to proceed.

Change port in gsisshd config file /etc/ssh/sshd_config
Disable UsePAM

WARNING:  Grid-mapfile:
The grid-mapfile located in the directory /etc/grid-security/ is necessary for the successful launch of the Globus container. 
If you have none of it, an empty file with the name grid-mapfile should be created.

To configure gsissh do the following:

administrator's script: configure.sh

```
 
```
```
#!/bin/bash
```
```
# configure interactive node
```
```
# To configure the gsisshd:
```
```
su root
```

sed -i "s/Port 22/Port 2222/g" /etc/ssh/sshd_config

sed -i "s/UsePAM/\#UsePAM/g" /etc/ssh/sshd_config

```
 
```
```
# Setting up GSI-SSH service
```

# In order to work with the GSI-SSH Service, the following line must be inserted as 'root' into the /etc/services:

```
#gsissh             2222/tcp 
```
```
 
```

# 2.1. In /etc/hosts the IP address of the server must be mapped to the FQDN as follows:

```
# <IP ADDRESS>    <FQDN>    <hostname>
```
```
 
```

# Insert as 'root' the following entries in the file /etc/hosts.allow:

echo "gsisshd:ALL:ALLOW" >> /etc/hosts.allow

Proceed

Start gsisshd

administrator's script: proceed.sh

```
 
```
```
#!/bin/bash
```

/etc/rc.d/init.d/gsisshd {start|stop|restart|reload|condrestart|status}

Initial test

Connect to server with gsissh client software
Grid user initialization
Try to connect with gsissh to interactive node with 2222 port

administrator's script: test.sh

```
 
```
```
#!/bin/bash
```
```
# initial test for interactive node
```

# Log on into a grid client (eg. with ssh)

```
ssh griduser@gridclient
```
```
# logged in griduser@gridclient
```
```
 
```
```
# GSI Authentication
```
```
grid-proxy-init 
```
```
 
```

# Your identity: /C=DE/O=GermanGrid/OU=FZK/CN=Grid User

# Enter GRID pass phrase for this identity:

# Creating proxy ...................................................... Done

# Your proxy is valid until: Fri Aug 15 23:27:06 2008

```
 
```
```
# GSI-SSH Access to login node
```
```
 
```
```
gsissh -p 2222 dgiref-login.fzk.de
```
```
 
```

#********************************************************

```
#
```

# Welcome to the D-Grid-Referenzinstallation:

```
#
```
```
# -  Interactive node Installation:
```
```
#
```
```
#  *  GSI-SSH (Globus 4.0.7 64 bit)
```
```
#  *  gLite WN_TAR 
```

#**********************************************************

```
 
```
```
# dgdt0001@dgiref-login.fzk.de:~>
```

Please open a NGI-DE ticket if you experience any Installation or Configuration problem.

Worker node

Prepare

Operating system: Scientific Linux version 5.6 64 bit

Optimizing the configuration: 

Use minimal operating system installation without firewall.
To verify installed packages use the command 
rpm -qa | grep package_name
Install the following additional packages:
yum -y install wget yum rpm make gcc gcc-c++ tar sed zlib openssl
After the installation is complete, turn off any unnecessary services (like gpm, sendmail, cups, haldaemon, messagebus, pcmcia, anacron, atd) with the following command: 
chkconfig <SERVICE> off

Configure the following settings for the server:

Firewall configuration

Allowing incoming connections directed to the WNs is optional and Resource Providers can freely decide whether to permit them on a voluntary base. However, when such inbound connections are blocked, data transfers using GridFTP will be forced to work in "single-stream" mode and their performance might be accordingly degraded (how to open port in firewall).

Service	Incoming ports (TCP)	Change to default configuration
GridFTP	20000-25000	Yes

WN should have an access to external network

administrator's script: prepare.sh

```
 
```
```
#!/bin/bash
```
```
# install umd
```
```
#clean old
```
```
sudo - su
```

rm /etc/yum.repos.d/UMD* /etc/yum.repos.d/epel*

wget http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm

wget http://repository.egi.eu/sw/production/umd/1/sl5/x86_64/updates/umd-release-1.0.2-1.el5.noarch.rpm

rm -f epel-release-5-4.noarch.rpm umd-release-1.0.2-1.el5.noarch.rpm

```
yum install epel-release-5-4.noarch.rpm
```
```
yum install yum-priorities
```

yum install umd-release-1.0.2-1.el5.noarch.rpm

sed -i -e "s/priority=.*/priority=5/g" /etc/yum.repos.d/UMD-1-base.repo

sed -i -e "s/priority=.*/priority=4/g" /etc/yum.repos.d/UMD-1-updates.repo

```
 
```
```
# Missing packages installation  
```
```
yum -y install gcc gcc-c++ openssl
```
```
#<- end routine
```

Install

There are some types of packages to install into the Cluster Node that it will provide the Worker Node functionality

glite-WN packages to operate with Grid middleware

administrator's script: install.sh

```
 
```
```
#!/bin/bash
```
```
# install worker node packages
```
```
# install glite-WN-3.2
```

yum -y install glite-yaim-torque-utils.noarch yaim-voms.x86_64 glite-yaim-clients.noarch glite-yaim-core.noarch glite-yaim-mpi.noarch glite-yaim-torque-client.noarch lcgutil-yaim.noarch lfc-yaim.noarch yaim-glexec-wn.noarch

Configure

Mount File system
Configure users
Prepare WNs for gLite
- The packages for the gLite middleware and OGSA-DAI will be provided by NFS server.
- The middleware configuration for all Worker nodes is unique to any WN.
- This require the corresponding WN performs the write rights for the configuration scripts to the directory /opt/glite-MW.
- This directory mounts with appropriate write rights.
- Rights configuration can be changed later, after general configuration.
- The specific configuration can be implemented using the prepared templates on the: http://www.d-grid.de/index.php?id=132
- The info.def, groups.conf and users.conf files are required for the WN configuration.

Note: The site-info.def have the JAVA_LOCATION which should be configured!

WARNING: 
The dgrid_env.sh script should be edited and the variables VOS, INSTALL_ROOT and DGRID_VO_DIRECTORY adjusted. The script ensures that only the D-Grid VOs users used the middleware environment variables.

The dgrid_env.sh is calling another script - grid_env.sh

Optional adjustment: In order to accelerate the WN configuration, the Certificates and CRLs configurations can be denied (they will be executed on the gLite-CE). This require removing the following functions from the $GLITE_DIR/glite/yaim/scripts/node-info.def:
- install_certs_userland
- config_fix_edg-fetch-crl-cron
- config_crl

by using the function TAR_WN_FUNCTIONS.

The following error message is NOT important: [ERROR] Failed to add group

administrator's script: configure.sh

```
 
```

Update

administrator's script: update.sh

```
 
```

cluster:Interactive/3

Contents

Introduction

Login server

Prepare

Install

Configure

Proceed

Initial test

Worker node

Prepare

Install

Configure

Update

Views

Personal tools

general

guidelines

reference installation

Search

internal

Toolbox