Clean installation

At a first instance deployment tests are executed starting from a clean environment and using unicore deployment test scripts. For the tsi component the tsi deployment testcase has been created. Tsi is installed, setup is done and errors are checked into log files.

Here the full test report version:

• full: full tsi output

Here the short version:

--- [INFO] Deployment test: ./testcases.d/tsi
--- [INFO] Started at: Tue Mar 29 14:59:37 CEST 2011
--- [INFO] Platform: Scientific Linux CERN SLC release 5.6 (Boron) x86_64
--- [INFO] Uninstalling the package unicore-tsi and cleaning all its files
unicore-tsi-6.4.0-rc2.noarch
Loaded plugins: changelog, kernel-module, protectbase, security, tsflags,
              : versionlock
Repository EMI-1-RC2 is listed more than once in the configuration
Setting up Remove Process
Resolving Dependencies
--> Running transaction check
---> Package unicore-tsi.noarch 0:6.4.0-rc2 set to be erased
--> Finished Dependency Resolution
Beginning Kernel Module Plugin
Finished Kernel Module Plugin

Dependencies Resolved

================================================================================
 Package             Arch           Version             Repository         Size
================================================================================
Removing:
 unicore-tsi         noarch         6.4.0-rc2           installed         1.2 M

Transaction Summary
================================================================================
Remove        1 Package(s)
Reinstall     0 Package(s)
Downgrade     0 Package(s)

Is this ok [y/N]: Downloading Packages:
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Erasing        : unicore-tsi                                              1/1 

Removed:
  unicore-tsi.noarch 0:6.4.0-rc2                                                

Complete!
--- [INFO] Setting up the repository
--- [INFO] 
--- [INFO] YUM_REPOSITORY=https://twiki.cern.ch/twiki/pub/EMI/EMI-1/rc2.repo
--- [INFO] 
--- [INFO] Fetching yum Repository definition
--2011-03-29 14:59:40--  https://twiki.cern.ch/twiki/pub/EMI/EMI-1/rc2.repo
Resolving twiki.cern.ch... 137.138.6.73
Connecting to twiki.cern.ch|137.138.6.73|:443... connected.
WARNING: cannot verify twiki.cern.ch's certificate, issued by `/C=US/O=VeriSign, Inc./OU=VeriSign Trust Network/OU=Terms of use at https://www.verisign.com/rpa (c)10/CN=VeriSign Class 3 Secure Server CA - G3':
  Unable to locally verify the issuer's authority.
HTTP request sent, awaiting response... 200 OK
Length: 144 [application/octet-stream]
Saving to: `/etc/yum.repos.d/unicore-tsi.repo'

     0K                                                       100% 4.47M=0s

2011-03-29 14:59:40 (4.47 MB/s) - `/etc/yum.repos.d/unicore-tsi.repo' saved [144/144]

--- [INFO] Installing from binary package
--- [INFO]   Component: tsi
--- [INFO]   Package:   unicore-tsi
--- [INFO] 
Loaded plugins: changelog, kernel-module, protectbase, security, tsflags,
              : versionlock
Repository EMI-1-RC2 is listed more than once in the configuration
0 packages excluded due to repository protections
Reading version lock configuration
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package unicore-tsi.noarch 0:6.4.0-rc2 set to be updated
--> Finished Dependency Resolution
Beginning Kernel Module Plugin
Finished Kernel Module Plugin

Dependencies Resolved

================================================================================
 Package             Arch           Version             Repository         Size
================================================================================
Installing:
 unicore-tsi         noarch         6.4.0-rc2           EMI-1-RC2         641 k

Transaction Summary
================================================================================
Install       1 Package(s)
Upgrade       0 Package(s)

Total download size: 641 k
Downloading Packages:
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : unicore-tsi                                              1/1 

Installed:
  unicore-tsi.noarch 0:6.4.0-rc2                                                

Complete!
unicore-tsi-6.4.0-rc2.noarch
./testcases.d/tsi: line 11: prepare_configuration: command not found

Available TSI implementations are:

1: tsi/aix_ll
2: tsi/ccs
3: tsi/linux_condor
4: tsi/linux_lsf
5: tsi/linux_slurm
6: tsi/linux_torque
7: tsi/NOBATCH
8: tsi/sun_gridengine
9: tsi_contrib/aix_lsf
10: tsi_contrib/crayxt_torque
11: tsi_contrib/hitachi
12: tsi_contrib/hpux_pbs
13: tsi_contrib/irix_nqs
14: tsi_contrib/linux_pbs
15: tsi_contrib/sgi_lsf
16: tsi_contrib/superux
17: tsi_contrib/unicos
18: tsi_contrib/vpp

The installation will copy all required files into a new directory.
Files common to all TSI implementations are copied from tsi/bin,
tsi/conf and tsi/SHARED.
The TSI without a batch sub-system requires also files from tsi/NOBATCH.
Each TSI with a batch sub-system needs the files from tsi/<specific_system>.

Select a TSI to install (enter number)
Copy common files (bin,conf) first:
Copy bin/find_pids to /usr/share/unicore/tsi_selected/bin/find_pids
Copy bin/find_tsi to /usr/share/unicore/tsi_selected/bin/find_tsi
Copy bin/kill_tsi to /usr/share/unicore/tsi_selected/bin/kill_tsi
Copy bin/list_log_files to /usr/share/unicore/tsi_selected/bin/list_log_files
Copy bin/start_tsi to /usr/share/unicore/tsi_selected/bin/start_tsi
Copy conf/path2njs to /usr/share/unicore/tsi_selected/conf/path2njs
Copy conf/tsi.properties to /usr/share/unicore/tsi_selected/conf/tsi.properties
Copy shared files (common to all installations):
Copy tsi/SHARED/BecomeUser.pm to /usr/share/unicore/tsi_selected/perl/BecomeUser.pm
Copy tsi/SHARED/Dump2File.pm to /usr/share/unicore/tsi_selected/perl/Dump2File.pm
Copy tsi/SHARED/EndProcessing.pm to /usr/share/unicore/tsi_selected/perl/EndProcessing.pm
Copy tsi/SHARED/ExecuteScript.pm to /usr/share/unicore/tsi_selected/perl/ExecuteScript.pm
Copy tsi/SHARED/GetFileChunk.pm to /usr/share/unicore/tsi_selected/perl/GetFileChunk.pm
Copy tsi/SHARED/Initialisation.pm to /usr/share/unicore/tsi_selected/perl/Initialisation.pm
Copy tsi/SHARED/JobControl.pm to /usr/share/unicore/tsi_selected/perl/JobControl.pm
Copy tsi/SHARED/MainLoop.pm to /usr/share/unicore/tsi_selected/perl/MainLoop.pm
Copy tsi/SHARED/PutFiles.pm to /usr/share/unicore/tsi_selected/perl/PutFiles.pm
Copy tsi/SHARED/Reporting.pm to /usr/share/unicore/tsi_selected/perl/Reporting.pm
Copy tsi/SHARED/ResourceReservation.pm to /usr/share/unicore/tsi_selected/perl/ResourceReservation.pm
Copy tsi/SHARED/SharedConfiguration.pm to /usr/share/unicore/tsi_selected/perl/SharedConfiguration.pm
Copy tsi/SHARED/tsi_df to /usr/share/unicore/tsi_selected/perl/tsi_df
Copy tsi/SHARED/tsi_ls to /usr/share/unicore/tsi_selected/perl/tsi_ls

Copy (overwrite) specific files:
Copy tsi/NOBATCH/GetStatusListing.pm to /usr/share/unicore/tsi_selected/perl/GetStatusListing.pm
Copy tsi/NOBATCH/JobControl.pm to /usr/share/unicore/tsi_selected/perl/JobControl.pm
Copy tsi/NOBATCH/MainLoop.pm to /usr/share/unicore/tsi_selected/perl/MainLoop.pm
Copy tsi/NOBATCH/NoBatchOnly.pm to /usr/share/unicore/tsi_selected/perl/NoBatchOnly.pm
Copy tsi/NOBATCH/Submit.pm to /usr/share/unicore/tsi_selected/perl/Submit.pm
Copy tsi/NOBATCH/tsi to /usr/share/unicore/tsi_selected/perl/tsi
Copy tsi/NOBATCH/tsi.HPUX to /usr/share/unicore/tsi_selected/perl/tsi.HPUX
Copy tsi/NOBATCH/tsi.IRIX to /usr/share/unicore/tsi_selected/perl/tsi.IRIX
Copy tsi/NOBATCH/tsi.LINUX to /usr/share/unicore/tsi_selected/perl/tsi.LINUX
Copy tsi/NOBATCH/tsi.MACOSX to /usr/share/unicore/tsi_selected/perl/tsi.MACOSX
Copy tsi/NOBATCH/tsi.SOLARIS to /usr/share/unicore/tsi_selected/perl/tsi.SOLARIS

##########################################################
NOTE: for NON-LINUX systems, copy the correct variation of
  /usr/share/unicore/tsi_selected/perl/tsi.*
to /usr/share/unicore/tsi_selected/tsi
Finish installation by editing /usr/share/unicore/tsi_selected/perl/tsi.
and /usr/share/unicore/tsi_selected/conf/tsi.properties.
Execute "Install_permissions.sh /usr/share/unicore/tsi_selected" after update.
Finally start the TSI as described in the README file
##########################################################

NB: When porting to new platform all specific files have to be adapted!


Restricting permissions of directory /usr/share/unicore/tsi_selected to read only
for the owner but executable for world (needed for tsi_ls).

Restricting permissions of scripts in directory /usr/share/unicore/tsi_selected/bin 
to be executable for the owner

Making tsi_ls and tsi_df world readable again.

Showing permissions: "ls -al /usr/share/unicore/tsi_selected"
total 24
dr-x--x--x 6 root root 4096 Mar 29 14:24 .
drwxr-xr-x 9 root root 4096 Mar 29 14:59 ..
dr-x--x--x 2 root root 4096 Mar 29 14:24 bin
dr-x--x--x 2 root root 4096 Mar 29 14:24 conf
dr-x--x--x 2 root root 4096 Mar 29 14:24 logs
dr-x--x--x 2 root root 4096 Mar 29 14:24 perl

######################################################################
Check that all parent directories of /usr/share/unicore/tsi_selected are world executable.
Otherwise the tsi_ls script cannot be executed.
######################################################################

Starting UNICORE TSI: 
Evaluating /usr/share/unicore/tsi_selected/conf/tsi.properties:
Found TSI /usr/share/unicore/tsi_selected

Logging to /var/log/unicore/tsi/TSILog_2011_03_29_14_59
nohup perl /usr/share/unicore/tsi_selected/perl/tsi /usr/share/unicore/tsi_selected/conf/tsi.properties > /var/log/unicore/tsi/TSILog_2011_03_29_14_59 2>&1 &
  PID  PPID     USER    RUSER    GROUP   RGROUP COMMAND
13933 13920 root     root     root     root     perl /usr/share/unicore/tsi_selected/perl/tsi /usr/share/unicore/tsi_selected/conf/tsi.properties
Found pids 13933
                                                           [  OK  ]
--- [INFO] Checking if log file TSI of tsi contains any problematic phrases
--- [INFO] No problems in the log file were found.
--- [INFO] Outcome: PASSED

-- MicheleCarpene - 21-Feb-2011