SA3 Testing

org.glite.testsuites.ctb/Argus

Argus

Test Plan

Argus Test Plan

Available tests

org.glite.testsuites.ctb/Argus-pepj

How to test Argus for patch certification

Use the meta-scripts ARGUS-certconfig and ARGUS-certtest.sh to run local tests. Configure a WN with gLExec to issue authZ requests to Argus, and verify that users are correctly authorized/banned.

Argus PEP-j certifications

Since Argus PEP-j certification tests were not written at the same time, or by the same person that did the other Argus tests, they are separate from the Argus tests. The CVS includes a testing manual. The PEP-j tests follow the testplan of PEP-c, since the functionality is basically the same.

Certification Reports

EMI-1:

gLite 3.2:

Standard Patches:
Internal Patches:

BDII

Test Plan

Available tests

See GStat UserGuide

tests documentation

How to test BDII for patch certification

Execute job submission tests, and the DM tests

. To check the validity of the schema use the gstat-validate-schema script.

Test Reports

BLAH

Test Plan

BLAH test plan

Available tests

BLAH tests

tests documentation

How to test BLAH for patch certification

to certify blah stand alone use tests described here BLAH tests
to certify blah together with CREAM use the tests described here CREAM tests

Test Reports

CE (lcg-CE)

Test Plan

Available tests

link to tests repository

link to documentation

CE stress testing page: CEStressTesting

How to test CE for patch certification

Execute:

Job submission to the CE via the WMS, e.g. you can use the WN tests.
Direct job submission with globus-job-run.

Test Reports

CREAM CE

Test Plan

Available tests

CREAM CLI tests: org.glite.testsuites.ctb/CREAM/CREAM-cli

CREAM CLI test documentation

CREAM Service: org.glite.testsuites.ctb/CREAM/CREAM-service

CREAM test submission with multiple users: org.glite.testsuites.ctb/CREAM/CREAM-multiple-users/

CE stress testing page: CEStressTesting

Tests documentation

How to test CREAM for patch certification

No information yet.

Test Reports

dCache

Test Plan

Available tests

How to test dCache for patch certification

Run the DM tests specifying in the DM-certconfig file the LCG_UTILS and GFAL tests plus the SE to test (FIRSTSE and SECONDSE).
Run the S2 and SAME tests using the SRM scripts. The tests must succeed on the ctb machines provided by Desy.
Run the Desy test suite to test dCache srm clients (test_srmMkdir_passive test_srm_passive). The dcap clients cannot be tested at the moment.

Test Reports

Tesplan for delegation-java

Delegation

Test Plan

Available tests

None.

How to test delegation for patch certification

None.

Test Reports

Reports for the delegation tests

DPM

Test Plan

DPM Test Plan

Available tests

How to test DPM for patch certification

Run the DM tests specifying in the DM-certconfig file the LCG_UTILS and GFAL tests plus the SE to test (FIRSTSE and SECONDSE).
Run the S2 and SAME tests using the SRM scripts.
When configuring both the head node and a disk node, the head node has to be configured first, specifying in DPM_FILESYSTEMS the head and disk filesystems.

Test Reports

Certification Report For Patches 2967 and 2968

Certification Report, DPM 1.7.4 SL4, Patches #3940, #3967

Certification Report, DPM/LFC 1.7.4-7 SL4 32-bit, Patch #4188

Certification Report, DPM/LFC 1.7.4-7 SL4 64-bit, Patch #4189

Certification Report, DPM 1.7.4 SL5, Patch #3970

Certification Report, DPM/LFC 1.7.4-7 SL5, Patch #4190

Certification Report, DPM/LFC 1.8.0 SL5, Patches #4470, #4471, #4472, #4473

Certification Report, LFC 1.8.0 SL4, gLite 3.1, Patches #4518, #4519, #4520, #4521

Certification Report, DPM 1.8.0 SL4, gLite 3.1, Patches #4514, #4515, #4516, #4517

Certification Report, LFC 1.8.2 gLite 3.2, Patches #5003, #5004

Certification Report, DPM 1.8.2-3 gLite 3.2, Patches #5005, #5006

FTS/FTA/FTM

Test Plan

FTS test plan

Service Discovery Test Plan

Available tests

FTS tests

For documentation see the README file in the manual directory.

How to test FTS for patch certification

To configure FTS/FTA for certification we suggest to use yaimgen as described here.
The tests have to be done using the org.glite.voms-test VO (>15 char, DNS style VO)
Use the meta-script
```
FTS-certtest.sh
```
that will run FTS-basic, FTS-services, FTS-channels and FTS-submission (info here).
Regression tests: use the fts.txt testlist file to run available regression tests.

Test Reports

Testing glexec on the worker node using YAIM

GFAL

Test Plan

GFAL test plan

Available tests

GFAL tests

For documentation see the README file in the manual directory.

How to test GFAL for patch certification

The tests have to be done using the org.glite.voms-test VO (>15 char, DNS style VO)
Edit the file GFAL-certconfig and run the meta-script GFAL-certtest.sh
Run both basic and python API tests. Expect many failures in Python API tests (many of them are related to wrong exit codes), and look at the tests output to state whether the errors are expected (due to open bugs) or not.

Test Reports

CertReport3754, CertReport4161

GLEXEC

Test Plan

SCAS-glexec test plan

Available tests

A set of tests is available at: org.glite.testsuites.ctb/glexec

See the README file for documentation.

A stress test suite for testing the multi-user pilot job scenario is available here

How to test GLEXEC for patch certification

See the README file in CVS in order to run basic tests, regression tests and exit codes tests. A script to check the environment wrap/unwrap scripts is also available.

Test Reports

Test report on EMI Task 18708

GridSite

Test Plan

GridSite Test Plan

GridSite Software Verification and Validation Plan

Available tests

No information yet.

How to test GridSite for patch certification

http://jra1mw.cvs.cern.ch/cgi-bin/jra1mw.cgi/org.glite.testsuites.ctb/gridsite/tests/

Test Reports

Certification Report for Patch 3992, [ gridsite ] lsc capability + fix for mod_ssl update, 26 Jul 2010 [Certified]
Certification Report for Patch 4413, gridsite v. 1.1.21, SLC4, 32-bit [Certified]
Certification Report for Patch 4496, [Gridsite] v. 1.1.21, slc4, x86 [Certified]
Certification Report for Patch 4547, [Gridsite] v. 1.7.9-3, sl5, x86 [Certified]

Certification Report for EMI RC0, [Gridsite] v. 1.7.9-4, sl5, x86 [Certified]
Certification Report for EMI RC1, [Gridsite] v. 1.7.11-1, sl5, x86 [Certified]
Certification Report for EMI RC2, [Gridsite] v. 1.7.12-1, sl5, x86 [Certified]
Certification Report for EMI RC4, [Gridsite] v. 1.7.13-1, sl5, x86 [Certified]

Certification Report for Task 20915, [Gridsite] v. 1.7.15-2, sl5, x86 [Certified]
Certification Report for Task 26880, [Gridsite] v. 1.7.19-1, sl5, x86 [Certified]
Certification Report for Task 36602, [Gridsite] v. 1.7.23-1, sl5, x86 [Certified]
Certification Report for Task 38299, [Gridsite] v. 1.7.25-1emi1, sl5 [Certified]

Certification Report for EMI-2 RC3, [Gridsite] v. 1.7.17-1, multiplatform [Finished]
Certification Report for EMI-2 RC4, [Gridsite] v. 1.7.20-1, multiplatform [Finished]
Certification Report for EMI-2 Final RC, [Gridsite] v. 1.7.21-1, multiplatform [Certified]
Certification Report for EMI-2 update 2, [Gridsite] v. 1.7.22-1, multiplatform [Certified]
Certification Report for Task 36603, [Gridsite] v. 1.7.24-1, multiplatform [Certified]
Certification Report for Task 38300, [Gridsite] v. 1.7.25-1emi2, multiplatform [Certified]

Certification Report for EMI-3 RC1, [Gridsite] v. 2.0.0-1, multiplatform [Finished]
Certification Report for EMI-3 Final RC, [Gridsite] v. 2.0.4-1, multiplatform [Finished]
Certification Report for EMI-3 Update 1, [Gridsite] v. 2.0.4-2, multiplatform [Certified]

HYDRA

Test Plan

Hydra Test Plan

Available tests

org.glite.testsuites.ctb/hydra

Tests are documented in the README file in CVS.

How to test HYDRA for patch certification

These instructions apply for testing both server and client. You can't test the server without the client tools and vice versa. You need to have access to a LFC, SE, BDII and VOMS server from the server/client, so the EGEE certification testbed is recommended.

First install the client and server versions to be tested. Here are instructions. For testing purposes you can use one machine for both. Hydra server instances are usually run on N (N>=3) servers, but for testing purposes you can install three instances on one server. Add the hydra parts (link above) to the testbed site-info and configure the server. For the client, install glite-UI or glite-WN and configure that. Hydra server can publish its information to the bdii, but if the site bdii isn't configured for it, you need to use file based service discovery for the client (link above). After that you need a client certificate to test with, and after voms-proxy-init you are ready to go. Some tests can make use of two proxy certificates. In that case they also check if the permissions are enforced correctly. If you have a second proxy certificate (recommended), you can configure it in config.sh

The parameters the tests use can be configured in the config.sh file, it is documented. After that you can start running the tests. The tests output report on the progress, and return 0 on success and 1 on error (with a more specific output). Since some tests depend on features tested in other tests, the recommended execution order is:

On the server:
hydra-server-test.sh

On the client:
ssss-test.sh
keyregister-test.sh
crypt-test.sh
acl-test.sh
chmod-test.sh
putgetrm-test.sh

Test Reports

LB Software Verification and Validation Plan

LB

Test Plan

LB Test Plan

Available tests

org.glite.testsuites.ctb/LB

External Test Documentation: LBTP.pdf

How to test LB for patch certification

https://twiki.cern.ch/twiki/bin/view/EGEE/HowToCertifyAPatch

https://twiki.cern.ch/twiki/bin/view/EMI/EmiSa2CertTestGuidelines

Test Reports

glite-LB_R_2_0_4_1 Test Result, 25 May 2009 [Deprecated]
Certification Report for Patch 3022, LB 2.0/SL5/64, 29 Jan 2010 [Certified], rejected before rollout
Certification Report for Patch 3641, LB Harvester 1.0/SL5/64, 22 Jan 2010 [Certified]
Certification Report for Patch 3075, LB 1.9.4/SLC4/32, 29 Jan 2010 [Certified]
Certification Report for Patch 3795, LB 2.0/SL5/64, 22 Feb 2010 [Certified]
Certification Report for Patch 4006, LB 2.0.9/SL5/64, 7 May 2010 [Certified]
Certification Report for Patch 4083, LB 2.0.12/SL5/64, 17 May 2010 [Certified]
Certification Report for Patch 3596, LB 2.1/SL5/64, 5 Aug 2010 [Certified]
Certification Report for Patch 3882, LB 1.10/SLC4/32, 27 Aug 2010 [Certified]
Certification Report for Patch 4423, LB 2.1.16, SL5, X86_64, 25 Oct 2010 [Certified]
Certification Report for Patch 4566, LB 2.1.17, SL5, X86_64 [Certified]
Certification Report for Patch 4610, LB 2.1.18, SL5, X86_64 [Certified]
Certification Report for Patch 4623, LB 2.1.21, SL5, X86_64 [Certified]

Test Report for LB 3 RC1, LB 3.0.4, SL5, X86_64 [Certified]
Test Report for LB 3 RC2, LB 3.0.5, SL5, X86_64 [Certified]
Test Report for LB 3 RC4, LB 3.0.10, SL5, X86_64 [Certified]

Certification Report for Patch 4873, LB 3.0.12, SL5, X86_64 [Certified]
Certification Report for Task 23047, LB 3.1.0, SL5, X86_64 [Certified]
Certification Report for Task 36601, LB 3.2.9, SL5, multiarch [Certified]

Test Report for LB EMI2 RC4, LB 3.2.4, multiplatform, X86_64 [Finished]
Test Report for LB EMI2 Final RC, LB 3.2.6, multiplatform, X86_64 [Certified]

Test Report for LB EMI2 update 2, LB 3.2.7, multiplatform, X86_64 [Certified]
Test Report for LB EMI2 update 3, LB 3.2.9, multiplatform, X86_64 [Certified]
Test Report for LB EMI2 update 11, LB 3.2.10, multiplatform, X86_64 [Certified]

Test Report for LB EMI3 RC1, LB 4.0.1, multiplatform, X86_64 [Finished]
Test Report for LB EMI3 RC2, LB 4.0.2, multiplatform, X86_64 [Finished]
Test Report for LB EMI3 Final RC, LB 4.0.4, multiplatform, X86_64 [Finished]

Test Report for LB EMI3 update 1, LB 4.0.5, multiplatform, X86_64 [Certified]

LCAS/LCMAPS

LCG_UTILS

Test Plan

LCG_UTILS tests documentation

Available tests

LCG_UTILS tests

How to test LCG_UTILS for patch certification

Edit the file DM-certconfig specifying to run LCG_UTILS and SAME tests, then run the script DM-certtest.sh.

Test Reports

Certification Report for Patch#4038: R3.2/SL4/x86_64: LFC v1.7.4

LFC

Test Plan

LFC test plan

Available tests

LFC tests

Tests documentation not available

How to test LFC for patch certification

Edit the file LFC-certconfig and run the script LFC-certtest.sh.

Since many lcg_utils commands use the LFC, also the lcg_utils tests must be done. See the SA3Testing#LCG_UTILS section.

Test Reports

Certification Report for Patch#4037: R3.1/SL4/i386: LFC v1.7.4

Certification Report for Patch#4035: R3.2/SL5/x86_64: LFC v1.7.4

Certification Report for Patches 2969 (R1.7.2/SL4/32) and 2970 (R1.7.2/SL4/64)

Certification Report for Patch 3020 (R1.7.2/SL5/64)

Certification Report for Patch 3970 (R3.2/SL5/x86_64: DPM/LFC v1.7.4)

MyProxy

Test Plan

MyProxy test plan

Available tests

MyProxy tests

Tests documentation: README

How to test MyProxy for patch certification

Edit myproxy-certconfig and run myproxy-certtest.sh. Results are stored in the tests directory (*_result.txt files).

Test Reports

Certification Report for Patch 4435, glite-PX 3.2.0-1, SL5, X86_64 Unofficial
Certification Report for Patch 4435 with MyProxy 5.4, glite-PX 3.2.0, SL5, X86_64 [In progress]

PX Software Verification and Validation Plan

Proxy Renewal

Test Plan

No information yet.

Available tests

No information yet.

How to test Proxy Renewal for patch certification

No information yet.

Test Reports

Certification Report for Patch 3753, Proxy renewal for glite 3.2/SL5/64, 26 Apr 2010 [Certified]
Certification Report for Patch 4828, Proxy renewal 1.3.21 for glite 3.1, 21 Apr 2011 [Certified]

PX

org.glite.px is a new subsystem created for joint releases of gLite specific packages for MyProxy and ProxyRenewal.

Test Plan

Available tests

MyProxy tests

How to test PX for patch certification

https://twiki.cern.ch/twiki/bin/view/EGEE/HowToCertifyAPatch

https://twiki.cern.ch/twiki/bin/view/EMI/EmiSa2CertTestGuidelines

Test Reports

Certification Report for Patch 3753, Proxy renewal for glite 3.2/SL5/64, 26 Apr 2010 [Certified]
Certification Report for Patch 4435, glite-PX 3.2.0-1, SL5, X86_64 Unofficial
Certification Report for Patch 4435 with MyProxy 5.4, glite-PX 3.2.0, SL5, X86_64 [In progress]

PX Certification Report for EMI RC1, [PX] v. 1.0.5-1, sl5, x86 [Finished]
PX Certification Report for EMI RC2, [PX] v. 1.0.7-1, sl5, x86 [Finished]
PX Certification Report for EMI RC4, [PX] v. 1.0.9-1, sl5, x86 [Finished]

PX Certification Report for task 20914, [PX] v. 1.0.11-1, sl5, x86 [Certified]
PX Certification Report for task 27541, [PX] v. 1.0.15-1emi1, sl5, x86 [Certified]
PX Certification Report for task 27541 take 2 [PX] v. 1.0.15-2emi1, sl5, x86 [Certified]
PX Certification Report for task 27541 take 3 [PX] v. 1.0.15-3emi1, sl5, x86 [Certified]

PX Certification Report for EMI2 RC4, [PX] v. 1.0.15-1, multiplatform [Finished]
PX Certification Report for EMI2 Final RC, [PX] v. 1.0.16-1, multiplatform [Certified]

PX Certification Report for EMI3 RC1, [PX] v. 1.0.18-1, multiplatform [Finished]
PX Certification Report for EMI3 Final RC, [PX] v. 1.0.21-1, multiplatform [Finished]
PX Certification Report for EMI3 Update 1, [PX] v. 1.0.22-1, multiplatform [Finished]

R-GMA

Test Plan

R-GMA test plan

Available tests

How to test R-GMA for patch certification

RGMA test procedure

Test Reports

RGMA test reports

SCAS

Test Plan

SCAS test plan

Available tests

A stress test suite is available here

and it is explained in the README file.

Scripts to test the error codes are available here.

How to test SCAS for patch certification

Executes the glexec identity switch test with SCAS described in the SCAS test plan.

Executes the scripts for testing the error codes available in CVS.

When the patch involves significant updates or performance related issues, the stress test suite should be used.

Test Reports

For what concerns stress tests, the collected results are available at: SCAS stress tests results SCAS Test reports

SD

Test Plan

Service Discovery test plan

Available tests

SD tests

How to test SD for patch certification

SD (SAGA)

Test Plan

Service Discovery test plan

Available tests

http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.saga-adapter.sd-cpp/test

http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.saga-adapter.sd-java/test

http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.saga-adapter.isn-cpp/test

http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.saga-adapter.isn-java/test

How to test SAGA SD for patch certification

Service Discovery test procedure

Test Reports

Service Discovery test reports

UI

Test Plan

UI test plan

Available tests

UI tests

No documentation available.

How to test UI for patch certification

To test the UI for patch certification you need to run a bunch of different testsuites. The general UI tests only test a part of the components available on the UI. For the rest, component specific tests need to be run.

To run the tests, you could run them in this order

The basic UI tests They can be run with UI-certconfig/UI-certtest.sh)
The AMGA tests (only the parts relevant to the client)
The CREAM client tests
The dCache tests (The client part, the tests are incomplete)
The DPM tests (The client part, the tests are incomplete)
The FTS tests
The GFAL tests
The GridSite tests
The Hydra tests
The LB tests
The VOMS tests - The client part
The WMS tests - API (Python) and CLI
Regression tests - Run regression tests using glite-UI.txt test list.

Test Reports

Test reports for trustmanager

Trustmanager

Test Plan

Test plan

Available tests

Tests are in the cvs

How to test Trustmanager for patch certification

Testing guidelines

Test Reports

VOBOX

Test Plan

Available tests

VOBOX tests

For documentation look at the README file in CVS.

How to test VOBOX for patch certification

Use the script lcg_vobox_test.sh.

Test Reports

VOMS

Test Plan

VOMS Test Plan

Available tests

VOMS tests

For documentation look at the README file in CVS.

How to test VOMS for patch certification

Use the myCheck-VOMS script.

Test Reports

Certification Report for Patch 2771

Certification Report for Patch 2913

Certification report for patches 3340, 3341, 3226, 2828

Certification report for patch 4583

Test report for task #18587: VOMS release v.2.0.0

How to test WMS for patch certification

No information available yet.

WMS

Test Plan

WMS test plan

Available tests

WMS tests

No documentation available.

How to test WMS for patch certification

No information available yet.

Test Reports

WN

Test Plan

Available tests

WN tests

This available script creates a tarball WNtests.tgz and a jdl file WNtest.jdl. Submitting this jdl sends WNtests.tgz to some WN and executes the tests contained therein. The output of the job contains the test results. WNtests.tgz contains the following UI tests: UI--data-lcg-*, UI-data-lfc-*, UI-inf-lcg-*. To use this script you also have to check out the UI tests.

How to test WN for patch certification

Execute the WN test.
Execute the broker-info-test script.
Call VOMS CLI on the WN.
Regression tests - Run regression tests using glite-WN.txt test list.

Test Reports

YAIM

Test Plan

Available tests

No specific tests available.

How to test YAIM for patch certification

How to certify YAIM

Test Reports