Task SA2.5: QA Implementation Review and Support

Task Description

• This task includes review activities of the QA, test and certification implementations done by the Product Teams, such as sample review of test plans and tests, compliance with packaging and porting guidelines, validation of documentation, etc.
• The task also includes supporting the Product Teams in effective design and implementation of tests to be used with testing tools such as ETICS.
• The success criterion for this task is the correct usage of tools and procedures by all project members to be measured by regular surveys and verifications.

Team:

Eamonn Kenny eamonn.kenny at cs.tcd.ie TCD

Fabio Capannini fabio.capannini at cnaf.infn.it INFN

Eva Cernakova cernakova.projekt@gmailSPAMNOTNOSPAMPLEASE.com UPJS

Meetings

Links to Indico entries...

Progress

Links to Savannah tasks...

Contacts

Email address of leader and contact persons...

Links

Any other material of interest for the task, documentation etc..

Reviews of EMI documents:

Document title	Link	Actions	Remarks
DSA1.3.2 Software Maintenance Quality Control Report	https://twiki.cern.ch/twiki/bin/view/EMI/DeliverableDSA132	1.February	The acceptance to be reviewer was sent by e-mail to A. Aimar. A proposal to specify Input and Output titles was sent to author
DJRA1.6.1 Integration Work Plan and Status Report	https://twiki.cern.ch/twiki/bin/view/EMI/DeliverableDJRA161	11. February	The second review was finished. Status-proposed to accept

Quality Control validation activity for EMI1:

https://twiki.cern.ch/twiki/pub/EMI/SA1CVEMI1/Quality_Control_Verification_EMI-1_Task_Assignment.ods

Template to submit report:

https://spreadsheets.google.com/viewform?formkey=dFFZckNHUE9sbnpwTEM0OE95TGFJTVE6MQ

Page to coordinate activity:

https://twiki.cern.ch/twiki/bin/view/EMI/SA1CVEMI1

Support of product teams:

Performance testing

Date 18. March 2011

As I reported during SA2 meeting I think that not all teams are ready to perform reliable performance tests. Despite this fact I started with preparation such so called performance tests for ARC CE and Client chain. I tried to find requirements which we have to approach or verify. I found that Technical developmemt plan does not contain such information. https://twiki.cern.ch/twiki/bin/view/EMI/DeliverableDNA131 It seems that in project we have not defined technical specification of some components (for example reliability of CE job submission process of successfully finished jobs) by right way which is easy understandable for potential users. Public availability of these parameters may provide very clear message about EMI middleware quality.

I tried to find this information on other places (home pages of joined sub-projects). I focused only on CE element this means ARC and gLite teams.

I was not able to find detailed technical specification of these performance parameters for ARC see for example:

http://www.knowarc.eu/documents/Knowarc_D1.1-1_07.pdf

http://www.knowarc.eu/documents/Knowarc_D5.4-1_09.pdf

I found very good specification for CREAM CE which is attached.

My proposal is to ask Technical director about official specification expected performance parameters of CE and clients and change Technical development plan to clarify expected performance parameters in beginning of second year of the project. Clear specification has side effect that we will be able to prepare useful performance tests.

P2 activities

activity	date	real date
Checking availability of Development plan and associated Area Work Plans, Test plans	July 2011
Availability of ETICS configurations for all platforms	July 2011
Verification and Validation	December 2011-April 2012
Documentation review	December 2011-April 2012
Support of PTs in proposal and realization of performance testing of ARC CE and clients	June August 2011

Reviews of updating documentations:

Update 7 15. September-22. September 2011

task in Savanah	date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?22523
https://savannah.cern.ch/task/?22464	12 September 2011, OK
https://savannah.cern.ch/task/?22331	12 September 2011, OK
https://savannah.cern.ch/task/?22249
https://savannah.cern.ch/task/?22248
https://savannah.cern.ch/task/?22135	n/a- cancelled
https://savannah.cern.ch/task/?21935	19. September 2011, 21. September OK
https://savannah.cern.ch/task/?21934	19. September 2011, OK
https://savannah.cern.ch/task/?21933	12 September 2011, OK
https://savannah.cern.ch/task/?21931	12 September 2011, OK
https://savannah.cern.ch/task/?21843
https://savannah.cern.ch/task/?21060
https://savannah.cern.ch/task/?21059
https://savannah.cern.ch/task/?20652	n/a- cancelled
https://savannah.cern.ch/task/?18710

Update 8

done

Update 9 25 October -3 November 2011

task in Savanah	date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?23047	1 November 2011, OK
https://savannah.cern.ch/task/?22523	1 November 2011, OK

Update 10 16 November -18 November 2011

task in Savanah	date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?23903	17 November 2011, OK

Update 11 5 December -15 December 2011

task in Savanah	date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?24178	new task created https://savannah.cern.ch/task/?24797, DONE update of release notes is needed
https://savannah.cern.ch/task/?24173	new task created https://savannah.cern.ch/task/?24799
https://savannah.cern.ch/task/?24381
https://savannah.cern.ch/task/?22847	14.12.2011: new task created https://savannah.cern.ch/task/index.php?24933
https://savannah.cern.ch/task/?24435

-- GianniPucciani - 02-Jun-2010

• _CE-proposal.doc: EGEE CE from 2007