UNICORE EMI ES

SERVICE STATUS

Referring to

• Specification https://twiki.cern.ch/twiki/pub/EMI/EmiExecutionService/EMI-ES-Specification_v1.03.odt

We're approximately at the 80% of the first base implementation. The first EMI UNICORE ES prototype has been released in the EMI 2 Major release as part of UNICOREX.

Tasks

• Resource Info services implementation (Shiraz)

• ActivityInfo
  • XNJS status to EMI-ES status mapping (Shahbaz)
  • Filters (Date, owner, ...) (Bernd)

• CreateActivity
  • More complete parsing/support of activity description (Bernd)

• ActivityManagement
  • abort and others (Michele)

• Data staging
  • Tests using GridFTP (Michele)

• Client APIs review (Björn)
  • nice way of dealing with delegation, data push etc

• UCC module (who?)
  • require at least submit, get-status, resource-info (like in the BES module)
  • no client data push/pull since we don't want to call gridftp from UCC?
  • only XML job format supported (no .u)?

• Packaging and releasing
  • individually or as part of UNICORE/X ?

• Prepare Padova AHM

• Start to prepare new Etics configurations for EMI2 release (Michele, Fabrizio, Bernd)

• Finalize GLUE Schema part and ActivityInfo service (Bjorn/Shiraz)

DEADLINES

• 11 April 2011: First commit of Delegation Services (ok)
• 25 Jun 2011: First Activity Management Service implementation (ok)
• 29 Oct 2011: First code released for Activity and Resource Info part, new tests on code refactored, Delegation Service testing with new methods (Shahbaz/Shiraz/Michele) (ok)
• 18 Jan 2012: Code Freeze for EMI2 release (ok)
• 30 April 2012: EMI2 official release: Matterhorn

Summary (past history):

• 15/11/2010 First phone meeting UNICORE team to plan next steps
• 20/12/2010 EMI ES Specification f.v. released
• 14/02/2011 Second phone meeting UNICORE team
• ... New svn project created
• ... Interface code committed with xml schema on svn
• 23/02/2011 Started working to Delegation Service implementation
• 11/04/2011 Delegation Service code implementation terminated and committed
• ... Implemented test suite to test emi es code
• 17/05/2011 Sent abstract for UNICORE Summit 2011 in Torun
• 01/06/2011 New phone meeting, new tasks and deadlines planned
• ... Activity Management service implementation started
• 27/06/2011 Activity management service implementation ended and test suite created
• 28/06/2011 Finished to write full paper for the UNICORE Summit
• 7/07/2011 Partecipation to the UNICORE Summit
• 19/07/2011 EMI UNICORE phone conference
• ...Other bugfixes and changes in the code
• ...Started to implement also the Client part, new directories added on svn
• in August: started to implement the Info part
• 07/09/2011 EMI code in the UNICORE SVN has been reorganized, some contribution added
• ...Refactored code in emi project: emi-es -> emi-es-core, emi-es-client, emi-es-types
• 26/09/2011 UNICORE Summit paper corrected after revision and sent to Mathilde Romberg for pubblication
• 29/09/2011 New phone meeting: checkpoint, new deadlines, Resource and Activity Info part, new people involved, new tasks allocation proposed
• 17/10/2011 EMI 3rd AHM in Padova, attended Compute Session, showed results and state of activities
• ...Some clean up in the code, comments added
• 24/10/2011 Created XNJSToESActivityStateMapper to convert XNJS ActionState to the EMI-ES activity state modeI (Shahbaz)
• ...Added XNJSNegotiator and TestActivityManagementService (Michele)
• 11/11/2011 Sent EMI-ES "mandatory parts" document to Balazs (Bernd)
• ...Worked on EMI-ES Client (Bjorn)
• Created abstract for EGI Community Forum about EMI ES activities (Shahbaz)
• 14/12/2011 Code freeze for EMI2 release
• 18/01/2012 Reached the 80% of the EMI ES base implementation
• ...Updated the development tracker task (Bernd)
• 01/02/2012 Changes in unicorex and uas-client (Bjorn)
• ...Globus GridFTP installation on the Juelich testbed (Michele, Bjorn)
• 21/02/2012 Started to modify and prepare new unicorex Etics configurations for EMI2 release (Michele, Fabrizio, Bernd, ...)
• 29/02/2012 New code freeze for EMI2 release
• ...Bug Fixes
• ...Created proper tag for UNICORE EMI ES
• 20/04/2012 Created task configuration on Savannah for the EMI2 release (release candidate RC4)
• 03/05/2012 UNICORE EMI JRA1 phone meeting
• 07/05/2012 EMI All Hands in Hamburg
• 15/05/2012 Release of UNICORE EMI ES inside EMI2 Major Release

-- MicheleCarpene - 28-Jun-2011