gLExec Deployment Tracking

Conclusion !

• a new plan for gLExec has been proposed in Ian Bird's presentation on the
  "Follow-up to the WLCG Workshop in Lisbon" during the MB meeting of Feb 16, 2016
• page 4 says:
  "Freeze deployment of glexec - keep it supported for the existing use,
  but no point to expend further effort in deployment"
• efforts should rather be spent to increase the use of common technologies
  • cgroups, namespaces, containers
  • 'big data' tools for managing traceability data

Introduction

In its meeting on May 14, 2013, the WLCG Management Board decided that the deployment of gLExec shall be ramped up for all WLCG sites, as summarized in the minutes. In the meeting on June 18, 2013, a deployment plan was presented and agreed after some discussion, as summarized in the minutes.

The deployment needs to happen already now, even when some of the experiments are not yet ready to let their multi-user pilot jobs make use of gLExec. Deployment issues can thus be debugged in parallel and should not interfere with current workflows. Each site will have its gLExec infrastructure regularly tested through SAM. The Management Board proposed such tests to become critical for the site availability computations in a number of months. The tentative deadline was Oct 1, 2013, while the actual deadline will likely be coupled to the timeline for the WN migration to SL6.

Further documentation is available here.

Task tracking

Notes on the following tables

For every site the cell for each officially supported LHC experiment should have links to:

• the SAM-3 summary of gLExec test results for the experiment
  • the previously used MyWLCG service has been retired on Jan 26, 2015
• the latest Nagios test results for all CEs of the type used by the site
  • for now there is no shortcut directly to the CE(s) of the site
  • to access those pages one needs a certificate from an IGTF CA loaded in the browser

An unsupported experiment just has a dash in its cell.

For the Ops VO there is a link to the MyEGI summary.

The background color  cyan  is used to indicate that tests for the given VO were successful on the given date, which implies the following conditions:

1. the site's gLExec infrastructure was working;
2. the VO actually sent a (successful) test via its SAM-Nagios framework.

As with any service, subsequent tests may fail for a variety of reasons: the site needs to try keeping the gLExec infrastructure in good shape. To facilitate early detection of failures, EGI sites are advised to support gLExec testing by the Ops VO as well.

The following topic macros have been defined to facilitate manipulating the table:

    %alice_arc{name}%      - links for ALICE ARC   sites
    %alice_cream{name}%    - links for ALICE CREAM sites

    %atlas_arc{name}%      - links for ATLAS ARC   sites
    %atlas_cream{name}%    - links for ATLAS CREAM sites
    %atlas_osg{name}%      - links for ATLAS OSG   sites

    %cms_arc{name}%        - links for CMS   ARC   sites
    %cms_cream{name}%      - links for CMS   CREAM sites
    %cms_osg{name}%        - links for CMS   OSG   sites

    %lhcb_arc{name}%       - links for LHCb  ARC   sites
    %lhcb_cream{name}%     - links for LHCb  CREAM sites

    %ops{id}%              - links for Ops   EGI   sites

The name is the site's experiment-specific name. The id is the site's numeric ID in the MyEGI DB.

For each macro there also is a version with Done attached to the name (e.g. opsDone) which will make the cell's background color  cyan .

NOTE: when the line for a site is updated (e.g. it now passes the tests for some VO), its date should be adjusted correspondingly.

CERN and Tier-1 sites

Site	Alice	Atlas	CMS	LHCb	Ops	Date	Comments
ASGC	-	atlas  N	-	-	egi	2013-06-30
BNL	-	atlas  N	-	-	-	2013-07-30
CERN	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-07-03
FNAL	-	-	cms  N	-	-	2013-06-30
IN2P3-CC	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-07-10
INFN-T1	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-06-30
JINR-T1	-	-	cms  N	-	egi	2013-07-02
KISTI	alice  N	-	-	-	egi	2013-07-10
KIT	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-07-30
NDGF-T1	?	?	-	-	-	2013-06-30	n/a ?
NIKHEF	alice  N	atlas  N	-	lhcb  N	egi	2013-06-30
PIC	-	atlas  N	cms  N	lhcb  N	egi	2013-06-30
RAL	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-06-30
RRC-KI-T1	alice  N	atlas  N	-	lhcb  N	egi	2013-06-30	GGUS:95225
SARA	alice  N	atlas  N	-	lhcb  N	egi	2013-07-15
TRIUMF	-	atlas  N	-	-	egi	2013-06-30

Tier-2 sites

EGI

Site	Alice	Atlas	CMS	LHCb	Ops	Date	Comments
Australia
Australia-ATLAS	-	atlas  N	-	-	egi	2014-06-02	Ops tested manually
Austria
HEPHY-UIBK	-	atlas  N	-	-	egi	2013-07-26
Hephy-Vienna	-	-	cms  N	-	egi	2013-06-30
Belgium
BEgrid-ULB-VUB	-	-	cms  N	-	egi	2013-06-30
BelGrid-UCL	-	-	cms  N	-	egi	2013-07-03
Canada
CA-MCGILL-CLUMEQ-T2	-	atlas  N	-	-	egi	2014-05-29
CA-SCINET-T2	-	atlas  N	-	-	egi	2014-05-19
CA-VICTORIA-WESTGRID-T2	-	atlas  N	-	-	egi	2014-05-13	log-only mode
SFU-LCG2	-	atlas  N	-	-	egi	2013-12-17
China
BEIJING-LCG2	-	atlas  N	cms  N	-	egi	2013-07-26
Czech Republic
praguelcg2	alice  N	atlas  N	-	-	egi	2013-11-21
Estonia
T2_Estonia	-	-	cms  N	-	-	2013-07-02
Finland
FI_HIP_T2	-	-	cms  N	-	-	2013-07-09
France
GRIF	alice  N alice  N	atlas  N atlas  N atlas  N	cms  N cms  N	lhcb  N lhcb  N lhcb  N	egi	2013-07-17
IN2P3-CC-T2	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-07-10
IN2P3-CPPM	-	atlas  N	-	lhcb  N	egi	2013-06-30
IN2P3-IRES	alice  N	-	cms  N	-	egi	2013-06-30
IN2P3-LAPP	-	atlas  N	-	lhcb  N	egi	2013-06-30
IN2P3-LPC	alice  N	atlas  N	-	lhcb  N	egi	2013-08-26
IN2P3-LPSC	alice  N	atlas  N	-	-	egi	2013-07-29
IN2P3-SUBATECH	alice  N	-	-	-	egi	2013-08-13
Germany
DESY-HH	-	atlas  N	cms  N	-	egi	2013-07-04	log-only mode
DESY-ZN	-	atlas  N	-	lhcb  N	egi	2013-09-05
GoeGrid	-	atlas  N	-	-	egi	2013-06-30	GGUS:95243
GSI-LCG2	?	-	-	-	-	2013-06-30
LRZ-LMU	-	?	-	-	-	2013-10-07	ARC
MPPMU	-	atlas  N	-	-	egi	2013-09-24
RWTH-Aachen	-	-	cms  N	-	egi	2013-08-13
UNI-FREIBURG	-	atlas  N	-	-	egi	2013-06-30	GGUS:95248
Wuppertal	-	?	-	-	-	2013-09-30	ARC
Greece
GR-07-UOI-HEPLAB	-	-	cms  N	-	egi	2013-07-03
Hungary
BUDAPEST	alice  N	-	cms  N	-	egi	2013-06-30
India
IN-DAE-VECC-02	alice  N	-	-	-	egi	2013-06-30	GGUS:95251
INDIACMS-TIFR	-	-	cms  N	-	egi	2013-08-27
Israel
IL-TAU-HEP	-	atlas  N	-	-	egi	2013-12-26
TECHNION-HEP	-	atlas  N	-	-	egi	2013-12-26
WEIZMANN-LCG2	-	atlas  N	-	-	egi	2013-07-31
Italy
INFN-BARI	alice  N	-	cms  N	-	egi	2013-11-23	log-only mode
INFN-CATANIA	alice  N	-	-	-	egi	2014-04-08
INFN-CNAF-LHCB	-	-	-	lhcb  N	egi	2013-06-30
INFN-FRASCATI	-	atlas  N	-	-	egi	2014-02-19
INFN-LNL-2	alice  N	-	cms  N	-	egi	2013-06-30
INFN-MILANO-ATLASC	-	atlas  N	-	-	egi	2013-12-09
INFN-NAPOLI-ATLAS	-	atlas  N	-	-	egi	2013-12-18
INFN-PISA	-	-	cms  N	lhcb  N	egi	2014-02-18
INFN-ROMA1	-	atlas  N	-	-	egi	2013-07-22
INFN-ROMA1-CMS	-	-	cms  N	-	egi	2013-06-30
INFN-TORINO	alice  N	-	-	-	egi	2013-06-30	GGUS:95263
Japan
TOKYO-LCG2	-	atlas  N	-	-	egi	2013-06-30	GGUS:95264
Norway
NO-NORGRID-T2	-	?	-	-	-	2013-06-30	n/a ?
Pakistan
NCP-LCG2	-	-	cms  N	-	egi	2013-09-10
Poland
CYFRONET-LCG2	alice  N	atlas  N	-	lhcb  N	egi	2015-05-26
ICM	-	-	cms  N	lhcb  N	egi	2013-10-30
PSNC	alice  N	atlas  N	-	lhcb  N	egi	2013-09-05
Portugal
LIP-Coimbra	-	atlas  N	-	-	egi	2013-06-30
LIP-Lisbon	-	T3	-	-	egi	2013-07-03
NCG-INGRID-PT	-	atlas  N	cms  N	-	egi	2013-07-05
Republic of Korea
KR-KISTI-GCRT-01	alice  N	-	-	-	egi	2013-07-11
LCG_KNU	-	-	cms  N	-	egi	2013-07-12
Romania
NIHAM	?	-	-	-	-	2013-06-30
RO-02-NIPNE	-	atlas  N	-	-	egi	2014-05-20
RO-07-NIPNE	alice  N	atlas  N	-	lhcb  N	egi	2014-03-03
RO-11-NIPNE	-	-	-	lhcb  N	egi	2014-03-05
RO-13-ISS	alice  N	-	-	-	egi	2013-11-26
RO-14-ITIM	-	atlas  N	-	-	egi	2013-11-14
RO-16-UAIC	-	atlas  N	-	-	egi	2013-11-11
Russian Federation
ITEP	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-07-17
JINR-LCG2	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-08-31
RRC-KI	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-06-30	GGUS:95225
ru-Moscow-FIAN-LCG2	-	atlas  N	cms  N	-	egi	2013-11-13
ru-Moscow-SINP-LCG2	-	atlas  N	cms  N	lhcb  N	egi	2013-12-15
ru-PNPI	alice  N	atlas  N	cms  N	lhcb  N	egi	2014-02-03
RU-Protvino-IHEP	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-12-11
RU-SPbSU	alice  N	-	-	lhcb  N	egi	2013-07-25
Ru-Troitsk-INR-LCG2	alice  N	-	cms  N	lhcb  N	egi	2013-12-21
Slovak Republic
FMPhI-UNIBA	alice  N	atlas  N	-	-	egi	2013-06-30
IEPSAS-Kosice	alice  N	atlas  N	-	-	egi	2013-07-23
Slovenia
SiGNET	-	?	-	-	-	2013-06-30	n/a ?
Spain
CIEMAT-LCG2	-	-	cms  N	-	egi	2013-06-30
ifae	-	atlas  N	-	-	egi	2013-07-02
IFCA-LCG2	-	-	cms  N	-	egi	2013-06-30
IFIC-LCG2	-	atlas  N	-	-	egi	2013-10-31
UAM-LCG2	-	atlas  N	-	-	egi	2013-07-11
UB-LCG2	-	-	-	lhcb  N	egi	2013-09-10
USC-LCG2	-	-	-	lhcb  N	egi	2013-07-01
Sweden
SE-SNIC-T2	?	?	-	-	-	2013-06-30	n/a ?
Switzerland
CSCS-LCG2	-	atlas  N	cms  N	lhcb  N	egi	2013-07-01
UNIBE-LHEP	-	?	-	-	-	2013-06-30	n/a ?
Taipei
TW-FTT	-	atlas  N	-	-	egi	2013-06-30
Turkey
TR-03-METU	-	-	cms  N	-	egi	2013-07-04
TR-10-ULAKBIM	-	atlas  N	-	-	egi	2013-07-25
UK
EFDA-JET	-	-	-	lhcb  N	egi	2014-01-17
UKI-LT2-Brunel	-	atlas  N	cms  N	lhcb  N	egi	2013-06-30
UKI-LT2-IC-HEP	-	atlas  N	cms  N	lhcb  N	egi	2013-06-30
UKI-LT2-QMUL	-	atlas  N	cms  N	lhcb  N	egi	2013-11-14
UKI-LT2-RHUL	-	atlas  N	cms  N	lhcb  N	egi	2013-11-05
UKI-LT2-UCL-HEP	-	atlas  N	-	-	egi	2013-06-30	GGUS:95298
UKI-NORTHGRID-LANCS-HEP	-	atlas  N	-	lhcb  N	egi	2013-06-30	GGUS:95299
UKI-NORTHGRID-LIV-HEP	-	atlas  N	-	lhcb  N	egi	2013-06-30
UKI-NORTHGRID-MAN-HEP	-	atlas  N	-	lhcb  N	egi	2013-10-04
UKI-NORTHGRID-SHEF-HEP	-	atlas  N	-	lhcb  N	egi	2014-01-27
UKI-SCOTGRID-DURHAM	-	-	-	lhcb  N	egi	2014-01-29
UKI-SCOTGRID-ECDF	-	atlas  N	-	lhcb  N	egi	2013-06-30	GGUS:95303
UKI-SCOTGRID-GLASGOW	-	atlas  N	cms  N	lhcb  N	egi	2013-06-30
UKI-SOUTHGRID-BHAM-HEP	alice  N	atlas  N	-	lhcb  N	egi	2013-10-11
UKI-SOUTHGRID-BRIS-HEP	-	-	cms  N	lhcb  N	egi	2013-11-22
UKI-SOUTHGRID-CAM-HEP	-	atlas  N	-	lhcb  N	egi	2013-11-04
UKI-SOUTHGRID-OX-HEP	alice  N	atlas  N	cms  N	lhcb  N	egi	2013-07-04
UKI-SOUTHGRID-RALPP	-	atlas  N	cms  N	lhcb  N	egi	2013-07-05
UKI-SOUTHGRID-SUSX	-	atlas  N	-	-	egi	2013-08-14
Ukraine
Kharkov-KIPT-LCG2	-	-	cms  N	-	egi	2013-06-30
UA-BITP	alice  N	-	-	-	egi	2013-08-14
UA-ISMA	alice  N	-	-	-	egi	2014-02-08
UA-KNU	alice  N	?	-	-	egi	2013-12-03

OSG

Site	Alice	Atlas	CMS	LHCb	Ops	Date	Comments
USALICE
LC-glcc	?	-	-	-	-	2013-06-30
NERSC-PDSF	?	-	-	-	-	2013-06-30
USATLAS
AGLT2	-	atlas  N	-	-	-	2013-06-30
BU_ATLAS_Tier2	-	atlas  N	-	-	-	2013-06-30
HU_ATLAS_Tier2	-	?	-	-	-	2013-06-30
MWT2	-	atlas  N	-	-	-	2013-06-30
MWT2_UC	-	atlas  N	-	-	-	2013-06-30
OU_OCHEP_SWT2	-	atlas  N	-	-	-	2013-06-30
SWT2_CPB	-	atlas  N	-	-	-	2013-06-30
UTA_SWT2	-	atlas  N	-	-	-	2013-06-30
WT2	-	atlas  N	-	-	-	2013-06-30
USCMS
Caltech	-	-	cms  N	-	-	2013-06-30
Florida	-	-	cms  N	-	-	2013-06-30
MIT	-	-	cms  N	-	-	2013-06-30
Nebraska	-	-	cms  N	-	-	2013-06-30
Purdue	-	-	cms  N	-	-	2013-06-30
UCSD	-	-	cms  N	-	-	2013-06-30
Vanderbilt	-	-	cms  N	-	-	2013-06-30
Wisconsin	-	-	cms  N	-	-	2013-06-30
Brazil
GridUNESP_CENTRAL	-	-	?	-	-	2013-06-30
SPRACE	-	-	cms  N	-	-	2013-06-30