WLCG Operations Coordination Minutes, May 2, 2024

Highlights

Agenda

https://indico.cern.ch/event/1411424/

Attendance

• local:
• remote:
• apologies:

Operations News

Special topics

HammerCloud status and plans

htgettoken + HashiCorp Vault as a Service for Managing Grid Tokens

Middleware News

• Useful Links
  • WLCGBaselineTable
• Baselines/News
  • While the UMD-5 for EL9 is not ready yet, the BDII auxiliary rpms
    have been made available from the WLCG repository
    • For EL9 and EL8
    • The BDII itself is available from EPEL

• EL9 vs. SHA-1
  • the situation is summarized here
  • further discussion in this fetch-crl ticket
    • the problem is with OpenSSL instead
  • DigiCert are not going to update their root CA (presumably OK in browsers)
    • might be removed from IGTF if nothing important depends on it
      • today there are 84 WLCG users with such certificates
        • 74 in ATLAS
    • also is the issuer of 2 TERENA CAs
      • today there are 418 WLCG users with such certificates
        • 178 in ATLAS
        • 149 in CMS
    • LHC experiment users could switch to CERN Grid CA certificates
    • but there could also be many services with affected certificates
  • to be followed up further
    • hopefully we can at least push our classic CAs faster toward SHA-2

Tier 0 News

Tier 1 Feedback

Tier 2 Feedback

Experiments Reports

ALICE

• normal to high activity on average in the last weeks
• an XRootD server I/O performance problem was badly affecting analysis trains at KIT
  • thanks very much to the KIT experts for resolving that with urgency!

ATLAS

CMS

• overall smooth data taking and computing operations
  • core usage between 310k and 580k cores
  • due to HPC/opportunistic contributions
  • almost all production activities now Run 3
  • back to a more usual production/analysis split of about 3:1
  • various monitoring outages the last weeks.
• work on SRM to REST migration for tape endpoints continues
  • four done / four remaining
• phasing out SRMv2/GSIftp/gridFTP at sites
  • 20 done / 20 remaining
• three remaining DPM sites to migrate
• token migration progressing steadily
• waiting on python3 version/port of HammerCloud
• we will ask sites to remove x86-64-v1 microarchitecture worker nodes with the end of SL7, i.e. June 30, for CMS (five sites, less than 100 Worker nodes)

LHCb

Task Forces and Working Groups

Accounting TF

Migration from DPM to the alternative solutions

Information System Evolution TF

IPv6 Validation and Deployment TF

Detailed status here.

Monitoring

Network Throughput WG

WG for Transition to Tokens and Globus Retirement

• timeline for the transition from VOMS-Admin to IAM services for VO management
  • the legacy VOMS servers are being removed from the
    vomses configuration files used to create VOMS proxies
    • on QA hosts at CERN since today
    • on production hosts at CERN planned for Tuesday May 7
    • wlcg-voms rpms will be updated accordingly
  • only the VOMS endpoints of the IAM services on OpenShift will be used
    • they have been used in production since 2 years by ATLAS and CMS,
      since ~2 months by ALICE and LHCb
    • all corresponding LSC files are in production since 2 years
  • switches from VOMS-Admin to IAM are planned for this month
    • per experiment, when it gives the green light
  • ultimate deadline: end of June!

Action list

Specific actions for experiments

Specific actions for sites

AOB