GaudiMP::GMPBase::GMPComponent Class Reference

Inheritance diagram for GaudiMP::GMPBase::GMPComponent:

List of all members.

Public Member Functions
def	__init__
def	Start
def	Engine
def	processConfiguration
def	SetupGaudiPython
def	StartGaudiPython
def	LoadTES
def	getEventNumber
def	IdentifyWriters
def	dumpHistograms
def	Initialize
def	Finalize
def	Report
Public Attributes
	nodeType
	finalEvent
	lastEvent
	log
	nodeID
	currentEvent
	evcom
	evcoms
	hq
	fq
	nIn
	nOut
	stat
	iTime
	rTime
	fTime
	firstEvTime
	tTime
	proc
	a
	evt
	hvt
	fsr
	inc
	pers
	ts
	TS

---

Detailed Description

Definition at line 389 of file GMPBase.py.

---

Constructor & Destructor Documentation

def GaudiMP::GMPBase::GMPComponent::__init__	(		self,
			nodeType,
			nodeID,
			queues,
			events,
			params
	)

Definition at line 396 of file GMPBase.py.

                                                                    :
        # declare a Gaudi MultiProcessing Node
        # the nodeType is going to be one of Reader, Worker, Writer
        # qPair is going to be a tuple of ( qin, qout )
        # for sending and receiving
        # if nodeType is "Writer", it will be a list of qPairs,
        # as there's one queue-in from each Worker
        #
        # params is a tuple of (nWorkers, config, log)

        self.nodeType = nodeType
        current_process().name = nodeType

        # Synchronisation Event() objects for keeping track of the system
        self.initEvent, eventLoopSyncer, self.finalEvent = events
        self.eventLoopSyncer, self.lastEvent = eventLoopSyncer   # unpack tuple

        # necessary for knowledge of the system
        self.nWorkers, self.sEvent, self.config, self.log = params
        self.nodeID   = nodeID

        # describe the state of the node by the current Event Number
        self.currentEvent = None

        # Unpack the Queues : (events, histos, filerecords)
        qPair, histq, fq = queues

        # Set up the Queue Mechanisms ( Event Communicators )
        if self.nodeType == 'Reader' or self.nodeType == 'Worker' :
            # Reader or Worker Node
            qin, qout = qPair
            self.evcom = EventCommunicator( self, qin, qout )
        else :
            # Writer : many queues in, no queue out
            assert self.nodeType == 'Writer'
            self.evcoms = []
            qsin = qPair[0]
            for q in qsin :
                ec = EventCommunicator( self, q, None )
                self.evcoms.append( ec )
        # Histogram Queue
        self.hq = histq
        # FileRecords Queue
        self.fq = fq

        # Universal Counters (available to all nodes)
        # Use sensibly!!!
        self.nIn  = 0
        self.nOut = 0

        # Status Flag (possibly remove later)
        self.stat = SUCCESS

        # Set logger name
        self.log.name = '%s-%i'%(self.nodeType, self.nodeID)

        # Heuristic variables
        # time for init, run, final, firstEventTime, totalTime
        self.iTime       = 0.0
        self.rTime       = 0.0
        self.fTime       = 0.0
        self.firstEvTime = 0.0
        self.tTime       = 0.0

        # define the separate process
        self.proc = Process( target=self.Engine )

---

Member Function Documentation

def GaudiMP::GMPBase::GMPComponent::dumpHistograms

(

self )

Method used by the GaudiPython algorithm CollectHistos
to obtain a dictionary of form { path : object }
representing the Histogram Store

Definition at line 562 of file GMPBase.py.

                               :
        '''
        Method used by the GaudiPython algorithm CollectHistos
        to obtain a dictionary of form { path : object }
        representing the Histogram Store
        '''
        nlist = self.hvt.getHistoNames( )
        histDict = {}
        objects = 0 ; histos = 0
        if nlist :
            for n in nlist :
                o = self.hvt[ n ]
                if type(o) in aidatypes :
                    o = aida2root(o)
                    histos  += 1
                else :
                    objects += 1
                histDict[ n ] = o
        else :
            print 'WARNING : no histograms to recover?'
        return histDict

def GaudiMP::GMPBase::GMPComponent::Engine

(

self )

Reimplemented in GaudiMP::GMPBase::Reader, GaudiMP::GMPBase::Worker, and GaudiMP::GMPBase::Writer.

Definition at line 467 of file GMPBase.py.

                       :
        # This will be the method carried out by the Node
        # Different for all
        pass

def GaudiMP::GMPBase::GMPComponent::Finalize

(

self )

Definition at line 593 of file GMPBase.py.

                         :
        start = time.time()
        self.a.stop()
        self.a.finalize()
        self.log.info( '%s-%i Finalized'%(self.nodeType, self.nodeID) )
        self.finalEvent.set()
        self.fTime = time.time() - start

def GaudiMP::GMPBase::GMPComponent::getEventNumber

(

self )

Definition at line 506 of file GMPBase.py.

                               :
        # Using getList or getHistoNames can result in the EventSelector
        # re-initialising connection to RootDBase, which costs a lot of
        # time... try to build a set of Header paths??

        # First Attempt : Unpacked Event Data
        lst = [ '/Event/Gen/Header',
                '/Event/Rec/Header' ]
        for l in lst :
            path = l
            try :
                n = self.evt[path].evtNumber()
                return n
            except :
                # No evt number at this path
                continue

        # second attepmt : try DAQ/RawEvent data
        # The Evt Number is in bank type 16, bank 0, data pt 4
        try :
            n = self.evt['/Event/DAQ/RawEvent'].banks(16)[0].data()[4]
            return n
        except :
            pass

        # Default Action
        if self.nIn > 0 or self.nOut > 0 :
            pass
        else :
            self.log.warning('Could not determine Event Number')
        return -1

def GaudiMP::GMPBase::GMPComponent::IdentifyWriters

(

self )

Definition at line 538 of file GMPBase.py.

                                :
        #
        # Identify Writers in the Configuration
        #
        d = {}
        keys = [ "events", "records", "tuples", "histos" ]
        for k in keys :
            d[k] = []

        # Identify Writers and Classify
        wkeys = WRITERTYPES.keys()
        for v in self.config.values() :
            if v.__class__.__name__ in wkeys :
                writerType = WRITERTYPES[ v.__class__.__name__ ]
                d[writerType].append( MiniWriter(v, writerType, self.config) )
                if self.nodeID == 0 :
                    self.log.info('Writer Found : %s'%(v.name()))

        # Now Check for the Histogram Service
        if 'HistogramPersistencySvc' in  self.config.keys() :
            hfile =self.config['HistogramPersistencySvc'].getProp('OutputFile')
            d[ "histos" ].append( hfile )
        return d

def GaudiMP::GMPBase::GMPComponent::Initialize

(

self )

Definition at line 584 of file GMPBase.py.

                           :
        start = time.time()
        self.processConfiguration( )
        self.SetupGaudiPython( )
        # Set the initialisation flag!
        self.initEvent.set()
        self.StartGaudiPython( )
        self.iTime = time.time() - start

def GaudiMP::GMPBase::GMPComponent::LoadTES	(		self,
			tbufferfile
	)

Definition at line 500 of file GMPBase.py.

                                     :
        root = gbl.DataObject()
        setOwnership(root, False)
        self.evt.setRoot( '/Event', root )
        self.ts.loadBuffer(tbufferfile)

def GaudiMP::GMPBase::GMPComponent::processConfiguration

(

self )

Reimplemented in GaudiMP::GMPBase::Reader, GaudiMP::GMPBase::Worker, and GaudiMP::GMPBase::Writer.

Definition at line 472 of file GMPBase.py.

                                     :
        # Different for all ; customize Configuration for multicore
        pass

def GaudiMP::GMPBase::GMPComponent::Report

(

self )

Definition at line 601 of file GMPBase.py.

                       :
        self.log.name = "%s-%i Audit"%(self.nodeType, self.nodeID)
        allTime  = "Alive Time     : %5.2f"%(self.tTime)
        initTime = "Init Time      : %5.2f"%(self.iTime)
        frstTime = "1st Event Time : %5.2f"%(self.firstEvTime)
        runTime  = "Run Time       : %5.2f"%(self.rTime)
        finTime  = "Finalise Time  : %5.2f"%(self.fTime)
        tup = ( allTime, initTime, frstTime, runTime, finTime )
        for t in tup :
            self.log.info( t )
        self.log.name = "%s-%i"%(self.nodeType, self.nodeID)
        # and report from the TESSerializer
        self.TS.Report()

# =============================================================================

def GaudiMP::GMPBase::GMPComponent::SetupGaudiPython

(

self )

Definition at line 476 of file GMPBase.py.

                                 :
        # This method will initialize the GaudiPython Tools
        # such as the AppMgr and so on
        self.a   = AppMgr()
        if SMAPS :
            from AlgSmapShot import SmapShot
            smapsLog = self.nodeType+'-'+str(self.nodeID)+'.smp'
            ss = SmapShot( logname=smapsLog )
            self.a.addAlgorithm( ss )
        self.evt = self.a.evtsvc()
        self.hvt = self.a.histsvc()
        self.fsr = self.a.filerecordsvc()
        self.inc = self.a.service('IncidentSvc','IIncidentSvc')
        self.pers = self.a.service( 'EventPersistencySvc', 'IAddressCreator' )
        self.ts  = gbl.GaudiMP.TESSerializer( self.evt._idp, self.pers )
        self.TS  = TESSerializer( self.ts, self.evt,
                                  self.nodeType, self.nodeID, self.log )
        return SUCCESS

def GaudiMP::GMPBase::GMPComponent::Start

(

self )

Definition at line 463 of file GMPBase.py.

                      :
        # Fork and start the separate process
        self.proc.start()

def GaudiMP::GMPBase::GMPComponent::StartGaudiPython

(

self )

Definition at line 495 of file GMPBase.py.

                                 :
        self.a.initialize()
        self.a.start()
        return SUCCESS

---

Member Data Documentation

GaudiMP::GMPBase::GMPComponent::a

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::currentEvent

Reimplemented in GaudiMP::GMPBase::Reader, GaudiMP::GMPBase::Worker, and GaudiMP::GMPBase::Writer.

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::evcom

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::evcoms

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::evt

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::finalEvent

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::firstEvTime

Reimplemented in GaudiMP::GMPBase::Reader, and GaudiMP::GMPBase::Worker.

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::fq

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::fsr

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::fTime

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::hq

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::hvt

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::inc

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::iTime

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::lastEvent

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::log

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::nIn

Reimplemented in GaudiMP::GMPBase::Worker.

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::nodeID

Reimplemented in GaudiMP::GMPBase::Worker.

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::nodeType

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::nOut

Reimplemented in GaudiMP::GMPBase::Reader.

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::pers

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::proc

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::rTime

Reimplemented in GaudiMP::GMPBase::Writer.

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::stat

Reimplemented in GaudiMP::GMPBase::Reader.

Definition at line 396 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::TS

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::ts

Definition at line 476 of file GMPBase.py.

GaudiMP::GMPBase::GMPComponent::tTime

Reimplemented in GaudiMP::GMPBase::Reader, and GaudiMP::GMPBase::Worker.

Definition at line 396 of file GMPBase.py.

---

The documentation for this class was generated from the following file:

• /afs/cern.ch/sw/Gaudi/releases/GAUDI/GAUDI_v23r0/GaudiMP/python/GaudiMP/GMPBase.py