Round Trip testing June 2021

Details

Date 02/06/2021
Location University of Bristol lab
People Sudan

Test objective

  • Test the round trip (return path) with both 50Mhz and 62.5Mhz firmware with both TLU to FMC and Fanout to FMC.
  • Three firmware/software configurations were tested.
    • 1. v5.4.0 firmware (62.5MHz) with dune daq software v2.5.0
    • 2. v5.3.0b2 firmware (62.5MHz) with standalone 5.3.0 software
    • 3. v5.2.1 firmware (50 Mhz) with standalone 5.3.0 software

Test setup - TLU-FMC

Hardware

An AIDA 2020 TLU was configured to acts as master using the overlord fw design. An Enclustra AX3+PM3 with a timing FMC (pc053d) acted as an endpoint. The output from the TLU was fed into an 1:8 passive optical splitter via single mode optical fibre. The timing FMC was connected to one of the splitter outputs using a single mode optical fibre.

TLU UID: 0x5410ecbba408

FMC UID: 0x49162b675e3

Test 1: v5.4.0 (62.5MHz)

Firmware

The bitfile used for the TLU was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.4.0/latest/overlord_tlu_v5-4-0_sha-212bbdf0_runner-6bb6b053-project-19909-concurrent-0_210528_1049.tgz

The endpoint bitfile was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.4.0/latest/endpoint_pc053d_fmc_v5-4-0_sha-212bbdf0_runner-slu9p8x4-project-19909-concurrent-4_210528_1047.tgz

Software

The software version used for this test was: dune daq v2.5.0 with timing tag rtt_testing

Device configuration

The TLU was configured using the following commands:

pdtbutler io PROD_MASTER reset  
pdtbutler mst PROD_MASTER synctime
pdtbutler mst PROD_MASTER part 0 configure

The endpoint was configured using the commands below:

pdtbutler io EPT_0 reset 
pdtbutler ept EPT_0 0 enable -a 0x1
pdtbutler ept EPT_0 0 status

Test results

Following the configuration of the TLU and timing partition 0, the partition status command,

pdtbutler mst PROD_MASTER part 0 status

yielded the following output:

Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5

-- Master state---

Timestamp: 0x1203d95266aed16 -> Wed, 02 Jun 2021 17:08:01 +0000

--------------Cmd gen counters--------------
+------+-----------------+-----------------+
|      | Accept counters | Reject counters |
+------+-----------------+-----------------+
| Chan |  cnts  |   hex  |  cnts  |   hex  |
+------+--------+--------+--------+--------+
|  0x0 |    0   |    0   |    0   |    0   |
|  0x1 |    0   |    0   |    0   |    0   |
|  0x2 |    0   |    0   |    0   |    0   |
|  0x3 |    0   |    0   |    0   |    0   |
|  0x4 |    0   |    0   |    0   |    0   |
+------+--------+--------+--------+--------+


=> Partition 0

---------Controls--------
+---------------+-------+
|    Register   | Value |
+---------------+-------+
|     buf_en    |   0   |
|   frag_mask   |   0   |
|    part_en    |  0x1  |
|  rate_ctrl_en |  0x1  |
|    run_req    |   0   |
| spill_gate_en |  0x1  |
|  trig_ctr_rst |   0   |
|    trig_en    |   0   |
|   trig_mask   |  0xf1 |
+---------------+-------+

--------State-------
+----------+-------+
| Register | Value |
+----------+-------+
|  buf_err |   0   |
| buf_warn |   0   |
|  in_run  |   0   |
| in_spill |   0   |
|  part_up |  0x1  |
|  run_int |   0   |
+----------+-------+

Event Counter: 0
Buffer status: OK
Buffer occupancy: 0

+-------------+-----------------+-----------------+
|             | Accept counters | Reject counters |
+-------------+-----------------+-----------------+
|     Cmd     |  cnts  |   hex  |  cnts  |   hex  |
+-------------+--------+--------+--------+--------+
|   TimeSync  |   343  |  0x157 |    0   |    0   |
|     Echo    |    0   |    0   |    0   |    0   |
|  SpillStart |    0   |    0   |    0   |    0   |
|  SpillStop  |    0   |    0   |    0   |    0   |
|   RunStart  |    0   |    0   |    0   |    0   |
|   RunStop   |    0   |    0   |    0   |    0   |
|   WibCalib  |    0   |    0   |    0   |    0   |
|   SSPCalib  |    0   |    0   |    0   |    0   |
|  FakeTrig0  |    0   |    0   |    0   |    0   |
|  FakeTrig1  |    0   |    0   |    0   |    0   |
|  FakeTrig2  |    0   |    0   |    0   |    0   |
|  FakeTrig3  |    0   |    0   |    0   |    0   |
|   BeamTrig  |    0   |    0   |    0   |    0   |
|  NoBeamTrig |    0   |    0   |    0   |    0   |
| ExtFakeTrig |    0   |    0   |    0   |    0   |
+-------------+--------+--------+--------+--------+

The endpoint status command

pdtbutler ept EPT_0 0 status

gives the output below.

Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Wed, 02 Jun 2021 17:08:50 +0000            |
| Timestamp (hex)  | 0x1203d95b7a655cd                          |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |   363    |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+

Delay adjustment

Sending the delay adjustment command,

pdtbutler mst PROD_MASTER align apply-delay 0x1 0x3 0x7 --force

applies a coarse delay of 0x3, and a fine delay of 0x7 to endpoint address 0x1. The endpoint status after delay adjustment is: 

(dbt-pyvenv) -bash-4.2$ pdtbutler ept EPT_0 0 status

Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

Error: Endpoints 'endpoint1' do(es) not exist
(dbt-pyvenv) -bash-4.2$ pdtbutler ept EPT_0 0  status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+---------------------------------+
|     Endpoint     |                0                |
+------------------+---------------------------------+
| State            | Ready (0x8)                     |
| Partition        | 0                               |
| Address          | 1                               |
| Timestamp        | Wed, 02 Jun 2021 17:11:24 +0000 |
| Timestamp (hex)  | 0x1203d97812a4923               |
| EventCounter     | 0                               |
| Buffer status    | OK                              |
| Buffer occupancy | 0                               |
+------------------+---------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x3    |
| ep_rdy     |   0x1    |
| ep_rsto    |   0x0    |
| ep_stat    |   0x8    |
| fdelay     |   0x7    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |   485    |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+

Checking application of delays

pdtbutler mst PROD_MASTER align apply-delay 0x1 0x3 0x7 --force

pdtbutler mst PROD_MASTER align toggle-tx 0 --on

(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_MASTER align measure-delay 0
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5
2021-Jun-02 17:09:54,986 LOG [dunedaq::timing::GlobalNode::enable_upstream_endpoint(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/GlobalNode.cpp:96] Upstream endpoint reset, waiting for lock
ERROR ('RuntimeError' exception): ' Failed to bring up the RTT endpoint. Current state: 0xe'

File "/users/sp13109/daq_2_5_0/rtt_testing/build/timing/python/timing/cli/align.py", line 82, in measuredelay
   echo("Endpoint (adr: {}) RTT: {}".format(addr,lTopDesign.measure_endpoint_rtt(addr, True)))
Exception in user code:
------------------------------------------------------------
Traceback (most recent call last):
  File "/users/sp13109/daq_2_5_0/rtt_testing/build/timing/scripts/pdtbutler", line 104, in <module>
    cli(obj=PDTContext())
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context().obj, *args, **kwargs)
  File "/users/sp13109/daq_2_5_0/rtt_testing/dbt-pyvenv/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/users/sp13109/daq_2_5_0/rtt_testing/build/timing/python/timing/cli/align.py", line 82, in measuredelay
    echo("Endpoint (adr: {}) RTT: {}".format(addr,lTopDesign.measure_endpoint_rtt(addr, True)))
RuntimeError:  Failed to bring up the RTT endpoint. Current state: 0xe

Test 2: 5.3.0b2 (62.5MHz)

Firmware

The bitfile used for the TLU was: https://pdts-fw.web.cern.ch/pdts-fw/tags/relval/v5.3.0/b2/latest/overlord_tlu_relval-v5-3-0-b2_sha-ac158d6a_runner-slu9p8x4-project-19909-concurrent-1_210301_1408.tgz

The endpoint bitfile was: https://pdts-fw.web.cern.ch/pdts-fw/tags/relval/v5.3.0/b2/latest/endpoint_pc053d_fmc_relval-v5-3-0-b2_sha-ac158d6a_runner-slu9p8x4-project-19909-concurrent-12_210301_1403.tgz

Software

The software version used for this test was: standalone/rtt_testing

Device configuration

The TLU was configured using the following commands:

pdtbutler io PROD_MASTER reset  --force-pll-cfg DUNE_TLU-DUNTLU09-Registers_62.5_mhz.txt
pdtbutler mst PROD_MASTER synctime
pdtbutler mst PROD_MASTER part 0 configure

The endpoint was configured using the commands below:

pdtbutler io EPT_0 reset --force-pll-cfg Si5394-053endptr_62-5MHz_4kHz-Registers.txt
pdtbutler ept EPT_0 0 enable -a 0x1
pdtbutler ept EPT_0 0 status

Test results

Following the configuration of the TLU and timing partition 0, the partition status command,

pdtbutler mst PROD_MASTER part 0 status

-bash-4.2$ pdtbutler mst PROD_MASTER part 0 status
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

-- Master state---

Timestamp: 0x1203d84e2728d8b -> Wed, 02 Jun 2021 16:44:44 +0000

--------------Cmd gen counters--------------
+------+-----------------+-----------------+
|      | Accept counters | Reject counters |
+------+-----------------+-----------------+
| Chan |  cnts  |   hex  |  cnts  |   hex  |
+------+--------+--------+--------+--------+
|  0x0 |    0   |   0x0  |    0   |   0x0  |
|  0x1 |    0   |   0x0  |    0   |   0x0  |
|  0x2 |    0   |   0x0  |    0   |   0x0  |
|  0x3 |    0   |   0x0  |    0   |   0x0  |
|  0x4 |    0   |   0x0  |    0   |   0x0  |
+------+--------+--------+--------+--------+


=> Partition 0

---------Controls--------
+---------------+-------+
|    Register   | Value |
+---------------+-------+
|     buf_en    |  0x0  |
|   frag_mask   |  0x0  |
|    part_en    |  0x1  |
|  rate_ctrl_en |  0x1  |
|    run_req    |  0x0  |
| spill_gate_en |  0x1  |
|  trig_ctr_rst |  0x0  |
|    trig_en    |  0x0  |
|   trig_mask   |  0xf1 |
+---------------+-------+

--------State-------
+----------+-------+
| Register | Value |
+----------+-------+
|  buf_err |  0x0  |
| buf_warn |  0x0  |
|  in_run  |  0x0  |
| in_spill |  0x0  |
|  part_up |  0x1  |
|  run_int |  0x0  |
+----------+-------+

Event Counter: 0
Buffer status: OK
Buffer occupancy: 0

+-------------+-----------------+-----------------+
|             | Accept counters | Reject counters |
+-------------+-----------------+-----------------+
|     Cmd     |  cnts  |   hex  |  cnts  |   hex  |
+-------------+--------+--------+--------+--------+
|   TimeSync  |  1638  |  0x666 |    0   |   0x0  |
|     Echo    |    0   |   0x0  |    0   |   0x0  |
|  SpillStart |    0   |   0x0  |    0   |   0x0  |
|  SpillStop  |    0   |   0x0  |    0   |   0x0  |
|   RunStart  |    0   |   0x0  |    0   |   0x0  |
|   RunStop   |    0   |   0x0  |    0   |   0x0  |
|   WibCalib  |    0   |   0x0  |    0   |   0x0  |
|   SSPCalib  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig0  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig1  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig2  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig3  |    0   |   0x0  |    0   |   0x0  |
|   BeamTrig  |    0   |   0x0  |    0   |   0x0  |
|  NoBeamTrig |    0   |   0x0  |    0   |   0x0  |
| ExtFakeTrig |    0   |   0x0  |    0   |   0x0  |
+-------------+--------+--------+--------+--------+



pdtbutler ept EPT_0 0 status
-bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+---------------------------------+
|     Endpoint     |                0                |
+------------------+---------------------------------+
| State            | Ready (0x8)                     |
| Partition        | 0                               |
| Address          | 1                               |
| Timestamp        | Wed, 02 Jun 2021 16:48:45 +0000 |
| Timestamp (hex)  | 0x1203d87af8d72df               |
| EventCounter     | 0                               |
| Buffer status    | OK                              |
| Buffer occupancy | 0                               |
+------------------+---------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x3    |
| ep_rdy     |   0x1    |
| ep_rsto    |   0x0    |
| ep_stat    |   0x8    |
| fdelay     |   0x7    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x0    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |   1544   |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
-bash-4.2$


Delay adjustment

Sending the delay adjustment command,

pdtbutler mst PROD_MASTER align apply-delay 0x1 0x3 0x7 --force

applies a coarse delay of 0x3, and a fine delay of 0x7 to endpoint address 0x1. The endpoint status after delay adjustment is:

Created endpoint device EPT_0


Hardware info---------- +----------------+---------------+
Board type fmc
Board revision kFMCRev3
Board UID 0x49162b675e3
Carrier type enclustra-a35
Design type endpoint
+----------------+---------------+

+---------+

0
0x50100

+---------+ +------------------+---------------------------------+

Endpoint 0

+------------------+---------------------------------+

State Ready (0x8)
Partition 0
Address 1
Timestamp Wed, 02 Jun 2021 16:53:43 +0000
Timestamp (hex) 0x1203d8b2792504f
EventCounter 0
Buffer status OK
Buffer occupancy 0
+------------------+---------------------------------+


Endpoint state --- +------------+----------+
Endpoint 0

+------------+----------+

buf_err 0x0
buf_warn 0x0
cdelay 0x3
ep_rdy 0x1
ep_rsto 0x0
ep_stat 0x8
fdelay 0x7
in_run 0x0
in_spill 0x0
sfp_tx_dis 0x0
+------------+----------+


Command counters --- +--------------+----------+
Endpoint 0

+--------------+----------+

TimeSync 87
Echo  
SpillStart  
SpillStop  
RunStart  
RunStop  
WibCalib  
SSPCalib  
FakeTrig0  
FakeTrig1  
FakeTrig2  
FakeTrig3  
BeamTrig  
NoBeamTrig  
ExtFakeTrig  
None  
+--------------+----------+ </verbatim>

indicating the successful application of the coarse and fine delays

Checking application of delays

pdtbutler mst PROD_MASTER align apply-delay 0x1 0x3 0x7 --force

pdtbutler mst PROD_MASTER align toggle-tx 0 --on

-bash-4.2$ pdtbutler mst PROD_MASTER align measure-delay 1
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-02 16:47:50.304 pdt NOTICE   | Upstream endpoint reset, waiting for lock
2021-06-02 16:47:50.404 pdt NOTICE   | ept state: 0xe ept ready: 0x0
2021-06-02 16:47:50.505 pdt NOTICE   | ept state: 0xe ept ready: 0x1
2021-06-02 16:47:50.605 pdt NOTICE   | ept state: 0xe ept ready: 0x0
2021-06-02 16:47:50.706 pdt NOTICE   | ept state: 0xe ept ready: 0x1
2021-06-02 16:47:50.806 pdt NOTICE   | ept state: 0xe ept ready: 0x1
2021-06-02 16:47:50.907 pdt NOTICE   | ept state: 0xe ept ready: 0x0
2021-06-02 16:47:50.907 pdt ERROR    | Failed to bring up the RTT endpoint. Current state: 0xe
ERROR ('RuntimeError' exception): 'RTT endpoint failed to lock. Downstream ept address: 0x1'

File "/users/sp13109/rtt_testing_5_3_0/timing/python/pkg/pdt/cli/align.py", line 82, in measuredelay
   echo("Endpoint (adr: {}) RTT: {}".format(addr,lTopDesign.measureEndpointRTT(addr, True)))
Exception in user code:
------------------------------------------------------------
Traceback (most recent call last):
  File "/users/sp13109/rtt_testing_5_3_0/timing/tests/scripts/pdtbutler", line 102, in <module>
    cli(obj=PDTContext())
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context().obj, *args, **kwargs)
  File "/users/sp13109/.local/lib/python2.7/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/users/sp13109/rtt_testing_5_3_0/timing/python/pkg/pdt/cli/align.py", line 82, in measuredelay
    echo("Endpoint (adr: {}) RTT: {}".format(addr,lTopDesign.measureEndpointRTT(addr, True)))
RuntimeError: RTT endpoint failed to lock. Downstream ept address: 0x1

------------------------------------------------------------

Test 3: v5.2.1 50MHz

Firmware

The bitfile used for the TLU was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.2.1/latest/overlord_tlu_v5-2-1_runner-slu9p8x4-project-19909-concurrent-2_201102_1553.tgz

The endpoint bitfile was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.2.1/latest/endpoint_pc053d_fmc_v5-2-1_runner-6bb6b053-project-19909-concurrent-3_201102_1549.tgz

Software

The software version used for this test was: standalone/rtt_testing

Device configuration

The TLU was configured using the following commands:

pdtbutler io PROD_MASTER reset 
pdtbutler mst PROD_MASTER synctime
pdtbutler mst PROD_MASTER part 0 configure

The endpoint was configured using the commands below:

pdtbutler io EPT_0 reset --force-pll-cfg tests/etc/clock/devel/ENDPOINT-Si5344-50MHzRef.txt
pdtbutler ept EPT_0 0 enable -a 0x1
pdtbutler ept EPT_0 0 status

--+++Test results Following the configuration of the TLU and timing partition 0, the following was observed:

-bash-4.2$ pdtbutler mst PROD_MASTER part 0 configure
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

Configuring partition 0
Trigger mask set to 0xf1
  Fake mask 0x1
  Phys mask 0xf
Partition 0 enabled and configured
-bash-4.2$ pdtbutler io EPT_0 reset
Created device EPT_0
Design 'endpoint' on board 'fmc' on carrier 'enclustra-a35'
Resetting EPT_0
2021-06-02 17:30:05.211 pdt NOTICE   | PLL configuration file : /users/sp13109/rtt_testing_5_3_0/timing/tests/etc/clock/devel/ENDPOINT-Si5344-50MHzRef.txt
2021-06-02 17:30:05.214 pdt NOTICE   | Configuring PLL        : SI5394
2021-06-02 17:30:07.622 pdt NOTICE   | PLL configuration id   : 20180917
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

------FMC IO state-----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x0  |
|   cdr_los   |  0x0  |
|   mmcm_ok   |  0x0  |
| mmcm_sticky |  0x0  |
|   sfp_flt   |  0x0  |
|   sfp_los   |  0x0  |
+-------------+-------+


PLL Clock frequency measurement:
PLL freq: 249.991277693
CDR freq: 249.995211599


PLL configuration id   : 20180917
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |   0x0  |
| Device revision |   0x0  |
|   Part number   | 0x5394 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |  0x0  |
|        HOLD       |  0x0  |
|        LOL        |  0x0  |
|        LOS        |  0x0  |
|      LOSXAXB      |  0x0  |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |  0x0  |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |  0x0  |
| SMBUS_TIMEOUT_FLG |  0x0  |
|      SYSINCAL     |  0x0  |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |  0x0  |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

<\verbatim>

-bash-4.2$ pdtbutler ept EPT_0 0 enable -a 0x1
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Thu, 01 Jan 1970 01:00:00 +0000            |
| Timestamp (hex)  | 0x0                                        |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |          |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
> Endpoints 0 on in partition 0
-bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Wed, 02 Jun 2021 17:30:19 +0000            |
| Timestamp (hex)  | 0x1203da4b7d9aee9                          |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    5     |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+


Delay adjustment

Sending the delay adjustment command,


bash-4.2$ pdtbutler mst PROD_MASTER align apply-delay 0x1 0x3 0x7 --force
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-02 17:30:32.506 pdt NOTICE   | Coarse delay 0x3 applied
2021-06-02 17:30:32.506 pdt NOTICE   | Fine delay   0x7 applied
2021-06-02 17:30:32.506 pdt NOTICE   | Phase delay  0x0 applied
-bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+---------------------------------+
|     Endpoint     |                0                |
+------------------+---------------------------------+
| State            | Ready (0x8)                     |
| Partition        | 0                               |
| Address          | 1                               |
| Timestamp        | Wed, 02 Jun 2021 17:30:38 +0000 |
| Timestamp (hex)  | 0x1203da4f02ce799               |
| EventCounter     | 0                               |
| Buffer status    | OK                              |
| Buffer occupancy | 0                               |
+------------------+---------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x3    |
| ep_rdy     |   0x1    |
| ep_rsto    |   0x0    |
| ep_stat    |   0x8    |
| fdelay     |   0x7    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x0    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    23    |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
-bash-4.2$ pdtbutler mst PROD_MASTER align toggle-tx 0 --on
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
-bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+---------------------------------+
|     Endpoint     |                0                |
+------------------+---------------------------------+
| State            | Ready (0x8)                     |
| Partition        | 0                               |
| Address          | 1                               |
| Timestamp        | Wed, 02 Jun 2021 17:31:12 +0000 |
| Timestamp (hex)  | 0x1203da555698d8a               |
| EventCounter     | 0                               |
| Buffer status    | OK                              |
| Buffer occupancy | 0                               |
+------------------+---------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x3    |
| ep_rdy     |   0x1    |
| ep_rsto    |   0x0    |
| ep_stat    |   0x8    |
| fdelay     |   0x7    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x0    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    57    |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
-bash-4.2$ pdtbutler mst PROD_MASTER align measure-delay 1
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-02 17:31:32.973 pdt NOTICE   | Upstream endpoint reset, waiting for lock
2021-06-02 17:31:33.073 pdt NOTICE   | ept state: 0x8 ept ready: 0x1
2021-06-02 17:31:33.073 pdt NOTICE   | Endpoint locked: state= 0x8
2021-06-02 17:31:33.174 pdt NOTICE   | rx done: 1
Endpoint (adr: 1) RTT: 31
-bash-4.2$ pdtbutler mst PROD_MASTER align measure-delay 1
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-02 17:31:39.244 pdt NOTICE   | Upstream endpoint reset, waiting for lock
2021-06-02 17:31:39.345 pdt NOTICE   | ept state: 0x8 ept ready: 0x1
2021-06-02 17:31:39.345 pdt NOTICE   | Endpoint locked: state= 0x8
2021-06-02 17:31:39.445 pdt NOTICE   | rx done: 1
Endpoint (adr: 1) RTT: 31

Test setup - Fanout to FMC

Hardware

A fanout was configured to acts as master using the fanout fw design. An Enclustra AX3+PM3 with a timing FMC (pc053d) acted as an endpoint. The output from the fanout was fed into an 1:8 passive optical splitter via single mode optical fibre. The timing FMC was connected to one of the splitter outputs using a single mode optical fibre.

Fanout 0 was used.

FMC UID: 0x49162b675e3

Test 4: 5.4.0 - 62.5MHz

Firmware

The bitfile used for the fanout was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.4.0/latest/fanout_0_pc059_v5-4-0_sha-212bbdf0_runner-6bb6b053-project-19909-concurrent-2_210528_1052.tgz

The endpoint bitfile was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.4.0/latest/endpoint_pc053d_fmc_v5-4-0_sha-212bbdf0_runner-slu9p8x4-project-19909-concurrent-4_210528_1047.tgz

Software

The software version used for this test was: dune daq v2.5.0 with timing tag rtt_testing

Test results

(dbt-pyvenv) -bash-4.2$ pdtbutler io PROD_FANOUT_0 reset

Created device PROD_FANOUT_0
Design 'fanout' on board 'pc059' on carrier 'enclustra-a35'
Resetting PROD_FANOUT_0
Fanout mode enabled
2021-Jun-04 13:07:35,775 LOG [dunedaq::timing::PC059IONode::reset(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/PC059IONode.cpp:101] Reset done
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

-----PC059 IO state----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x1  |
|   cdr_los   |  0x1  |
|   mmcm_ok   |  0x1  |
| mmcm_sticky |   0   |
|   pll_lol   |  0x1  |
|    pll_ok   |   0   |
|  pll_sticky |   0   |
|   sfp_los   |  0xff |
|   ucdr_lol  |   0   |
|   ucdr_los  |   0   |
|   usfp_flt  |   0   |
|   usfp_los  |   0   |
+-------------+-------+


PLL Clock frequency measurement:
PLL freq: 312.476371526
CDR freq: 792.126472906


PLL configuration id   : 059_0s62
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |    0   |
| Device revision |   0x1  |
|   Part number   | 0x5345 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |   0   |
|        HOLD       |  0x1  |
|        LOL        |  0x1  |
|        LOS        |  0x5  |
|      LOSXAXB      |   0   |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |  0x7  |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |   0   |
| SMBUS_TIMEOUT_FLG |   0   |
|      SYSINCAL     |   0   |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |   0   |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

(dbt-pyvenv) -bash-4.2$ pdtbutler io PROD_FANOUT_0 reset --fanout-mode 1

Created device PROD_FANOUT_0
Design 'fanout' on board 'pc059' on carrier 'enclustra-a35'
Resetting PROD_FANOUT_0
2021-Jun-04 13:08:01,571 LOG [dunedaq::timing::PC059IONode::reset(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/PC059IONode.cpp:101] Reset done
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

-----PC059 IO state----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x1  |
|   cdr_los   |  0x1  |
|   mmcm_ok   |  0x1  |
| mmcm_sticky |   0   |
|   pll_lol   |  0x1  |
|    pll_ok   |   0   |
|  pll_sticky |   0   |
|   sfp_los   |  0xff |
|   ucdr_lol  |   0   |
|   ucdr_los  |   0   |
|   usfp_flt  |   0   |
|   usfp_los  |   0   |
+-------------+-------+


PLL Clock frequency measurement:
PLL freq: 312.499259708
CDR freq: 791.374858396


PLL configuration id   : 059_1_62
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |    0   |
| Device revision |   0x1  |
|   Part number   | 0x5345 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |   0   |
|        HOLD       |  0x1  |
|        LOL        |  0x1  |
|        LOS        |   0   |
|      LOSXAXB      |   0   |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |   0   |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |   0   |
| SMBUS_TIMEOUT_FLG |   0   |
|      SYSINCAL     |   0   |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |   0   |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_FANOUT_0 synctime

Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5
2021-Jun-04 13:08:38,573 LOG [dunedaq::timing::PDIMasterNode::sync_timestamp(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/PDIMasterNode.cpp:229] Old timestamp: 0x89e6dca5, Thu, 01 Jan 1970 01:00:46 +0000
2021-Jun-04 13:08:38,581 LOG [dunedaq::timing::PDIMasterNode::sync_timestamp(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/PDIMasterNode.cpp:235] New timestamp: 0x12044c996b1a1fa, Fri, 04 Jun 2021 13:08:38 +0000
(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_MASTER part 0 configure
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

Configuring partition 0
Trigger mask set to 0xf1
  Fake mask 0x1
  Phys mask 0xf
Partition 0 enabled and configured
(reverse-i-search)`': ^C
(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_MASTER part 0 status
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

-- Master state---

Timestamp: 0x12044c9b64706d3 -> Fri, 04 Jun 2021 13:08:48 +0000

--------------Cmd gen counters--------------
+------+-----------------+-----------------+
|      | Accept counters | Reject counters |
+------+-----------------+-----------------+
| Chan |  cnts  |   hex  |  cnts  |   hex  |
+------+--------+--------+--------+--------+
|  0x0 |    0   |    0   |    0   |    0   |
|  0x1 |    0   |    0   |    0   |    0   |
|  0x2 |    0   |    0   |    0   |    0   |
|  0x3 |    0   |    0   |    0   |    0   |
|  0x4 |    0   |    0   |    0   |    0   |
+------+--------+--------+--------+--------+


=> Partition 0

---------Controls--------
+---------------+-------+
|    Register   | Value |
+---------------+-------+
|     buf_en    |   0   |
|   frag_mask   |   0   |
|    part_en    |  0x1  |
|  rate_ctrl_en |  0x1  |
|    run_req    |   0   |
| spill_gate_en |  0x1  |
|  trig_ctr_rst |   0   |
|    trig_en    |   0   |
|   trig_mask   |  0xf1 |
+---------------+-------+

--------State-------
+----------+-------+
| Register | Value |
+----------+-------+
|  buf_err |   0   |
| buf_warn |   0   |
|  in_run  |   0   |
| in_spill |   0   |
|  part_up |  0x1  |
|  run_int |   0   |
+----------+-------+

Event Counter: 0
Buffer status: OK
Buffer occupancy: 0

+-------------+-----------------+-----------------+
|             | Accept counters | Reject counters |
+-------------+-----------------+-----------------+
|     Cmd     |  cnts  |   hex  |  cnts  |   hex  |
+-------------+--------+--------+--------+--------+
|   TimeSync  |    7   |   0x7  |    0   |    0   |
|     Echo    |    0   |    0   |    0   |    0   |
|  SpillStart |    0   |    0   |    0   |    0   |
|  SpillStop  |    0   |    0   |    0   |    0   |
|   RunStart  |    0   |    0   |    0   |    0   |
|   RunStop   |    0   |    0   |    0   |    0   |
|   WibCalib  |    0   |    0   |    0   |    0   |
|   SSPCalib  |    0   |    0   |    0   |    0   |
|  FakeTrig0  |    0   |    0   |    0   |    0   |
|  FakeTrig1  |    0   |    0   |    0   |    0   |
|  FakeTrig2  |    0   |    0   |    0   |    0   |
|  FakeTrig3  |    0   |    0   |    0   |    0   |
|   BeamTrig  |    0   |    0   |    0   |    0   |
|  NoBeamTrig |    0   |    0   |    0   |    0   |
| ExtFakeTrig |    0   |    0   |    0   |    0   |
+-------------+--------+--------+--------+--------+

(dbt-pyvenv) -bash-4.2$ pdtbutler io EPT_0 reset

Created device EPT_0
Design 'endpoint' on board 'fmc' on carrier 'enclustra-a35'
Resetting EPT_0
2021-Jun-04 13:09:44,378 LOG [dunedaq::timing::FMCIONode::reset(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/FMCIONode.cpp:82] Reset done
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

------FMC IO state-----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |   0   |
|   cdr_los   |   0   |
|   mmcm_ok   |   0   |
| mmcm_sticky |   0   |
|   sfp_flt   |   0   |
|   sfp_los   |   0   |
+-------------+-------+


PLL Clock frequency measurement:
PLL freq: 312.488411663
CDR freq: 312.491749523


PLL configuration id   : 053endpt
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |    0   |
| Device revision |    0   |
|   Part number   | 0x5394 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |   0   |
|        HOLD       |   0   |
|        LOL        |   0   |
|        LOS        |   0   |
|      LOSXAXB      |   0   |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |   0   |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |   0   |
| SMBUS_TIMEOUT_FLG |   0   |
|      SYSINCAL     |   0   |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |   0   |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_FANOUT_0 part 0 configure

Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5

Configuring partition 0
Trigger mask set to 0xf1
  Fake mask 0x1
  Phys mask 0xf
Partition 0 enabled and configured
(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_FANOUT_0 part 0 status
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5

-- Master state---

Timestamp: 0x12044cb0b515511 -> Fri, 04 Jun 2021 13:10:43 +0000

--------------Cmd gen counters--------------
+------+-----------------+-----------------+
|      | Accept counters | Reject counters |
+------+-----------------+-----------------+
| Chan |  cnts  |   hex  |  cnts  |   hex  |
+------+--------+--------+--------+--------+
|  0x0 |    0   |    0   |    0   |    0   |
|  0x1 |    0   |    0   |    0   |    0   |
|  0x2 |    0   |    0   |    0   |    0   |
|  0x3 |    0   |    0   |    0   |    0   |
|  0x4 |    0   |    0   |    0   |    0   |
+------+--------+--------+--------+--------+


=> Partition 0

---------Controls--------
+---------------+-------+
|    Register   | Value |
+---------------+-------+
|     buf_en    |   0   |
|   frag_mask   |   0   |
|    part_en    |  0x1  |
|  rate_ctrl_en |  0x1  |
|    run_req    |   0   |
| spill_gate_en |  0x1  |
|  trig_ctr_rst |   0   |
|    trig_en    |   0   |
|   trig_mask   |  0xf1 |
+---------------+-------+

--------State-------
+----------+-------+
| Register | Value |
+----------+-------+
|  buf_err |   0   |
| buf_warn |   0   |
|  in_run  |   0   |
| in_spill |   0   |
|  part_up |  0x1  |
|  run_int |   0   |
+----------+-------+

Event Counter: 0
Buffer status: OK
Buffer occupancy: 0

+-------------+-----------------+-----------------+
|             | Accept counters | Reject counters |
+-------------+-----------------+-----------------+
|     Cmd     |  cnts  |   hex  |  cnts  |   hex  |
+-------------+--------+--------+--------+--------+
|   TimeSync  |   11   |   0xb  |    0   |    0   |
|     Echo    |    0   |    0   |    0   |    0   |
|  SpillStart |    0   |    0   |    0   |    0   |
|  SpillStop  |    0   |    0   |    0   |    0   |
|   RunStart  |    0   |    0   |    0   |    0   |
|   RunStop   |    0   |    0   |    0   |    0   |
|   WibCalib  |    0   |    0   |    0   |    0   |
|   SSPCalib  |    0   |    0   |    0   |    0   |
|  FakeTrig0  |    0   |    0   |    0   |    0   |
|  FakeTrig1  |    0   |    0   |    0   |    0   |
|  FakeTrig2  |    0   |    0   |    0   |    0   |
|  FakeTrig3  |    0   |    0   |    0   |    0   |
|   BeamTrig  |    0   |    0   |    0   |    0   |
|  NoBeamTrig |    0   |    0   |    0   |    0   |
| ExtFakeTrig |    0   |    0   |    0   |    0   |
+-------------+--------+--------+--------+--------+

(dbt-pyvenv) -bash-4.2$ pdtbutler io EPT_0 reset

Created device EPT_0
Design 'endpoint' on board 'fmc' on carrier 'enclustra-a35'
Resetting EPT_0
2021-Jun-04 13:10:30,215 LOG [dunedaq::timing::FMCIONode::reset(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/FMCIONode.cpp:82] Reset done
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

------FMC IO state-----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |   0   |
|   cdr_los   |   0   |
|   mmcm_ok   |   0   |
| mmcm_sticky |   0   |
|   sfp_flt   |   0   |
|   sfp_los   |   0   |
+-------------+-------+


PLL Clock frequency measurement:
PLL freq: 312.488530872
CDR freq: 312.491749523


PLL configuration id   : 053endpt
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |    0   |
| Device revision |    0   |
|   Part number   | 0x5394 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |   0   |
|        HOLD       |   0   |
|        LOL        |   0   |
|        LOS        |   0   |
|      LOSXAXB      |   0   |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |   0   |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |   0   |
| SMBUS_TIMEOUT_FLG |   0   |
|      SYSINCAL     |   0   |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |   0   |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

(dbt-pyvenv) -bash-4.2$ pdtbutler ept EPT_0 0 enable -a 0x1

Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Thu, 01 Jan 1970 01:00:00 +0000            |
| Timestamp (hex)  | 0x0                                        |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |          |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
> Endpoints 0 on in partition 0

(dbt-pyvenv) -bash-4.2$ pdtbutler ept EPT_0 0 status

Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Fri, 04 Jun 2021 13:11:18 +0000            |
| Timestamp (hex)  | 0x12044cb746061ff                          |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    7     |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+

(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_FANOUT_0 align apply-delay 0x1 0x2 0x7 --force

Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5
2021-Jun-04 13:11:02,886 LOG [dunedaq::timing::VLCmdGeneratorNode::apply_endpoint_delay(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/VLCmdGeneratorNode.cpp:75] Coarse delay 0x2 applied
2021-Jun-04 13:11:02,896 LOG [dunedaq::timing::VLCmdGeneratorNode::apply_endpoint_delay(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/VLCmdGeneratorNode.cpp:76] Fine delay   0x7 applied
2021-Jun-04 13:11:02,896 LOG [dunedaq::timing::VLCmdGeneratorNode::apply_endpoint_delay(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/VLCmdGeneratorNode.cpp:77] Phase delay  0 applied
(dbt-pyvenv) -bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+---------------------------------+
|     Endpoint     |                0                |
+------------------+---------------------------------+
| State            | Ready (0x8)                     |
| Partition        | 0                               |
| Address          | 1                               |
| Timestamp        | Fri, 04 Jun 2021 13:11:45 +0000 |
| Timestamp (hex)  | 0x12044cbc5147e8b               |
| EventCounter     | 0                               |
| Buffer status    | OK                              |
| Buffer occupancy | 0                               |
+------------------+---------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x2    |
| ep_rdy     |   0x1    |
| ep_rsto    |   0x0    |
| ep_stat    |   0x8    |
| fdelay     |   0x7    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    27    |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+

(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_FANOUT_0 align measure-delay -m 0 1
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5
2021-Jun-04 13:12:29,218 LOG [dunedaq::timing::GlobalNode::enable_upstream_endpoint(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/GlobalNode.cpp:96] Upstream endpoint reset, waiting for lock
Endpoint (adr: 1, mux: 0) RTT: 32
(dbt-pyvenv) -bash-4.2$ pdtbutler mst PROD_FANOUT_0 align measure-delay -m 0 1
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50400, partitions: 4, channels: 5
2021-Jun-04 13:12:35,824 LOG [dunedaq::timing::GlobalNode::enable_upstream_endpoint(...) at /users/sp13109/daq_2_5_0/rtt_testing/sourcecode/timing/src/GlobalNode.cpp:96] Upstream endpoint reset, waiting for lock
Endpoint (adr: 1, mux: 0) RTT: 32
(dbt-pyvenv) -bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+---------------------------------+
|     Endpoint     |                0                |
+------------------+---------------------------------+
| State            | Ready (0x8)                     |
| Partition        | 0                               |
| Address          | 1                               |
| Timestamp        | Fri, 04 Jun 2021 13:13:52 +0000 |
| Timestamp (hex)  | 0x12044cd3ff9f626               |
| EventCounter     | 0                               |
| Buffer status    | OK                              |
| Buffer occupancy | 0                               |
+------------------+---------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x2    |
| ep_rdy     |   0x1    |
| ep_rsto    |   0x0    |
| ep_stat    |   0x8    |
| fdelay     |   0x7    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |   128    |
| Echo         |    2     |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |

Test 5: 5.3.0b2 (62.5MHz)

Firmware

The bitfile used for the fanout was: https://pdts-fw.web.cern.ch/pdts-fw/tags/relval/v5.3.0/b2/latest/fanout_0_pc059_relval-v5-3-0-b2_sha-ac158d6a_runner-slu9p8x4-project-19909-concurrent-7_210301_1408.tgz

The endpoint bitfile was: https://pdts-fw.web.cern.ch/pdts-fw/tags/relval/v5.3.0/b2/latest/endpoint_pc053d_fmc_relval-v5-3-0-b2_sha-ac158d6a_runner-slu9p8x4-project-19909-concurrent-12_210301_1403.tgz

Software

The software version used for this test was: standalone/rtt_testing

Test results


    -bash-4.2$ pdtbutler io PROD_FANOUT_0 reset --fanout-mode 1 --force-pll-cfg ~/clkfiles/pc059_standalone_312_mhz-059_1_62-Registers.txt
Created device PROD_FANOUT_0
Design 'fanout' on board 'pc059' on carrier 'enclustra-a35'
Resetting PROD_FANOUT_0
local master - standalone mode
2021-06-04 12:34:21.842 pdt NOTICE   | PLL configuration file : /users/sp13109/clkfiles/pc059_standalone_312_mhz-059_1_62-Registers.txt
2021-06-04 12:34:21.845 pdt NOTICE   | Configuring PLL        : SI5345
2021-06-04 12:34:24.230 pdt NOTICE   | PLL configuration id   : 059_1_62
2021-06-04 12:34:24.236 pdt NOTICE   | SFPs 0-7 enabled
2021-06-04 12:34:24.236 pdt NOTICE   | Reset done
2021-06-04 12:34:24.236 pdt NOTICE   | SFP input mux set to 0
Active sfp mux 0x0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

-----PC059 IO state----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x1  |
|   cdr_los   |  0x1  |
|   mmcm_ok   |  0x1  |
| mmcm_sticky |  0x0  |
|   pll_lol   |  0x1  |
|    pll_ok   |  0x0  |
|  pll_sticky |  0x0  |
|   sfp_los   |  0xff |
|   ucdr_lol  |  0x1  |
|   ucdr_los  |  0x0  |
|   usfp_flt  |  0x0  |
|   usfp_los  |  0x0  |
+-------------+-------+

Active sfp mux 0

PLL Clock frequency measurement:
PLL freq: 312.499140498
CDR freq: 790.225442518


PLL configuration id   : 059_1_62
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |   0x0  |
| Device revision |   0x1  |
|   Part number   | 0x5345 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |  0x0  |
|        HOLD       |  0x1  |
|        LOL        |  0x1  |
|        LOS        |  0x0  |
|      LOSXAXB      |  0x0  |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |  0x0  |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |  0x0  |
| SMBUS_TIMEOUT_FLG |  0x0  |
|      SYSINCAL     |  0x0  |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |  0x0  |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

-bash-4.2$ pdtbutler mst PROD_FANOUT_0 synctime
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:34:42.472 pdt NOTICE   | Old timestamp: 0x4418cbc4, Thu, 01 Jan 1970 01:00:22 +0000
2021-06-04 12:34:42.473 pdt NOTICE   | New timestamp: 0x12044b1e2f0fa1a, Fri, 04 Jun 2021 12:34:42 +0000
(reverse-i-search)`confi': cd ^Cnfig/etc/clock/
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 part 0 configure
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

Configuring partition 0
Trigger mask set to 0xf1
  Fake mask 0x1
  Phys mask 0xf
Partition 0 enabled and configured
-
-bash-4.2$ pdtbutler io EPT_0 reset --force-pll-cfg tests/etc/clock/devel/Si5394-053endptr_62-5MHz_4kHz-Registers.txt
Created device EPT_0
Design 'endpoint' on board 'fmc' on carrier 'enclustra-a35'
Resetting EPT_0
2021-06-04 12:36:21.196 pdt NOTICE   | PLL configuration file : tests/etc/clock/devel/Si5394-053endptr_62-5MHz_4kHz-Registers.txt
2021-06-04 12:36:21.200 pdt NOTICE   | Configuring PLL        : SI5394
2021-06-04 12:36:23.736 pdt NOTICE   | PLL configuration id   : 053endpt
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

------FMC IO state-----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x0  |
|   cdr_los   |  0x0  |
|   mmcm_ok   |  0x0  |
| mmcm_sticky |  0x0  |
|   sfp_flt   |  0x0  |
|   sfp_los   |  0x0  |
+-------------+-------+


PLL Clock frequency measurement:
PLL freq: 312.488530872
CDR freq: 312.491868732


PLL configuration id   : 053endpt
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |   0x0  |
| Device revision |   0x0  |
|   Part number   | 0x5394 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |  0x0  |
|        HOLD       |  0x0  |
|        LOL        |  0x0  |
|        LOS        |  0x0  |
|      LOSXAXB      |  0x0  |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |  0x0  |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |  0x0  |
| SMBUS_TIMEOUT_FLG |  0x0  |
|      SYSINCAL     |  0x0  |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |  0x0  |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

-bash-4.2$ pdtbutler ept EPT_0 0 enable -a 0x1
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Thu, 01 Jan 1970 01:00:00 +0000            |
| Timestamp (hex)  | 0x0                                        |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |          |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
> Endpoints 0 on in partition 0
-bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Fri, 04 Jun 2021 12:37:12 +0000            |
| Timestamp (hex)  | 0x12044b3a2915aa8                          |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    8     |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 part 0 status
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

-- Master state---

Timestamp: 0x12044b3d561d39a -> Fri, 04 Jun 2021 12:37:29 +0000

--------------Cmd gen counters--------------
+------+-----------------+-----------------+
|      | Accept counters | Reject counters |
+------+-----------------+-----------------+
| Chan |  cnts  |   hex  |  cnts  |   hex  |
+------+--------+--------+--------+--------+
|  0x0 |    0   |   0x0  |    0   |   0x0  |
|  0x1 |    0   |   0x0  |    0   |   0x0  |
|  0x2 |    0   |   0x0  |    0   |   0x0  |
|  0x3 |    0   |   0x0  |    0   |   0x0  |
|  0x4 |    0   |   0x0  |    0   |   0x0  |
+------+--------+--------+--------+--------+


=> Partition 0

---------Controls--------
+---------------+-------+
|    Register   | Value |
+---------------+-------+
|     buf_en    |  0x0  |
|   frag_mask   |  0x0  |
|    part_en    |  0x1  |
|  rate_ctrl_en |  0x1  |
|    run_req    |  0x0  |
| spill_gate_en |  0x1  |
|  trig_ctr_rst |  0x0  |
|    trig_en    |  0x0  |
|   trig_mask   |  0xf1 |
+---------------+-------+

--------State-------
+----------+-------+
| Register | Value |
+----------+-------+
|  buf_err |  0x0  |
| buf_warn |  0x0  |
|  in_run  |  0x0  |
| in_spill |  0x0  |
|  part_up |  0x1  |
|  run_int |  0x0  |
+----------+-------+

Event Counter: 0
Buffer status: OK
Buffer occupancy: 0

+-------------+-----------------+-----------------+
|             | Accept counters | Reject counters |
+-------------+-----------------+-----------------+
|     Cmd     |  cnts  |   hex  |  cnts  |   hex  |
+-------------+--------+--------+--------+--------+
|   TimeSync  |   122  |  0x7a  |    0   |   0x0  |
|     Echo    |    0   |   0x0  |    0   |   0x0  |
|  SpillStart |    0   |   0x0  |    0   |   0x0  |
|  SpillStop  |    0   |   0x0  |    0   |   0x0  |
|   RunStart  |    0   |   0x0  |    0   |   0x0  |
|   RunStop   |    0   |   0x0  |    0   |   0x0  |
|   WibCalib  |    0   |   0x0  |    0   |   0x0  |
|   SSPCalib  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig0  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig1  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig2  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig3  |    0   |   0x0  |    0   |   0x0  |
|   BeamTrig  |    0   |   0x0  |    0   |   0x0  |
|  NoBeamTrig |    0   |   0x0  |    0   |   0x0  |
| ExtFakeTrig |    0   |   0x0  |    0   |   0x0  |
+-------------+--------+--------+--------+--------+

(reverse-i-search)`aling': pdtbutler mst ^Cing -h
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 align apply-delay 0x1 0x3 0x7 --force
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:37:28.366 pdt NOTICE   | Coarse delay 0x3 applied
2021-06-04 12:37:28.366 pdt NOTICE   | Fine delay   0x7 applied
2021-06-04 12:37:28.366 pdt NOTICE   | Phase delay  0x0 applied
-bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+---------------------------------+
|     Endpoint     |                0                |
+------------------+---------------------------------+
| State            | Ready (0x8)                     |
| Partition        | 0                               |
| Address          | 1                               |
| Timestamp        | Fri, 04 Jun 2021 12:38:20 +0000 |
| Timestamp (hex)  | 0x12044b46cc5cda4               |
| EventCounter     | 0                               |
| Buffer status    | OK                              |
| Buffer occupancy | 0                               |
+------------------+---------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x3    |
| ep_rdy     |   0x1    |
| ep_rsto    |   0x0    |
| ep_stat    |   0x8    |
| fdelay     |   0x7    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x0    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    61    |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 align measure-delay -m 0 1
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:37:53.327 pdt NOTICE   | SFP input mux set to 0
2021-06-04 12:37:53.528 pdt NOTICE   | Upstream endpoint reset, waiting for lock
2021-06-04 12:37:53.628 pdt NOTICE   | ept state: 0x8 ept ready: 0x1
2021-06-04 12:37:53.628 pdt NOTICE   | Endpoint locked: state= 0x8
2021-06-04 12:37:53.729 pdt NOTICE   | rx done: 1
Endpoint (adr: 1, mux: 0) RTT: 33

-bash-4.2$ pdtbutler mst PROD_FANOUT_0 align apply-delay 0x1 0x2 0x7 --force
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:54:04.265 pdt NOTICE   | Coarse delay 0x2 applied
2021-06-04 12:54:04.265 pdt NOTICE   | Fine delay   0x7 applied
2021-06-04 12:54:04.265 pdt NOTICE   | Phase delay  0x0 applied
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 align measure-delay -m 0 1
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:54:06.749 pdt NOTICE   | SFP input mux set to 0
2021-06-04 12:54:06.950 pdt NOTICE   | Upstream endpoint reset, waiting for lock
2021-06-04 12:54:07.050 pdt NOTICE   | ept state: 0x8 ept ready: 0x1
2021-06-04 12:54:07.050 pdt NOTICE   | Endpoint locked: state= 0x8
2021-06-04 12:54:07.151 pdt NOTICE   | rx done: 1
Endpoint (adr: 1, mux: 0) RTT: 32
-bash-4.2$

Test 6: 5.2.1 (50MHz)

Firmware

The bitfile used for the fanout was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.2.1/latest/fanout_0_pc059_v5-2-1_runner-6bb6b053-project-19909-concurrent-1_201102_1554.tgz The endpoint bitfile was: https://pdts-fw.web.cern.ch/pdts-fw/tags/v5.2.1/latest/endpoint_pc053d_fmc_v5-2-1_runner-6bb6b053-project-19909-concurrent-3_201102_1549.tgz

The software version used for this test was: standalone/rtt_testing

Test results

-bash-4.2$ pdtbutler io PROD_FANOUT_0 reset
Created device PROD_FANOUT_0
Design 'fanout' on board 'pc059' on carrier 'enclustra-a35'
Resetting PROD_FANOUT_0
Fanout mode enabled
2021-06-04 12:11:00.067 pdt NOTICE   | PLL configuration file : /users/sp13109/rtt_testing_5_3_0/timing/tests/etc/clock/wr/FANOUT_PLL_WIDEBW_SFPIN.txt
2021-06-04 12:11:00.069 pdt NOTICE   | Configuring PLL        : SI5345
2021-06-04 12:11:02.332 pdt NOTICE   | PLL configuration id   : pc059_10
2021-06-04 12:11:02.337 pdt NOTICE   | SFPs 0-7 enabled
2021-06-04 12:11:02.337 pdt NOTICE   | Reset done
2021-06-04 12:11:02.338 pdt NOTICE   | SFP input mux set to 0
Active sfp mux 0x0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

-----PC059 IO state----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x1  |
|   cdr_los   |  0x1  |
|   mmcm_ok   |  0x1  |
| mmcm_sticky |  0x0  |
|   pll_lol   |  0x1  |
|    pll_ok   |  0x0  |
|  pll_sticky |  0x0  |
|   sfp_los   |  0xff |
|   ucdr_lol  |  0x0  |
|   ucdr_los  |  0x0  |
|   usfp_flt  |  0x0  |
|   usfp_los  |  0x0  |
+-------------+-------+

Active sfp mux 0

PLL Clock frequency measurement:
PLL freq: 249.999622343
CDR freq: 791.949804753


PLL configuration id   : pc059_10
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |   0x0  |
| Device revision |   0x1  |
|   Part number   | 0x5345 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |  0x0  |
|        HOLD       |  0x1  |
|        LOL        |  0x1  |
|        LOS        |  0x5  |
|      LOSXAXB      |  0x0  |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |  0x7  |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |  0x0  |
| SMBUS_TIMEOUT_FLG |  0x0  |
|      SYSINCAL     |  0x0  |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |  0x0  |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

-bash-4.2$ pdtbutler io PROD_FANOUT_0 reset  ^C
-bash-4.2$ pdtbutler io PROD_FANOUT_0 reset --fanout-mode 1
Created device PROD_FANOUT_0
Design 'fanout' on board 'pc059' on carrier 'enclustra-a35'
Resetting PROD_FANOUT_0
local master - standalone mode
2021-06-04 12:11:29.609 pdt NOTICE   | PLL configuration file : /users/sp13109/rtt_testing_5_3_0/timing/tests/etc/clock/devel/PDTS_PC059_FANOUT.txt
2021-06-04 12:11:29.612 pdt NOTICE   | Configuring PLL        : SI5345
2021-06-04 12:11:31.932 pdt NOTICE   | PLL configuration id   : pc059_08
2021-06-04 12:11:31.937 pdt NOTICE   | SFPs 0-7 enabled
2021-06-04 12:11:31.937 pdt NOTICE   | Reset done
2021-06-04 12:11:31.938 pdt NOTICE   | SFP input mux set to 0
Active sfp mux 0x0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

-----PC059 IO state----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x1  |
|   cdr_los   |  0x1  |
|   mmcm_ok   |  0x1  |
| mmcm_sticky |  0x0  |
|   pll_lol   |  0x1  |
|    pll_ok   |  0x0  |
|  pll_sticky |  0x0  |
|   sfp_los   |  0xff |
|   ucdr_lol  |  0x0  |
|   ucdr_los  |  0x0  |
|   usfp_flt  |  0x0  |
|   usfp_los  |  0x0  |
+-------------+-------+

Active sfp mux 0

PLL Clock frequency measurement:
PLL freq: 249.999383924
CDR freq: 791.102226772


PLL configuration id   : pc059_08
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |   0x0  |
| Device revision |   0x1  |
|   Part number   | 0x5345 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |  0x0  |
|        HOLD       |  0x1  |
|        LOL        |  0x1  |
|        LOS        |  0x5  |
|      LOSXAXB      |  0x0  |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |  0x5  |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |  0x0  |
| SMBUS_TIMEOUT_FLG |  0x0  |
|      SYSINCAL     |  0x0  |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |  0x0  |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

-bash-4.2$ pdtbutler mst PROD_MASTER synctime
Created device PROD_MASTER
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |       tlu      |
| Board revision |    kTLURev1    |
|    Board UID   | 0x5410ecbba408 |
|  Carrier type  |  enclustra-a35 |
|   Design type  |    overlord    |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:11:55.790 pdt NOTICE   | Old timestamp: 0x12044a1f7b5abb5, Fri, 04 Jun 2021 12:11:54 +0000
2021-06-04 12:11:55.791 pdt NOTICE   | New timestamp: 0x12044a1f8f6a31a, Fri, 04 Jun 2021 12:11:55 +0000
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 synctime
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:12:07.274 pdt NOTICE   | Old timestamp: 0x696e8eb2, Thu, 01 Jan 1970 01:00:35 +0000
2021-06-04 12:12:07.274 pdt NOTICE   | New timestamp: 0x12044a21cb9e741, Fri, 04 Jun 2021 12:12:07 +0000
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 part 0 configure
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

Configuring partition 0
Trigger mask set to 0xf1
  Fake mask 0x1
  Phys mask 0xf
Partition 0 enabled and configured
-bash-4.2$ pdtbutler io EPT_0 reset
Created device EPT_0
Design 'endpoint' on board 'fmc' on carrier 'enclustra-a35'
Resetting EPT_0
2021-06-04 12:12:31.256 pdt NOTICE   | PLL configuration file : /users/sp13109/rtt_testing_5_3_0/timing/tests/etc/clock/devel/ENDPOINT-Si5344-50MHzRef.txt
2021-06-04 12:12:31.260 pdt NOTICE   | Configuring PLL        : SI5394
2021-06-04 12:12:34.309 pdt NOTICE   | PLL configuration id   : 20180917
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

------FMC IO state-----
+-------------+-------+
|   Register  | Value |
+-------------+-------+
|   cdr_lol   |  0x0  |
|   cdr_los   |  0x0  |
|   mmcm_ok   |  0x0  |
| mmcm_sticky |  0x0  |
|   sfp_flt   |  0x0  |
|   sfp_los   |  0x0  |
+-------------+-------+


PLL Clock frequency measurement:
PLL freq: 249.991039275
CDR freq: 249.994019507


PLL configuration id   : 20180917
-------PLL information------
+-----------------+--------+
|     Register    |  Value |
+-----------------+--------+
|   Device grade  |   0x0  |
| Device revision |   0x0  |
|   Part number   | 0x5394 |
+-----------------+--------+

----------PLL state----------
+-------------------+-------+
|      Register     | Value |
+-------------------+-------+
|      CAL_PLL      |  0x0  |
|        HOLD       |  0x0  |
|        LOL        |  0x0  |
|        LOS        |  0x0  |
|      LOSXAXB      |  0x0  |
|    LOSXAXB_FLG    |  0x1  |
|        OOF        |  0x0  |
|    OOF (sticky)   |  0xf  |
|   SMBUS_TIMEOUT   |  0x0  |
| SMBUS_TIMEOUT_FLG |  0x0  |
|      SYSINCAL     |  0x0  |
|    SYSINCAL_FLG   |  0x1  |
|      XAXB_ERR     |  0x0  |
|    XAXB_ERR_FLG   |  0x1  |
+-------------------+-------+

-bash-4.2$ pdtbutler ept EPT_0 0 enable -a 0x1
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Thu, 01 Jan 1970 01:00:00 +0000            |
| Timestamp (hex)  | 0x0                                        |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |          |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
> Endpoints 0 on in partition 0
-bash-4.2$ pdtbutler ept EPT_0 0 status
Created endpoint device EPT_0
-----------Hardware info----------
+----------------+---------------+
|   Board type   |      fmc      |
| Board revision |    kFMCRev3   |
|    Board UID   | 0x49162b675e3 |
|  Carrier type  | enclustra-a35 |
|   Design type  |    endpoint   |
+----------------+---------------+

+---------+
|    0    |
| 0x50100 |
+---------+
+------------------+--------------------------------------------+
|     Endpoint     |                     0                      |
+------------------+--------------------------------------------+
| State            | Waiting for phase adjustment command (0x6) |
| Partition        | 0                                          |
| Address          | 1                                          |
| Timestamp        | Fri, 04 Jun 2021 12:13:01 +0000            |
| Timestamp (hex)  | 0x12044a2bf081d50                          |
| EventCounter     | 0                                          |
| Buffer status    | OK                                         |
| Buffer occupancy | 0                                          |
+------------------+--------------------------------------------+

--- Endpoint state ---
+------------+----------+
|  Endpoint  |    0     |
+------------+----------+
| buf_err    |   0x0    |
| buf_warn   |   0x0    |
| cdelay     |   0x0    |
| ep_rdy     |   0x0    |
| ep_rsto    |   0x1    |
| ep_stat    |   0x6    |
| fdelay     |   0x0    |
| in_run     |   0x0    |
| in_spill   |   0x0    |
| sfp_tx_dis |   0x1    |
+------------+----------+

--- Command counters ---
+--------------+----------+
|   Endpoint   |    0     |
+--------------+----------+
| TimeSync     |    13    |
| Echo         |          |
| SpillStart   |          |
| SpillStop    |          |
| RunStart     |          |
| RunStop      |          |
| WibCalib     |          |
| SSPCalib     |          |
| FakeTrig0    |          |
| FakeTrig1    |          |
| FakeTrig2    |          |
| FakeTrig3    |          |
| BeamTrig     |          |
| NoBeamTrig   |          |
| ExtFakeTrig  |          |
| None         |          |
+--------------+----------+
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 part 0 status
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5

-- Master state---

Timestamp: 0x12044a2f81b285f -> Fri, 04 Jun 2021 12:13:20 +0000

--------------Cmd gen counters--------------
+------+-----------------+-----------------+
|      | Accept counters | Reject counters |
+------+-----------------+-----------------+
| Chan |  cnts  |   hex  |  cnts  |   hex  |
+------+--------+--------+--------+--------+
|  0x0 |    0   |   0x0  |    0   |   0x0  |
|  0x1 |    0   |   0x0  |    0   |   0x0  |
|  0x2 |    0   |   0x0  |    0   |   0x0  |
|  0x3 |    0   |   0x0  |    0   |   0x0  |
|  0x4 |    0   |   0x0  |    0   |   0x0  |
+------+--------+--------+--------+--------+


=> Partition 0

---------Controls--------
+---------------+-------+
|    Register   | Value |
+---------------+-------+
|     buf_en    |  0x0  |
|   frag_mask   |  0x0  |
|    part_en    |  0x1  |
|  rate_ctrl_en |  0x1  |
|    run_req    |  0x0  |
| spill_gate_en |  0x1  |
|  trig_ctr_rst |  0x0  |
|    trig_en    |  0x0  |
|   trig_mask   |  0xf1 |
+---------------+-------+

--------State-------
+----------+-------+
| Register | Value |
+----------+-------+
|  buf_err |  0x0  |
| buf_warn |  0x0  |
|  in_run  |  0x0  |
| in_spill |  0x0  |
|  part_up |  0x1  |
|  run_int |  0x0  |
+----------+-------+

Event Counter: 0
Buffer status: OK
Buffer occupancy: 0

+-------------+-----------------+-----------------+
|             | Accept counters | Reject counters |
+-------------+-----------------+-----------------+
|     Cmd     |  cnts  |   hex  |  cnts  |   hex  |
+-------------+--------+--------+--------+--------+
|   TimeSync  |   59   |  0x3b  |    0   |   0x0  |
|     Echo    |    0   |   0x0  |    0   |   0x0  |
|  SpillStart |    0   |   0x0  |    0   |   0x0  |
|  SpillStop  |    0   |   0x0  |    0   |   0x0  |
|   RunStart  |    0   |   0x0  |    0   |   0x0  |
|   RunStop   |    0   |   0x0  |    0   |   0x0  |
|   WibCalib  |    0   |   0x0  |    0   |   0x0  |
|   SSPCalib  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig0  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig1  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig2  |    0   |   0x0  |    0   |   0x0  |
|  FakeTrig3  |    0   |   0x0  |    0   |   0x0  |
|   BeamTrig  |    0   |   0x0  |    0   |   0x0  |
|  NoBeamTrig |    0   |   0x0  |    0   |   0x0  |
| ExtFakeTrig |    0   |   0x0  |    0   |   0x0  |
+-------------+--------+--------+--------+--------+



-bash-4.2$ pdtbutler mst PROD_FANOUT_0 align apply-delay 0x1 0x3 0x2 --force
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:17:18.501 pdt NOTICE   | Coarse delay 0x3 applied
2021-06-04 12:17:18.501 pdt NOTICE   | Fine delay   0x2 applied
2021-06-04 12:17:18.501 pdt NOTICE   | Phase delay  0x0 applied
-bash-4.2$ pdtbutler mst PROD_FANOUT_0 align measure-delay -m 0 1
Created device PROD_FANOUT_0
-----------Hardware info-----------
+----------------+----------------+
|   Board type   |      pc059     |
| Board revision |   kPC059Rev1   |
|    Board UID   | 0xd88039d9248e |
|  Carrier type  |  enclustra-a35 |
|   Design type  |     fanout     |
+----------------+----------------+

Master FW rev: 0x50100, partitions: 4, channels: 5
2021-06-04 12:17:21.239 pdt NOTICE   | SFP input mux set to 0
2021-06-04 12:17:21.440 pdt NOTICE   | Upstream endpoint reset, waiting for lock
2021-06-04 12:17:21.540 pdt NOTICE   | ept state: 0x8 ept ready: 0x1
2021-06-04 12:17:21.541 pdt NOTICE   | Endpoint locked: state= 0x8
2021-06-04 12:17:21.641 pdt NOTICE   | rx done: 1
Endpoint (adr: 1, mux: 0) RTT: 30
-bash-4.2$

-- SudarshanParamesvaran - 2021-06-02

Edit | Attach | Watch | Print version | History: r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r3 - 2021-06-08 - SudarshanParamesvaran
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CENF All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback