CERN Accelerating science

Talk
Title Persistent Memory based Key-Value Store for Data Acquisition Systems
Video
If you experience any problem watching the video, click the download button below
Download Embed
Mp4:Medium
(1000 kbps)
High
(4000 kbps)
More..
Copy-paste this code into your page:
Copy-paste this code into your page to include both slides and lecture:
Author(s) Maciejewski, Maciej (speaker) (Intel Corporation)
Corporate author(s) CERN. Geneva
Imprint 2019-09-25. - 0:30:47.
Series (other events or meetings)
(IXPUG 2019 Annual Conference at CERN)
Lecture note on 2019-09-25T15:45:00
Subject category other events or meetings
Abstract Data acquisition (DAQ) systems are a key component for successful data taking in any experiment. The DAQ is a complex distributed computing system and coordinates all operations, from the data selection stage to long-term storage. With increasing throughput demand, new ways to handle distributed data are being explored. One of the approaches is to use specialized Key-Value store, that would be able to handle data rates bound to network interfaces only (100-400 Gbps), while providing usage flexibility with specialized APIs designed for DAQ. We shall present how combining new storage technologies based on Intel Optane DC Persistent Memory and NVMe drives, with specialized design of Key-Value store can help achieve throughput goals, and provide operational flexibility and safety.
Copyright/License © 2019-2024 CERN
Submitted by kristina.ulrika.gunne@cern.ch

 


 Record created 2019-10-08, last modified 2022-11-02


External links:
Download fulltextTalk details
Download fulltextEvent details