Redis-based streaming architecture for accelerator beam instrumentation DAQ systems

WEAG002
24 Sept 2025, 09:15
15m
Grand Ballroom (Palmer House Hilton Chicago)

Grand Ballroom

Palmer House Hilton Chicago

17 East Monroe Street Chicago, IL 60603, United States of America
Contributed Oral Presentation MC10: Software Architecture & Technology Evolution WEAG MC10 Software Architecture and Technology Evolution

Speaker

Shreya Joshi (Fermi National Accelerator Laboratory)

Description

The Fermilab Acceleraor Division, Beam Instrumentation Department, is always adopting modern and current software methodologies for complex DAQ architectures. This paper highlights the Redis Adapter (RA) as the key software component enabling high performance, modular communication between digitizers and distributed control systems by leveraging Redis and containerization. The RA provides a unified, efficient interface between Redis based data streams and consumer systems. In the legacy architecture, digitized data flowed through the custom, UDP based Distributed Data Communication Protocol in the middle layer. In the current system, DDCP remains the ingestion path, while the RA serves as the decoupling layer. The proposed system replaces old VME digitizers with a SOM-based digitizer that communicates with Redis using the RA. The RA acts as both a performance-critical bridge and a protocol-agnostic adapter, ensuring compatibility with legacy control frameworks while enabling future scalability and modularity. This restructuring of the middle layer also helps the system achieve high throughput, reduce latency, and simplify the data path. Finally, we will demonstrate how RA is utilized in our two core products to deliver both legacy compatibility and future flexibility.

Author

Shreya Joshi (Fermi National Accelerator Laboratory)

Co-author

Derek Steinkamp (Fermi National Accelerator Laboratory)

Presentation materials

There are no materials yet.