9–13 Sept 2024
Wanda Realm Beijing
Asia/Shanghai timezone
Registration Deadline: August 9 (23:59 UTC+8), 2024; Paper Submission Deadline: September 5 (23:59 UTC+8), 2024

A generic distributed stream-processing framework for neutron spectrometer data process based on the asynchronous aggregation network

WEP70
11 Sept 2024, 14:20
1h 30m
China Hall 3

China Hall 3

Poster Presentation MC7: Data Acquisition and Processing Platforms WEP: Wednesday Poster Session

Speaker

haiyun teng (Chinese Academy of Sciences)

Description

In the recent project of China Spallation Neutron Source (CSNS), a new designed distributed stream-processing framework is applied as the fundamental schema of data process system on user cooperative instruments. It is constructed with the open-source Apache Kafka software, which aims to aggregate the big data for manipulate sharing, and also with an synchronous trigger&tagging system, which provide synchronous mark for verious data sources. Correlation could be identified among different measurements and subsystems to perform asynchronous manipulation,while quasi real-time characteristics is another profit from the stream-processing framework. Efficiency and adaptability of this technical framework has been verified during the operation of constructed user cooperative instruments in CSNS. An increasing number of data-processing functions and experiment methods have got benefit from it.

I have read and accept the Privacy Policy Statement Yes

Primary author

Jiajie Li (Chinese Academy of Sciences)

Co-authors

Jian Zhuang (Institute of High Energy Physics, Chinese Academy of Sciences) haiyun teng (Chinese Academy of Sciences)

Presentation materials

There are no materials yet.