Publications Repository - Helmholtz-Zentrum Dresden-Rossendorf
1 PublicationReal-time Data Processing for Ultrafast X-Ray Computed Tomography using Modular CUDA based Pipelines
Windisch, D.; Kelling, J.; Juckeland, G.; Bieberle, A.
Abstract
In this article, a new version of the Real-time Image Stream Algorithms (RISA) data processing suite is introduced. It now features
online detector data acquisition, high-throughput data dumping and enhanced real-time data processing capabilities. The achieved
low-latency real-time data processing extends the application of ultrafast electron beam X-ray computed tomography (UFXCT)
scanners to real-time scanner control and process control. We implemented high performance data packet reception based on data
plane development kit (DPDK) and high-throughput data storing using both hierarchical data format version 5 (HDF5) as well
as the adaptable input/output system version 2 (ADIOS2). Furthermore, we extended RISA’s underlying pipelining framework to
support the fork-join paradigm. This allows for more complex workflows as it is necessary, e.g. for online data processing. Also,
the pipeline configuration is moved from compile-time to runtime, i.e. processing stages and their interconnections can now be
configured using a configuration file. In several benchmarks, RISA is profiled regarding data acquisition performance, data storage
throughput and overall processing latency. We found that using direct IO mode significantly improves data writing performance
on the local data storage. We could further prove that RISA is now capable of processing data from up to 768 detector channels
(3072MB/s) at 8000 fps on a single-GPU computer in real-time.
Keywords: real-time; data processing; parallel processing
Involved research facilities
- ROFEX
Related publications
-
Real-time Image Stream Algorithms: Core Library - libRISA_Core
ROBIS: 34604 is a supplement to this (Id 34743) publication -
Real-time Image Stream Algorithms - RISA
ROBIS: 34593 is a supplement to this (Id 34743) publication -
Generic Library for Asynchronous Data Operations and Streaming - GLADOS
ROBIS: 34605 is a supplement to this (Id 34743) publication -
Benchmark results for real-time UFXCT data processing
ROBIS: 34747 HZDR-primary research data are used by this (Id 34743) publication
-
Computer Physics Communications 287(2023), 108719
DOI: 10.1016/j.cpc.2023.108719
Cited 2 times in Scopus
Permalink: https://www.hzdr.de/publications/Publ-34743
Years: 2023 2022 2021 2020 2019 2018 2017 2016 2015