Research on Multi-Sensor Fusion Fault Diagnosis Method Based on Spatiotemporal Attention Mechanism

Authors

  • Tianrui Chu
  • Zhixuan Wang

DOI:

https://doi.org/10.62051/ijcsit.v4n2.25

Keywords:

Multi-sensor fusion, Fault diagnosis, One-dimensional convolutional neural network, Spatio-temporal attention mechanism

Abstract

As industrial systems become increasingly complex, real-time monitoring and intelligent management of industrial equipment have become imperative. However, the limitations in coverage and accuracy of single sensors make it challenging to comprehensively characterize the operational state of equipment, leading to reduced system reliability and increased pressures on data transmission and storage. To address these challenges, this study presents a novel fault diagnosis method based on multi-sensor fusion using a spatio-temporal attention mechanism. Initially, one-dimensional convolutional neural networks (1D-CNN) are employed to extract features from raw signals, effectively capturing local characteristics and ensuring the integrity and validity of fault signals. Subsequently, the spatiotemporal attention mechanism adjusts the feature weights based on the temporal and spatial correlations of different sensors, as well as their respective importance, thereby capturing the spatio-temporal dependencies across multiple sensors and enhancing the efficacy of information fusion. Finally, the proposed method is validated through experiments on a nickel flash smelting furnace system. The results demonstrate that the method achieves a fault diagnosis accuracy exceeding 97.78%, significantly enhancing fault detection and decision-making performance.

Downloads

Download data is not yet available.

References

[1] Xiao X, Li C, He H, et al. Rotating machinery fault diagnosis method based on multi-level fusion framework of multi-sensor information. Information Fusion,Vol 113, pp. 102621, 2025.

[2] Zhang Q, Wei Y, Han Z, et al. Multimodal fusion on low-quality data: A comprehensive survey. arXiv preprint arXiv:240418947,Vol, 2024.

[3] Yang J, Gao T, Zhang H, et al. A multi-sensor fault diagnosis method for rotating machinery based on improved fuzzy support fusion and self-normalized spatio-temporal network. Measurement Science and Technology,Vol 34, pp. 125112, 2023.

[4] Zeng N, Wu P, Wang Z, et al. A small-sized object detection oriented multi-scale feature fusion approach with application to defect detection. IEEE Transactions on Instrumentation and Measurement,Vol 71, pp. 1-14, 2022.

[5] Wang J, Fu P, Zhang L, et al. Multilevel information fusion for induction motor fault diagnosis. IEEE/ASME Transactions on Mechatronics,Vol 24, pp. 2139-50, 2019.

[6] Cui X, Wu Y, Zhang X, et al. A novel fault diagnosis method for rotor-bearing system based on instantaneous orbit fusion feature image and deep convolutional neural network. IEEE/ASME Transactions on Mechatronics,Vol 28, pp. 1013-24, 2022.

[7] Yang C, Liu J, Zhou K, et al. An improved multi-channel graph convolutional network and its applications for rotating machinery diagnosis. Measurement,Vol 190, pp. 110720, 2022.

[8] Xing Z, Liu Y, Wang Q, et al. Multi-sensor signals with parallel attention convolutional neural network for bearing fault diagnosis. AIP Advances,Vol 12, 2022.

[9] Xie Y, Zhang T. Fault diagnosis for rotating machinery based on convolutional neural network and empirical mode decomposition. Shock and Vibration,Vol 2017, pp. 3084197, 2017.

[10] Gong W, Chen H, Zhang Z, et al. A novel deep learning method for intelligent fault diagnosis of rotating machinery based on improved CNN-SVM and multichannel data fusion. Sensors,Vol 19, pp. 1693, 2019.

[11] Chen Z, Li W. Multisensor feature fusion for bearing fault diagnosis using sparse autoencoder and deep belief network. IEEE Transactions on instrumentation and measurement,Vol 66, pp. 1693-702, 2017.

[12] Hao S, Ge F-X, Li Y, et al. Multisensor bearing fault diagnosis based on one-dimensional convolutional long short-term memory networks. Measurement,Vol 159, pp. 107802, 2020.

[13] Jiang J, Li H, Mao Z, et al. A digital twin auxiliary approach based on adaptive sparse attention network for diesel engine fault diagnosis. Scientific reports,Vol 12, pp. 675, 2022.

[14] Plakias S, Boutalis Y S. Fault detection and identification of rolling element bearings with Attentive Dense CNN. Neurocomputing,Vol 405, pp. 208-17, 2020.

[15] Huang P, Wang Q, Chen H, et al. Gas Sensor Array Fault Diagnosis Based on Multi-Dimensional Fusion, an Attention Mechanism, and Multi-Task Learning. Sensors,Vol 23, pp. 7836, 2023.

[16] Miao Z, Feng W, Long Z, et al. Motor Fault Diagnosis Using Attention-Based Multisensor Feature Fusion. Energies,Vol 17, pp. 4053, 2024.

Downloads

Published

10-10-2024

Issue

Section

Articles

How to Cite

Chu, T., & Wang, Z. (2024). Research on Multi-Sensor Fusion Fault Diagnosis Method Based on Spatiotemporal Attention Mechanism. International Journal of Computer Science and Information Technology, 4(2), 189-203. https://doi.org/10.62051/ijcsit.v4n2.25