Survey on Foundation Models for Prognostics and Health Management in Industrial Cyber-Physical Systems (2312.06261v3)
Abstract: Industrial Cyber-Physical Systems (ICPS) integrate the disciplines of computer science, communication technology, and engineering, and have emerged as integral components of contemporary manufacturing and industries. However, ICPS encounters various challenges in long-term operation, including equipment failures, performance degradation, and security threats. To achieve efficient maintenance and management, prognostics and health management (PHM) finds widespread application in ICPS for critical tasks, including failure prediction, health monitoring, and maintenance decision-making. The emergence of large-scale foundation models (LFMs) like BERT and GPT signifies a significant advancement in AI technology, and ChatGPT stands as a remarkable accomplishment within this research paradigm, harboring potential for General Artificial Intelligence. Considering the ongoing enhancement in data acquisition technology and data processing capability, LFMs are anticipated to assume a crucial role in the PHM domain of ICPS. However, at present, a consensus is lacking regarding the application of LFMs to PHM in ICPS, necessitating systematic reviews and roadmaps to elucidate future directions. To bridge this gap, this paper elucidates the key components and recent advances in the underlying model.A comprehensive examination and comprehension of the latest advances in grand modeling for PHM in ICPS can offer valuable references for decision makers and researchers in the industrial field while facilitating further enhancements in the reliability, availability, and safety of ICPS.
- D. Hoang, H. Kang, “A survey on deep learning based bearing fault diagnosis,” in Neurocomputing, vol. 335, p. 327-335, 2019.
- J. Huang, H. Wang, et al, “ERNIE-GeoL: A Geography-and-Language Pre-trained Model and its Applications in Baidu Maps,” in arXiv:2203.09127, 2023.
- C. Huang, X. Yin, etal., “An Enhanced Deep Learning-Based Fusion Prognostic Method for RUL Prediction,” in IEEE Trans. Reliab., vol. 69, no. 3, p. 1097-1109, 2020.
- T. Mikolov, I. Sutskever, et al, “Distributed representations of words and phrases and their compositionality,” in Proc. 27th Int. Conf. Neural Inf. Process. Syst., vol. 26, p. 3111–3119, 2013.
- M. Andrew, V. Quoc, “Semi-supervised sequence learning,” in Proc. 29th Int. Conf. Neural Inf. Process. Syst., vol. 2, p. 3079–3087, 2015.
- OpenAI, “Gpt-4 technical report”, in OpenAI, 2023.
- E. Ruijters, M. Stoelinga, “Fault tree analysis: A survey of the state-of-the-art in modeling, analysis and tools,” in Comput. Sci. Rev., vol. 15, p. 29-62, 2015.
- H. Jun, D. Kim, “A Bayesian network-based approach for fault analysis,” in Expert Syst. Appl., vol. 81, p. 332-348, 2017.
- X. Liu, J. Tang, “Network representation learning: A macro and micro view,” in AI Open, vol. 2, p. 43-64, 2021.
- Q. Zhao, “Construction and application of fault knowledge graph for numerical control equipment,” in Aerospace Manuf. Tech., vol. 63, p. 96-102, 2020.
- G. Bayar, T. Bilir, “A novel study for the estimation of crack propagation in concrete using machine learning algorithms,” in Constr. Build. Mater., vol. 215, p. 670-685, 2019.
- H. Huang, N. Baddour, “Bearing vibration data collected under time-varying rotational speed conditions,” in Data in Brief, vol. 21, p. 1745-1749, 2018.
- W.A. Smith, R.B. Randall, “Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study,” in Mech. Syst. Signal Pr., vol. 64-65, p. 100-131, 2015.
- S. Vollert, A. Theissler, “Challenges of machine learning-based RUL prognosis: A review on NASA’s C-MAPSS data set,” in Proc. 26th IEEE Conf. Emerg. Techn. Fact. Automa., p. 1-8, 2021.
- H. Zhang, Y. Shen, “Template-based prediction of protein structure with deep learning,” in BMC Genomics, vol. 21, 2020.
- Y. Zhang, K. Feng, et al, “Dynamic Model-Assisted Bearing Remaining Useful Life Prediction Using the Cross-Domain Transformer Network,” in IEEE ASME Trans. Mechatron., vol.28, no.2, pp.1070-1080, 2023.
- Z. Dai “Chemical process fault diagnosis based on Bayesian nets and knowledge mapping,” in Dalian University of Technology, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.