Table of Content

Open Access iconOpen Access



A Reinforcement Learning System for Fault Detection and Diagnosis in Mechatronic Systems

Wanxin Zhang1,*, Jihong Zhu2

1 School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510006, China.
2 Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China.

* Corresponding Author: Wanxin Zhang. Email: email

(This article belongs to this Special Issue: Machine Learning based Methods for Mechanics)

Computer Modeling in Engineering & Sciences 2020, 124(3), 1119-1130.


With the increasing demand for the automation of operations and processes in mechatronic systems, fault detection and diagnosis has become a major topic to guarantee the process performance. There exist numerous studies on the topic of applying artificial intelligence methods for fault detection and diagnosis. However, much of the focus has been given on the detection of faults. In terms of the diagnosis of faults, on one hand, assumptions are required, which restricts the diagnosis range. On the other hand, different faults with similar symptoms cannot be distinguished, especially when the model is not trained by plenty of data. In this work, we proposed a reinforcement learning system for fault detection and diagnosis. No assumption is required. Feature exaction is first made. Then with the features as the states of the environment, the agent directly interacts with the environment. Optimal policy, which determines the exact category, size and location of the fault, is obtained by updating Q values. The method takes advantage of expert knowledge. When the features are unclear, action will be made to get more information from the new state for further determination. We create recurrent neural network with the long short-term memory architecture to approximate Q values. The application on a motor is discussed. The experimental results validate that the proposed method demonstrates a significant improvement compared with existing state-of-the-art methods of fault detection and diagnosis.


Cite This Article

Zhang, W., Zhu, J. (2020). A Reinforcement Learning System for Fault Detection and Diagnosis in Mechatronic Systems. CMES-Computer Modeling in Engineering & Sciences, 124(3), 1119–1130.

cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 3145


  • 3598


  • 0


Share Link