Automated Defect Report Generation for Enhanced Industrial Quality Control

Authors

  • Jiayuan Xie Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China
  • Zhiping Zhou School of Software Engineering, South China University of Technology, Guangzhou, China
  • Zihan Wu School of Software Engineering, South China University of Technology, Guangzhou, China
  • Xinting Zhang Department of Mathematics, The University of Hong Kong, Hong Kong SAR, China
  • Jiexin Wang School of Software Engineering, South China University of Technology, Guangzhou, China Key Laboratory of Big Data and Intelligent Robot (SCUT), MOE of China
  • Yi Cai School of Software Engineering, South China University of Technology, Guangzhou, China Key Laboratory of Big Data and Intelligent Robot (SCUT), MOE of China
  • Qing Li Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China

DOI:

https://doi.org/10.1609/aaai.v38i17.29900

Keywords:

NLP: Generation, APP: Other Applications, CV: Applications, NLP: Applications

Abstract

Defect detection is a pivotal aspect ensuring product quality and production efficiency in industrial manufacturing. Existing studies on defect detection predominantly focus on locating defects through bounding boxes and classifying defect types. However, their methods can only provide limited information and fail to meet the requirements for further processing after detecting defects. To this end, we propose a novel task called defect detection report generation, which aims to provide more comprehensive and informative insights into detected defects in the form of text reports. For this task, we propose some new datasets, which contain 16 different materials and each defect contains a detailed report of human constructs. In addition, we propose a knowledge-aware report generation model as a baseline for future research, which aims to incorporate additional knowledge to generate detailed analysis and subsequent processing related to defect in images. By constructing defect report datasets and proposing corresponding baselines, we chart new directions for future research and practical applications of this task.

Published

2024-03-24

How to Cite

Xie, J., Zhou, Z., Wu, Z., Zhang, X., Wang, J., Cai, Y., & Li, Q. (2024). Automated Defect Report Generation for Enhanced Industrial Quality Control. Proceedings of the AAAI Conference on Artificial Intelligence, 38(17), 19306–19314. https://doi.org/10.1609/aaai.v38i17.29900

Issue

Section

AAAI Technical Track on Natural Language Processing II