Skip to main navigation Skip to search Skip to main content

Automating Industrial Quality Assurance: A Zero-Shot MLLM Framework for Defect Detection and 3R

Research output: Journal contributionsConference article in journalResearchpeer-review

Abstract

In modern industrial production, particularly within the circular economy, automated defect detection is crucial for quality control and resource efficiency. Traditional inspection methods are often inconsistent and inefficient, while existing machine learning approaches are constrained by data scarcity, poor generalization, and a lack of interpretability. This paper proposes a zero-training visual inspection framework that leverages Multi-Modal Large Language Models (MLLMs) for automated defect detection and decision-making in industrial components, using starter motors as a case study. The framework integrates the zero-shot reasoning capabilities of an MLLM with an Elasticsearch-powered knowledge base to create an end-to-end automated system for "defect identification, standard matching, and decision-making." By processing images and relevant technical documentation, the system identifies defects and provides handling recommendations based on the 3R principles (Reuse, Remanufacture, Recycle) without requiring task-specific training. Experimental results on 584 starter motor samples show that our optimized system achieves an overall accuracy of 81.4% and an F1 score of 85.3%. This work validates the potential of MLLMs for industrial visual inspection and provides a replicable framework for advancing intelligent automation in manufacturing.

Original languageEnglish
JournalProcedia CIRP
Volume139
Pages (from-to)313-318
Number of pages6
ISSN2212-8271
DOIs
Publication statusPublished - 2026
Event13th CIRP Global Web Conference, CIRPe 2025 -
Duration: 16.10.202517.10.2025
Conference number: 13
https://www.cirpe2025.org

Bibliographical note

Publisher Copyright:
Copyright © 2025. Published by Elsevier B.V.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 8 - Decent Work and Economic Growth
    SDG 8 Decent Work and Economic Growth
  2. SDG 12 - Responsible Consumption and Production
    SDG 12 Responsible Consumption and Production

Research areas and keywords

  • 3R Decision-Making
  • Industrial Automation
  • Multi-Modal Large Language Model
  • Quality Assurance
  • Visual Defect Detection
  • Zero-Shot Learning
  • Mathematics

ASJC Scopus Subject Areas

  • Control and Systems Engineering
  • Industrial and Manufacturing Engineering

Fingerprint

Dive into the research topics of 'Automating Industrial Quality Assurance: A Zero-Shot MLLM Framework for Defect Detection and 3R'. Together they form a unique fingerprint.

Cite this