Editorial: Beyond the overlay: generative AI, vision language models and skills transfer in maintenance

Ask a maintenance engineer to “replace the seal.” A quiet chain of interpretation begins. Which seal? In which orientation? To what torque? In what order? For decades, experience filled these gaps. Paper documented the rest. Augmented reality (AR) promised to move that information into the technician's line of sight. In several well-defined maintenance and repair settings, it has delivered measurable benefits.The harder question for this journal is now different. What does AR become when generative artificial intelligence can author, interpret and reason about the work itself?This editorial argues that the next research frontier is not AR display technology alone, but the generation, grounding, verification, governance and learning effects of AI-mediated maintenance guidance. The central question is whether AR systems can produce correct guidance, connect it to the physical asset, verify it before action and leave the technician more capable over time.AR in maintenance has moved beyond speculation in several task settings. Overlays can register instructions onto the physical asset. Headsets can keep the hands free. Remote experts can see what the maintenance worker sees. Guided procedures can generate digital records for audit.The evidence base has also matured. Eversberg and Lambrecht (2023) studied turbine blade repair with ten experienced metalworkers. Using an AR assistance system, the workers completed a familiar repair task 21% faster. Their perceived workload fell by 26%. Every participant preferred the system to paper. Earlier comparative work reached compatible conclusions across different media (Funk et al., 2016).These results are important, but they should be placed in perspective. The demonstration that AR can help under suitable task and deployment conditions should no longer be treated as the central research question. The frontier has shifted toward scalable authoring, contextual interpretation, verification, human learning and organizational integration. This is consistent with systematic review evidence showing that AR in maintenance has progressed substantially, but that industrial deployment remains constrained by fragmentation in hardware, software, tracking, interaction design and evaluation methods (Palmarini et al., 2018).The constraint that has limited AR maintenance at scale is content. Every asset needs spatially registered instructions. Every engineering change demands new ones. When the underlying model changes, the AR content quietly goes stale. The dominant cost was never only the headset. It was the authoring labor. It was also the burden of keeping thousands of procedures aligned with engineering reality.Generative AI addresses this problem first. This is its least speculative contribution. Emerging commercial platforms are beginning to generate AR work instructions from CAD models and process definitions (Druet, 2025). However, independent evidence on accuracy, maintainability and lifecycle cost remains limited. Computer vision pushes this further. Systems that recognize objects and assembly states can detect what the technician has actually done (Malta et al., 2023). They can advance steps automatically. They can flag an action that did not produce the expected result.Two distinct forms of generative capability should be separated. The first is offline authoring, where AI converts engineering documents, CAD models and static process definitions into AR-ready instructions. This supports maintainability and couples the content lifecycle directly to the engineering lifecycle. The second is online guidance, where AI dynamically interprets the live scene and adapts instructions during execution. This form is not only more powerful but also more safety critical.This structural shift matters. AR moves from a bespoke deployment to a maintainable system. For a maintenance organization, this is decisive. It is the difference between a pilot that impresses on one asset and a program that survives a large equipment register. The research question changes accordingly. It is no longer whether we can overlay a step. It is whether we can generate, validate and version that step automatically.An overlay is not understanding. The deeper frontier is interpretation. The system must read an abstract instruction and ground it in the scene in front of the worker. It must resolve “tighten the bolt” into which bolt, in what sequence, on this assembly.Early work paired large language models with AR for exactly this purpose. Xu et al. (2024) converted textual maintenance instructions into executable, context-specific actions. They targeted the ambiguity that arises when abstract text must become precise motion. More recent systems generate the visual guidance itself. Zhao et al. (2025) combined language models with vision models to produce situated, visually rich guidance on demand. No author needs to place each cue in advance. Vision language models enable content that adapts to the scene in real time (Behravan and Gračanin, 2024). The broader trajectory points the same way. Generative AI is meeting extended reality. The result is interfaces that interpret ambiguous instructions, parse physical scenes and generate three-dimensional content (Zhu et al., 2026).For maintenance, the implication is concrete. In such systems, the AR interface becomes the visible layer of a broader reasoning pipeline. Language models interpret instructions. Vision models ground them in the physical scene. Verification modules assess whether proposed actions are safe and correct. AR therefore begins to support task reasoning rather than merely task display. It can recognize an unexpected condition. It can suggest a revised sequence. It can explain the basis for that suggestion. This is also where AR meets the wider shift in maintenance toward agentic and foundation models. Those systems increasingly act as copilots to human experts (Lukens et al., 2024).The move from display to reasoning changes the risk profile. In safety-critical maintenance, an incorrect instruction is not merely a usability defect. It can create asset damage, production loss, environmental risk or injury. A vision language model that confidently misidentifies a component in a safety-critical task is worse than no guidance.AI-generated guidance therefore requires an independent verification layer. That verifier could draw on a knowledge graph, a numerical solver, a rules engine, a validated procedure library or live digital twin state. The important point is independence. The model that generates a step should not be the only authority that approves it.Provenance is equally important. Procedures authored or adapted by AI need traceability to an engineering source of truth. They need model version records, approval workflows, technician override mechanisms and audit trails. In regulated assets, the key question is not only whether the instruction is useful. It is who approved it, based on what evidence, under which asset conditions and with what accountability.Trust must also be calibrated. Technicians should neither ignore useful guidance nor comply blindly with uncertain guidance. Systems should disclose uncertainty, identify the source of recommendations and make clear when an instruction is generated, retrieved, modified or verified. Trust in AI-mediated AR should be earned through evidence, not assumed through interface design.The most important long-term implication concerns the workforce. The maintenance labor force is aging and thinning. Tacit knowledge leaves faster than it can be captured. This concern recurs across the prognostics literature as much as in AR (Lukens et al., 2024). Reframed this way, AR becomes a training instrument. Adaptive AR tutoring can tailor guidance to the individual learner. It can shorten the path to proficiency (Huang et al., 2021). In some settings, structured AR tutoring may reduce dependence on prolonged shadowing.A serious editorial must hold the counterweight. The evidence on cognitive load is mixed and strongly task-dependent. Kolla et al. (2021) found AR superior to paper in errors and usability. Yet they found no significant difference in completion time or workload. Benefits often concentrate in complex tasks and can vanish on simple ones.There is also a subtler risk that should concern anyone serious about skills transfer: deskilling driven by automation complacency. A technician who passively follows step-by-step overlays may never build a durable mental model of the machinery. If guidance routinely substitutes for spatial and mechanical reasoning, the worker becomes highly capable during assisted execution, yet less capable over time when left unaided. This represents a decoupling of immediate task performance from long-term diagnostic capability (Parasuraman and Riley, 1997).The design imperative follows. AR for maintenance should build understanding, not merely secure compliance. A system that improves immediate task completion while weakening long-term diagnostic judgment is a poor organizational investment. Future studies should therefore measure not only assisted performance but also unaided retention, transfer to unfamiliar faults and the technician's willingness and ability to challenge incomplete or incorrect AI guidance.Much of the headline benefit circulates as vendor benchmarks rather than controlled science. The peer-reviewed picture is more nuanced. Some trials show that AR can reduce errors, but benefits depend heavily on display technology, task complexity and operator expertise (Funk et al., 2016). These moderators are too often left uncontrolled in empirical designs.This journal can help raise the standard. We invite properly powered comparative trials. We ask authors to stratify by task complexity and operator expertise and to employ standardized error taxonomies rather than ad hoc error counts. Crucially, the generative era introduces a comparison the field has not yet made rigorously: guidance authored by AI against guidance authored by humans, held to the exact same evaluative standard.Because skills transfer is the ultimate claim, outcome measures must include long-term retention and transfer. They cannot stop at completion time measured during active assistance. Researchers should ask whether a technician can perform the task later without guidance, diagnose a variant fault, detect an incorrect instruction and explain the engineering rationale behind their maintenance actions.Transitioning from basic visual overlays to generative reasoning introduces deep socio-technical hurdles. Beyond structural and algorithmic verification, industrial plants impose harsh operating constraints. These include edge inference requirements, latency penalties, unreliable connectivity, device ruggedness and the physical ergonomics of prolonged headset use during long shifts. In such settings, verification cannot be treated as an optional safeguard. Beneath these constraints sits a fundamental governance question: who validates an instruction authored by AI and against what reference and asset state?To address these challenges, this journal proposes an organized research agenda for prospective contributors, structured around four core clusters.The overlay was the first phase of maintenance AR; the questions ahead are more consequential. Can automated guidance be shown to be correct? Can it be grounded reliably in complex physical environments? Can it be verified before it reaches a worker's line of sight? Most importantly, can it leave that worker more capable, not merely more compliant?These questions will shape the next decade of industrial AR. This journal welcomes the empirical trials, system architectures, human factors studies and field deployments that will answer them.LLMs were used for English editing and searching for some suitable references.

Authors

Publication Details

Journal
Journal of Quality in Maintenance Engineering
Published
2026-07-02
DOI
https://doi.org/10.1108/jqme-08-2026-165
Primary Topic
Augmented Reality Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Editorial: Beyond the overlay: generative AI, vision language models and skills transfer in maintenance

Mohamed Ben-Daya
Journal of Quality in Maintenance Engineering
Augmented Reality Applications
article

Editorial: Beyond the overlay: generative AI, vision language models and skills transfer in maintenance

Mohamed Ben-Daya
article en

Abstract

Ask a maintenance engineer to “replace the seal.” A quiet chain of interpretation begins. Which seal? In which orientation? To what torque? In what order? For decades, experience filled these gaps. Paper documented the rest. Augmented reality (AR) promised to move that information into the technician's line of sight. In several well-defined maintenance and repair settings, it has delivered measurable benefits.The harder question for this journal is now different. What does AR become when generative artificial intelligence can author, interpret and reason about the work itself?This editorial argues that the next research frontier is not AR display technology alone, but the generation, grounding, verification, governance and learning effects of AI-mediated maintenance guidance. The central question is whether AR systems can produce correct guidance, connect it to the physical asset, verify it before action and leave the technician more capable over time.AR in maintenance has moved beyond speculation in several task settings. Overlays can register instructions onto the physical asset. Headsets can keep the hands free. Remote experts can see what the maintenance worker sees. Guided procedures can generate digital records for audit.The evidence base has also matured. Eversberg and Lambrecht (2023) studied turbine blade repair with ten experienced metalworkers. Using an AR assistance system, the workers completed a familiar repair task 21% faster. Their perceived workload fell by 26%. Every participant preferred the system to paper. Earlier comparative work reached compatible conclusions across different media (Funk et al., 2016).These results are important, but they should be placed in perspective. The demonstration that AR can help under suitable task and deployment conditions should no longer be treated as the central research question. The frontier has shifted toward scalable authoring, contextual interpretation, verification, human learning and organizational integration. This is consistent with systematic review evidence showing that AR in maintenance has progressed substantially, but that industrial deployment remains constrained by fragmentation in hardware, software, tracking, interaction design and evaluation methods (Palmarini et al., 2018).The constraint that has limited AR maintenance at scale is content. Every asset needs spatially registered instructions. Every engineering change demands new ones. When the underlying model changes, the AR content quietly goes stale. The dominant cost was never only the headset. It was the authoring labor. It was also the burden of keeping thousands of procedures aligned with engineering reality.Generative AI addresses this problem first. This is its least speculative contribution. Emerging commercial platforms are beginning to generate AR work instructions from CAD models and process definitions (Druet, 2025). However, independent evidence on accuracy, maintainability and lifecycle cost remains limited. Computer vision pushes this further. Systems that recognize objects and assembly states can detect what the technician has actually done (Malta et al., 2023). They can advance steps automatically. They can flag an action that did not produce the expected result.Two distinct forms of generative capability should be separated. The first is offline authoring, where AI converts engineering documents, CAD models and static process definitions into AR-ready instructions. This supports maintainability and couples the content lifecycle directly to the engineering lifecycle. The second is online guidance, where AI dynamically interprets the live scene and adapts instructions during execution. This form is not only more powerful but also more safety critical.This structural shift matters. AR moves from a bespoke deployment to a maintainable system. For a maintenance organization, this is decisive. It is the difference between a pilot that impresses on one asset and a program that survives a large equipment register. The research question changes accordingly. It is no longer whether we can overlay a step. It is whether we can generate, validate and version that step automatically.An overlay is not understanding. The deeper frontier is interpretation. The system must read an abstract instruction and ground it in the scene in front of the worker. It must resolve “tighten the bolt” into which bolt, in what sequence, on this assembly.Early work paired large language models with AR for exactly this purpose. Xu et al. (2024) converted textual maintenance instructions into executable, context-specific actions. They targeted the ambiguity that arises when abstract text must become precise motion. More recent systems generate the visual guidance itself. Zhao et al. (2025) combined language models with vision models to produce situated, visually rich guidance on demand. No author needs to place each cue in advance. Vision language models enable content that adapts to the scene in real time (Behravan and Gračanin, 2024). The broader trajectory points the same way. Generative AI is meeting extended reality. The result is interfaces that interpret ambiguous instructions, parse physical scenes and generate three-dimensional content (Zhu et al., 2026).For maintenance, the implication is concrete. In such systems, the AR interface becomes the visible layer of a broader reasoning pipeline. Language models interpret instructions. Vision models ground them in the physical scene. Verification modules assess whether proposed actions are safe and correct. AR therefore begins to support task reasoning rather than merely task display. It can recognize an unexpected condition. It can suggest a revised sequence. It can explain the basis for that suggestion. This is also where AR meets the wider shift in maintenance toward agentic and foundation models. Those systems increasingly act as copilots to human experts (Lukens et al., 2024).The move from display to reasoning changes the risk profile. In safety-critical maintenance, an incorrect instruction is not merely a usability defect. It can create asset damage, production loss, environmental risk or injury. A vision language model that confidently misidentifies a component in a safety-critical task is worse than no guidance.AI-generated guidance therefore requires an independent verification layer. That verifier could draw on a knowledge graph, a numerical solver, a rules engine, a validated procedure library or live digital twin state. The important point is independence. The model that generates a step should not be the only authority that approves it.Provenance is equally important. Procedures authored or adapted by AI need traceability to an engineering source of truth. They need model version records, approval workflows, technician override mechanisms and audit trails. In regulated assets, the key question is not only whether the instruction is useful. It is who approved it, based on what evidence, under which asset conditions and with what accountability.Trust must also be calibrated. Technicians should neither ignore useful guidance nor comply blindly with uncertain guidance. Systems should disclose uncertainty, identify the source of recommendations and make clear when an instruction is generated, retrieved, modified or verified. Trust in AI-mediated AR should be earned through evidence, not assumed through interface design.The most important long-term implication concerns the workforce. The maintenance labor force is aging and thinning. Tacit knowledge leaves faster than it can be captured. This concern recurs across the prognostics literature as much as in AR (Lukens et al., 2024). Reframed this way, AR becomes a training instrument. Adaptive AR tutoring can tailor guidance to the individual learner. It can shorten the path to proficiency (Huang et al., 2021). In some settings, structured AR tutoring may reduce dependence on prolonged shadowing.A serious editorial must hold the counterweight. The evidence on cognitive load is mixed and strongly task-dependent. Kolla et al. (2021) found AR superior to paper in errors and usability. Yet they found no significant difference in completion time or workload. Benefits often concentrate in complex tasks and can vanish on simple ones.There is also a subtler risk that should concern anyone serious about skills transfer: deskilling driven by automation complacency. A technician who passively follows step-by-step overlays may never build a durable mental model of the machinery. If guidance routinely substitutes for spatial and mechanical reasoning, the worker becomes highly capable during assisted execution, yet less capable over time when left unaided. This represents a decoupling of immediate task performance from long-term diagnostic capability (Parasuraman and Riley, 1997).The design imperative follows. AR for maintenance should build understanding, not merely secure compliance. A system that improves immediate task completion while weakening long-term diagnostic judgment is a poor organizational investment. Future studies should therefore measure not only assisted performance but also unaided retention, transfer to unfamiliar faults and the technician's willingness and ability to challenge incomplete or incorrect AI guidance.Much of the headline benefit circulates as vendor benchmarks rather than controlled science. The peer-reviewed picture is more nuanced. Some trials show that AR can reduce errors, but benefits depend heavily on display technology, task complexity and operator expertise (Funk et al., 2016). These moderators are too often left uncontrolled in empirical designs.This journal can help raise the standard. We invite properly powered comparative trials. We ask authors to stratify by task complexity and operator expertise and to employ standardized error taxonomies rather than ad hoc error counts. Crucially, the generative era introduces a comparison the field has not yet made rigorously: guidance authored by AI against guidance authored by humans, held to the exact same evaluative standard.Because skills transfer is the ultimate claim, outcome measures must include long-term retention and transfer. They cannot stop at completion time measured during active assistance. Researchers should ask whether a technician can perform the task later without guidance, diagnose a variant fault, detect an incorrect instruction and explain the engineering rationale behind their maintenance actions.Transitioning from basic visual overlays to generative reasoning introduces deep socio-technical hurdles. Beyond structural and algorithmic verification, industrial plants impose harsh operating constraints. These include edge inference requirements, latency penalties, unreliable connectivity, device ruggedness and the physical ergonomics of prolonged headset use during long shifts. In such settings, verification cannot be treated as an optional safeguard. Beneath these constraints sits a fundamental governance question: who validates an instruction authored by AI and against what reference and asset state?To address these challenges, this journal proposes an organized research agenda for prospective contributors, structured around four core clusters.The overlay was the first phase of maintenance AR; the questions ahead are more consequential. Can automated guidance be shown to be correct? Can it be grounded reliably in complex physical environments? Can it be verified before it reaches a worker's line of sight? Most importantly, can it leave that worker more capable, not merely more compliant?These questions will shape the next decade of industrial AR. This journal welcomes the empirical trials, system architectures, human factors studies and field deployments that will answer them.LLMs were used for English editing and searching for some suitable references.

Journal of Quality in Maintenance EngineeringVol. 32(3)
Quality Education
Openalex Percentile: Top 7%
Augmented Reality Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.