Imitation Learning-Driven Self-Learning Robotic Manipulation for Industrial Automation: From Human Demonstration to Perception-Guided Pick-and-Place

This study develops and evaluates a laboratory-scale Self-Learning Robotic System (SLRS) for an industrial motivated pick-and-place task using imitation learning and perception-guided manipulation. Human demonstrations are encoded using a Dynamic Movement Primitive (DMP)-based representation, while YOLOv8 object detection, stereo vision, point-cloud processing, and centroid estimation provide the three-dimensional target position. The perceived target and selected destination condition the demonstrated movement representation before Cartesian waypoint generation, inverse kinematics, MoveIt-based planning, trajectory refinement, and execution on a MyCobot 280 Jetson Nano manipulator. A separate image-classification component was evaluated before and after SMOTE balancing, producing a mean post-SMOTE training accuracy of 89.02% across three recorded runs; this value is interpreted as training performance rather than independent test performance. Robot execution was evaluated across four destination bins with 40 trials per trajectory condition. Mean completion time was 43.90 ± 3.61s without optimisation and 21.95 ± 1.80s with optimisation. The exact 2:1 relationship is reported as a characteristic of the recorded experimental dataset and requires independent verification using controller-based timing. The methodological contribution is the perception-conditioned transfer of demonstration-derived movement information into robot-specific manipulation through a DMP-based process that combines perception, planning, and robot execution.

Authors

Publication Details

Journal
Preprints.org
Published
2026-11-16
DOI
https://doi.org/10.20944/preprints202611.1524.v1
Primary Topic
Robot Manipulation and Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Imitation Learning-Driven Self-Learning Robotic Manipulation for Industrial Automation: From Human Demonstration to Perception-Guided Pick-and-Place

Mahmoud Shafik, Aaisha Makkar, Yagna Jadeja, Paul Wood
1 links
Preprints.org
Robot Manipulation and Learning
preprint

Imitation Learning-Driven Self-Learning Robotic Manipulation for Industrial Automation: From Human Demonstration to Perception-Guided Pick-and-Place

Mahmoud Shafik, Aaisha Makkar, Yagna Jadeja, Paul Wood
preprint en

Abstract

This study develops and evaluates a laboratory-scale Self-Learning Robotic System (SLRS) for an industrial motivated pick-and-place task using imitation learning and perception-guided manipulation. Human demonstrations are encoded using a Dynamic Movement Primitive (DMP)-based representation, while YOLOv8 object detection, stereo vision, point-cloud processing, and centroid estimation provide the three-dimensional target position. The perceived target and selected destination condition the demonstrated movement representation before Cartesian waypoint generation, inverse kinematics, MoveIt-based planning, trajectory refinement, and execution on a MyCobot 280 Jetson Nano manipulator. A separate image-classification component was evaluated before and after SMOTE balancing, producing a mean post-SMOTE training accuracy of 89.02% across three recorded runs; this value is interpreted as training performance rather than independent test performance. Robot execution was evaluated across four destination bins with 40 trials per trajectory condition. Mean completion time was 43.90 ± 3.61s without optimisation and 21.95 ± 1.80s with optimisation. The exact 2:1 relationship is reported as a characteristic of the recorded experimental dataset and requires independent verification using controller-based timing. The methodological contribution is the perception-conditioned transfer of demonstration-derived movement information into robot-specific manipulation through a DMP-based process that combines perception, planning, and robot execution.

Preprints.org
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon