Imitation Learning-Driven Self-Learning Robotic Manipulation for Industrial Automation: From Human Demonstration to Perception-Guided Pick-and-Place
This study develops and evaluates a laboratory-scale Self-Learning Robotic System (SLRS) for an industrial motivated pick-and-place task using imitation learning and perception-guided manipulation. Human demonstrations are encoded using a Dynamic Movement Primitive (DMP)-based representation, while YOLOv8 object detection, stereo vision, point-cloud processing, and centroid estimation provide the three-dimensional target position. The perceived target and selected destination condition the demonstrated movement representation before Cartesian waypoint generation, inverse kinematics, MoveIt-based planning, trajectory refinement, and execution on a MyCobot 280 Jetson Nano manipulator. A separate image-classification component was evaluated before and after SMOTE balancing, producing a mean post-SMOTE training accuracy of 89.02% across three recorded runs; this value is interpreted as training performance rather than independent test performance. Robot execution was evaluated across four destination bins with 40 trials per trajectory condition. Mean completion time was 43.90 ± 3.61s without optimisation and 21.95 ± 1.80s with optimisation. The exact 2:1 relationship is reported as a characteristic of the recorded experimental dataset and requires independent verification using controller-based timing. The methodological contribution is the perception-conditioned transfer of demonstration-derived movement information into robot-specific manipulation through a DMP-based process that combines perception, planning, and robot execution.
Authors
- Mahmoud Shafik (ORCID: https://orcid.org/0000-0001-8296-5698)
- Aaisha Makkar (ORCID: https://orcid.org/0000-0001-7203-6553)
- Yagna Jadeja
- Paul Wood
Publication Details
- Journal
- Preprints.org
- Published
- 2026-11-16
- DOI
- https://doi.org/10.20944/preprints202611.1524.v1
- Primary Topic
- Robot Manipulation and Learning
- Type
- preprint