Edge AI for Autonomous Agricultural Drone Data Processing: Onboard Real-Time MobileNetV3 Inference with RPLiDAR Sensor Fusion for Instant In-Flight Crop Health Monitoring

Unmanned aerial vehicle (UAV) systems for monitoring crops have usually followed a two-step process: the drone flies over an entire field, gathers images and sensor data, returns to the base station, and then, sometimes hours or even days later, uploads the data to remote servers for analysis. Often by the time the agronomist gets the results, the best time to act on issues like disease, irrigation, or fertilizer has already passed. This paper presents an Edge AI drone framework designed to remove that delay by performing machine learning analysis, LiDAR data processing, sensor fusion, and health reporting on the drone itself, in real time, as it flies. A MobileNetV3-Large network, fine-tuned on 8,400 real aerial images of coconut palms from three farms in Karnataka and evaluated on a 1,260-image held-out real-imagery test set, classifies crop canopies as Healthy, Stressed, or Diseased with per-class accuracies of 98.2%, 92.5%, and 95.8% respectively. Separately, an RPLiDAR sensor estimates plant height and canopy volume with a mean absolute error of 14.3 cm against simulated ground truth, and these structural metrics are fused with the camera-derived classification confidence into a single 0-100 health index. The complete system pipeline — MobileNetV3 inference, LiDAR processing, GPS-guided lawnmower coverage of a 400-tree virtual coconut palm plantation, a Flask backend, a Three.js live dashboard, and automated PDF reporting — was validated end-to-end across five missions in the Microsoft AirSim simulation environment, completing full-field coverage in an average of 18.4 minutes with a Flask API response time of 22 ms, a 4K heatmap render time of 187 ms, and a PDF report generated in 3.1 seconds. Inference throughput of 62 FPS was benchmarked using the TensorRT FP16 engine on the simulation workstation's RTX 3060 GPU as a proxy for the target NVIDIA Jetson NX platform; physical Jetson NX benchmarking, thermal characterisation, and field validation remain to be completed. To the best of our knowledge, this is among the more complete frameworks integrating onboard real-time inference, LiDAR-camera fusion, autonomous navigation, live visualisation, and automated reporting within a single UAV platform, and it is presented here as a simulation-validated proof-of-concept pending real-hardware and real-field confirmation.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-17
DOI
https://doi.org/10.5281/zenodo.24305974
Primary Topic
Smart Agriculture and AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Edge AI for Autonomous Agricultural Drone Data Processing: Onboard Real-Time MobileNetV3 Inference with RPLiDAR Sensor Fusion for Instant In-Flight Crop Health Monitoring

Pooja M V, Deekshith R
1 links
Zenodo (CERN European Organization for Nuclear Research)
Smart Agriculture and AI
article

Edge AI for Autonomous Agricultural Drone Data Processing: Onboard Real-Time MobileNetV3 Inference with RPLiDAR Sensor Fusion for Instant In-Flight Crop Health Monitoring

Pooja M V, Deekshith R
article en

Abstract

Unmanned aerial vehicle (UAV) systems for monitoring crops have usually followed a two-step process: the drone flies over an entire field, gathers images and sensor data, returns to the base station, and then, sometimes hours or even days later, uploads the data to remote servers for analysis. Often by the time the agronomist gets the results, the best time to act on issues like disease, irrigation, or fertilizer has already passed. This paper presents an Edge AI drone framework designed to remove that delay by performing machine learning analysis, LiDAR data processing, sensor fusion, and health reporting on the drone itself, in real time, as it flies. A MobileNetV3-Large network, fine-tuned on 8,400 real aerial images of coconut palms from three farms in Karnataka and evaluated on a 1,260-image held-out real-imagery test set, classifies crop canopies as Healthy, Stressed, or Diseased with per-class accuracies of 98.2%, 92.5%, and 95.8% respectively. Separately, an RPLiDAR sensor estimates plant height and canopy volume with a mean absolute error of 14.3 cm against simulated ground truth, and these structural metrics are fused with the camera-derived classification confidence into a single 0-100 health index. The complete system pipeline — MobileNetV3 inference, LiDAR processing, GPS-guided lawnmower coverage of a 400-tree virtual coconut palm plantation, a Flask backend, a Three.js live dashboard, and automated PDF reporting — was validated end-to-end across five missions in the Microsoft AirSim simulation environment, completing full-field coverage in an average of 18.4 minutes with a Flask API response time of 22 ms, a 4K heatmap render time of 187 ms, and a PDF report generated in 3.1 seconds. Inference throughput of 62 FPS was benchmarked using the TensorRT FP16 engine on the simulation workstation's RTX 3060 GPU as a proxy for the target NVIDIA Jetson NX platform; physical Jetson NX benchmarking, thermal characterisation, and field validation remain to be completed. To the best of our knowledge, this is among the more complete frameworks integrating onboard real-time inference, LiDAR-camera fusion, autonomous navigation, live visualisation, and automated reporting within a single UAV platform, and it is presented here as a simulation-validated proof-of-concept pending real-hardware and real-field confirmation.

Zenodo (CERN European Organization for Nuclear Research)
GM University Davanagere Karnataka (IN)
Zero hunger, Industry, innovation and infrastructure
Smart Agriculture and AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon