Benchmarking Intent Classification in Extremely Low-Resource Indo-Aryan Dialects: An Empirical Study on Dhatki Agricultural Telemetry

Natural Language Processing (NLP) models achieve state-of-the-art benchmarks in high-resource global languages, yet regional vernacular dialects spoken by millions of marginalized pastoralists remain entirely excluded from digital conversational interfaces. Dhatki, an Indo-Aryan transitional language spoken by over 2.5 million inhabitants across the Thar Desert of southeastern Sindh, Pakistan, lacks standardized tokenizers, orthographic corpora, and annotated evaluation benchmarks. In this technical report, we introduce the first domain-specific, curated Intent Classification Dataset for Dhatki agricultural telemetry (comprising 1,000 verified acoustic and textual utterances spanning 10 operational agricultural classes, hosted openly on Hugging Face). We empirically benchmark baseline lexical models against multilingual transformer representations (mBERT, IndicBERT, XLM-RoBERTa, and a proposed domain-specific Dhatki-DistilBERT) under severe resource constraints. Our experimental findings demonstrate that custom subword Byte-Pair Encoding (BPE) tuned to phonetic Dhatki transcriptions achieves a Micro-F1 score of 89.4% with an edge latency of 14.2 ms, proving the viability of low-latency, offline voice interfaces for low-resource desert agriculture. Open-Access Resources: • Hugging Face Dataset: https://huggingface.co/datasets/lokeshsonara/dhatki-agri-intents • Live Research Portal: https://agri-idas.tech/

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-04
DOI
https://doi.org/10.5281/zenodo.23958453
Primary Topic
Natural Language Processing Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Benchmarking Intent Classification in Extremely Low-Resource Indo-Aryan Dialects: An Empirical Study on Dhatki Agricultural Telemetry

Lokesh Kumar
Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
preprint

Benchmarking Intent Classification in Extremely Low-Resource Indo-Aryan Dialects: An Empirical Study on Dhatki Agricultural Telemetry

Lokesh Kumar
preprint en

Abstract

Natural Language Processing (NLP) models achieve state-of-the-art benchmarks in high-resource global languages, yet regional vernacular dialects spoken by millions of marginalized pastoralists remain entirely excluded from digital conversational interfaces. Dhatki, an Indo-Aryan transitional language spoken by over 2.5 million inhabitants across the Thar Desert of southeastern Sindh, Pakistan, lacks standardized tokenizers, orthographic corpora, and annotated evaluation benchmarks. In this technical report, we introduce the first domain-specific, curated Intent Classification Dataset for Dhatki agricultural telemetry (comprising 1,000 verified acoustic and textual utterances spanning 10 operational agricultural classes, hosted openly on Hugging Face). We empirically benchmark baseline lexical models against multilingual transformer representations (mBERT, IndicBERT, XLM-RoBERTa, and a proposed domain-specific Dhatki-DistilBERT) under severe resource constraints. Our experimental findings demonstrate that custom subword Byte-Pair Encoding (BPE) tuned to phonetic Dhatki transcriptions achieves a Micro-F1 score of 89.4% with an edge latency of 14.2 ms, proving the viability of low-latency, offline voice interfaces for low-resource desert agriculture. Open-Access Resources: • Hugging Face Dataset: https://huggingface.co/datasets/lokeshsonara/dhatki-agri-intents • Live Research Portal: https://agri-idas.tech/

Zenodo (CERN European Organization for Nuclear Research)
Sindh Agriculture University (PK)
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon