<i>Descriptron</i> : Artificial intelligence for automating taxonomic species descriptions with a user‐friendly software package
Abstract Recent advances in Computer Vision, Convolutional Neural Networks (CNNs), Vision Transformers (ViTs) and Large Language Models (LLMs) suggest it may be possible to mimic the ability to decode knowledge about morphology and taxonomy to describe species in an automated way. Here, for the first time, we test a state‐of‐the‐art Vision Language Model (VLM) that combines ViTs and LLMs to approximate taxonomic species descriptions automatically. The test uses a new graphical user interface, Descriptron , which gathers data about biological images and transmits this specialised knowledge to a VLM (GPT‐4o) to decode morphological features. Our results indicate that GPT‐4o can produce draft taxonomic species descriptions using taxonomist‐defined morphological features, although the model still requires supervision to avoid erroneous text predictions. Despite that, the time saved using Descriptron is already significant. The Descriptron programme, with example prompts, is free under an Apache2 License from GitHub; https://github.com/alexrvandam/Descriptron .
Authors
- Alex R. Van Dam (ORCID: https://orcid.org/0000-0002-1966-0338)
- Liliya Štarhová Serbina (ORCID: https://orcid.org/0000-0002-5171-8253)
Institutions
- Institute for Biodiversity (DE)
Publication Details
- Journal
- Systematic Entomology
- Published
- 2025-09-29
- DOI
- https://doi.org/10.1111/syen.70005
- Citations
- 2
- Primary Topic
- Species Distribution and Climate Change
- Type
- article
- Field-Weighted Citation Impact
- 3.68