DualSigVL: confidence-aware expert fusion for offline signature verification based on dualview multimodal large language models

Offline signatures serve as a fundamental basis for financial instrument verification and legal document authentication. Since signature authenticity directly impacts property security and the establishment of legal facts, automated verification systems require high discriminative accuracy. However, existing approaches, predominantly based on Siamese networks and metric learning, suffer from clear performance bottlenecks when confronted with forgeries, limiting their applicability in real-world scenarios. To address this limitation, we propose DualSigVL, which reformulates offline signature verification within an instruction-driven Visual Question Answering (VQA) paradigm using the multimodal large language model Qwen3-VL. DualSigVL employs a complementary dual-expert architecture: the raw-image expert captures appearance-level semantic cues, while the multi-feature expert encodes geometric and structural characteristics. Both experts share a frozen Qwen3-VL backbone and achieve functional specialization via independent Low-Rank Adaptation (LoRA) parameters. To quantify the decision reliability of each expert, a confidence extraction strategy based on the first-token logit is introduced, transforming generative outputs into continuous discriminative confidence scores. Building upon this, the Dual-Expert Confidence-Aware Mixture of Experts (DECA-MoE) module performs confidence-aware fusion via score scaling and dynamic gating in the logit space, enabling sample-adaptive decision-making. Extensive experiments on the CEDAR, BHSig-B, BHSig-H, and ChiSig datasets show that DualSigVL achieves accuracies of 100.00%, 98.33%, 98.70%, and 96.38%, respectively, demonstrating competitive or improved performance under the adopted evaluation protocol. The source code is publicly available at https://github.com/BEFINE-code/DualsigVL .

Authors

Institutions

Publication Details

Journal
Journal of King Saud University - Computer and Information Sciences
Published
2026-08-20
DOI
https://doi.org/10.1007/s44443-026-01106-6
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DualSigVL: confidence-aware expert fusion for offline signature verification based on dualview multimodal large language models

Liyan Huang, Zhichen Xie, Bohan Jiang
Journal of King Saud University - Computer and Information Sciences
Handwritten Text Recognition Techniques
article

DualSigVL: confidence-aware expert fusion for offline signature verification based on dualview multimodal large language models

Liyan Huang, Zhichen Xie, Bohan Jiang
article en

Abstract

Offline signatures serve as a fundamental basis for financial instrument verification and legal document authentication. Since signature authenticity directly impacts property security and the establishment of legal facts, automated verification systems require high discriminative accuracy. However, existing approaches, predominantly based on Siamese networks and metric learning, suffer from clear performance bottlenecks when confronted with forgeries, limiting their applicability in real-world scenarios. To address this limitation, we propose DualSigVL, which reformulates offline signature verification within an instruction-driven Visual Question Answering (VQA) paradigm using the multimodal large language model Qwen3-VL. DualSigVL employs a complementary dual-expert architecture: the raw-image expert captures appearance-level semantic cues, while the multi-feature expert encodes geometric and structural characteristics. Both experts share a frozen Qwen3-VL backbone and achieve functional specialization via independent Low-Rank Adaptation (LoRA) parameters. To quantify the decision reliability of each expert, a confidence extraction strategy based on the first-token logit is introduced, transforming generative outputs into continuous discriminative confidence scores. Building upon this, the Dual-Expert Confidence-Aware Mixture of Experts (DECA-MoE) module performs confidence-aware fusion via score scaling and dynamic gating in the logit space, enabling sample-adaptive decision-making. Extensive experiments on the CEDAR, BHSig-B, BHSig-H, and ChiSig datasets show that DualSigVL achieves accuracies of 100.00%, 98.33%, 98.70%, and 96.38%, respectively, demonstrating competitive or improved performance under the adopted evaluation protocol. The source code is publicly available at https://github.com/BEFINE-code/DualsigVL .

Journal of King Saud University - Computer and Information SciencesVol. 38(7)
Guangdong Police College (CN), Tsinghua University (CN)
Reduced inequalities
Openalex Percentile: Top 12%
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.