An Enhanced BiLSTM-Based Model with Bidirectional Attention and Ant Colony Optimization for English NLP

This study aims to overcome limitations in traditional natural language processing (NLP) models, particularly in network structure and hyperparameter tuning, which often hinder optimal performance across diverse tasks. To address these issues, the ant colony optimization (ACO) algorithm is introduced. This paper optimizes the layer count and other training hyperparameters of the Bidirectional Long Short-Term Memory (BiLSTM) network, enhancing both its flexibility and classification accuracy. To further enhance BiLSTM’s bidirectional selectivity, a bidirectional attention mechanism (BAM) is incorporated, strengthening the model’s capacity to integrate historical and future contextual information. The proposed ACO-BiLSTM-BAM model is validated on the Internet Movie Database (IMDb) movie review dataset, where it achieves a classification accuracy of 92.74%, marking a significant 12.05% improvement over the base BiLSTM model, particularly in discriminating sentiment at varied levels.

Publication Details

Journal
Open Journal Systems (Taiwan Association of Engineering and Technology Innovation)
Published
2025-08-29
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Enhanced BiLSTM-Based Model with Bidirectional Attention and Ant Colony Optimization for English NLP

Open Journal Systems (Taiwan Association of Engineering and Technology Innovation)
Geochemistry and Geologic Mapping
article

An Enhanced BiLSTM-Based Model with Bidirectional Attention and Ant Colony Optimization for English NLP

article en

Abstract

This study aims to overcome limitations in traditional natural language processing (NLP) models, particularly in network structure and hyperparameter tuning, which often hinder optimal performance across diverse tasks. To address these issues, the ant colony optimization (ACO) algorithm is introduced. This paper optimizes the layer count and other training hyperparameters of the Bidirectional Long Short-Term Memory (BiLSTM) network, enhancing both its flexibility and classification accuracy. To further enhance BiLSTM’s bidirectional selectivity, a bidirectional attention mechanism (BAM) is incorporated, strengthening the model’s capacity to integrate historical and future contextual information. The proposed ACO-BiLSTM-BAM model is validated on the Internet Movie Database (IMDb) movie review dataset, where it achieves a classification accuracy of 92.74%, marking a significant 12.05% improvement over the base BiLSTM model, particularly in discriminating sentiment at varied levels.

Open Journal Systems (Taiwan Association of Engineering and Technology Innovation)
Reduced inequalities
Openalex Percentile: Top 58%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An Enhanced BiLSTM-Based Model with Bidirectional Attention and Ant Colony Optimization for English NLP · Open Journal Systems (Taiwan Association of Engineering and Technology Innovation) (2025) | TGRS Research Map | TGRS