Remote Sensing Based Advance Image Captioning Improved Feature Attention

In the domain of image description generation, the focal point mechanism is crucial for highlighting the most relevant features within an image, thereby influencing the quality of generated descriptions. To address this challenge, we introduce an innovative optimization module called the Enhanced Focal (EF) mechanism, which builds upon the traditional multi-head focal point mechanism. The EF module is designed to assess the correlation levels between objects within an image, thereby guiding the process of subtitle generation more effectively. The EF mechanism integrates the output of the multi-head focal point mechanism with the current context (i.e., the query) to generate two components: an “information vector” and an “attention gate.” The “attention gate” is then applied to the “information vector” to create a refined focal point mechanism. This refined mechanism undergoes element-wise multiplication with the “information vector,” producing attention information that reveals a strong correlation between the target and the background in the image. This process leverages the Long Short-Term Memory (LSTM) mechanism to enhance the model's capability to capture intricate relationships. Upon training and evaluating our enhanced model on the MS COCO dataset, we observed significant improvements in key evaluation metrics. The BLEU-1 and METEOR scores reached 73.01% and 28.81%, respectively, showcasing the effectiveness of the proposed EF mechanism in improving image description generation.