Advanced Techniques for Chinese Image Captioning: Investigating Attention Mechanisms Based on Object Detection for Chinese Image Caption Generation

The task of image caption generation aims to automatically produce natural language descriptions that match the content of images, integrating the fields of machine vision and natural language processing, which holds significant theoretical and practical value. Inspired by top-down attention mechanisms, this paper proposes an innovative attention model. Utilizing the output of pretrained object detection networks as prior knowledge for images, the model guides the generation of natural language descriptions. By directly incorporating the results of object detection as attention inputs into the text generation network, the model effectively focuses on key descriptive regions of images, thereby significantly enhancing performance. On public Chinese image captioning datasets, this model demonstrates substantial advantages in metrics such as BLEU-4 and METEOR.