UPBD: Construction and Evaluation Methods of the Underwater Polarization Benchmark Dataset for Complex Scenarios

Existing underwater polarization datasets are primarily designed for deep learning training and lack diverse data types and corresponding evaluation methods for comprehensive algorithm assessment. To address this limitation, we propose the Underwater Polarization Benchmark Dataset (UPBD), which consists of three functionally distinct subsets designed to evaluate different aspects of underwater image restoration. The dataset is accompanied by a novel multidimensional image quality evaluation framework. Our scene variation subset evaluates polarization image restoration performance across scenes with low, high, and complex degrees of polarization. The resolution test subset quantitatively assesses spatial resolution preservation using both USAF and ISO12233 resolution test charts. The color fidelity subset provides objective color restoration analysis through a 24-color standard chart. UPBD implements rigorous acquisition protocols to ensure evaluation consistency. To demonstrate the effectiveness of our multidimensional evaluation approach, we tested six representative restoration algorithms spanning different methodologies: image enhancement algorithm, imaging model-based algorithm, three underwater polarization imaging algorithms, and a deep learning algorithm. Experimental results reveal significant performance variations across different subsets and metrics, validating the importance of comprehensive evaluation enabled by UPBD. The dataset and implementation code are publicly available at: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/ysl-oAo/UPBD</uri>.