Affordable 3D Reconstruction of Underwater Structures Towards Shipwreck Visualization and the Remediation of Marine Debris and Ghost Fishing Gear

This project proposes an innovative and affordable approach that uses standard single-camera underwater videos, such as those captured during shipwreck explorations or bio-diversity studies, to produce detailed 3D models. Unlike photogrammetry techniques, which require specialized and expensive equipment, our workflow transforms single-camera underwater video into digital 3D models in a few simple steps, without the need for video reconstruction. This allows for lower-cost imaging systems and previously collected data to be used for 3D reconstruction of underwater structures and scenes. These digital models can then be produced and viewed from all angles, or 3D printed, providing a tangible model for use in research, exhibition planning, or outreach and education. We started by conducting an in-depth study of various photogrammetry software packages, from well-known commercial packages such as Agrisoft Metashape and 3D Zephyr to free software tools such as Reality Capture, Matisse, and Colmap. Following our analysis, we concluded that 3D Zephyr was the best option for our purposes due to its complete package, which allows all processing stages to be efficiently and accurately completed, without the need for additional software tools to integrate navigation data. In this study, we were able to generate 3D Models using only video data and without adding navigation information. This allows us to consider the potential of using the workflow on legacy data, which are often forgotten despite its incredible value. Furthermore, a 3D print was created from the reconstruction. With this technique, having physical models in hand also enables us to identify optimal sites for deploying underwater vehicles, opening up opportunities for ecological monitoring, structural inspections, scientific exploration, and marine debris mitigation. In this study, we used videos of several shipwrecks located in the Stellwagen Bank National Marine Sanctuary, including “The Mystery Collier” and “Portland”. Video data was initially captured using Remotely Operated Vehicles (ROVs) to survey the structure of the ship and surrounding artifacts. We processed these videos using 3D Zephyr to generate a digital model which we then 3D printed to create a small-scale replica. Although further analysis is needed, this technique has the potential to uncover additional insight into the mystery of its sinking and its preservation as a cultural heritage site. Our proposed method for modeling underwater environments opens up many possibilities, from studying shipwrecks and preserving historic marine sanctuaries to marine debris removal. By using a single camera to create detailed underwater models, our approach transforms video recorded into detailed 3D models of underwater structures. This opportunity enables researchers to better visualize and analyze sites that would otherwise be inaccessible.