MVImgNet2.0: A Larger-scale Dataset of Multi-view Images
MVImgNet is a large-scale dataset that contains multi-view images of ~220k real-world objects in 238 classes. As a counterpart of ImageNet, it introduces 3D visual signals via multi-view shooting, making a soft bridge between 2D and 3D vision. This paper constructs the MVImgNet2.0 dataset that expands MVImgNet into a total of ~520k objects and 515 categories, which derives a 3D dataset with a larger scale that is more comparable to ones in the 2D domain. In addition to the expanded dataset scale and category range, MVImgNet2.0 is of a higher quality than MVImgNet owing to four new features: (i) most shoots capture 360° views of the objects, which can support the learning of object reconstruction with completeness; (ii) the segmentation manner is advanced to produce foreground object masks of higher accuracy; (iii) a more powerful structure-from-motion method is adopted to derive the camera pose for each frame of a lower estimation error; (iv) higher-quality dense point clouds are reconstructed via advanced methods for objects captured in 360 ° views, which can serve for downstream applications. Extensive experiments confirm the value of the proposed MVImgNet2.0 in boosting the performance of large 3D reconstruction models. MVImgNet2.0 will be public at luyues.github.io/mvimgnet2 , including multi-view images of all 520k objects, the reconstructed high-quality point clouds, and data annotation codes, hoping to inspire the broader vision community.
Authors
- Shuguang Cui (ORCID: https://orcid.org/0000-0003-2608-775X)
- Zilong Dong (ORCID: https://orcid.org/0000-0002-6833-9102)
- Yushuang Wu (ORCID: https://orcid.org/0009-0002-9725-0606)
- Lingteng Qiu (ORCID: https://orcid.org/0000-0002-3250-0486)
- Xiaoguang Han (ORCID: https://orcid.org/0000-0003-0162-3296)
- Xiaodong Gu (ORCID: https://orcid.org/0000-0003-2623-7973)
- Weihao Yuan (ORCID: https://orcid.org/0000-0002-1362-3747)
- Haolin Liu (ORCID: https://orcid.org/0009-0009-4962-9217)
- Hongjie Liao (ORCID: https://orcid.org/0009-0005-1992-7089)
- Luyue Shi
Institutions
- Chinese University of Hong Kong, Shenzhen (CN)
- Alibaba Group (China) (CN)
Publication Details
- Journal
- ACM Transactions on Graphics
- Published
- 2024-11-19
- DOI
- https://doi.org/10.1145/3687973
- Primary Topic
- Medical Image Segmentation Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00