| Title: |
Coupling V-SLAM and Semantic Segmentation for Cultural Heritage Documentation |
| Authors: |
ElAlailyi, Ahmad; Zhang, Kai; Mea, Chiara; Perfetti, Luca; Remondino, Fabio; Fassi, Francesco |
| Contributors: |
Hyeseung Shim, Seungae Choi, Wonjin Lee, HaeUn Rii, and Sungyoung Kim; Elalailyi, Ahmad; Zhang, Kai; Mea, Chiara; Perfetti, Luca; Remondino, Fabio; Fassi, Francesco |
| Publication Year: |
2025 |
| Collection: |
Fondazione Bruno Kessler: CINECA IRIS |
| Subject Terms: |
Multi-camera Mobile Mapping System; V-SLAM and 3D Reconstruction; Deep Learning; Heritage Documentation; Architectural and Pathologies Semantics; 2D-to-3D Enrichment |
| Description: |
3D digitization has become an essential tool in cultural heritage documentation, offering unprecedented opportunities for preservation, analysis, and dissemination. Beyond only capturing 3D spatial geometry, the semantic enrichment of 3D models is rapidly evolving offering a more efficient interpretation and usage of 3D data. Traditionally, 3D semantic enrichment has relied on point cloud-based segmentation. However, 3D point cloud-based segmentation approaches can struggle with the efficient identification of small-scale, geometric elements, or visually ambiguous classes, limiting their applicability in such contexts. This study leverages the rich contextual and textural information of 2D imagery to detect challenging semantic categories, such as fine architectural elements (e.g., individual stone blocks) and material decay (e.g., material detachment and material loss), using deep learning-based 2D semantic segmentation techniques. These detections are then projected into 3D space through a 2D-to-3D semantic segmentation framework that couples V-SLAM and 3D results with the 2D predictions. The framework is evaluated on data acquired using the fish-eye multi-camera mobile mapping system ATOM-ANT3D in two challenging case study environments. Achieved results demonstrate a reliable level of accu-racy given the inherent complexity of targeted classes, enhancing the interpretability of 3D models by providing meaningful and met-rically interpreted objects classifications in 3D models. (Demonstration video: https://youtu.be/GidxhNS7ECc) |
| Document Type: |
conference object |
| File Description: |
ELETTRONICO |
| Language: |
unknown |
| Relation: |
ispartofbook:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLVIII-M-9-2025; 30th CIPA Symposium “Heritage Conservation from Bits: From Digital Documentation to Data-driven Heritage Conservation"; volume:48; firstpage:435; lastpage:442; numberofpages:8; journal:INTERNATIONAL ARCHIVES OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES; https://hdl.handle.net/11582/363167 |
| DOI: |
10.5194/isprs-archives-xlviii-m-9-2025-435-2025 |
| Availability: |
https://hdl.handle.net/11582/363167; https://doi.org/10.5194/isprs-archives-xlviii-m-9-2025-435-2025; https://isprs-archives.copernicus.org/articles/XLVIII-M-9-2025/435/2025/ |
| Rights: |
info:eu-repo/semantics/openAccess ; license:Creative commons ; license uri:http://creativecommons.org/licenses/by-nc/4.0/ |
| Accession Number: |
edsbas.3AEBCEB5 |
| Database: |
BASE |