Papers › Identification of Stone Deterioration Patterns with Large Multimodal Models

Identification of Stone Deterioration Patterns with Large Multimodal Models

5 Jun 2024arXiv:2406.03207archive 2025-07-28

Daniele Corradetti, Jose Delgado Rodrigues

The conservation of stone-based cultural heritage sites is a critical concern for preserving cultural and historical landmarks. With the advent of Large Multimodal Models, as GPT-4omni (OpenAI), Claude 3 Opus (Anthropic) and Gemini 1.5 Pro (Google), it is becoming increasingly important to define the operational capabilities of these models. In this work, we systematically evaluate the abilities of the main foundational multimodal models to recognise and classify anomalies and deterioration patterns of the stone elements that are useful in the practice of conservation and restoration of world heritage. After defining a taxonomy of the main stone deterioration patterns and anomalies, we asked the foundational models to identify a curated selection of 354 highly representative images of stone-built heritage, offering them a careful selection of labels to choose from. The result, which varies depending on the type of pattern, allowed us to identify the strengths and weaknesses of these models in the field of heritage conservation and restoration.

PaperPDFCode

Code

dcorradetti/redai_id_pattern officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image Classification

Datasets

Introduced by this paper, per the archive.

Id Pattern Dataset

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification Id Pattern Dataset Claude 3 Opus Percentage correct 24.3% #1 of 3 Archive leaderboard report
Image Classification Id Pattern Dataset Gemini 1.5 Pro Percentage correct 39% #2 of 3 Archive leaderboard report
Image Classification Id Pattern Dataset GPT-4omni Percentage correct 42.1% #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections