TabPFN extensions for interpretable geotechnical modelling

Geotechnical site characterisation relies on sparse, heterogeneous borehole data, where uncertainty quantification and interpretability matter as much as predictive accuracy. We evaluate TabPFN, a tabular foundation model, and its tabpfn-extensions library on two geotechnical tasks: (1) soil-type classification from N-value and shear-wave velocity data as a controlled illustrative case, and (2) iterative imputation of five mechanical parameters (su, Eu, σ′p, Cc, Cv) in BM/AirportSoilProperties/2/2025. Without retraining, we apply cosine-similarity analysis to TabPFN embeddings, visualise predictive distributions, and compute SHAP attributions. On the regression benchmark we compare TabPFN with mean imputation, linear regression, random forests, XGBoost, and HBM; introduce a proxy decomposition of predictive uncertainty across context-perturbation classes; and propagate marginal Cc and σ′p distributions through a one-dimensional consolidation model to obtain the reliability index β and serviceability exceedance probability Pf. Embeddings exhibit label-consistent Clay/Sand grouping; iterative imputation reduces RMSE for all five targets, with TabPFN lowest on four; SHAP attributions are consistent with the Skempton compression-index correlation and the inverse preconsolidation-pressure-water-content dependence; the within-posterior component is largest in the proxy decomposition. We position the contribution as a worked evaluation workflow that may complement established methods for data-scarce geotechnics, not as algorithmic innovation.

Authors

Institutions

Publication Details

Journal
Georisk Assessment and Management of Risk for Engineered Systems and Geohazards
Published
2026-07-28
DOI
https://doi.org/10.1080/17499518.2026.2707500
Primary Topic
Geological Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TabPFN extensions for interpretable geotechnical modelling

Yu Otake, Daijiro MIZUTANI, Stephen Wu, Taiga Saito
Georisk Assessment and Management of Risk for Engineered Systems and Geohazards
Geological Modeling and Analysis
article

TabPFN extensions for interpretable geotechnical modelling

Yu Otake, Daijiro MIZUTANI, Stephen Wu, Taiga Saito
article en

Abstract

Geotechnical site characterisation relies on sparse, heterogeneous borehole data, where uncertainty quantification and interpretability matter as much as predictive accuracy. We evaluate TabPFN, a tabular foundation model, and its tabpfn-extensions library on two geotechnical tasks: (1) soil-type classification from N-value and shear-wave velocity data as a controlled illustrative case, and (2) iterative imputation of five mechanical parameters (su, Eu, σ′p, Cc, Cv) in BM/AirportSoilProperties/2/2025. Without retraining, we apply cosine-similarity analysis to TabPFN embeddings, visualise predictive distributions, and compute SHAP attributions. On the regression benchmark we compare TabPFN with mean imputation, linear regression, random forests, XGBoost, and HBM; introduce a proxy decomposition of predictive uncertainty across context-perturbation classes; and propagate marginal Cc and σ′p distributions through a one-dimensional consolidation model to obtain the reliability index β and serviceability exceedance probability Pf. Embeddings exhibit label-consistent Clay/Sand grouping; iterative imputation reduces RMSE for all five targets, with TabPFN lowest on four; SHAP attributions are consistent with the Skempton compression-index correlation and the inverse preconsolidation-pressure-water-content dependence; the within-posterior component is largest in the proxy decomposition. We position the contribution as a worked evaluation workflow that may complement established methods for data-scarce geotechnics, not as algorithmic innovation.

Georisk Assessment and Management of Risk for Engineered Systems and Geohazards
The Graduate University for Advanced Studies, SOKENDAI (JP), Tohoku University (JP), The Institute of Statistical Mathematics (JP)
Industry, innovation and infrastructure
Openalex Percentile: Top 10%
Geological Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.