Domain-Driven Column Governance on Snowflake: An Empirical Evaluation of Data Contracts and LLM-Assisted Classification
Column governance requires both accurate sensitivity labels and reliable enforcement as data products are published and shared. This article presents a contract-based reference implementation on Snowflake and a controlled empirical study using TPC-H-derived products. The study distinguishes classification accuracy, publication-time enforcement, sharing behavior, and compute allocation. Across 40-400 products with a modeled 20% column-renaming probability, a name-pattern sweep achieved 0.782-0.803 enforcement recall; contracts with ground-truth labels achieved 1.000, and contracts with a 5% injected omission rate achieved 0.923-0.948. The ideal-contract condition verifies the enforcement path under correct labels. Its publication time was approximately 41%-51% higher than the sweep. On separately generated classification workloads, Llama 3.1 70B given names, label definitions, and five sample values achieved 0.99-1.00 sensitivity recall with 0.04-0.05 over-masking. The native default classifier achieved 0.40-0.46 recall under the study's business-specific sensitivity policy; unequal category coverage limits that comparison. A set-union analysis characterizes the recall gain and unavoidable masking cost of combining contract and LLM flags, and a conditional loss model relates those trade-offs to sensitivity prevalence and error costs. Supporting experiments expose the latency-throughput trade-off of dedicated warehouses and the role-dependent behavior of copies, clones, and views. The findings characterize the implementation under specified label, data-generation, and role assumptions and provide a basis for weighing classification coverage against additional masking restrictions.
Authors
- Akshay Sharma
Publication Details
- Journal
- Preprints.org
- Published
- 2026-11-18
- DOI
- https://doi.org/10.20944/preprints202611.1770.v1
- Primary Topic
- Privacy-Preserving Technologies in Data
- Type
- preprint