Research on Key Technologies and Verification Methods for Software Pilot Testing Oriented to Production Deployment

Software pilot testing plays a critical role as an intermediate stage between R&D validation and production deployment, particularly in the context of digital transformation. However, the lack of systematic frameworks has hindered its effectiveness in ensuring readiness for deployment at scale. This paper proposes a software pilot testing framework specifically designed for production environments, addressing key challenges related to environmental fidelity, method selection, and maturity assessment. Three core technologies are introduced: (1) an Environment Discrepancy Risk Index (EDRI) model for quantifying environmental deviations; (2) a Dynamic Combinatorial Verification Strategy (DCVS) that balances cost and risk; and (3) an interpretable maturity evaluation model based on XGBoost-SHAP. Experimental results show that the EDRI model strongly correlates with failure rates (r > 0.91), the DCVS improves defect coverage by 7.3% while reducing cost by 35.9%, and the maturity model achieves an F1-score of 0.91. The proposed framework significantly enhances the scientific rigor and operational reliability of software pilot testing for production deployment.

Authors

Institutions

Publication Details

Published
2025-07-11
DOI
https://doi.org/10.1109/cisat66811.2025.11181980
Primary Topic
Software Reliability and Analysis Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Key Technologies and Verification Methods for Software Pilot Testing Oriented to Production Deployment

Cijia Zhi, Yin Luo, Dan Li, Jun Lin et al.
Software Reliability and Analysis Research
article

Research on Key Technologies and Verification Methods for Software Pilot Testing Oriented to Production Deployment

Cijia Zhi, Yin Luo, Dan Li, Jun Lin, Dongyu Yang, Xun Lu
article en

Abstract

Software pilot testing plays a critical role as an intermediate stage between R&D validation and production deployment, particularly in the context of digital transformation. However, the lack of systematic frameworks has hindered its effectiveness in ensuring readiness for deployment at scale. This paper proposes a software pilot testing framework specifically designed for production environments, addressing key challenges related to environmental fidelity, method selection, and maturity assessment. Three core technologies are introduced: (1) an Environment Discrepancy Risk Index (EDRI) model for quantifying environmental deviations; (2) a Dynamic Combinatorial Verification Strategy (DCVS) that balances cost and risk; and (3) an interpretable maturity evaluation model based on XGBoost-SHAP. Experimental results show that the EDRI model strongly correlates with failure rates (r > 0.91), the DCVS improves defect coverage by 7.3% while reducing cost by 35.9%, and the maturity model achieves an F1-score of 0.91. The proposed framework significantly enhances the scientific rigor and operational reliability of software pilot testing for production deployment.

China Electronic Product Reliability and Environmental Test Institute (CN), UCSI University (MY), Ministry of Industry and Information Technology (CN)
Openalex Percentile: Top 72%
Software Reliability and Analysis Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on Key Technologies and Verification Methods for Software Pilot Testing Oriented to Production Deployment — Cijia Zhi, Yin Luo, et al. · (2025) | TGRS Research Map | TGRS