Trust model for artificial intelligence application systems

The problem of assessment and trust validation of applied artificial intelligence systems is examined. Despite the diversity of studies in this area, it is shown that in fact there is no unified approach to trust validation. At the same time, different researchers emphasize one or another aspect of trust without attempting to cover the problem as a whole. The trust feature is reduced to an emotional characteristic, the constructive meaning of which in the context of artificial intelligence systems lifecycle management is not defined. In some cases there is an unjustified ‘humanization’ of the concept of trust, as a result of which the characteristics of a technical system are completely replaced by the subjective treatment of its creators, suppliers or owners. The paper attempts to substantiate a holistic trust model for artificial intelligence systems based on formalization of the relationship between trust and system quality. In this case the paper shows that the characteristic of trust can be used to make a decision by the operator, regulators and other interested parties about the possibility (or impossibility) to use the system as intended in certain operating conditions. The main aspects of trust are identified, taking into account both the general issues of trust in automated systems (technical reliability, information security and import independence) and the specifics of AI systems based on machine learning algorithms (functional correctness), and an approach to evaluating the characteristics of the artificial intelligence systems according to these aspects is proposed. The obtained results can be used for the development of conformity assessment system in the field of AI technologies, as well as for the selection of systems that provide the solution of intelligent data processing tasks in various industries and social sphere.

Authors

Institutions

Publication Details

Journal
Moscow University Bulletin Series 21 Public administration
Published
2024-12-30
DOI
https://doi.org/10.55959/msu2073-2643-21-2024-4-151-169
Citations
2
Primary Topic
Cloud Data Security Solutions
Type
article
Field-Weighted Citation Impact
1.56
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Trust model for artificial intelligence application systems

S.V. Garbuk
2 citations
Moscow University Bulletin Series 21 Public administration
Cloud Data Security Solutions
1.56
article

Trust model for artificial intelligence application systems

S.V. Garbuk
article en
2 citations

Abstract

The problem of assessment and trust validation of applied artificial intelligence systems is examined. Despite the diversity of studies in this area, it is shown that in fact there is no unified approach to trust validation. At the same time, different researchers emphasize one or another aspect of trust without attempting to cover the problem as a whole. The trust feature is reduced to an emotional characteristic, the constructive meaning of which in the context of artificial intelligence systems lifecycle management is not defined. In some cases there is an unjustified ‘humanization’ of the concept of trust, as a result of which the characteristics of a technical system are completely replaced by the subjective treatment of its creators, suppliers or owners. The paper attempts to substantiate a holistic trust model for artificial intelligence systems based on formalization of the relationship between trust and system quality. In this case the paper shows that the characteristic of trust can be used to make a decision by the operator, regulators and other interested parties about the possibility (or impossibility) to use the system as intended in certain operating conditions. The main aspects of trust are identified, taking into account both the general issues of trust in automated systems (technical reliability, information security and import independence) and the specifics of AI systems based on machine learning algorithms (functional correctness), and an approach to evaluating the characteristics of the artificial intelligence systems according to these aspects is proposed. The obtained results can be used for the development of conformity assessment system in the field of AI technologies, as well as for the selection of systems that provide the solution of intelligent data processing tasks in various industries and social sphere.

Moscow University Bulletin Series 21 Public administrationVol. 21(№4, 2024)
Russian Academy of Sciences (RU), All Russian Institute for Scientific and Technical Information (RU)
Openalex Percentile: Top 11%
Cloud Data Security Solutions
1.56
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.