Evaluating User Experience of SITASI System using HEART Metrics and Importance-Performance Analysis (IPA)

SITASI is a web-based system developed to help students manage references and citations for their final projects. Despite its importance, no comprehensive evaluation of the system’s user experience (UX) had been conducted. This study aims to evaluate the UX of SITASI used by students of the Information Systems Study Programme at UIN Suska Riau. Using a quantitative survey method, data were collected from 72 active students from the 2018-2021 cohorts through an online questionnaire. The evaluation was based on the five HEART Metrics dimensions: Happiness, Engagement, Adoption, Retention, and Task Success. Respondents were selected through random sampling using the Slovin formula. Data were analysed using SPSS version 30 for validity, reliability, and Importance-Performance Analysis (IPA). The HEART results indicated high usability levels across all dimensions, with Happiness and Retention scoring highest (73%) and Engagement lowest (70%). IPA showed an average suitability of 92%, with four indicators placed in Quadrant I, signifying urgent areas for improvement. These results serve as a foundation for actionable recommendations to enhance system satisfaction, improve performance, and develop a more user-centered and adaptive SITASI platform.

Institutions

Publication Details

Journal
EDUMATIC Jurnal Pendidikan Informatika
Published
2025-08-14
DOI
https://doi.org/10.29408/edumatic.v9i2.30691
Primary Topic
Genomics and Phylogenetic Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating User Experience of SITASI System using HEART Metrics and Importance-Performance Analysis (IPA)

EDUMATIC Jurnal Pendidikan Informatika
Genomics and Phylogenetic Studies
article

Evaluating User Experience of SITASI System using HEART Metrics and Importance-Performance Analysis (IPA)

article en

Abstract

SITASI is a web-based system developed to help students manage references and citations for their final projects. Despite its importance, no comprehensive evaluation of the system’s user experience (UX) had been conducted. This study aims to evaluate the UX of SITASI used by students of the Information Systems Study Programme at UIN Suska Riau. Using a quantitative survey method, data were collected from 72 active students from the 2018-2021 cohorts through an online questionnaire. The evaluation was based on the five HEART Metrics dimensions: Happiness, Engagement, Adoption, Retention, and Task Success. Respondents were selected through random sampling using the Slovin formula. Data were analysed using SPSS version 30 for validity, reliability, and Importance-Performance Analysis (IPA). The HEART results indicated high usability levels across all dimensions, with Happiness and Retention scoring highest (73%) and Engagement lowest (70%). IPA showed an average suitability of 92%, with four indicators placed in Quadrant I, signifying urgent areas for improvement. These results serve as a foundation for actionable recommendations to enhance system satisfaction, improve performance, and develop a more user-centered and adaptive SITASI platform.

EDUMATIC Jurnal Pendidikan InformatikaVol. 9(2)
Universitas Islam Negeri Sultan Syarif Kasim Riau (ID)
Openalex Percentile: Top 47%
Genomics and Phylogenetic Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.