Multicriteria Selection of Conference Manuscript Evaluation System Type Based on TOPSIS in Scientific Review Management

When managing scientific review, to organize its successful functioning, the conference committee needs not only to conduct correct reviewer assignment on manuscripts received, but to provide reviewers with a high-quality scientific work evaluation system. A scoring rubric or special instruction usually acts as this system. Several studies focus on developing and evaluating manuscript scoring rubrics, however, in the former the main emphasis is on the content and descriptive components of the scoring rubrics. They do not consider a preferred degree of detail of the scoring rubric. Also, in the current works, the impact of this manuscript evaluation system on all the review process stakeholders is not sufficiently taken into account. To close this gap, a method of multicriteria selection of a conference manuscript evaluation system type based on TOPSIS, is suggested in the paper. When testing the method for international conferences, the scoring rubric type that in general accommodates the interests of the main review process participants was defined.

Authors

Publication Details

Published
2024-11-13
DOI
https://doi.org/10.1109/summa64428.2024.10803687
Primary Topic
Educational Technology and Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multicriteria Selection of Conference Manuscript Evaluation System Type Based on TOPSIS in Scientific Review Management

В.А. Латыпова
Educational Technology and Assessment
article

Multicriteria Selection of Conference Manuscript Evaluation System Type Based on TOPSIS in Scientific Review Management

В.А. Латыпова
article en

Abstract

When managing scientific review, to organize its successful functioning, the conference committee needs not only to conduct correct reviewer assignment on manuscripts received, but to provide reviewers with a high-quality scientific work evaluation system. A scoring rubric or special instruction usually acts as this system. Several studies focus on developing and evaluating manuscript scoring rubrics, however, in the former the main emphasis is on the content and descriptive components of the scoring rubrics. They do not consider a preferred degree of detail of the scoring rubric. Also, in the current works, the impact of this manuscript evaluation system on all the review process stakeholders is not sufficiently taken into account. To close this gap, a method of multicriteria selection of a conference manuscript evaluation system type based on TOPSIS, is suggested in the paper. When testing the method for international conferences, the scoring rubric type that in general accommodates the interests of the main review process participants was defined.

Climate action
Openalex Percentile: Top 62%
Educational Technology and Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.