Generative Simulations of Online Social Networks for Evaluating Moderation Strategies

Evaluation of moderation effects on the macro-level dynamics of Online Social Networks (OSNs) has traditionally relied on empirical, on-the-field methods that impose considerable limitations on both data collection and reliability, primarily concerning high costs and lack of control. The advent of Large Language Models (LLMs) and prompt learning frameworks has led to significant advancements in Agent Based Modeling (ABM), enabling the simulation of human-like behavior with unprecedented degree of believability. These latest developments pave the way for new experimental solutions. The present work takes the pioneering step of exploring simulation-based evaluation of moderation systems by introducing a novel OSN simulator powered by LLMs. Designed for the implementation of counterfactual-based experiments, this software tool supports robust, multi-dimensional analyses of moderation effects, with a keen focus on abusive and toxic discourse.

Publication Details

Journal
Electronic Theses and Dissertations Repository (University of Pisa)
Published
2024-11-03
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generative Simulations of Online Social Networks for Evaluating Moderation Strategies

Electronic Theses and Dissertations Repository (University of Pisa)
Hate Speech and Cyberbullying Detection
article

Generative Simulations of Online Social Networks for Evaluating Moderation Strategies

article en

Abstract

Evaluation of moderation effects on the macro-level dynamics of Online Social Networks (OSNs) has traditionally relied on empirical, on-the-field methods that impose considerable limitations on both data collection and reliability, primarily concerning high costs and lack of control. The advent of Large Language Models (LLMs) and prompt learning frameworks has led to significant advancements in Agent Based Modeling (ABM), enabling the simulation of human-like behavior with unprecedented degree of believability. These latest developments pave the way for new experimental solutions. The present work takes the pioneering step of exploring simulation-based evaluation of moderation systems by introducing a novel OSN simulator powered by LLMs. Designed for the implementation of counterfactual-based experiments, this software tool supports robust, multi-dimensional analyses of moderation effects, with a keen focus on abusive and toxic discourse.

Electronic Theses and Dissertations Repository (University of Pisa)
Peace, Justice and strong institutions
Openalex Percentile: Top 55%
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.