Network accuracy across levels of analysis using stochastic block models.

Researchers apply network psychometric methods across many levels of analysis-from understanding causal pathways (edges) and variable importance (centrality) to uncovering dimensionality (community) and group differences (network similarity).Valid inferences at each level depends on the accuracy of network estimation methods, yet simulation studies have focused almost exclusively on edge recovery using data generating mechanisms that lack known community structures.In this large-scale simulation study, we evaluated four network estimation methods (EBICglasso variants, ggmModSelect, GGMncv, GGMnonreg) across four levels of analysis using stochastic block models with empirically informed edge weight distributions derived from 293 empirical networks in psychology.For most levels, large samples ($1,000) were necessary for adequate recovery, echoing concerns about sufficient evidence for inferences drawn by many published studies.The EBICglasso variants outperformed the other methods in smaller samples (#1,000) and dichotomous data; however, these conditions demonstrated inadequate recovery across methods (including EBICglasso).Most methods achieved adequate accuracy in larger samples ($2,500) and continuous data.Centrality accuracy varied substantially: Network loadings were reliably recovered across all conditions whereas bridge strength was unreliable even under ideal conditions.For node and bridge strength, we recommend reporting raw values rather than rankings, as rank-order recovery required substantially larger samples.We also established interpretation benchmarks for network similarity metrics (s F and Jensen-Shannon similarity) and found community detection to be robust except under challenging conditions (small samples and dichotomous data).Collectively, these findings provide concrete, level-specific guidance for method and measure selection based on sample size and data categories.

Authors

Institutions

Publication Details

Journal
Psychological Methods
Published
2026-07-16
DOI
https://doi.org/10.1037/met0000853
Primary Topic
Network Traffic and Congestion Control
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Network accuracy across levels of analysis using stochastic block models.

Alexander P. Christensen, Jeongwon Choi
Psychological Methods
Network Traffic and Congestion Control
article

Network accuracy across levels of analysis using stochastic block models.

Alexander P. Christensen, Jeongwon Choi
article en

Abstract

Researchers apply network psychometric methods across many levels of analysis-from understanding causal pathways (edges) and variable importance (centrality) to uncovering dimensionality (community) and group differences (network similarity).Valid inferences at each level depends on the accuracy of network estimation methods, yet simulation studies have focused almost exclusively on edge recovery using data generating mechanisms that lack known community structures.In this large-scale simulation study, we evaluated four network estimation methods (EBICglasso variants, ggmModSelect, GGMncv, GGMnonreg) across four levels of analysis using stochastic block models with empirically informed edge weight distributions derived from 293 empirical networks in psychology.For most levels, large samples ($1,000) were necessary for adequate recovery, echoing concerns about sufficient evidence for inferences drawn by many published studies.The EBICglasso variants outperformed the other methods in smaller samples (#1,000) and dichotomous data; however, these conditions demonstrated inadequate recovery across methods (including EBICglasso).Most methods achieved adequate accuracy in larger samples ($2,500) and continuous data.Centrality accuracy varied substantially: Network loadings were reliably recovered across all conditions whereas bridge strength was unreliable even under ideal conditions.For node and bridge strength, we recommend reporting raw values rather than rankings, as rank-order recovery required substantially larger samples.We also established interpretation benchmarks for network similarity metrics (s F and Jensen-Shannon similarity) and found community detection to be robust except under challenging conditions (small samples and dichotomous data).Collectively, these findings provide concrete, level-specific guidance for method and measure selection based on sample size and data categories.

Psychological Methods
Vanderbilt University (US), Peabody (GB)
Openalex Percentile: Top 6%
Network Traffic and Congestion Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.