An evaluation of the racial equity of the actuarial Family risk assessment instrument used in Queensland, Australia

• The FRA did not meet either criterion of racial equity tested. • Most items on the FRA were better predictors of race than child protection recurrence. • The FRA produced high rates of false positives for Indigenous children. • Practitioner discretion did not mitigate racial bias inherent in the FRA. • Observed bias exacerbates Indigenous overrepresentation in child protection. Risk assessment instruments used in child protection to guide intervention decisions should be equitable. To be considered equitable, two criteria are necessary: instruments should avoid discriminatory logic and display comparative validity for children of different races. Empirical evidence about the equity of risk assessment instruments is limited. Objective: To investigate the racial equity of a widely used risk assessment instrument, the Structured Decision Making Family Risk Assessment (FRA). Participants and setting: Administrative data were obtained for all children subject to investigation in Queensland, Australia in 2018, for whom an FRA was completed (n = 17,851). Relationships between FRA items, race, and recurrence (subsequent investigation within 12 months) were explored using crosstabulations and Cox Proportional Hazards. Accuracy of FRA recommendations and practitioner decisions were compared using sensitivity and specificity for Indigenous and non-Indigenous children. Most FRA items predicted race better than recurrence. Differences in recurrence by race were only partially explained by FRA items. The FRA produced high rates of false positives for Indigenous children (incorrectly classifying 48.9% of children who did not recur compared to 31.7% for non-Indigenous children) and high rates of false negatives for non-Indigenous children (incorrectly classifying 59% of children who did recur compared to 39% for Indigenous children). Practitioner discretion did not mitigate inequitable FRA recommendations. The FRA failed both criteria of equity, discriminating indirectly by relying heavily on factors correlated with race, and demonstrating less accuracy for Indigenous children. High rates of false positives for Indigenous children exacerbate Indigenous overrepresentation in child protection.

Authors

Institutions

Publication Details

Journal
Children and Youth Services Review
Published
2024-08-29
DOI
https://doi.org/10.1016/j.childyouth.2024.107891
Citations
3
Primary Topic
Insurance and Financial Risk Management
Type
article
Field-Weighted Citation Impact
3.39
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An evaluation of the racial equity of the actuarial Family risk assessment instrument used in Queensland, Australia

Brian Q. Jenkins, Clare Tilbury
3 citations
Children and Youth Services Review
Insurance and Financial Risk Management
3.39
article

An evaluation of the racial equity of the actuarial Family risk assessment instrument used in Queensland, Australia

Brian Q. Jenkins, Clare Tilbury
article en
3 citations

Abstract

• The FRA did not meet either criterion of racial equity tested. • Most items on the FRA were better predictors of race than child protection recurrence. • The FRA produced high rates of false positives for Indigenous children. • Practitioner discretion did not mitigate racial bias inherent in the FRA. • Observed bias exacerbates Indigenous overrepresentation in child protection. Risk assessment instruments used in child protection to guide intervention decisions should be equitable. To be considered equitable, two criteria are necessary: instruments should avoid discriminatory logic and display comparative validity for children of different races. Empirical evidence about the equity of risk assessment instruments is limited. Objective: To investigate the racial equity of a widely used risk assessment instrument, the Structured Decision Making Family Risk Assessment (FRA). Participants and setting: Administrative data were obtained for all children subject to investigation in Queensland, Australia in 2018, for whom an FRA was completed (n = 17,851). Relationships between FRA items, race, and recurrence (subsequent investigation within 12 months) were explored using crosstabulations and Cox Proportional Hazards. Accuracy of FRA recommendations and practitioner decisions were compared using sensitivity and specificity for Indigenous and non-Indigenous children. Most FRA items predicted race better than recurrence. Differences in recurrence by race were only partially explained by FRA items. The FRA produced high rates of false positives for Indigenous children (incorrectly classifying 48.9% of children who did not recur compared to 31.7% for non-Indigenous children) and high rates of false negatives for non-Indigenous children (incorrectly classifying 59% of children who did recur compared to 39% for Indigenous children). Practitioner discretion did not mitigate inequitable FRA recommendations. The FRA failed both criteria of equity, discriminating indirectly by relying heavily on factors correlated with race, and demonstrating less accuracy for Indigenous children. High rates of false positives for Indigenous children exacerbate Indigenous overrepresentation in child protection.

Children and Youth Services ReviewVol. 164
Griffith University (AU)
Openalex Percentile: Top 6%
Insurance and Financial Risk Management
3.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.