Page 4 - aruba-today-20220603

A4 U.S. NEWS
Friday 3 June 2022
Oregon dropping AI tool used in child abuse cases

By SALLY HO AND GA- scores the algorithm gener-
RANCE BURKE ates – the higher the num-
Associated Press ber, the greater the risk – as
Child welfare officials in they decide if a different
Oregon will stop using an social worker should go out
algorithm to help decide to investigate the family.
which families are investi- But Oregon officials
gated by social workers, tweaked their original al-
opting instead for a new gorithm to only draw from
process that officials say will internal child welfare data
make better, more racially in calculating a family's risk,
equitable decisions. and tried to deliberately
The move comes weeks address racial bias in its de-
after an Associated Press sign with a "fairness correc-
review of a separate algo- tion."
rithmic tool in Pennsylvania In response to Carnegie
that had originally inspired Mellon University research-
Oregon officials to develop ers' findings that Allegheny
their model, and was found County's algorithm initially
to have flagged a dis- flagged a disproportionate
proportionate number of number of Black families for
Black children for "manda- "mandatory" child neglect
tory" neglect investigations investigations, county of-
when it first was in place. ficials called the research
Oregon's Department "hypothetical," and noted
of Human Services an- that social workers can
nounced to staff via email always override the tool,
last month that after "exten- which was never intended
sive analysis" the agency's to be used on its own.
hotline workers would stop Wyden is a chief sponsor of
using the algorithm at the a bill that seeks to establish
end of June to reduce dis- transparency and national
parities concerning which oversight of software, algo-
families are investigated for Sen. Ron Wyden, D-Ore., speaks during a news conference, on Dec. 15, 2021, on Capitol Hill in rithms and other automat-
child abuse and neglect by Washington. ed systems.
child protective services. Associated Press "With the livelihoods and
"We are committed to con- safety of children and fami-
tinuous quality improve- vestigates the power and and racial disparities in the partment of Human Ser- lies at stake, technology
ment and equity," Lacey consequences of decisions use of the technology, in- vices is taking the concerns used by the state must be
Andresen, the agency's driven by algorithms on cluding their potential to I raised about racial bias equitable -- and I will con-
deputy director, said in the people's everyday lives. harden bias in the child seriously and is pausing the tinue to watchdog," Wyden
May 19 email. ——- welfare system. use of its screening tool." said. The second tool that
Jake Sunderland, a depart- Hotline workers' decisions U.S. Sen. Ron Wyden, an Sunderland said Oregon Oregon developed – an
ment spokesman, said the about reports of child Oregon Democrat, said he child welfare officials had algorithm to help decide
existing algorithm would abuse and neglect mark had long been concerned long been considering when foster care children
"no longer be necessary," a critical moment in the in- about the algorithms used changing their investiga- can be reunified with their
since it can't be used with vestigations process, when by his state's child welfare tions process before mak- families – remains on hiatus
the state's new screen- social workers first decide system and reached out to ing the announcement last as researchers rework the
ing process. He declined if families should face state the department again fol- month. model. Sunderland said the
to provide further details intervention. The stakes are lowing the AP story to ask He added that the state pilot was paused months
about why Oregon decid- high – not attending to an questions about racial bias decided recently that the ago due to inadequate
ed to replace the algorithm allegation could end with a – a prevailing concern with algorithm would be com- data but that there is "no
and would not elaborate child's death, but scrutiniz- the growing use of artificial pletely replaced by its expectation that it will be
on any related disparities ing a family's life could set intelligence tools in child new program, called the unpaused soon."
that influenced the policy them up for separation. protective services. Structured Decision Mak- In recent years while under
change. From California to Colo- "Making decisions about ing model, which aligns scrutiny by a crisis oversight
——- rado and Pennsylvania, as what should happen to with many other child wel- board ordered by the gov-
This story, supported by child welfare agencies use children and families is far fare jurisdictions across the ernor, the state agency –
the Pulitzer Center for Cri- or consider implementing too important a task to country. currently preparing to hire
sis Reporting, is part of an algorithms, an AP review give untested algorithms," Oregon's Safety at Screen- its eighth new child welfare
ongoing Associated Press identified concerns about Wyden said in a statement. ing Tool was inspired by the director in six years – con-
series, "Tracked," that in- transparency, reliability "I'm glad the Oregon De- influential Allegheny Fam- sidered three additional
LIKE US ON ily Screening Tool, which is algorithms, including pre-
dictive models that sought
named for the county sur-
rounding Pittsburgh, and is to assess a child's risk for
aimed at predicting the risk death and severe injury,
that children face of wind- whether children should be
ing up in foster care or be- placed in foster care, and
ing investigated in the fu- if so, where. Sunderland
ture. It was first implement- said the child welfare de-
Facebook.com/arubatoday/ ed in 2018. Social workers partment never built those
view the numerical risk tools, however.q