The growing use of artificial intelligence will likely lead to biased and discriminatory outcomes for minorities and disabled people, several groups warned the federal government this week.
The National Artificial intelligence Advisory Committee, an interagency group led by the Commerce Department, held a public hearing online Tuesday aimed at informing policymakers about how the government can best manage the use of AI. Panelists were told by most of the witnesses that bias and discrimination are the biggest fears for the people they represent.
Patrice Willoughby, vice president of policy and legislative affairs at the NAACP, told panelists that technology has already been used as a means to disenfranchise and mislead voters, and said her group worries about AI for the same reason.
‘In that context, we have great concerns about the rise and use of AI in its different platforms,’ she said. ‘The rise of AI and its ease of use really causes us great concern.’
Frank Torres, who works on civil rights issues at the Leadership Conference on Civil and Human Rights, told the panel that the government must take charge and create mechanisms to ensure AI systems are developed and used in ways that promote ‘equity and civil rights.
‘To realize the full potential of this technology, we have to address and make sure that it’s truly free from bias, that it doesn’t result in discriminatory outcomes,’ he said. ‘It has to be centered on equity and civil rights.’
Several observers have warned that AI has the potential to create discriminatory outcomes because it uses data sets that are biased. Using ‘bad data’ could lead AI systems to reject loans or make other decisions that perpetuate that bias.
In the advisory committee discussion, National Fair Housing Alliance President and CEO Lisa Rice said past technology has shown that bias is something the government needs to be wary of as it regulates AI.
‘Every algorithmic system we’ve analyzed — credit scoring systems, risk-based pricing, automated underwriting, insurance scoring, digital marketing, tenant screening selection, facial recognition, automated valuation and other models — generate bias and inflict untold harm on consumers,’ she said. ‘Machines have simply mimicked and replaced human bias.’
JudeAnne Health, national programs director for the Hispanic Technology & Telecommunications Partnership, said her group is worried about AI based on biased data that may ‘exacerbate existing inequalities.’ She suggested rigorous oversight by the federal government that should be aimed squarely at fighting bias.
‘Does that oversight include a diverse group of stakeholders, backgrounds, languages, educations?’ she asked. ‘Not just scientists, but sociologists, community members.’
Emily Chi, a senior director at Asian Americans Advancing Justice, said her group is also worried about discrimination that’s ‘already embedded in the data.’ When asked for an example of bias in AI, Chi said some content moderation systems are failing to remove content that’s discriminatory or ‘harmful’ to Asian Americans, and said systems need to be in place to ensure these sorts of oversights are corrected.
‘Going directly to the people who are most vulnerable, who are most oppressed in our society, and understanding how these technologies affect their day to day lived experiences,’ Chi said.
Another witness said the government needs to pay attention to how AI might discriminate against disabled people.
‘We are only going to see the full potential of tech for disabled people realized in all aspects of life if that technology, including AI, is built from the start to be accessible and free from ableism,’ said Maria Town, president and CEO of the American Association of People with Disabilities.
‘While many assume that automated employment decision tools are free from bias because the human element is removed, at AAPD we have seen repeatedly that AI-based tools reflect the preferences of the people who make them and of the larger society that these tools exist within,’ she said.
The advisory committee has held a handful of hearings and will hold a few more over the next week aimed at collecting input that will feed into the Biden administration’s process for determining when and how to regulate AI. Just this week, the White House said several efforts to set federal rules for AI would be coming in the next few weeks, and Congress is also examining how to regulate AI.
