Earth Science News
ABOUT US
Can we rid artificial intelligence of bias?
Reuters Events SMR and Advanced Reactor 2025
Can we rid artificial intelligence of bias?
By Julie JAMMOT with Alex PIGMAN in Washington
San Francisco (AFP) May 19, 2024

Artificial intelligence built on mountains of potentially biased information has created a real risk of automating discrimination, but is there any way to re-educate the machines?

The question for some is extremely urgent. In this ChatGPT era, AI will generate more and more decisions for health care providers, bank lenders or lawyers, using whatever was scoured from the internet as source material.

AI's underlying intelligence, therefore, is only as good as the world it came from, as likely to be filled with wit, wisdom, and usefulness, as well as hatred, prejudice and rants.

"It's dangerous because people are embracing and adopting AI software and really depending on it," said Joshua Weaver, Director of Texas Opportunity & Justice Incubator, a legal consultancy.

"We can get into this feedback loop where the bias in our own selves and culture informs bias in the AI and becomes a sort of reinforcing loop," he said.

Making sure technology more accurately reflects human diversity is not just a political choice.

Other uses of AI, like facial recognition, have seen companies thrown into hot water with authorities for discrimination.

This was the case against Rite-Aid, a US pharmacy chain, where in-store cameras falsely tagged consumers, particularly women and people of color, as shoplifters, according to the Federal Trade Commission.

- 'Got it wrong' -

ChatGPT-style generative AI, which can create a semblance of human-level reasoning in just seconds, opens up new opportunities to get things wrong, experts worry.

The AI giants are well aware of the problem, afraid that their models can descend into bad behavior, or overly reflect a western society when their user base is global.

"We have people asking queries from Indonesia or the US," said Google CEO Sundar Pichai, explaining why requests for images of doctors or lawyers will strive to reflect racial diversity.

But these considerations can reach absurd levels and lead to angry accusations of excessive political correctness.

This is what happened when Google's Gemini image generator spat out an image of German soldiers from World War Two that absurdly included a black man and Asian woman.

"Obviously, the mistake was that we over-applied... where it should have never applied. That was a bug and we got it wrong," Pichai said.

But Sasha Luccioni, a research scientist at Hugging Face, a leading platform for AI models cautioned that "thinking that there's a technological solution to bias is kind of already going down the wrong path."

Generative AI is essentially about whether the output "corresponds to what the user expects it to" and that is largely subjective, she said.

The huge models on which ChatGPT is built "can't reason about what is biased or what isn't so they can't do anything about it," cautioned Jayden Ziegler, head of product at Alembic Technologies.

For now at least, it is up to humans to ensure that the AI generates whatever is appropriate or meets their expectations.

- 'Baked in' bias -

But given the frenzy around AI, that is no easy task.

Hugging Face has about 600,000 AI or machine learning models available on its platform.

"Every couple of weeks a new model comes out and we're kind of scrambling in order to try to just evaluate and document biases or undesirable behaviors," said Luccioni.

One method under development is something called algorithmic disgorgement that would allow engineers to excise content, without ruining the whole model.

But there are serious doubts this can actually work.

Another method would "encourage" a model to go in the right direction, "fine tune" it, "rewarding for right and wrong," said Ram Sriharsha, chief technology officer at Pinecone.

Pinecone is a specialist of retrieval augmented generation (or RAG), a technique where the model fetches information from a fixed trusted source.

For Weaver of the Texas Opportunity & Justice Incubator, these "noble" attempts to fix bias are "projections of our hopes and dreams for what a better version of the future can look like."

But bias "is also inherent into what it means to be human and because of that, it's also baked into the AI as well," he said.

Related Links
All About Human Beings and How We Got To Be Here

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
ABOUT US
Amazonian chief at UN to combat traditional knowledge piracy
Geneva (AFP) May 14, 2024
The leader of the Brazilian Amazon's Huni Kui people remains hopeful that a planned United Nations treaty will advance the fight against biopiracy: the pillaging of traditional knowledge and genetic resources. However, discussions towards concluding the agreement are progressing "very slowly", Chief Ninawa told AFP on the sidelines of the treaty talks at the headquarters of the UN's World Intellectual Property Organization in Geneva. Wearing traditional costume, Ninawa officially blessed the WI ... read more

ABOUT US
Natural disasters hit 1 in 5 US adults' finances in 2023: Fed

Brazil mayor's mammoth task: rebuild from floods, prevent more

Mumbai billboard owner arrested after deadly collapse: reports

US military sees 500 tons of aid soon into Gaza via pier

ABOUT US
UK clears way for Microsoft-Mistral AI tie-up

'Grand Theft Auto VI' release set for late 2025

Energy transition risks critical mineral shortage: IEA

Microbial Enzyme Could Make Plastics Biodegradable

ABOUT US
Small island states win 'historic' climate case at UN court

French marines patrol New Caledonia after deadly riots

Paraguay, Pacific island leaders to attend Taiwan inauguration

Controversial floating beach unveiled off French Riviera

ABOUT US
For sale: unique piece of land in strategic Arctic archipelago

Climate change key driver of record-low Antarctic sea ice: study

For sale: unique piece of land in strategic Arctic archipelago

Daily ice loss in Greenland tracked by new GPS method

ABOUT US
Demise of rangelands 'severely underestimated': report

Changing climate influences London's Chelsea Flower Show

Mosaic grasslands found most effective in Switzerland

Fear brews in Turkey's landslide-plagued tea hills

ABOUT US
Schools, factories closed after quake 'swarm' near Naples

Indonesia evacuates hundreds near erupting volcano

Uncertain future for thousands after deadly Brazil floods

Parts of northern Europe clean up after floods

ABOUT US
US to withdraw from Niger by mid-Sept; Niger blames US 'threats' for broken military ties

Burkina loyalists rally after gunfire near presidency

Fighting in Niger kills 7 soldiers, dozens of 'terrorists'

Senegal PM questions French military presence

ABOUT US
Can we rid artificial intelligence of bias?

Amazonian chief at UN to combat traditional knowledge piracy

In US national parks, a historical wound begins to heal

A fragment of human brain, mapped

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.