Free Republic
Browse · Search
Bloggers & Personal
Topics · Post Article

Skip to comments.

A technique to improve both fairness and accuracy in artificial intelligence
techxplore ^ | 07/20/2022

Posted on 07/20/2022 3:25:25 PM PDT by devane617

For workers who use machine-learning models to help them make decisions, knowing when to trust a model's predictions is not always an easy task, especially since these models are often so complex that their inner workings remain a mystery.

Users sometimes employ a technique, known as selective regression, in which the model estimates its confidence level for each prediction and will reject predictions when its confidence is too low. Then a human can examine those cases, gather additional information, and make a decision about each one manually.

But while selective regression has been shown to improve the overall performance of a model, researchers at MIT and the MIT-IBM Watson AI Lab have discovered that the technique can have the opposite effect for underrepresented groups of people in a dataset. As the model's confidence increases with selective regression, its chance of making the right prediction also increases, but this does not always happen for all subgroups.

For instance, a model suggesting loan approvals might make fewer errors on average, but it may actually make more wrong predictions for Black or female applicants. One reason this can occur is due to the fact that the model's confidence measure is trained using overrepresented groups and may not be accurate for these underrepresented groups.

Once they had identified this problem, the MIT researchers developed two algorithms that can remedy the issue. Using real-world datasets, they show that the algorithms reduce performance disparities that had affected marginalized subgroups.

(Excerpt) Read more at techxplore.com ...


TOPICS:
KEYWORDS: ai; computers
Navigation: use the links below to view more comments.
first 1-2021-25 next last
...or, how to make an A.I. algorithm WOKE...
1 posted on 07/20/2022 3:25:25 PM PDT by devane617
[ Post Reply | Private Reply | View Replies]

To: devane617

The algorithms have NO bias. They are reflecting true facts of the world that today’s wokeness prevents us from admitting.


2 posted on 07/20/2022 3:28:08 PM PDT by I want the USA back (Damn it! We need Trump! America First!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: devane617

We demand equal outcomes


3 posted on 07/20/2022 3:31:46 PM PDT by Nifster (I see puppy dogs in the clouds)
[ Post Reply | Private Reply | To 1 | View Replies]

To: devane617

More poison...! You cannot gaslight an algorithm to make someone college material or credit worthy, but it looks like that is being tried.


4 posted on 07/20/2022 3:33:17 PM PDT by Anti-Bubba182
[ Post Reply | Private Reply | To 1 | View Replies]

To: devane617

Selective Regression as described is likely to increase the confidence and presumption of accuracy by the average user.
In other words, Selective Regression would require more checking, clarifying and tinkering than the average user would want to bother doing.

In America, we are used to a ‘set it & forget it’ type of dynamic. We expect extremely accurate results and we tend to get lazy on checking those results.
I saw it first some 45 years ago when calculators were introduced into classrooms. How many of us actually checked the sums provided by our little ‘miracle machines’?
I sure didn’t, unless ordered to by a teacher.


5 posted on 07/20/2022 3:33:21 PM PDT by lee martell
[ Post Reply | Private Reply | To 1 | View Replies]

To: devane617

“For instance, a model suggesting loan approvals might make fewer errors on average, but it may actually make more wrong predictions for Black or female applicants. One reason this can occur is due to the fact that the model’s confidence measure is trained using overrepresented groups and may not be accurate for these underrepresented groups.”

Ha ha ha. The model should be color-blind and just look at facts.

Confidence level? The confidence level that matters involves whether the loan applicant is likely to pay back the loan.


6 posted on 07/20/2022 3:34:27 PM PDT by plain talk
[ Post Reply | Private Reply | To 1 | View Replies]

To: devane617

Just wait until are almost fully socialized medical system uses AI to decide who gets rationed out and who gets rationed in for treatment.


7 posted on 07/20/2022 3:34:28 PM PDT by fruser1
[ Post Reply | Private Reply | To 1 | View Replies]

To: I want the USA back; All

Easy! Solve it by introducing the desired bias into the algorithm.
Then claim it isn’t there!


8 posted on 07/20/2022 3:41:19 PM PDT by Reily
[ Post Reply | Private Reply | To 2 | View Replies]

To: I want the USA back

🎯
How long before they talk about the Earth’s new black box, run by Ai and powered by solar. Making Ai more or less immortal.


9 posted on 07/20/2022 3:43:17 PM PDT by M_Continuum
[ Post Reply | Private Reply | To 2 | View Replies]

To: lee martell

I had a number crunching job in the 1990s and developed Excel spreadsheets to do the work.

My old timer boss checked every single calculation for a year before he trusted the spreadsheets.

At that point he threw in the towel and started using them.

;-)


10 posted on 07/20/2022 3:46:04 PM PDT by cgbg (A kleptocracy--if they can keep it. Think of it as the Cantillon Effect in action.)
[ Post Reply | Private Reply | To 5 | View Replies]

To: devane617
So now computer algorithms need to be WOKE? Our civilization is doomed if this nonsense is not halted immediately. We are experiencing something out of an episode of Star Trek: TOS, where the Enterprise stumbles across some ancient dead civilization that destroyed itself over some utter nonsense. That dead civilization will be us if we don't do something.
11 posted on 07/20/2022 3:46:12 PM PDT by Rummyfan (In any war between the civilized man and the savage, support the civilized man. )
[ Post Reply | Private Reply | To 1 | View Replies]

To: Anti-Bubba182

12 posted on 07/20/2022 3:48:15 PM PDT by Bobalu (A dem asked what side I was for in Ukraine, I said "I'm against the commies" -- He got real pissed!)
[ Post Reply | Private Reply | To 4 | View Replies]

To: devane617

paint everything black...


13 posted on 07/20/2022 3:49:06 PM PDT by heavy metal (smiling improves your face value and makes people wonder what the hell you're up to... 😁)
[ Post Reply | Private Reply | To 1 | View Replies]

To: I want the USA back
The algorithms have NO bias

That is what these algorithms aim to correct. Much like a woke employee making decisions based on race and sex rather than merit, they want the AI doing the same. I once listened to Jordan Peterson worry about AI because the worlds most evil people are generally in charge of programming it.

14 posted on 07/20/2022 3:49:31 PM PDT by RightOnTheBorder
[ Post Reply | Private Reply | To 2 | View Replies]

To: M_Continuum
...talk about the Earth’s new black box, run by Ai and powered by solar. Making Ai more or less immortal.

I was under the distinct impression that solar power is not available at night. Or on a cloudy day.

And batteries eventually wear out.

I am not too worried about an "immortal" AI.

15 posted on 07/20/2022 3:50:14 PM PDT by flamberge (Those who pose the greatest danger to you are living within five miles of you.)
[ Post Reply | Private Reply | To 9 | View Replies]

To: cgbg

That’s a good boss. He walked the talk.


16 posted on 07/20/2022 4:11:18 PM PDT by lee martell
[ Post Reply | Private Reply | To 10 | View Replies]

To: flamberge

I have not looked that deeply in to it yet. Technology, AI and batteries are all advancing rapidly. It is meant to survive the end of Earth and beyond. https://www.earthsblackbox.com/


17 posted on 07/20/2022 4:12:30 PM PDT by M_Continuum
[ Post Reply | Private Reply | To 15 | View Replies]

To: devane617

LOL. In other words, when a model built on logic does not take political pressure and liberal, woke concerns into account, it awards loans to the people most likely to repay them and doesn’t falsely claim that certain minorities are just as good of a credit risk as whites.


18 posted on 07/20/2022 4:13:48 PM PDT by Opinionated Blowhard (When the people find that they can vote themselves money, that will herald the end of the republic.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: cgbg
I was tasked with performing jet aircraft performance calculations for the Embraer Phenom 100 Jet and a couple Airbus helicopters. For the Phenom, I had CSV spreadsheets with real aircraft data for takeoff, climb, cruise, descent, landing and special cases with one engine out. Many of the calculations were quadrilinear interpolation problems. Most calcs were "forward" ops, but a few requested desired end-state and satisfied a subset of the "forward" calcs. In the end, my performance calculators were certified to match the manufacturers manual and integrated into the mission planning system. All performed in C++ to meet performance requirements.

Some of the "corner cases" for the H135 and H145 helicopters were very challenging. The delivered library had over 5500 unit tests with every normal and corner case tested.

19 posted on 07/20/2022 4:43:19 PM PDT by Myrddin
[ Post Reply | Private Reply | To 10 | View Replies]

To: devane617

fairness...

when it comes right down to it, it’s ALL 1’s and 0’s

what do they want, an equal number of 0’s and 1’s???


20 posted on 07/20/2022 4:47:37 PM PDT by Chode (there is no fall back position, there's no rally point, there is no LZ... we're on our own. #FJB)
[ Post Reply | Private Reply | To 1 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-25 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
Bloggers & Personal
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson