Position: Beyond Sensitive Attributes, ML Fairness Should Quantify Structural Injustice via Social Determinants
This position paper argues that algorithmic fairness research must move beyond focusing solely on sensitive attributes to quantify structural injustice through social determinants, demonstrating that current mitigation strategies often fail to address systemic inequities and can even exacerbate them.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
The Big Idea: Looking at the Whole Picture, Not Just the Person
Imagine you are a judge trying to decide who gets into a special club. For a long time, the rulebook for "fairness" has told you to look only at the person sitting in front of you. You check their race, gender, or age. If you see two people with the same race and gender, the rulebook says you must treat them exactly the same.
The authors of this paper argue that this approach is like judging a fish by its ability to climb a tree. It misses the most important part of the story: the environment.
They say we need to stop looking just at the "sensitive attributes" (like race or gender) and start measuring Social Determinants. Think of these as the "soil" the person is growing in. Is the soil rich and full of nutrients (good schools, clean air, safe streets)? Or is it rocky and dry (poor schools, pollution, lack of doctors)?
The paper argues that unfairness isn't just about how people are treated individually; it's about the structural injustice built into the neighborhoods and systems they live in.
The Problem: The "Noise" vs. The "Signal"
In current machine learning (AI) fairness research, when data scientists see variables related to a person's neighborhood or environment, they often treat them as "noise"—static background clutter that they try to filter out or ignore to make the model "clean."
The authors say this is a mistake. They argue that these environmental factors are actually the "signal." They are the real story.
The Analogy:
Imagine you are running a race.
- Current Approach: You look at two runners. One is wearing a red shirt, the other a blue shirt. You see the red-shirt runner is slower. You assume the red shirt is the problem and try to fix the runner's shoes.
- Paper's Approach: You realize the red-shirt runner is running on a muddy, uphill path, while the blue-shirt runner is on a smooth, flat track. The "red shirt" (sensitive attribute) isn't the cause of the slowness; the mud and the hill (social determinants) are. If you only fix the shoes but leave the mud, the runner will still lose.
Why the Old Way Fails (The "Quota" Trap)
The paper uses a thought experiment about college admissions to show why focusing only on sensitive attributes can actually make things worse.
The Scenario:
Imagine a college wants to be fair to "Underrepresented Minorities" (URMs). They decide to set aside a specific number of seats (a quota) for URM students.
- The Intention: This seems fair. It helps the group that has been historically left out.
- The Unintended Consequence: The authors show that this strategy often helps the wealthier URM students the most, while hurting the poorer non-URM students.
The Metaphor:
Imagine a lifeboat that can only hold 10 people.
- Old Fairness: "We will save 5 people from Group A and 5 from Group B."
- The Reality: Group A has 5 people on a sinking ship (rich area) and 5 people in a swamp (poor area). Group B has 5 people on a sinking ship and 5 in a swamp.
- If you only look at the "Group" label, you might save the 5 from Group A who are on the sinking ship. But you leave the 5 from Group B who are in the swamp to drown, even though they are in just as much danger.
- The Result: By focusing only on the "Group" label, you accidentally ignore the fact that the people in the swamp (regardless of their group) need help the most. You create a new kind of unfairness.
Real-World Proof: The "Black Women" Example
The authors didn't just use theory; they looked at real data.
- Income: They looked at Black women in different neighborhoods. Even though they are all "Black women" (same sensitive attributes), their incomes were wildly different depending on where they lived. In poor neighborhoods (high "Area Deprivation"), their incomes were much lower than in rich neighborhoods. The "Black woman" label didn't tell the whole story; the neighborhood did.
- Healthcare: They looked at breast cancer screening. Even among White women in the same healthcare system, those in poor neighborhoods waited much longer to get their first screening than those in rich neighborhoods. The doctors followed the same rules for everyone, but the environment (transportation, time off work, access) created the gap.
The Solution: A New Toolkit
The paper calls for three major changes in how we build and test AI:
- Data Governance (The Map): We need to start mapping the "soil." Instead of just collecting data on people, we need to collect data on their neighborhoods, school funding, and pollution levels. We need to treat this data as a crucial part of the puzzle, not as "noise" to be deleted.
- New Metrics (The Ruler): We need new ways to measure fairness. Instead of just asking, "Are the outcomes equal for Group A and Group B?", we should ask, "Are the outcomes equal for people living in Rich Soil vs. Poor Soil?"
- Causal Models (The Mechanic): We need to build AI that understands cause and effect. It shouldn't just see that "Living in a poor area" leads to "Worse outcomes." It needs to understand why (e.g., lack of doctors, bad roads) so we can fix the root cause, not just the symptom.
The Bottom Line
The paper concludes that we cannot achieve true fairness just by ignoring sensitive attributes or by trying to balance them perfectly. We have to audit the structural injustice first.
Think of it like fixing a leaky roof. If you just keep mopping the floor (fixing individual discrimination), the house will eventually rot. You have to fix the roof (the social determinants) to stop the water from coming in in the first place. The authors want machine learning to stop mopping the floor and start fixing the roof.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.