One method we can use to evaluate our model's predictions for fairness is to compare the admissions rate for the majority group and the minority group. If the two admissions rates are equal, then the model's predictions exhibit demographic parity: a student's chance of being admitted to the university doesn't vary by demographic group.
Suppose the admissions model accepts 16 candidates from the majority group and 4 candidates from the minority group. The model's decisions satisfy demographic parity, as the acceptance rate for both majority and minority candidates is 20%.
![Candidate pool, split into two groups: Rejected Candidates (64 blue
students, 16 orange students) and Accepted Candidates (16 blue
students, 4 orange students).](https://developers.google.cn/static/machine-learning/crash-course/fairness/images/fairness_metrics_demographic_parity.png?authuser=0000)
The following table quantifies the numbers supporting the rejected and accepted candidates in Figure 2.
Majority group | Minority group | |
---|---|---|
Accepted | 16 | 4 |
Rejected | 64 | 16 |
Acceptance Rate | 20% | 20% |
Exercise: Check your intuition
The university admissions committee is considering using demographic parity as the fairness evaluation metric for their model, and needs your guidance on the benefits and drawbacks of this approach. Can you identify one pro and one con of evaluating the model's predictions using demographic parity?
Continue reading the next section, Benefits and Drawbacks, for our summary of the key pros and cons of using demographic parity.
Benefits and Drawbacks
The key benefit of demographic parity for our admissions example is that it ensures that both majority and minority groups are represented in the admitted class of students in the same proportions as they are in the candidate pool. That is, if the applicant pool is comprised of 80% majority-group candidates and 20% minority-group candidates, demographic parity guarantees that the group of admittees will also be 80% majority-group students and 20% minority-group students.
However, demographic parity has one significant drawback: it does not take the distribution of predictions for each demographic group (the number of students classified as "qualified" vs. "unqualified") into account when evaluating how the 20 admissions slots should be allocated.
Let's take another look at the composition of our candidate pool from above. However, this time we'll classify candidates not only by demographic group, but also by whether the model has scored each candidate as "qualified" or "unqualified":
![The same breakdown of Rejected vs. Accepted candidates as in
the previous image, but this time the 50 students who are actually
qualified (35 blue students, 15 orange students) are shaded in green,
and the subset of qualified students who were rejected (19 blue students,
11 orange students) are marked with an X.](https://developers.google.cn/static/machine-learning/crash-course/fairness/images/fairness_metrics_demographic_parity_by_qualifications.png?authuser=0000)
The following table quantifies the numbers supporting the rejected and accepted candidates in Figure 3.
Majority group | Minority group | |||
---|---|---|---|---|
Accepted | Rejected | Accepted | Rejected | |
Qualified | 16 | 19 | 4 | 11 |
Unqualified | 0 | 45 | 0 | 5 |
Let's tabulate the acceptance rates for qualified students for both groups:
Even though both groups have an overall acceptance rate of 20%, satisfying demographic parity, the acceptance rate for qualified majority students is 46%, whereas the acceptance rate for qualified minority students is only 27%.
In cases like this, where the distribution of a preferred label (such as "qualified") varies greatly for both groups, demographic parity may not be the optimal metric to choose for evaluating fairness. In the next section, we'll look at an alternative fairness metric, equality of opportunity, which takes these differences into consideration.