Examples

See Aequitas in action with the following demos.

• COMPAS Analysis using Aequitas
  • Background
• Pre-Aequitas: Exploring the COMPAS Dataset
• Putting Aequitas to the task
  • Data Formatting
• What biases exist in my model?
  • Aequitas Group() Class
  • What is the distribution of groups, predicted scores, and labels across my dataset?
    • Group Counts Calculated:
    • Absolute Metrics Calculated:
  • What are bias metrics across groups?
    • View calculated counts across sample population groups
    • View calculated absolute metrics for each sample population group
  • How do I interpret biases in my model?
• How do I visualize bias in my model?
  • Visualizing a single absolute group metric across all population groups
  • View group metrics for only groups over a certain size threshold
  • Visualizing multiple user-specified absolute group metrics across all population groups
  • Visualizing default absolute group metrics across all population groups
    • Default absolute group metrics
• What levels of disparity exist between population groups?
  • Aequitas Bias() Class
    • Disparities Calculated Calcuated:
    • Disparities calculated in relation to a user-specified group for each attribute
  • How do I interpret calculated disparity ratios?
  • How does the selected reference group affect disparity calculations?
    • Evaluating disparities calculated in relation to a different ‘race’ reference group
    • Disparities calculated in relation to sample population majority group (in terms of group prevalence) for each attribute
    • Disparities calculated in relation to the minimum value for each metric
• How do I visualize disparities in my model?
  • Visualizing disparities between groups in a single user-specified attribute for a single user-specified disparity metric
  • Visualizing disparities between all groups for a single user-specified disparity metric
  • Visualizing disparities between groups in a single user-specified attribute for default metrics
  • Visualizing disparities between groups in a single user-specified attribute for all calculated disparity metrics
  • Visualizing disparity between all groups for multiple user-specified disparity metrics
• How do I assess model fairness?
  • Aequitas Fairness() Class
  • Group Level Fairness
    • Pairities Calcuated:
    • Also assessed:
  • How do I interpret parities?
  • Attribute Level Fairness
  • Overall Fairness
• How do I visualize bias metric parity?
  • Visualizing parity of a single absolute group metric across all population groups
  • Visualizing all absolute group metrics across all population groups
• How do I visualize parity between groups in my model?
  • Visualizing parity between groups in a single user-specified attribute for all calculated disparity metrics
  • Researcher Check: Could the unfairness I am seeing be related to small group sizes in my sample?
  • Visualizing parity between groups in a single user-specified attribute for all calculated disparity metrics
  • Visualizing parity between all groups for multiple user-specified disparity metrics
  • Visualizing parity between groups in multiple user-specified attributes
• The Aequitas Effect