Skip to Content
logologo
AI Incident Database
Donate
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Entities

Economically vulnerable patients

Incidents Harmed By

Incident 17683 Report
Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

2024-10-01

Kenya's Social Health Authority reportedly used a machine-learning means test to set health insurance premiums. Investigators alleged that income overestimation burdened poor households with unaffordable charges. A Nairobi laundry worker was reportedly sent home before surgery and could not afford follow-up care. The technical audit used a reconstruction; the exact deployed model and implementation of proposed changes were not confirmed. SHA defended the model as equitable.

More

Incident 811 Report
Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

2020-10-21

A study by the University of Toronto, the Vector Institute, and MIT showed the input databases that trained AI systems used to classify chest X-rays led the systems to show gender, socioeconomic, and racial biases.

More

Incident 6031 Report
Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

2021-07-02

A healthcare algorithm designed to equitably distribute caregiving resources is alleged to have drastically cut care hours for the disabled and elderly, purportedly leading to significant hardships and harm. Initially developed for fair resource allocation, the system reportedly faced legal challenges for its inability to accurately assess individual needs, resulting in allegedly reduced essential care.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Mount Sinai Hospitals

Incidents involved as Deployer
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Qure.ai

Incidents involved as Developer
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Google

Incidents involved as Developer
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

DarwinAI

Incidents involved as Developer
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Aidoc

Incidents involved as Developer
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Hispanic patients

Incidents Harmed By
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Women and girls

Incidents Harmed By
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Patients

Incidents Harmed By
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Medicaid beneficiaries

Incidents Harmed By
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Women

Incidents Harmed By
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Chest X-ray classification systems

Incidents implicated systems
  • Incident 81
    1 Report

    Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

More
Entity

Washington DC government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

State governments

Incidents involved as both Developer and Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Pennsylvania state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Missouri state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Iowa state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Idaho state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Arkansas state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Brant Fries

Incidents involved as Developer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Tammy Dobbs

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Larkin Seiler

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Economically vulnerable people

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Elderly individuals

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

People with disabilities

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Algorithmic home care assistance allocation systems

Incidents implicated systems
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Social Health Authority (Kenya)

Incidents involved as Deployer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Governments

Incidents involved as both Developer and Deployer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Government of Kenya

Incidents involved as both Developer and Deployer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Ministry of Health (Kenya)

Incidents involved as both Developer and Deployer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Government agencies

Incidents involved as both Developer and Deployer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Palladium

Incidents involved as Developer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Healthcare administrative AI developers

Incidents involved as Developer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

David Khaoya

Incidents involved as Developer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

IDinsight

Incidents involved as Developer
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Low-income households in Kenya

Incidents Harmed By
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

General public

Incidents Harmed By
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

General public of Kenya

Incidents Harmed By
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Peris Nduta

Incidents Harmed By
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Florence Atieno

Incidents Harmed By
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Kenya Social Health Authority means-testing system

Incidents implicated systems
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Healthcare administrative AI systems

Incidents implicated systems
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

Enterprise AI systems

Incidents implicated systems
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More
Entity

AI-enabled means-testing systems

Incidents implicated systems
  • Incident 1768
    3 Reports

    Kenya's AI Health Insurance Means Test Reportedly Overcharged Poor Households and Obstructed Care

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community test

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide
  • RAIC AIID Taxonomy Policy

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • 2a25224