Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 186: Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain

Description: In Spain, the algorithm that assesses recidivism risk in gender violence, VioGén, have critically underestimated the level of risk in a series of cases that ended in homicide of women and children since its first deployment.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Spanish Ministry of Interior and Spanish Secretary of State for Security developed an AI system deployed by Spanish Ministry of Interior, which harmed Spanish victims of gender violence.

Incident Stats

Incident ID
186
Report Count
7
Incident Date
2007-07-26
Editors
Sean McGregor, Khoa Lam
Applied Taxonomies
GMF, MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

7.3. Lack of capability or robustness

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. AI system safety, failures, and limitations

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Incident Reports

Reports Timeline

Incident OccurrenceThe murdered women who reported were assessed as 'low or no risk'+1
New protocol to assess the risk of gender victims
In Spain, the VioGén algorithm attempts to forecast gender violence+2
The External Audit of the VioGen System
The murdered women who reported were assessed as 'low or no risk'

The murdered women who reported were assessed as 'low or no risk'

elmundo.es

New protocol to assess the risk of gender victims

New protocol to assess the risk of gender victims

rtve.es

Validation and Calibration of the Spanish Police Intimate Partner Violence Risk Assessment System (VioGén)

Validation and Calibration of the Spanish Police Intimate Partner Violence Risk Assessment System (VioGén)

link.springer.com

In Spain, the VioGén algorithm attempts to forecast gender violence

In Spain, the VioGén algorithm attempts to forecast gender violence

algorithmwatch.org

The External Audit of the VioGen System

The External Audit of the VioGen System

eticasfoundation.org

Victims denounce failures in VioGén, the algorithm against gender violence

Victims denounce failures in VioGén, the algorithm against gender violence

eldiario.es

AI: Decoded: Spain’s flawed domestic abuse algorithm — Ban debate heats up — Holding the police accountable

AI: Decoded: Spain’s flawed domestic abuse algorithm — Ban debate heats up — Holding the police accountable

politico.eu

The murdered women who reported were assessed as 'low or no risk'
elmundo.es · 2014
AI Translated

Fourteen of the 15 murdered in 2014 who had reported their aggressor for sexist violence had a police risk assessment "not appreciated » or «low», according to the latest report of the Observatory of Domestic and Gender Violence of the Gene…

New protocol to assess the risk of gender victims
rtve.es · 2019
AI Translated

The Police will begin to apply this Wednesday the new protocol for assessing the level of risk of victims of gender violence, after the Secretary of State for Security has officially notified the instruction. As a novelty, the judicial auth…

Validation and Calibration of the Spanish Police Intimate Partner Violence Risk Assessment System (VioGén)
link.springer.com · 2019

This study describes the rationale, development, and validation of the intimate partner violence (IPV) police risk assessment forms of the VioGén System of the Spanish Ministry of Interior (VPR4.0 and VPER4.0), which promote greater predict…

In Spain, the VioGén algorithm attempts to forecast gender violence
algorithmwatch.org · 2020

As part of a program to curb feminicides, Spain built VioGén, an algorithm that assesses the risk faced by victims of gender violence. It remains a work in progress.

In the early morning of 24 February 2018, Itziar P., a psychologist living…

The External Audit of the VioGen System
eticasfoundation.org · 2022

We present the results of 7 months of work of Eticas and Ana Bella Foundation with the available data and affected women and other stakeholders. As mentioned above, it is a part of a broader external auditing project where Eticas, in collab…

Victims denounce failures in VioGén, the algorithm against gender violence
eldiario.es · 2022
AI Translated

Lack of transparency, underestimation of psychological violence, “rigid” questions that do not allow explanations or evaluations that take into account the police resources available when assigning a level of risk to the victim. These are s…

AI: Decoded: Spain’s flawed domestic abuse algorithm — Ban debate heats up — Holding the police accountable
politico.eu · 2022

Spanish algorithm leaves domestic violence victims out in the cold: For the past 15 years, Spain has been using an algorithmic system called VioGén to help the police assess the risk women face when they file complaints of abuse. But the sy…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
Previous IncidentNext Incident

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 8b8f151