Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 138: Alleged Issues with Proctorio's Remote-Testing AI Prompted Suspension by University

Description: Proctorio's remote-testing software were reported by students at the University of Illinois Urbana-Champaign for issues regarding privacy, accessibility, differential performance on darker-skinned students.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Proctorio developed an AI system deployed by University of Illinois, which harmed University of Illinois students of color and University of Illinois students.

Incident Stats

Incident ID
138
Report Count
6
Incident Date
2020-01-21
Editors
Sean McGregor, Khoa Lam
Applied Taxonomies
GMF, MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.3. Unequal performance across groups

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Incident Reports

Reports Timeline

Incident Occurrence+1
University of Illinois to Discontinue Remote-Testing Software After Students Complain of Privacy Violation
Students of color are getting flagged to their teachers because testing software can’t see themUsing 'AI-based software like Proctorio and ProctorU' to monitor online exams is a really bad idea, says uni panel+1
Stand Against Proctorio's SLAPP, organized by Ian Linkletter
University of Illinois to Discontinue Remote-Testing Software After Students Complain of Privacy Violation

University of Illinois to Discontinue Remote-Testing Software After Students Complain of Privacy Violation

techtimes.com

No More Proctorio

No More Proctorio

insidehighered.com

Students of color are getting flagged to their teachers because testing software can’t see them

Students of color are getting flagged to their teachers because testing software can’t see them

theverge.com

Using 'AI-based software like Proctorio and ProctorU' to monitor online exams is a really bad idea, says uni panel

Using 'AI-based software like Proctorio and ProctorU' to monitor online exams is a really bad idea, says uni panel

theregister.com

Stand Against Proctorio's SLAPP, organized by Ian Linkletter

Stand Against Proctorio's SLAPP, organized by Ian Linkletter

gofundme.com

EFF Client Erik Johnson and Proctorio Settle Lawsuit Over Bogus DMCA Claims

EFF Client Erik Johnson and Proctorio Settle Lawsuit Over Bogus DMCA Claims

eff.org

University of Illinois to Discontinue Remote-Testing Software After Students Complain of Privacy Violation
techtimes.com · 2021

The Univeristy of Illinois had finally announced that it will no longer use Proctorio, a remote-testing software that is used during exams to monitor students. The software will be discontinued in mid-2021.

The decision of the univeristy ca…

No More Proctorio
insidehighered.com · 2021

The University of Illinois at Urbana-Champaign said last week that it does not plan to renew its emergency contract with Proctorio, one of several online proctoring programs whose client bases have expanded during the pandemic but which rem…

Students of color are getting flagged to their teachers because testing software can’t see them
theverge.com · 2021

Proctorio, a piece of exam surveillance software designed to keep students from cheating while taking tests, relies on open-source software that has a history of racial bias issues, according to a report by Motherboard. The issue was discov…

Using 'AI-based software like Proctorio and ProctorU' to monitor online exams is a really bad idea, says uni panel
theregister.com · 2021

A committee at the University of Texas in Austin has advised against using AI software to oversee students' online tests, citing the psychological toll on students and the financial toll on academic institutions.

Acknowledging that some for…

Stand Against Proctorio's SLAPP, organized by Ian Linkletter
gofundme.com · 2022

My name is Ian Linkletter. Today is October 16th, 2020. I have filed legal documents in the B.C. Supreme Court to defend myself against a lawsuit filed by a company called Proctorio Incorporated. You may read these filings at http://defence…

EFF Client Erik Johnson and Proctorio Settle Lawsuit Over Bogus DMCA Claims
eff.org · 2022

EFF client Erik Johnson, a Miami University computer engineering undergraduate, reached a settlement in the lawsuit we brought on his behalf against exam surveillance software maker Proctorio, in a victory for fair use of copyrighted materi…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

High-Toxicity Assessed on Text Involving Women and Minority Groups

High-Toxicity Assessed on Text Involving Women and Minority Groups

Feb 2017 · 9 reports
COMPAS Algorithm Performs Poorly in Crime Recidivism Prediction

COMPAS Algorithm Performs Poorly in Crime Recidivism Prediction

May 2016 · 22 reports
Ever AI Reportedly Deceived Customers about FRT Use in App

Ever AI Reportedly Deceived Customers about FRT Use in App

Apr 2019 · 7 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

High-Toxicity Assessed on Text Involving Women and Minority Groups

High-Toxicity Assessed on Text Involving Women and Minority Groups

Feb 2017 · 9 reports
COMPAS Algorithm Performs Poorly in Crime Recidivism Prediction

COMPAS Algorithm Performs Poorly in Crime Recidivism Prediction

May 2016 · 22 reports
Ever AI Reportedly Deceived Customers about FRT Use in App

Ever AI Reportedly Deceived Customers about FRT Use in App

Apr 2019 · 7 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 30ebe76