Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Gmail Users

Incidents Harmed By

Incident 1722 Report
Inappropriate Gmail Smart Reply Suggestions

2015-11-03

Google's Gmail Smart Reply tool was over-recommending the response "I love you" in situations where it was deemed innappropriate.

More

Incident 94113 Report
AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

2025-02-17

A sophisticated AI-powered phishing scam has reportedly been targeting between 1.8 to 2.5 billion Gmail users, allegedly using deepfake robocalls and phishing emails to steal credentials. Attackers impersonate Google security. They claim suspicious account activity and direct victims to fake Google login pages. The stolen credentials have reportedly been used for identity theft, banking fraud, and session hijacking. The FBI has urged vigilance as AI increases the scale and effectiveness of such attacks.

More

Incident 831 Report
AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

2020-10-22

AlgorithmWatch tested spam filtering algorithms across Gmail, Yahoo, Outlook, GMX, and LaPoste. Their findings reportedly showed that Microsoft Outlook’s spam filter flagged emails based on specific keywords that led to racial and content-based biases blocking legitimate communications. Emails mentioning Nigeria or containing certain financial and sexual health terms were found to be disproportionately marked as spam.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 17
    22 Reports

    Inappropriate Gmail Smart Reply Suggestions

Incidents involved as Developer
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Yahoo

Incidents involved as both Developer and Deployer
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Outlook

Incidents involved as Deployer
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

LaPoste

Incidents involved as both Developer and Deployer
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

GMX

Incidents involved as both Developer and Deployer
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Gmail

Incidents involved as Deployer
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

Incidents implicated systems
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Microsoft

Incidents involved as Developer
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Yahoo! Mail users

Incidents Harmed By
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Microsoft Outlook users

Incidents Harmed By
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

LaPoste users

Incidents Harmed By
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

GMX users

Incidents Harmed By
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Yahoo! Mail's spam filter

Incidents implicated systems
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

SpamAssassin

Incidents implicated systems
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Microsoft Outlook's spam filter

Incidents implicated systems
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

LaPoste Mail's spam filter

Incidents implicated systems
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

GMX Mail's spam filter

Incidents implicated systems
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Gmail's spam filter

Incidents implicated systems
  • Incident 83
    1 Report

    AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection

More
Entity

Unknown scammers

Incidents involved as Deployer
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Unknown cybercriminals

Incidents involved as Deployer
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Scammers impersonating Google employees

Incidents involved as Deployer
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Unknown AI tool providers

Incidents involved as Developer
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Google users

Incidents Harmed By
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Unknown robocall system

Incidents implicated systems
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Unknown deepfake apps

Incidents implicated systems
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More
Entity

Google authentication system

Incidents implicated systems
  • Incident 941
    13 Reports

    AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1ce4c40