Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる

インシデント 443: ChatGPT Abused to Develop Malicious Softwares

概要: OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.

ツール

新しいレポート新しいレポート新しいレスポンス新しいレスポンス発見する発見する履歴を表示履歴を表示

組織

すべての組織を表示
推定: OpenAIが開発し提供したAIシステムで、internet usersに影響を与えた

インシデントのステータス

インシデントID
443
レポート数
25
インシデント発生日
2022-12-21
エディタ
Khoa Lam
Applied Taxonomies
MIT

MIT 分類法のクラス

Machine-Classified
分類法の詳細

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

4.3. Fraud, scams, and targeted manipulation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Malicious Actors & Misuse

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

インシデントレポート

レポートタイムライン

ChatGPT shows promise of using AI to write malwareHow ChatGPT can turn anyone into a ransomware and malware threat actor+2
Check Point: ChatGPT Can Compose Malicious Emails, Code
Incident Occurrence+3
ChatGPT is enabling script kiddies to write functional malware
+9
ChatGPT is helping hackers write malware codes
Yes, ChatGPT can write malicious code — but not well+1
Exploring The Dark Side Of ChatGPT
It's Scary Easy to Use ChatGPT to Write Phishing EmailsGPT-4 Can’t Stop Helping Hackers Make Cybercriminal ToolsAI-created malware sends shockwaves through cybersecurity world
ChatGPT shows promise of using AI to write malware

ChatGPT shows promise of using AI to write malware

cyberscoop.com

How ChatGPT can turn anyone into a ransomware and malware threat actor

How ChatGPT can turn anyone into a ransomware and malware threat actor

venturebeat.com

Check Point: ChatGPT Can Compose Malicious Emails, Code

Check Point: ChatGPT Can Compose Malicious Emails, Code

sdxcentral.com

ChatGPT is being used to create malicious emails and code

ChatGPT is being used to create malicious emails and code

techradar.com

ChatGPT can be used to generate malicious code, finds research

ChatGPT can be used to generate malicious code, finds research

livemint.com

ChatGPT is enabling script kiddies to write functional malware

ChatGPT is enabling script kiddies to write functional malware

arstechnica.com

Armed With ChatGPT, Cybercriminals Build Malware And Plot Fake Girl Bots

Armed With ChatGPT, Cybercriminals Build Malware And Plot Fake Girl Bots

forbes.com

OPWNAI: Cybercriminals Starting to Use ChatGPT

OPWNAI: Cybercriminals Starting to Use ChatGPT

research.checkpoint.com

Cybercrooks are telling ChatGPT to create malicious code

Cybercrooks are telling ChatGPT to create malicious code

theregister.com

ChatGPT is helping hackers write malware codes

ChatGPT is helping hackers write malware codes

thehindu.com

Hackers Exploiting OpenAI’s ChatGPT to Deploy Malware

Hackers Exploiting OpenAI’s ChatGPT to Deploy Malware

hackread.com

Cybercriminals Using ChatGPT to Build Hacking Tools, Write Code

Cybercriminals Using ChatGPT to Build Hacking Tools, Write Code

pcmag.com

How ChatGPT may be used by cybercriminals for hacking, ‘fraud and more

How ChatGPT may be used by cybercriminals for hacking, ‘fraud and more

timesofindia.indiatimes.com

ChatGPT wird zum Schreiben von Malware eingesetzt

ChatGPT wird zum Schreiben von Malware eingesetzt

zdnet.de

People are already trying to get ChatGPT to write malware

People are already trying to get ChatGPT to write malware

zdnet.com

ChatGPT being used to write malware, ransomware: reports

ChatGPT being used to write malware, ransomware: reports

foxbusiness.com

El lado oscuro de ChatGPT: generar malware funcional

El lado oscuro de ChatGPT: generar malware funcional

muycomputerpro.com

Malware con IA: online il codice generato con ChatGPT

Malware con IA: online il codice generato con ChatGPT

punto-informatico.it

People are already trying to get ChatGPT to write malware

People are already trying to get ChatGPT to write malware

zdnet.com

Yes, ChatGPT can write malicious code — but not well

Yes, ChatGPT can write malicious code — but not well

washingtonpost.com

Exploring The Dark Side Of ChatGPT

Exploring The Dark Side Of ChatGPT

augustman.com

ChatGPT lets scammers craft emails that are so convincing they can get cash from victims without even relying on malware

ChatGPT lets scammers craft emails that are so convincing they can get cash from victims without even relying on malware

fortune.com

It's Scary Easy to Use ChatGPT to Write Phishing Emails

It's Scary Easy to Use ChatGPT to Write Phishing Emails

cnet.com

GPT-4 Can’t Stop Helping Hackers Make Cybercriminal Tools

GPT-4 Can’t Stop Helping Hackers Make Cybercriminal Tools

forbes.com

AI-created malware sends shockwaves through cybersecurity world

AI-created malware sends shockwaves through cybersecurity world

foxnews.com

ChatGPT shows promise of using AI to write malware
cyberscoop.com · 2022

For even the most skilled hackers, it can take at least an hour to write a script to exploit a software vulnerability and infiltrate their target. Soon, a machine may be able to do it in mere seconds.

When OpenAI last week released its Chat…

How ChatGPT can turn anyone into a ransomware and malware threat actor
venturebeat.com · 2022

Ever since OpenAI launched ChatGPT at the end of November, commentators on all sides have been concerned about the impact AI-driven content-creation will have, particularly in the realm of cybersecurity. In fact, many researchers are concer…

Check Point: ChatGPT Can Compose Malicious Emails, Code
sdxcentral.com · 2022

Check Point Research today published a study into OpenAI’s ChatGPT and Codex, highlighting how threat actors can use these tools to produce malicious emails, code, and a full infection chain.

ChatGPT is an interface for OpenAI’s large langu…

ChatGPT is being used to create malicious emails and code
techradar.com · 2022

ChatGPT, the chatbot from Open AI that’s been causing a lot of excitement in recent months, can be used to create malicious Excel files, as well as convincing phishing emails to go along with the malware, experts have claimed.

The tool can …

ChatGPT can be used to generate malicious code, finds research
livemint.com · 2022

OpenAI’s ChatGPT, the large language model (LLM)-based artificial intelligence (AI) text generator, can be seemingly used to generate code for malicious tasks, a research note by cyber security firm Check Point observed on Tuesday. Research…

ChatGPT is enabling script kiddies to write functional malware
arstechnica.com · 2023

Since its beta launch in November, AI chatbot ChatGPT has been used for a wide range of tasks, including writing poetry, technical papers, novels, and essays and planning parties and learning about new topics. Now we can add malware develop…

Armed With ChatGPT, Cybercriminals Build Malware And Plot Fake Girl Bots
forbes.com · 2023

Hackers are testing ChatGPT's ability to create female chatbots as part of their efforts to scam men attracted to the digital persona.

Cybercriminals have started using OpenAI’s artificially intelligent chatbot ChatGPT to quickly build hack…

OPWNAI: Cybercriminals Starting to Use ChatGPT
research.checkpoint.com · 2023

Introduction

At the end of November 2022, OpenAI released ChatGPT, the new interface for its Large Language Model (LLM), which instantly created a flurry of interest in AI and its possible uses.  However, ChatGPT has also added some spice t…

Cybercrooks are telling ChatGPT to create malicious code
theregister.com · 2023

Cybercriminals are beginning to use OpenAI's wildly popular ChatGPT technology to quickly and easily develop code for malicious purposes.

A spin around underground hacking sites uncovered initial instances of miscreants developing cyberthre…

ChatGPT is helping hackers write malware codes
thehindu.com · 2023

ChatGPT, the new AI sensation, is helping even less skilled cyber threat actors write codes and launch cyberattacks effortlessly, researchers at security firm Check Point Research said in a blog post on Friday.

Since OpenAI released ChatGPT…

Hackers Exploiting OpenAI’s ChatGPT to Deploy Malware
hackread.com · 2023

In one instance, a hacker shared an Android malware code written by ChatGPT, which could steal desired files, compress them, and leak them online.

Cybercriminals have a new trick up their sleeve involving the abuse of an artificially intell…

Cybercriminals Using ChatGPT to Build Hacking Tools, Write Code
pcmag.com · 2023

Expert and novice cybercriminals have already started to use OpenAI’s chatbot ChatGPT in a bid to build hacking tools, security analysts have said. 

In one documented example, the Israeli security company Check Point spotted a thread on a p…

How ChatGPT may be used by cybercriminals for hacking, ‘fraud and more
timesofindia.indiatimes.com · 2023

In the last month or so, AI tool ChatGPT has become quite the talk of tech town. ChatGPT can be used to answer questions, write reports, and even software codes. And now it seems like cybercriminals are using for malicious activities. Accor…

ChatGPT wird zum Schreiben von Malware eingesetzt
zdnet.de · 2023

Die Analyse von Chats in Dark-Web-Foren zeigt, dass es bereits Bestrebungen gibt, den Chatbot von OpenAI zum Schreiben von Malware zu nutzen.

Der KI-Chatbot ChatGPT sorgt für viel Aufregung. Nun scheint es so, dass er für Versuche genutzt w…

People are already trying to get ChatGPT to write malware
zdnet.com · 2023

The ChatGPT AI chatbot has created plenty of excitement in the short time it has been available and now it seems it has been enlisted by some in attempts to help generate malicious code.

ChatGPT is an AI-driven natural language processing t…

ChatGPT being used to write malware, ransomware: reports
foxbusiness.com · 2023

A new AI chatbot intended to help with writing emails, essays, and coding, is being used by some for criminal activities like espionage, ransomware, and malicious spam, among other things. 

Since its release in November by the San Francisco…

El lado oscuro de ChatGPT: generar malware funcional
muycomputerpro.com · 2023

Open AI se enfrenta a un nuevo desafío difícil de frenar; el uso malicioso de ChatGPT. Un estudio desarrollado por la empresa de seguridad Check Point Research revela que la versión beta de este chatbot con IA se empezó a utilizar en fotos …

Malware con IA: online il codice generato con ChatGPT
punto-informatico.it · 2023

Gli esperti di Check Point Software avevano testato le capacità di ChatGPT nella scrittura di malware. A distanza di alcune settimane sono stati già pubblicati i primi esempi pratici su un noto forum di hacking, soprattutto da (aspiranti) c…

People are already trying to get ChatGPT to write malware
zdnet.com · 2023

The ChatGPT AI chatbot has created plenty of excitement in the short time it has been available and now it seems it has been enlisted by some in attempts to help generate malicious code.

ChatGPT is an AI-driven natural language processing t…

Yes, ChatGPT can write malicious code — but not well
washingtonpost.com · 2023

Welcome to The Cybersecurity 202! I accidentally sparked some fake-meat debates with yesterday's chatter. For the record, Beyond Burger is good, but I prefer Impossible Burger. Also, I still sometimes dig "fake meat" that isn't even really …

Exploring The Dark Side Of ChatGPT
augustman.com · 2023

Since its release on 30 November 2022, ChatGPT has been hailed as one of the biggest developments in artificial intelligence (AI). The ‘GPT’ in the name stands for Generative Pre-trained Transformer (GPT), a neural network learning model wh…

ChatGPT lets scammers craft emails that are so convincing they can get cash from victims without even relying on malware
fortune.com · 2023

The advent of ChatGPT has cybersecurity experts spooked. Some fear the powerful chatbot will make it far easier for non-coders to create malware and become cybercriminals. But so far, one cybersecurity company says, ChatGPT may be having a …

It's Scary Easy to Use ChatGPT to Write Phishing Emails
cnet.com · 2023

For the record, ChatGPT didn't write me a phishing email when I asked it to. In fact, it gave me a very stern lecture about why phishing is bad.

It called phishing a "malicious and illegal activity that aims to deceive individuals into prov…

GPT-4 Can’t Stop Helping Hackers Make Cybercriminal Tools
forbes.com · 2023

OpenAI released the latest version of its machine learning software, GPT-4, to great fanfare this week. One of the features the company highlighted about the new version was that it was supposed to have rules protecting it from cybercrimina…

AI-created malware sends shockwaves through cybersecurity world
foxnews.com · 2023

ChatGPT has caused a lot of buzz in the tech world these last few months, and not all the buzz has been great. Now, someone has claimed to have made powerful data-mining malware by using ChatGPT-based prompts in just a few hours. Here's wha…

バリアント

「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

High-Toxicity Assessed on Text Involving Women and Minority Groups

Google’s comment-ranking system will be a hit with the alt-right

Feb 2017 · 9 レポート
Biased Sentiment Analysis

Google's sentiment analysis API is just as biased as humans

Oct 2017 · 7 レポート
Wikipedia Vandalism Prevention Bot Loop

Danger, danger! 10 alarming examples of AI gone wild

Feb 2017 · 6 レポート
前のインシデント次のインシデント

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

High-Toxicity Assessed on Text Involving Women and Minority Groups

Google’s comment-ranking system will be a hit with the alt-right

Feb 2017 · 9 レポート
Biased Sentiment Analysis

Google's sentiment analysis API is just as biased as humans

Oct 2017 · 7 レポート
Wikipedia Vandalism Prevention Bot Loop

Danger, danger! 10 alarming examples of AI gone wild

Feb 2017 · 6 レポート

リサーチ

  • “AIインシデント”の定義
  • “AIインシデントレスポンス”の定義
  • データベースのロードマップ
  • 関連研究
  • 全データベースのダウンロード

プロジェクトとコミュニティ

  • AIIDについて
  • コンタクトとフォロー
  • アプリと要約
  • エディタのためのガイド

インシデント

  • 全インシデントの一覧
  • フラグの立ったインシデント
  • 登録待ち一覧
  • クラスごとの表示
  • 分類法

2023 - AI Incident Database

  • 利用規約
  • プライバシーポリシー
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1ce4c40