The AI Risk Repository: A Comprehensive Meta-Review, Database, and Taxonomy of Risks From Artificial Intelligence

The risks posed by Artificial Intelligence (AI) are of considerable concern to academics, auditors, policymakers, AI companies, and the public. However, a lack of shared understanding of AI risks can impede our ability to comprehensively discuss, research, and react to them. This paper addresses thi...

Full description

Saved in:
Bibliographic Details
Main Authors Slattery, Peter, Saeri, Alexander K, Grundy, Emily A. C, Graham, Jess, Noetel, Michael, Uuk, Risto, Dao, James, Pour, Soroush, Casper, Stephen, Thompson, Neil
Format Journal Article
LanguageEnglish
Published 14.08.2024
Subjects
Online AccessGet full text

Cover

Loading…
Abstract The risks posed by Artificial Intelligence (AI) are of considerable concern to academics, auditors, policymakers, AI companies, and the public. However, a lack of shared understanding of AI risks can impede our ability to comprehensively discuss, research, and react to them. This paper addresses this gap by creating an AI Risk Repository to serve as a common frame of reference. This comprises a living database of 777 risks extracted from 43 taxonomies, which can be filtered based on two overarching taxonomies and easily accessed, modified, and updated via our website and online spreadsheets. We construct our Repository with a systematic review of taxonomies and other structured classifications of AI risk followed by an expert consultation. We develop our taxonomies of AI risk using a best-fit framework synthesis. Our high-level Causal Taxonomy of AI Risks classifies each risk by its causal factors (1) Entity: Human, AI; (2) Intentionality: Intentional, Unintentional; and (3) Timing: Pre-deployment; Post-deployment. Our mid-level Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental, and (7) AI system safety, failures, & limitations. These are further divided into 23 subdomains. The AI Risk Repository is, to our knowledge, the first attempt to rigorously curate, analyze, and extract AI risk frameworks into a publicly accessible, comprehensive, extensible, and categorized risk database. This creates a foundation for a more coordinated, coherent, and complete approach to defining, auditing, and managing the risks posed by AI systems.
AbstractList The risks posed by Artificial Intelligence (AI) are of considerable concern to academics, auditors, policymakers, AI companies, and the public. However, a lack of shared understanding of AI risks can impede our ability to comprehensively discuss, research, and react to them. This paper addresses this gap by creating an AI Risk Repository to serve as a common frame of reference. This comprises a living database of 777 risks extracted from 43 taxonomies, which can be filtered based on two overarching taxonomies and easily accessed, modified, and updated via our website and online spreadsheets. We construct our Repository with a systematic review of taxonomies and other structured classifications of AI risk followed by an expert consultation. We develop our taxonomies of AI risk using a best-fit framework synthesis. Our high-level Causal Taxonomy of AI Risks classifies each risk by its causal factors (1) Entity: Human, AI; (2) Intentionality: Intentional, Unintentional; and (3) Timing: Pre-deployment; Post-deployment. Our mid-level Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental, and (7) AI system safety, failures, & limitations. These are further divided into 23 subdomains. The AI Risk Repository is, to our knowledge, the first attempt to rigorously curate, analyze, and extract AI risk frameworks into a publicly accessible, comprehensive, extensible, and categorized risk database. This creates a foundation for a more coordinated, coherent, and complete approach to defining, auditing, and managing the risks posed by AI systems.
Author Uuk, Risto
Pour, Soroush
Casper, Stephen
Saeri, Alexander K
Thompson, Neil
Noetel, Michael
Slattery, Peter
Grundy, Emily A. C
Dao, James
Graham, Jess
Author_xml – sequence: 1
  givenname: Peter
  surname: Slattery
  fullname: Slattery, Peter
– sequence: 2
  givenname: Alexander K
  surname: Saeri
  fullname: Saeri, Alexander K
– sequence: 3
  givenname: Emily A. C
  surname: Grundy
  fullname: Grundy, Emily A. C
– sequence: 4
  givenname: Jess
  surname: Graham
  fullname: Graham, Jess
– sequence: 5
  givenname: Michael
  surname: Noetel
  fullname: Noetel, Michael
– sequence: 6
  givenname: Risto
  surname: Uuk
  fullname: Uuk, Risto
– sequence: 7
  givenname: James
  surname: Dao
  fullname: Dao, James
– sequence: 8
  givenname: Soroush
  surname: Pour
  fullname: Pour, Soroush
– sequence: 9
  givenname: Stephen
  surname: Casper
  fullname: Casper, Stephen
– sequence: 10
  givenname: Neil
  surname: Thompson
  fullname: Thompson, Neil
BackLink https://doi.org/10.48550/arXiv.2408.12622$$DView paper in arXiv
BookMark eNqFzrsOgkAQheEttPD2AFbOAyACXkLsiEq0sCH0ZNRBJ8Iu7m4Q3t5I7K1O8-fkG4qeVJKEmPqeuwrXa2-BuuHaDVZe6PrBJggG4pU-CKITJGyekFClDFul2y1EsFNlpelB0nBNcCaL84RqprcDe7R4QUMOoLxBio2SqmxB5d2PgVirEiJtOecrYwEnaako-E7ySmPRz7EwNPntSMziQ7o7zjtcVmkuUbfZF5l1yOX_4gModEkw
ContentType Journal Article
Copyright http://creativecommons.org/licenses/by/4.0
Copyright_xml – notice: http://creativecommons.org/licenses/by/4.0
DBID AKY
GOX
DOI 10.48550/arxiv.2408.12622
DatabaseName arXiv Computer Science
arXiv.org
DatabaseTitleList
Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
ExternalDocumentID 2408_12622
GroupedDBID AKY
GOX
ID FETCH-arxiv_primary_2408_126223
IEDL.DBID GOX
IngestDate Tue Aug 27 12:20:13 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-arxiv_primary_2408_126223
OpenAccessLink https://arxiv.org/abs/2408.12622
ParticipantIDs arxiv_primary_2408_12622
PublicationCentury 2000
PublicationDate 2024-08-14
PublicationDateYYYYMMDD 2024-08-14
PublicationDate_xml – month: 08
  year: 2024
  text: 2024-08-14
  day: 14
PublicationDecade 2020
PublicationYear 2024
Score 3.871142
SecondaryResourceType preprint
Snippet The risks posed by Artificial Intelligence (AI) are of considerable concern to academics, auditors, policymakers, AI companies, and the public. However, a lack...
SourceID arxiv
SourceType Open Access Repository
SubjectTerms Computer Science - Artificial Intelligence
Computer Science - Cryptography and Security
Computer Science - Emerging Technologies
Computer Science - Learning
Computer Science - Systems and Control
Title The AI Risk Repository: A Comprehensive Meta-Review, Database, and Taxonomy of Risks From Artificial Intelligence
URI https://arxiv.org/abs/2408.12622
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdVxNS8MwGH6ZO3kRRWV-vwePi65Zmy7eilo3QQWZ0FtJsgSL6LStsp9vPibusmsSkpeE5HnejzwA59wkUgmZEM34zEWrFJEzqghXKWe204KOL5B9ZOOX-L5Iig7g318YUS-qn6APLJtLp791EVFG7SO7Qakr2bp7KkJy0ktxLcf_j7Mc0zetgES-DVtLdodZOI4d6OiPXfiyR4HZBJ-r5g0d4W0ql9m-wgzdbaz1aygixwfdChKC9X28Ea1wENNH6-vjVCz87wOcGz9Pg3k9f_cLBQkInKxoa-7BWX47vR4Tb2T5GRQlSmd_6e0f7kPX-v26BygsOxrKmKciZfFI6NHAcKYGJomYETxRB9BbN8vh-q4j2KQWl11YNIqPodvW3_rE4morT_3m_gIxJ30x
link.rule.ids 228,230,786,891
linkProvider Cornell University
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+AI+Risk+Repository%3A+A+Comprehensive+Meta-Review%2C+Database%2C+and+Taxonomy+of+Risks+From+Artificial+Intelligence&rft.au=Slattery%2C+Peter&rft.au=Saeri%2C+Alexander+K&rft.au=Grundy%2C+Emily+A.+C&rft.au=Graham%2C+Jess&rft.date=2024-08-14&rft_id=info:doi/10.48550%2Farxiv.2408.12622&rft.externalDocID=2408_12622