Understanding Causality with Large Language Models: Feasibility and Opportunities

We assess the ability of large language models (LLMs) to answer causal questions by analyzing their strengths and weaknesses against three types of causal question. We believe that current LLMs can answer causal questions with existing causal knowledge as combined domain experts. However, they are n...

Full description

Saved in:
Bibliographic Details
Main Authors Zhang, Cheng, Bauer, Stefan, Bennett, Paul, Gao, Jiangfeng, Gong, Wenbo, Hilmkil, Agrin, Jennings, Joel, Ma, Chao, Minka, Tom, Pawlowski, Nick, Vaughan, James
Format Journal Article
LanguageEnglish
Published 11.04.2023
Subjects
Computer Science - Computation and Language
Computer Science - Learning
Online AccessGet full text

Cover

More Information
Summary:We assess the ability of large language models (LLMs) to answer causal questions by analyzing their strengths and weaknesses against three types of causal question. We believe that current LLMs can answer causal questions with existing causal knowledge as combined domain experts. However, they are not yet able to provide satisfactory answers for discovering new knowledge or for high-stakes decision-making tasks with high precision. We discuss possible future directions and opportunities, such as enabling explicit and implicit causal modules as well as deep causal-aware LLMs. These will not only enable LLMs to answer many different types of causal questions for greater impact but also enable LLMs to be more trustworthy and efficient in general.
DOI:10.48550/arxiv.2304.05524