Selecting treatment strategies with dynamic limited-memory influence diagrams

• Published in: Artificial intelligence in medicine Vol. 40; no. 3; pp. 171 - 186
• Main Authors: van Gerven, Marcel A.J, Díez, Francisco J, Taal, Babs G, Lucas, Peter J.F
• Format: Journal Article
• Language: English
• Published: Netherlands Elsevier B.V 01.07.2007
• Subjects: Algorithms; Carcinoid Tumor - pathology; Carcinoid Tumor - therapy; Carcinoid tumors; Decision Support Techniques; Internal Medicine; Limited-memory influence diagrams; Markov Chains; Other; Partially observable Markov decision processes; Planning; Quality-Adjusted Life Years; Simulated annealing; Stochastic Processes; Carcinoid tumors; Planning; Partially observable Markov decision processes; Simulated annealing; Limited-memory influence diagrams
• ISSN: 0933-3657; 1873-2860
• DOI: 10.1016/j.artmed.2007.04.004

Summary Objective The development of dynamic limited-memory influence diagrams as a framework for representing factorized infinite-horizon partially observable Markov decision processes (POMDPs), the introduction of algorithms for their (approximate) solution, and the application to a dynamic decision problem in clinical oncology. Materials and methods A dynamic limited-memory influence diagram for high-grade carcinoid tumor pathophysiology was developed in collaboration with an expert physician. Three algorithms, known as single policy updating , single rule updating , and simulated annealing have been examined for approximating the optimal treatment strategy from a space of 1 0 19 possible strategies. Results Single policy updating proved intractable for finding a treatment strategy for carcinoid tumors. Single rule updating and simulated annealing both found the treatment strategy that is applied by physicians in practice. Conclusions Dynamic limited-memory influence diagrams are a suitable framework for the representation of factorized infinite-horizon POMDPs, and the developed algorithms find acceptable solutions under the assumption of limited memory about past observations. The framework allows for finding reasonable treatment strategies for complex dynamic decision problems in medicine.