Automatic detection of procedural knowledge in robotic-assisted surgical texts

• Published in: International journal for computer assisted radiology and surgery Vol. 16; no. 8; pp. 1287 - 1295
• Main Authors: Bombieri, Marco, Rospocher, Marco, Dall’Alba, Diego, Fiorini, Paolo
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.08.2021; Springer Nature B.V
• Subjects: Algorithms; Balancing; Classification; Computer Imaging; Computer Science; Data science; Datasets; Deep learning; Feasibility studies; Health Informatics; Imaging; Machine learning; Manuals; Medicine; Medicine & Public Health; Neural networks; Original; Original Article; Pattern Recognition and Graphics; Radiology; Robotic surgery; Surgery; Texts; Vision; Deep learning; Transformers; Embeddings; Procedural knowledge; Surgical data science; Text classification
• ISSN: 1861-6410; 1861-6429
• DOI: 10.1007/s11548-021-02370-9

Purpose The automatic extraction of knowledge about intervention execution from surgical manuals would be of the utmost importance to develop expert surgical systems and assistants. In this work we assess the feasibility of automatically identifying the sentences of a surgical intervention text containing procedural information, a subtask of the broader goal of extracting intervention workflows from surgical manuals. Methods We frame the problem as a binary classification task. We first introduce a new public dataset of 1958 sentences from robotic surgery texts, manually annotated as procedural or non-procedural. We then apply different classification methods, from classical machine learning algorithms, to more recent neural-network approaches and classification methods exploiting transformers (e.g., BERT, ClinicalBERT). We also analyze the benefits of applying balancing techniques to the dataset. Results The architectures based on neural-networks fed with FastText’s embeddings and the one based on ClinicalBERT outperform all the tested methods, empirically confirming the feasibility of the task. Adopting balancing techniques does not lead to substantial improvements in classification. Conclusion This is the first work experimenting with machine / deep learning algorithms for automatically identifying procedural sentences in surgical texts. It also introduces the first public dataset that can be used for benchmarking different classification methods for the task.