Using artificial intelligence to quantify dynamic retraction of brain tissue and the manipulation of instruments in neurosurgery

• Published in: International journal for computer assisted radiology and surgery Vol. 18; no. 8; pp. 1469 - 1478
• Main Authors: Martin, Tristan, El Hage, Gilles, Shedid, Daniel, Bojanowski, Michel W.
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.08.2023; Springer Nature B.V
• Subjects: Artificial Intelligence; Artificial neural networks; Brain; Brain - diagnostic imaging; Brain - surgery; Computer Imaging; Computer Science; Health Informatics; Humans; Image manipulation; Image Processing, Computer-Assisted - methods; Image segmentation; Imaging; Medicine; Medicine & Public Health; Multivariate statistical analysis; Neurosurgery; Neurosurgical Procedures; Original Article; Pattern Recognition and Graphics; Radiology; Reproducibility of Results; Soft tissues; Statistical analysis; Surgeons; Surgery; Surgical instruments; Vision; Tissue segmentation; Surgical instrument tracking; Neurosurgery; Convolutional neural network
• ISSN: 1861-6429; 1861-6410; 1861-6429
• DOI: 10.1007/s11548-022-02824-8

Purpose There is no objective way to measure the amount of manipulation and retraction of neural tissue by the surgeon. Our goal is to develop metrics quantifying dynamic retraction and manipulation by instruments during neurosurgery. Methods We trained a convolutional neural network (CNN) to analyze microscopic footage of neurosurgical procedures and thereby generate metrics evaluating the surgeon’s dynamic retraction of brain tissue and, using an object tracking process, evaluate the surgeon’s manipulation of the instruments themselves. U-Net image segmentation is used to output bounding polygons around cerebral parenchyma of interest, as well as the vascular structures and cranial nerves. A channel and spatial reliability tracker framework is used in conjunction with our CNN to track desired surgical instruments. Results Our network achieved a state-of-the-art intersection over union ( 72.64 % ) for biological tissue segmentation. Multivariate statistical analysis was used to evaluate dynamic retraction, tissue handling, and instrument manipulation. Conclusion Our model enables to evaluate dynamic retraction of soft tissue and manipulation of instruments during a surgical procedure, while accounting for movement of the operative microscope. This model can potentially provide the surgeon with objective feedback about the movement of instruments and its effect on brain tissue.