Objective measures for longitudinal assessment of robotic surgery training

• Published in: The Journal of thoracic and cardiovascular surgery Vol. 143; no. 3; pp. 528 - 534
• Main Authors: Kumar, Rajesh, Jog, Amod, Vagvolgyi, Balazs, Nguyen, Hiep, Hager, Gregory, Chen, Chi Chiung Grace, Yuh, David
• Format: Journal Article
• Language: English
• Published: New York, NY Mosby, Inc 01.03.2012; Elsevier
• Subjects: Analysis of Variance; Anesthesia. Intensive care medicine. Transfusions. Cell therapy and gene therapy; Automation; Biological and medical sciences; Cardiology. Vascular system; Cardiothoracic Surgery; Clinical Competence; Cluster Analysis; Education, Medical, Graduate; Humans; Learning Curve; Longitudinal Studies; Medical sciences; Motor Skills; Pneumology; Reproducibility of Results; Robotics - education; Support Vector Machine; Surgery, Computer-Assisted - education; Task Performance and Analysis; Time Factors; United States; United States; API; OSATS; SVM; objective structured assessment of technical skills; support vector machine; application programming interface; Objective; Treatment; Surgery; Anesthesia; Circulatory system; Cardiology; Robotics
• ISSN: 0022-5223; 1097-685X; 1097-685X
• DOI: 10.1016/j.jtcvs.2011.11.002

Current robotic training approaches lack the criteria for automatically assessing and tracking (over time) technical skills separately from clinical proficiency. We describe the development and validation of a novel automated and objective framework for the assessment of training. We are able to record all system variables (stereo instrument video, hand and instrument motion, buttons and pedal events) from the da Vinci surgical systems using a portable archival system integrated with the robotic surgical system. Data can be collected unsupervised, and the archival system does not change system operations in any way. Our open-ended multicenter protocol is collecting surgical skill benchmarking data from 24 trainees to surgical proficiency, subject only to their continued availability. Two independent experts performed structured (objective structured assessment of technical skills) assessments on longitudinal data from 8 novice and 4 expert surgeons to generate baseline data for training and to validate our computerized statistical analysis methods in identifying the ranges of operational and clinical skill measures. Objective differences in operational and technical skill between known experts and other subjects were quantified. The longitudinal learning curves and statistical analysis for trainee performance measures are reported. Graphic representations of the skills developed for feedback to the trainees are also included. We describe an open-ended longitudinal study and automated motion recognition system capable of objectively differentiating between clinical and technical operational skills in robotic surgery. Our results have demonstrated a convergence of trainee skill parameters toward those derived from expert robotic surgeons during the course of our training protocol.