Poor inter-observer agreement on the endoscopic diagnosis of eosinophilic esophagitis among Japanese endoscopists

• Published in: Esophagus : official journal of the Japan Esophageal Society Vol. 14; no. 4; pp. 309 - 316
• Main Authors: Izumi, Daisuke, Ishimura, Norihisa, Okada, Mayumi, Mikami, Hironobu, Okimoto, Eiko, Aimi, Masahito, Mishiro, Tsuyoshi, Oshima, Naoki, Sato, Shuichi, Ishihara, Shunji, Kinoshita, Yoshikazu
• Format: Journal Article
• Language: English
• Published: Tokyo Springer Japan 01.10.2017; Springer Nature B.V
• Subjects: Agreements; Allergies; Autoimmune diseases; Blood diseases; Endoscopy; Esophageal diseases; Esophagus; Gastroenterology; Gastrointestinal diseases; Inflammatory diseases; Leukocytes; Medical diagnosis; Medicine; Medicine & Public Health; Original Article; Surgical Oncology; Thoracic Surgery; Japan; Endoscopic diagnosis; Inter-observer agreement; Intra-observer agreement; Eosinophilic esophagitis
• ISSN: 1612-9059; 1612-9067
• DOI: 10.1007/s10388-017-0581-9

Background A variety of endoscopic findings are considered useful for the diagnosis of eosinophilic esophagitis (EoE). However, the diagnostic consistency among Japanese endoscopists for those findings has not been fully examined. The aim of this study was to investigate the inter- and intra-observer agreement for endoscopic findings suggesting EoE. Methods Forty endoscopists, including 20 with board certification from the Japan Gastroenterological Endoscopy Society (JGES), participated in this study. Initially, they examined 50 randomized white-light endoscopic images from 30 patients with EoE and 20 without EoE. Four weeks later, the same 50 endoscopic images were re-examined in a different random order. Inter- and intra-observer agreement was calculated using kappa statistics for multiple observers. Results The kappa coefficient of reliability [95% confidence interval (CI)] for all 40 endoscopists for diagnosis of EoE was 0.34 (0.33–0.35), indicating poor level of inter-observer agreement, while intra-observer agreement showed a moderate value of 0.52 (0.47–0.57). Among 4 possible endoscopic findings (linear furrows, concentric rings, edema, white exudates) for EoE, acceptable levels (kappa value >0.4) of inter- and intra-observer agreement were seen only for linear furrows. When the JGES board-certified and non-certified endoscopists were compared for successful diagnosis of EoE, the value was significantly higher for the board-certified group. However, the level of inter-observer agreement remained poor level. Conclusion We concluded that inter-observer agreement on the endoscopic diagnosis of EoE among Japanese endoscopists did not reach a clinically acceptable level.