Inter-Rater Variability of Reflux Finding Score Amongst Otolaryngologists

• Published in: Journal of voice Vol. 36; no. 5; pp. 685 - 689
• Main Authors: Jahshan, Forsan, Ronen, Ohad, Qarawany, Jamal, Markel, Boaz, Sberro, Amiel, Yeung, Winnie, Lahav, Yonatan, Layous, Eli, Eisenbach, Netanel, Sela, Eyal, Marshak, Tal
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.09.2022
• Subjects: Inter-rater reliability; Laryngopharyngeal reflux (LPR); Reflux Finding Score (RFS); Laryngopharyngeal reflux (LPR); Reflux Finding Score (RFS); Inter-rater reliability
• ISSN: 0892-1997; 1873-4588
• DOI: 10.1016/j.jvoice.2020.07.021

Laryngopharyngeal reflux (LPR) is an extra-oesophageal variant of gastro-oesophgeal reflux disease. Patients often do not present with the classic reflux symptoms of heartburn or regurgitation. Accurate diagnosis of LPR can be challenging. The reflux finding score (RFS) is system based on the assessment of eight parameters seen on fibre optic laryngoscopy, used to determine the presence and the severity of laryngopharyngeal reflux (LPR). Scoring the RFS is subjective and highly dependent on the examiner's eye and experience. In this study, we investigated the inter-rater reliability between three otolaryngologists scoring a large library of video-recorded laryngoscopies for RFS. To evaluate the usefulness of RFS in daily clinical practice by assessing inter-rater reliability among otolaryngologists when interpreting a bank of identical fibre optic laryngoscopy examinations. Three board-certified otolaryngologists with different subspecialist interests examined video-recorded fibre optic laryngoscopies of 193 patients with or without LPR symptoms and rated each video for RFS. Statistical analysis was performed. Results were compared to determine the inter-rater reliability. Fair to poor correlation was found between the three expert raters for total RFS score, as well as for RFS component items with nonbinary outcomes. For the dichotomous items, the inter-rater reliability was slight to moderate. Inter-rater correlation for determining whether an examination is pathological or nonpathological was fair. The RFS alone was not reliable for confirming the diagnosis of LPR, due to low inter-rater reliability and the subjective nature of the scoring system.