Yıl: 2019 Cilt: 57 Sayı: 1 Sayfa Aralığı: 7 - 13 Metin Dili: İngilizce DOI: 10.5152/tao.2019.3681 İndeks Tarihi: 09-07-2019

Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study

Öz:
Objective: To adapt an objective surgical assessmenttool (OSATS) for adenotonsillectomy/tonsillectomyto Turkish.Methods: A prospective longitudinal validation studywas planned. Adenoidectomy items were added to thetonsillectomy OSATS. Data were collected from 80real-time observed surgical performances. To examineinterrater reliability, 25 performances were simultaneously scored by two evaluators. In total, 105 test formswere filled, and reliability and validity studies wereconducted.Results: Regarding reliability, Cronbach's alphavalues were found to be >0.95, indicating very highinternal consistency. For interrater reliability, a statistically significant positive correlation was foundbetween the two evaluators’ task-specific checklist (TSC) (p=0.0001; r=0.969) and global ratingchecklist (GRC) (p=0.0001; r=0.957). Betweenthe TSC and GRC, there was a statistically significant positive correlation (p=0.0001; r=0.951).A model was developed using the generalizability theory, and the highest variances belonged tosurgical processes. Regarding validity, the trainers’scores were significantly higher than the trainees’scores (p=0.0001). As surgical experience increased,both the TSC and the GRC scores significantly increased (p=0.0001). A trainee’s first-ever 34adenotonsillectomy performances were scored. Ascatter plot of the obtained data showed that thetrainee had gained more scores as the number ofoperations increased.Conclusion: The results indicate that adenotonsillectomy OSATS is a reliable and valid tool for theassessment of residents’ surgical skills. This is the firstOSATS developed for adenotonsillectomy in theTurkish literature. It is ready to be used in the operating room to provide constructive feedback andmonitor the development of trainees’ surgical skills inadenotonsillectomy.
Anahtar Kelime:

Konular: Kulak, Burun, Boğaz
Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • Kulak burun boğaz hastalıkları müfredat v.2.1. Avaible from: URL: http://www.tuk.saglik.gov.tr/muf2.1/kulak_burun_bogaz_ hastaliklari/kulak_burun_bogaz_hastaliklari_mufredat_v.2.1.pdf.
  • Wagner N, Fahim C, Dunn K, Reid D, Sonnadara RR. Otolaryngology residency education: a scoping review on the shift towards competency-based medical education. Clin Otolaryngol 2017; 42: 564-72. [CrossRef ]
  • Kara CO. Kulak ameliyatları için ölçme değerlendirme araçları. KBB-Forum 2015; 14: 65-70.
  • Kara CO, Özdemir S. Assessment of technical skills in postgraduate surgical education. Türkiye Klinikleri J Med Educ-Special Topics 2016; 1: 41-6
  • Roberson DW, Kentala E, Forbes P. Development and validation of an objective instrument to measure surgical performance at tonsillectomy.Laryngoscope 2005; 115: 2127-37. [CrossRef ]
  • Ahmed A, Ishman SL, Laeeq K, Bhatti NI. Assessment of improvement of trainee surgical skills in the operating room for tonsillectomy. Laryngoscope 2013; 123: 1639-44. [CrossRef ]
  • Lin SY, Laeeq K, Ishii M, Kim J, Lane AP, Reh D, et al. Development and pilot-testing of a feasible, reliable, and valid operative competency assessment tool for endoscopic sinus surgery. Am J Rhinol Allergy 2009; 23: 354-9. [CrossRef ]
  • Francis HW, Masood H, Chaudhry KN, Laeeq K, Carey JP, Della Santina CC, et al. Objective assessment of mastoidectomy skills in the operating room. Otol Neurotol 2010; 31: 759-65. [CrossRef ]
  • Obeid AA, Al-Qahtani KH, Ashraf M, Alghamdi FR, Marglani O, Alherabi A. Development and testing for an operative competency assessment tool for nasal septoplasty surgery. Am J Rhinol Allergy 2014; 23: e163-7. [CrossRef ]
  • Awad Z, Hayden L, Robson AK, Muthuswamy K, Tolley NS. Reliability and valaidity of procedure-based assessments in otolaryngology training. Laryngoscope 2015; 125: 1328-35.[CrossRef ]
  • Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, et al.Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 1997; 84: 273-8. [CrossRef]
  • Şeker H, Gençdoğan B. Psikoloijide ve eğitimde ölçme aracı geliştirme. 2. Basım Ankara: Nobel Kitabevi; 2014.
  • Aydın HC. Eğitim iletişimi alanında Delfi tekniğinin uygulanışı. Kurgu Dergisi 1999; 16: 225-41.
  • Atılgan H. Genellenebilirlik kuramı ve puanlayıcılar arası güvenirlik için örnek bir uygulama. Eğitim Bilimleri ve Uygulama 2005; 4: 95-108.
  • Setna Z, Jha V, Boursicot KA, Roberts TE. Evaluating the utility of workplace-based assessment tools for speciality training. Best Pract Res Clin Obstet Gynaecol 2010; 24: 767-82. [CrossRef ]
  • Ali JM. Getting lost in translation? Workplace based assessments in surgical training. Surgeon 2013; 11: 286-9. [CrossRef ]
  • Kara CO, Mengi E, Tümkaya F, Topuz B, Ardıç FN. Direct observation of procedural skills in otorhinolaryngology training. Turk Arch Otorhinolaryngol 2018; 56: 7-14. [CrossRef ]
APA KARA C, Mengi E, TÜMKAYA F, ARDIÇ F, SENOL H (2019). Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. , 7 - 13. 10.5152/tao.2019.3681
Chicago KARA CÜNEYT ORHAN,Mengi Erdem,TÜMKAYA FUNDA,ARDIÇ FAZIL NECDET,SENOL HANDE Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. (2019): 7 - 13. 10.5152/tao.2019.3681
MLA KARA CÜNEYT ORHAN,Mengi Erdem,TÜMKAYA FUNDA,ARDIÇ FAZIL NECDET,SENOL HANDE Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. , 2019, ss.7 - 13. 10.5152/tao.2019.3681
AMA KARA C,Mengi E,TÜMKAYA F,ARDIÇ F,SENOL H Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. . 2019; 7 - 13. 10.5152/tao.2019.3681
Vancouver KARA C,Mengi E,TÜMKAYA F,ARDIÇ F,SENOL H Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. . 2019; 7 - 13. 10.5152/tao.2019.3681
IEEE KARA C,Mengi E,TÜMKAYA F,ARDIÇ F,SENOL H "Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study." , ss.7 - 13, 2019. 10.5152/tao.2019.3681
ISNAD KARA, CÜNEYT ORHAN vd. "Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study". (2019), 7-13. https://doi.org/10.5152/tao.2019.3681
APA KARA C, Mengi E, TÜMKAYA F, ARDIÇ F, SENOL H (2019). Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. Turkish archives of otorhinolaryngology , 57(1), 7 - 13. 10.5152/tao.2019.3681
Chicago KARA CÜNEYT ORHAN,Mengi Erdem,TÜMKAYA FUNDA,ARDIÇ FAZIL NECDET,SENOL HANDE Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. Turkish archives of otorhinolaryngology 57, no.1 (2019): 7 - 13. 10.5152/tao.2019.3681
MLA KARA CÜNEYT ORHAN,Mengi Erdem,TÜMKAYA FUNDA,ARDIÇ FAZIL NECDET,SENOL HANDE Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. Turkish archives of otorhinolaryngology , vol.57, no.1, 2019, ss.7 - 13. 10.5152/tao.2019.3681
AMA KARA C,Mengi E,TÜMKAYA F,ARDIÇ F,SENOL H Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. Turkish archives of otorhinolaryngology . 2019; 57(1): 7 - 13. 10.5152/tao.2019.3681
Vancouver KARA C,Mengi E,TÜMKAYA F,ARDIÇ F,SENOL H Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study. Turkish archives of otorhinolaryngology . 2019; 57(1): 7 - 13. 10.5152/tao.2019.3681
IEEE KARA C,Mengi E,TÜMKAYA F,ARDIÇ F,SENOL H "Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study." Turkish archives of otorhinolaryngology , 57, ss.7 - 13, 2019. 10.5152/tao.2019.3681
ISNAD KARA, CÜNEYT ORHAN vd. "Adaptation of “Objective Structured Assessment of Technical Skills” for Adenotonsillectomy into Turkish: A Validity and Reliability Study". Turkish archives of otorhinolaryngology 57/1 (2019), 7-13. https://doi.org/10.5152/tao.2019.3681