| Home | E-Submission | Sitemap | Contact Us |  
Korean Journal of Preventive Medicine 1997;30(4): 719-728.
Reliability for Multiple Reviewers by using Loglinear Models.
Byung Joo Park, Sung Im Lee, Young Jo Lee, Dong Hyun Kim, Ho Jang Kwon, Jong Myon Bae, Myung Hee Shin, Mi Na Ha, Sang Whan Han
1Department of Preventive Medicine, Seoul National University, Korea.
2Department of Statistics, Seoul National University, Korea.
3Department of Social Medicine, Hallymm University, Korea.
4Department of Preventive Medicine, Dankook University, Korea.
5Department of Preventive Medicine, Chungbuk University, Korea.
6Department of Preventive Medicine, Sungkyunkwan University, Korea.
7Institute of Occupational Health, Gil Medical Center, Korea.
To guarantee the inter-reviewer reliability is very important in evaluating the quality of large number of clinical research papers by multiple reviewers. We cannot find reports on statistical methods for evaluating reliability for multiple raters in clinical research field. The purpose of this paper is to introduce the statistical methods focused on kappa statistic and five kinds of loglinear models for, which can be applied when evaluating the reliability of multiple raters. We have applied these methods to the result of a project, in which seven reviewers have evaluated the quality of 33 papers with regard to four aspects of paper contents including study hypothesis, study design, study population, study method, data analysis and interpretation. Among the five loglinear models including Symmetry model, Conditional symmetry model, Quasi-symmetry model, Independence model, and Quasi-independence model, Quasi-symmetry model shows the best model of fitting. And the level of reliability among seven reviewers revealed to be acceptable as meaningful.
Key words: reliability; multiple reviewers; kappa; loglinear model
PDF Links  PDF Links
Full text via DOI  Full text via DOI
Download Citation  Download Citation
CrossRef TDM  CrossRef TDM
Editorial Office
#203, 92 Wangsan-ro, Dongdaemun-gu, Seoul 02585, Korea
Tel : +82-2-740-8328   Fax : +82-2-764-8328   E-mail: jpmph@prevmed.or.kr
About |  Browse Articles |  Current Issue |  For Authors and Reviewers
Copyright © 2023 by Korean Society for Preventive Medicine.                 Developed in M2PI