1Big Data Steering Department, National Health Insurance Service, Wonju, Korea
2Gwanak-Branch, National Health Insurance Service, Seoul, Korea
Copyright © 2017 The Korean Society for Preventive Medicine
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
CONFLICT OF INTEREST
The authors have no conflicts of interest associated with the material presented in this paper.
Year/disease diagnosis code |
Overall agreement |
Sensitivity |
Specificity |
Cohen kappa statistic |
||||
---|---|---|---|---|---|---|---|---|
Primary | 5 Codes1 | Primary | 5 Codes1 | Primary | 5 Codes1 | Primary | 5 Codes1 | |
Hypertension | ||||||||
2009-2014 | 93.03 (93.02, 93.05) | 90.60 (90.59, 90.62) | 75.38 (75.33, 75.43) | 66.26 (66.21, 66.31) | 97.93 (97.92, 97.94) | 99.33 (99.32, 99.33) | 0.782 (0.781, 0.782) | 0.731 (0.730, 0.731) |
2011-2014 | 93.63 (93.61, 93.64) | 92.30 (92.29, 92.32) | 79.22 (79.17, 79.27) | 70.98 (70.93, 71.03) | 97.20 (97.19, 97.21) | 99.22 (99.22, 99.24) | 0.793 (0.792, 0.793) | 0.772 (0.771, 0.772) |
2013-2014 | 93.73 (93.72, 93.75) | 94.12 (94.11, 94.13) | 84.25 (84.20, 84.30) | 77.15 (77.10, 77.20) | 95.70 (95.68, 95.71) | 98.98 (98.98, 98.99) | 0.784 (0.783, 0.784) | 0.818 (0.817, 0.818) |
Diabetes mellitus | ||||||||
2009-2014 | 95.49 (95.48, 95.50) | 87.80 (87.79, 87.83) | 60.71 (60.63, 60.80) | 34.96 (34.90, 35.02) | 99.33 (99.32, 99.33) | 99.78 (99.78, 99.79) | 0.704 (0.704, 0.705) | 0.462 (0.461, 0.463) |
2011-2014 | 96.24 (96.23, 96.25) | 90.38 (90.36, 90.39) | 66.29 (66.20, 66.38) | 40.56 (40.49, 40.63) | 99.14 (99.13, 99.14) | 99.75 (99.75, 99.75) | 0.737 (0.736, 0.737) | 0.528 (0.527, 0.528) |
2013-2014 | 96.89 (96.88, 96.90) | 93.87 (93.86, 93.88) | 75.09 (75.00, 75.18) | 52.08 (52.00, 52.16) | 98.54 (98.53, 98.55) | 99.65 (99.65, 99.66) | 0.756 (0.755, 0.757) | 0.643 (0.642, 0.644) |
Stroke | ||||||||
2009-2014 | 97.96 (97.96, 97.97) | 96.78 (96.78, 96.79) | 24.25 (24.10, 24.40) | 17.22 (17.12, 17.33) | 99.75 (99.75, 99.76) | 99.81 (99.81, 99.81) | 0.353 (0.351, 0.355) | 0.272 (0.271, 0.274) |
2011-2014 | 98.37 (98.37, 98.38) | 97.50 (97.48, 97.50) | 28.09 (27.90, 28.27) | 20.45 (20.32, 20.58) | 99.70 (99.70, 99.70) | 99.76 (99.76, 99.77) | 0.383 (0.381, 0.385) | 0.310 (0.308, 0.311) |
2013-2014 | 98.80 (98.80, 98.81) | 98.27 (98.26, 98.27) | 34.75 (34.51, 34.98) | 26.35 (26.18, 26.53) | 99.61 (99.61, 99.62) | 99.69 (99.69, 99.69) | 0.414 (0.412, 0.417) | 0.364 (0.362, 0.366) |
Pulmonary tuberculosis | ||||||||
2009-2014 | 98.42 (98.42, 98.43) | 97.98 (97.97, 97.99) | 24.33 (24.05, 24.62) | 16.66 (16.47, 16.85) | 98.93 (98.92, 98.93) | 98.96 (98.95, 98.96) | 0.166 (0.163, 0.168) | 0.153 (0.152, 0.155) |
2011-2014 | 98.58 (98.58, 98.60) | 98.31 (98.30, 98.31) | 27.76 (27.38, 28.15) | 18.48 (18.24, 18.73) | 98.88 (98.88, 98.89) | 98.90 (98.90, 98.91) | 0.134 (0.132, 0.136) | 0.131 (0.130, 0.133) |
2013-2014 | 98.71 (98.70, 98.71) | 98.57 (98.57, 98.58) | 33.56 (32.99, 34.14) | 22.93 (22.54, 23.32) | 98.84 (98.83, 98.84) | 98.85 (98.84, 98.86) | 0.093 (0.091, 0.095) | 0.999 (0.097, 0.101) |
Dyslipidemia | ||||||||
2009-2014 | 88.19 (88.17, 88.21) | 67.44 (67.42, 67.47) | 18.88 (18.82, 18.94) | 10.72 (10.69, 10.74) | 97.86 (97.85, 97.87) | 99.50 (99.50, 99.51) | 0.234 (0.233, 0.234) | 0.127 (0.126, 0.127) |
2011-2014 | 90.20 (90.18, 90.22) | 71.97 (71.94, 71.99) | 20.84 (20.76, 20.91) | 12.07 (12.04, 12.11) | 97.58 (97.57, 97.59) | 99.43 (99.42, 99.43) | 0.246 (0.245, 0.247) | 0.150 (0.150, 0.151) |
2013-2014 | 93.20 (93.20, 93.22) | 79.61 (79.59, 79.63) | 26.20 (26.09, 26.30) | 15.40 (15.35, 15.44) | 97.09 (97.08, 97.10) | 99.24 (99.23, 99.24) | 0.262 (0.261, 0.263) | 0.205 (0.204, 0.205) |
Heart disease | ||||||||
2009-2014 | 96.65 (96.63, 96.65) | 93.22 (93.21, 93.24) | 33.45 (33.32, 33.58) | 20.13 (20.05, 20.21) | 99.21 (99.20, 99.21) | 99.48 (99.48, 99.49) | 0.422 (0.421, 0.423) | 0.296 (0.295, 0.297) |
2011-2014 | 97.29 (97.28, 97.30) | 94.85 (94.84, 94.86) | 39.35 (39.20, 39.51) | 24.61 (24.52, 24.71) | 99.10 (99.09, 99.10) | 99.39 (99.39, 99.40) | 0.454 (0.452, 0.456) | 0.347 (0.346, 0.349) |
2013-2014 | 97.93 (97.92, 97.94) | 96.54 (96.53, 96.55) | 49.83 (49.63, 50.02) | 32.98 (32.86, 33.11) | 98.91 (98.90, 98.91) | 99.26 (99.25, 99.26) | 0.479 (0.478, 0.481) | 0.423 (0.421, 0.424) |
Hypertension | Diabetes mellitus | Stroke | Heart disease | Dyslipidemia | Pulmonary tuberculosis | |
---|---|---|---|---|---|---|
Total (n) | 2 167 431 | 890 825 | 157 809 | 253 144 | 693 190 | 25 958 |
Gender (reference: women) | ||||||
Men | 1.17* | 0.82* | 0.68* | 0.64* | 1.44* | 0.82* |
Age (reference: 60-69, y) | ||||||
≤39 | 3.21* | 1.91* | 1.18* | 5.64* | 2.16* | 0.36* |
40-49 | 1.58* | 1.11* | 0.83* | 2.00* | 1.55* | 0.51* |
50-59 | 1.27* | 1.07* | 0.89* | 1.32* | 1.26* | 0.77* |
≥70 | 1.01* | 1.09* | 1.17* | 0.88* | 1.08* | 1.39* |
Employed (reference: no) | ||||||
Yes | 1.14* | 1.23* | 1.53* | 1.22* | 1.07* | 1.11* |
Charlson comorbidity index (reference: 0-1) | ||||||
≥2 | 1.04* | 0.45* | 0.81* | 0.83* | 1.02* | 1.07* |
Insurance contribution (reference: 4th, quintile) | ||||||
1st | 1.06* | 0.98* | 0.95* | 1.01 | 1.09* | 1.11* |
2nd | 1.01* | 0.99 | 1.03 | 1.07* | 1.10* | 1.19* |
3rd | 1.02* | 1.01 | 1.02 | 1.02 | 1.07* | 1.06 |
5th | 1.03* | 1.03* | 1.03 | 1.02 | 0.87* | 0.94 |
Region (reference: metropolitan city) | ||||||
City | 1.01* | 1.03* | 1.09* | 1.02* | 1.01 | 1.08* |
Rural | 1.04* | 1.06* | 1.17* | 1.07* | 1.14* | 1.49* |
Hypertension | Diabetes mellitus | Stroke | Heart disease | Dyslipidemia | Pulmonary tuberculosis | |
---|---|---|---|---|---|---|
Total (n) | 10 501 500 | 11 778 106 | 12 511 122 | 12 415 787 | 11 975 741 | 12 642 973 |
Gender (reference: women) | ||||||
Men | 1.66* | 1.68* | 1.40* | 1.16* | 0.83* | 1.75* |
Age (reference: ≤39, y) | ||||||
40-49 | 1.69* | 3.19* | 2.24* | 1.64* | 2.35* | 1.87* |
50-59 | 3.59* | 6.53* | 5.18* | 3.89* | 4.65* | 2.11* |
60-69 | 8.31* | 11.38* | 9.88* | 8.62* | 8.37* | 2.28* |
≥70 | 14.50* | 14.18* | 18.43* | 16.33* | 7.71* | 2.09* |
Employed (reference: yes) | ||||||
No | 1.10* | 1.09* | 2.03* | 1.37* | 1.05* | 0.94* |
Charlson comorbidity index (reference: 0-1) | ||||||
≥2 | 4.49* | 5.71* | 2.82* | 2.50* | 2.42* | 0.93* |
Insurance contribution (reference: 3rd, quintile) | ||||||
1st | 1.08* | 1.10* | 1.33* | 1.09* | 1.03* | 1.01 |
2nd | 1.00 | 1.03* | 1.05* | 0.99 | 0.97* | 0.98* |
4th | 1.01* | 1.00 | 1.00 | 1.03* | 1.10* | 1.09* |
5th | 1.06* | 0.98* | 0.96* | 1.05* | 1.39* | 1.26* |
Region (reference: rural) | ||||||
Metropolitan city | 1.19* | 1.24* | 0.94* | 0.95* | 1.47* | 1.71* |
City | 1.19* | 1.20* | 1.01 | 0.97* | 1.42* | 1.50* |
Variables | n | % |
---|---|---|
Total (n) | 12 668 931 | |
Gender | ||
Men | 6 769 570 | 53.4 |
Women | 5 899 361 | 46.6 |
Age (y) | ||
≤39 | 3 316 318 | 26.2 |
40-49 | 3 265 034 | 25.8 |
50-59 | 3 103 475 | 24.5 |
60-69 | 1 824 886 | 14.4 |
≥70 | 1 159 218 | 9.2 |
Insurance type | ||
Self-employed individuals | 1 385 168 | 10.9 |
Family of self-employed individuals | 889 863 | 7.0 |
Employed individuals | 7 690 634 | 60.7 |
Dependents of employed individuals | 2 552 395 | 20.2 |
Medical Aid beneficiaries | 125 008 | 1.0 |
Family of Medical Aid beneficiaries | 25 863 | 0.2 |
Income level, quintile (based on insurance contribution) | ||
1st | 1 844 637 | 14.6 |
2nd | 2 646 843 | 20.9 |
3rd | 2 871 931 | 22.7 |
4th | 2 795 547 | 22.1 |
5th | 2 509 973 | 19.8 |
Charlson comorbidity index | ||
0-1 | 9 896 606 | 78.1 |
≥2 | 2 772 325 | 21.9 |
Region | ||
Metropolitan city | 5 617 821 | 44.3 |
City | 6 031 389 | 47.6 |
Rural | 1 019 721 | 8.1 |
Diagnosis in questionnaire | ||
Hypertension | 2 278 189 | 18.0 |
Diabetes mellitus | 840 782 | 6.6 |
Stroke | 103 282 | 0.8 |
Pulmonary tuberculosis | 155 587 | 1.2 |
Dyslipidemia | 530 526 | 4.2 |
Heart disease | 261 683 | 2.1 |
Diagnosis in claims data (2013-2014, primary diagnosis) | ||
Hypertension | 2 167 431 | 17.1 |
Diabetes mellitus | 890 825 | 7.0 |
Stroke | 157 809 | 1.3 |
Pulmonary tuberculosis | 25 958 | 0.2 |
Dyslipidemia | 693 190 | 5.5 |
Heart disease | 253 144 | 2.0 |
Year/disease diagnosis code | Overall agreement |
Sensitivity |
Specificity |
Cohen kappa statistic |
||||
---|---|---|---|---|---|---|---|---|
Primary | 5 Codes |
Primary | 5 Codes |
Primary | 5 Codes |
Primary | 5 Codes |
|
Hypertension | ||||||||
2009-2014 | 93.03 (93.02, 93.05) | 90.60 (90.59, 90.62) | 75.38 (75.33, 75.43) | 66.26 (66.21, 66.31) | 97.93 (97.92, 97.94) | 99.33 (99.32, 99.33) | 0.782 (0.781, 0.782) | 0.731 (0.730, 0.731) |
2011-2014 | 93.63 (93.61, 93.64) | 92.30 (92.29, 92.32) | 79.22 (79.17, 79.27) | 70.98 (70.93, 71.03) | 97.20 (97.19, 97.21) | 99.22 (99.22, 99.24) | 0.793 (0.792, 0.793) | 0.772 (0.771, 0.772) |
2013-2014 | 93.73 (93.72, 93.75) | 94.12 (94.11, 94.13) | 84.25 (84.20, 84.30) | 77.15 (77.10, 77.20) | 95.70 (95.68, 95.71) | 98.98 (98.98, 98.99) | 0.784 (0.783, 0.784) | 0.818 (0.817, 0.818) |
Diabetes mellitus | ||||||||
2009-2014 | 95.49 (95.48, 95.50) | 87.80 (87.79, 87.83) | 60.71 (60.63, 60.80) | 34.96 (34.90, 35.02) | 99.33 (99.32, 99.33) | 99.78 (99.78, 99.79) | 0.704 (0.704, 0.705) | 0.462 (0.461, 0.463) |
2011-2014 | 96.24 (96.23, 96.25) | 90.38 (90.36, 90.39) | 66.29 (66.20, 66.38) | 40.56 (40.49, 40.63) | 99.14 (99.13, 99.14) | 99.75 (99.75, 99.75) | 0.737 (0.736, 0.737) | 0.528 (0.527, 0.528) |
2013-2014 | 96.89 (96.88, 96.90) | 93.87 (93.86, 93.88) | 75.09 (75.00, 75.18) | 52.08 (52.00, 52.16) | 98.54 (98.53, 98.55) | 99.65 (99.65, 99.66) | 0.756 (0.755, 0.757) | 0.643 (0.642, 0.644) |
Stroke | ||||||||
2009-2014 | 97.96 (97.96, 97.97) | 96.78 (96.78, 96.79) | 24.25 (24.10, 24.40) | 17.22 (17.12, 17.33) | 99.75 (99.75, 99.76) | 99.81 (99.81, 99.81) | 0.353 (0.351, 0.355) | 0.272 (0.271, 0.274) |
2011-2014 | 98.37 (98.37, 98.38) | 97.50 (97.48, 97.50) | 28.09 (27.90, 28.27) | 20.45 (20.32, 20.58) | 99.70 (99.70, 99.70) | 99.76 (99.76, 99.77) | 0.383 (0.381, 0.385) | 0.310 (0.308, 0.311) |
2013-2014 | 98.80 (98.80, 98.81) | 98.27 (98.26, 98.27) | 34.75 (34.51, 34.98) | 26.35 (26.18, 26.53) | 99.61 (99.61, 99.62) | 99.69 (99.69, 99.69) | 0.414 (0.412, 0.417) | 0.364 (0.362, 0.366) |
Pulmonary tuberculosis | ||||||||
2009-2014 | 98.42 (98.42, 98.43) | 97.98 (97.97, 97.99) | 24.33 (24.05, 24.62) | 16.66 (16.47, 16.85) | 98.93 (98.92, 98.93) | 98.96 (98.95, 98.96) | 0.166 (0.163, 0.168) | 0.153 (0.152, 0.155) |
2011-2014 | 98.58 (98.58, 98.60) | 98.31 (98.30, 98.31) | 27.76 (27.38, 28.15) | 18.48 (18.24, 18.73) | 98.88 (98.88, 98.89) | 98.90 (98.90, 98.91) | 0.134 (0.132, 0.136) | 0.131 (0.130, 0.133) |
2013-2014 | 98.71 (98.70, 98.71) | 98.57 (98.57, 98.58) | 33.56 (32.99, 34.14) | 22.93 (22.54, 23.32) | 98.84 (98.83, 98.84) | 98.85 (98.84, 98.86) | 0.093 (0.091, 0.095) | 0.999 (0.097, 0.101) |
Dyslipidemia | ||||||||
2009-2014 | 88.19 (88.17, 88.21) | 67.44 (67.42, 67.47) | 18.88 (18.82, 18.94) | 10.72 (10.69, 10.74) | 97.86 (97.85, 97.87) | 99.50 (99.50, 99.51) | 0.234 (0.233, 0.234) | 0.127 (0.126, 0.127) |
2011-2014 | 90.20 (90.18, 90.22) | 71.97 (71.94, 71.99) | 20.84 (20.76, 20.91) | 12.07 (12.04, 12.11) | 97.58 (97.57, 97.59) | 99.43 (99.42, 99.43) | 0.246 (0.245, 0.247) | 0.150 (0.150, 0.151) |
2013-2014 | 93.20 (93.20, 93.22) | 79.61 (79.59, 79.63) | 26.20 (26.09, 26.30) | 15.40 (15.35, 15.44) | 97.09 (97.08, 97.10) | 99.24 (99.23, 99.24) | 0.262 (0.261, 0.263) | 0.205 (0.204, 0.205) |
Heart disease | ||||||||
2009-2014 | 96.65 (96.63, 96.65) | 93.22 (93.21, 93.24) | 33.45 (33.32, 33.58) | 20.13 (20.05, 20.21) | 99.21 (99.20, 99.21) | 99.48 (99.48, 99.49) | 0.422 (0.421, 0.423) | 0.296 (0.295, 0.297) |
2011-2014 | 97.29 (97.28, 97.30) | 94.85 (94.84, 94.86) | 39.35 (39.20, 39.51) | 24.61 (24.52, 24.71) | 99.10 (99.09, 99.10) | 99.39 (99.39, 99.40) | 0.454 (0.452, 0.456) | 0.347 (0.346, 0.349) |
2013-2014 | 97.93 (97.92, 97.94) | 96.54 (96.53, 96.55) | 49.83 (49.63, 50.02) | 32.98 (32.86, 33.11) | 98.91 (98.90, 98.91) | 99.26 (99.25, 99.26) | 0.479 (0.478, 0.481) | 0.423 (0.421, 0.424) |
Hypertension | Diabetes mellitus | Stroke | Heart disease | Dyslipidemia | Pulmonary tuberculosis | |
---|---|---|---|---|---|---|
Total (n) | 2 167 431 | 890 825 | 157 809 | 253 144 | 693 190 | 25 958 |
Gender (reference: women) | ||||||
Men | 1.17 |
0.82 |
0.68 |
0.64 |
1.44 |
0.82 |
Age (reference: 60-69, y) | ||||||
≤39 | 3.21 |
1.91 |
1.18 |
5.64 |
2.16 |
0.36 |
40-49 | 1.58 |
1.11 |
0.83 |
2.00 |
1.55 |
0.51 |
50-59 | 1.27 |
1.07 |
0.89 |
1.32 |
1.26 |
0.77 |
≥70 | 1.01 |
1.09 |
1.17 |
0.88 |
1.08 |
1.39 |
Employed (reference: no) | ||||||
Yes | 1.14 |
1.23 |
1.53 |
1.22 |
1.07 |
1.11 |
Charlson comorbidity index (reference: 0-1) | ||||||
≥2 | 1.04 |
0.45 |
0.81 |
0.83 |
1.02 |
1.07 |
Insurance contribution (reference: 4th, quintile) | ||||||
1st | 1.06 |
0.98 |
0.95 |
1.01 | 1.09 |
1.11 |
2nd | 1.01 |
0.99 | 1.03 | 1.07 |
1.10 |
1.19 |
3rd | 1.02 |
1.01 | 1.02 | 1.02 | 1.07 |
1.06 |
5th | 1.03 |
1.03 |
1.03 | 1.02 | 0.87 |
0.94 |
Region (reference: metropolitan city) | ||||||
City | 1.01 |
1.03 |
1.09 |
1.02 |
1.01 | 1.08 |
Rural | 1.04 |
1.06 |
1.17 |
1.07 |
1.14 |
1.49 |
Hypertension | Diabetes mellitus | Stroke | Heart disease | Dyslipidemia | Pulmonary tuberculosis | |
---|---|---|---|---|---|---|
Total (n) | 10 501 500 | 11 778 106 | 12 511 122 | 12 415 787 | 11 975 741 | 12 642 973 |
Gender (reference: women) | ||||||
Men | 1.66 |
1.68 |
1.40 |
1.16 |
0.83 |
1.75 |
Age (reference: ≤39, y) | ||||||
40-49 | 1.69 |
3.19 |
2.24 |
1.64 |
2.35 |
1.87 |
50-59 | 3.59 |
6.53 |
5.18 |
3.89 |
4.65 |
2.11 |
60-69 | 8.31 |
11.38 |
9.88 |
8.62 |
8.37 |
2.28 |
≥70 | 14.50 |
14.18 |
18.43 |
16.33 |
7.71 |
2.09 |
Employed (reference: yes) | ||||||
No | 1.10 |
1.09 |
2.03 |
1.37 |
1.05 |
0.94 |
Charlson comorbidity index (reference: 0-1) | ||||||
≥2 | 4.49 |
5.71 |
2.82 |
2.50 |
2.42 |
0.93 |
Insurance contribution (reference: 3rd, quintile) | ||||||
1st | 1.08 |
1.10 |
1.33 |
1.09 |
1.03 |
1.01 |
2nd | 1.00 | 1.03 |
1.05 |
0.99 | 0.97 |
0.98 |
4th | 1.01 |
1.00 | 1.00 | 1.03 |
1.10 |
1.09 |
5th | 1.06 |
0.98 |
0.96 |
1.05 |
1.39 |
1.26 |
Region (reference: rural) | ||||||
Metropolitan city | 1.19 |
1.24 |
0.94 |
0.95 |
1.47 |
1.71 |
City | 1.19 |
1.20 |
1.01 | 0.97 |
1.42 |
1.50 |
Values are presented as odds ratio (95% confidence interval). Primary diagnosis codes in addition to 4 secondary diagnosis codes.
We used claims data from 2013-2014 with primary diagnosis codes.
We used claims data from 2013-2014 with primary diagnosis codes.