Updating Korean Disability Weights for Causes of Disease: Adopting an Add-on Study Method
Article information
Abstract
Objectives
Disability weights require regular updates, as they are influenced by both diseases and societal perceptions. Consequently, it is necessary to develop an up-to-date list of the causes of diseases and establish a survey panel for estimating disability weights. Accordingly, this study was conducted to calculate, assess, modify, and validate disability weights suitable for Korea, accounting for its cultural and social characteristics.
Methods
The 380 causes of disease used in the survey were derived from the 2019 Global Burden of Disease Collaborative Network and from 2019 and 2020 Korean studies on disability weights for causes of disease. Disability weights were reanalyzed by integrating the findings of an earlier survey on disability weights in Korea with those of the additional survey conducted in this study. The responses were transformed into paired comparisons and analyzed using probit regression analysis. Coefficients for the causes of disease were converted into predicted probabilities, and disability weights in 2 models (model 1 and 2) were rescaled using a normal distribution and the natural logarithm, respectively.
Results
The mean values for the 380 causes of disease in models 1 and 2 were 0.488 and 0.369, respectively. Both models exhibited the same order of disability weights. The disability weights for the 300 causes of disease present in both the current and 2019 studies demonstrated a Pearson correlation coefficient of 0.994 (p=0.001 for both models). This study presents a detailed add-on approach for calculating disability weights.
Conclusions
This method can be employed in other countries to obtain timely disability weight estimations.
INTRODUCTION
A disability weight (DW) is a measure that represents the severity of specific health states or causes of disease, in contrast to a utility weight. DW values range from 0, indicating full health, to 1, representing a disability equivalent to death [1]. DW is a critical component in calculating disability-adjusted life years (DALYs) and disability-adjusted life expectancy (DALE), which are used to determine summary measures of population health [2,3]. Therefore, it is essential to ensure the validity of DW, as it impacts the validity of the DALY and DALE calculations. An overestimated DW for a particular disease would lead to an overestimation of the burden of that disease, while the opposite would occur if the DW were underestimated.
DW validity cannot be guaranteed by a single instance of validity verification. The emergence of new diseases, as well as changes in conditions, treatments, or societal perceptions, may render previously valid DWs inapplicable in the current era. Therefore, it is necessary to assess the validity of past DWs and determine whether modifications are required. The Global Burden of Disease Study has been updating DWs to reflect their current relevance [4–6]. The emergence of coronavirus disease 2019 (COVID-19) has further underscored the importance of revising DWs. While some studies have temporarily replaced COVID-19 with another disease for DW measurement [7,8], COVID-19 should be incorporated into DW evaluations given the disease’s expected persistence.
Two DW measurement approaches are used according to the DALY calculation method [3]. One is an incidence-based approach involving the cause of disease, while the other is a prevalence-based approach focused on the health state. After determining which strategy to use, it is necessary to categorize the cause of disease or health state in order to construct a survey panel and to modify or create a health state description if needed [1]. Subsequently, a survey must be initiated, taking into account the valuation method and time presentation, as its results will be incorporated into DW calculations and validated. Due to cultural and social differences across countries, care should be taken when applying DWs to other nations. The 2010 Global Burden of Disease Report demonstrated relatively few discrepancies in health state preferences among countries [4]; however, it is challenging to assert that no differences were present in cultural perceptions of health states or diseases, as the 2010 survey exhibited bias in the number of participating countries and cultures. Therefore, DWs must be appropriately measured for the Korea, with their validity evaluated and their calculations adjusted as needed [1].
In this study, we estimated DWs using an incidence-based approach with an updated list of disease causes. The validity of these DWs was assessed in consideration of Korea’s cultural and social characteristics. In particular, the DW survey results from previous studies employing an incidence-based approach were utilized through an add-on study method to refine the DWs [9,10].
METHODS
Study Design and Participants
A web-based self-administered survey was conducted, drawing from a previous study [10]. The survey took place between August 1, 2022, and August 30, 2022. Eligible participants were restricted to medically licensed physicians in Korea, with nurses and Korean medical doctors excluded due to improper response patterns observed in previous studies [10]. Furthermore, since the survey did not offer detailed descriptions of diseases, medical expertise was necessary to determine the cause of each disease based on its apparent value and severity level. Participants were recruited through advertisements on medical institution-related web boards, word of mouth, and snowball sampling, with participants who had completed the survey recommending other qualified individuals to join the study.
Valuation Method and Causes of Disease
The questionnaire consisted of 4 socio-demographic characteristics—age, sex, specialty, and occupation—as well as 20 questions regarding the ranking of causes of disease, in line with methods used in previous studies [9,10]. Of 378 causes of disease (excluding “full health” and “death”), 5 causes of disease were randomly selected for each question. Participants ranked these causes of disease in order of good health based on severity and face value [11]. “Full health” and “death” served as valuation anchor points to ensure the validity of survey responses and the participants’ full comprehension of the survey content. Specifically, “full health” was the first fixed alternative for questions 5, 10, 15, and 20, while “death” was the first fixed alternative for questions 9–12. Questions 9–12 were designed to include at least 1 of the new causes of disease as the second alternative for each question, increasing the likelihood of newly added causes of disease appearing in the questionnaire. An example of a ranking method question can be found in Supplemental Material 1.
The list of causes of diseases used in the survey required modification, as previously measured DWs needed to be reviewed and validated to ensure their relevance to the current era considering new disease outbreaks such as COVID-19, changes in treatment, and shifts in social judgment regarding specific diseases [4–6]. A total of 380 causes of disease were identified for the study in the following manner. First, the list of causes of disease used in the 2019 Global Burden of Disease Collaborative Network was evaluated to incorporate global DW trends. In total, 281 causes of disease were selected, excluding those that could be further classified by severity. Next, 99 additional causes of disease were included after examining the causes of disease lists from the 2016, 2019, and 2020 Korean DW measurements to reflect the cultural characteristics of Korea [9,10,12]. Specifically, common causes of diseases from those 3 years, such as “hemorrhagic and other non-ischemic strokes” and “Asperger syndrome and other autistic spectrum disorders,” were added. Other common causes of diseases from 2016 and 2019, such as “influenza and intestinal infection,” and from 2019 and 2020, such as “stomach cancer” and “breast cancer stages 1–4,” were also included. From the 2020 list, “unintentional suffocation,” “COVID-19” with severity classification, “ischemic heart disease,” and others were added. The researchers and a DW expert reviewed each selection process and the English-to-Korean translation of disease terminology.
Statistical Analysis
During the data cleaning process, incomplete surveys and incorrect anchor-point answer data related to “full health” were removed. To enhance the validity of the results, raw data for measuring DW by the cause of disease from the 2019 [9] and 2020 [10] studies were utilized. Specifically, raw data from 430 participants in the 2019 study [9] and 685 participants in the 2020 study [10] were included after eliminating any data that did not meet the present participation eligibility criteria and any data derived from a set of questions with at least 1 cause of disease that did not overlap with the present list of causes of disease. For instance, in the 2019 study [9], 71 participants who did not complete the survey were initially removed from the data, followed by the exclusion of 175 participants who were either medical students, nurses, or Korean medical doctors; data derived from a set of questions that included 38 causes of diseases were also removed. Additionally, “human immunodeficiency virus disease resulting in mycobacterial infection” and “typhoid and paratyphoid fevers” were excluded, as they did not match the current list and were subdivided into 2 separate entities, respectively. In the 2020 study [10], 95 participants who did not complete the survey were initially removed, and 157 participants who did not meet the eligibility criteria were excluded; data resulting from any questions that included 11 disease causes were also withdrawn. Chronic kidney disease due to diabetes mellitus was excluded due to its subdivision in the current list. Subsequently, the labeling of the extracted data with cause of disease numbers was converted to match the present labeling system.
First, a descriptive analysis of the participants’ socio-demographic characteristics was conducted using the complete dataset. The 5 alternatively ranked datasets were then transformed into a paired comparison format to adapt a precedent method [9,10]. Specifically, if a participant responded to a ranking questionnaire in the order of C1-C2-C3-C4-C5, this was transformed into C1–C5, C1–C4, C1–C3, C1–C2, C2–C5, C2–C4, C2–C3, C3–C5, C3–C4, and C4–C5. Probit regression analysis was performed using 2 models, in line with previous studies [12,13]. The cause of disease was treated as a dummy variable and set as an independent variable, while preference was set as a dependent variable. The regression coefficient for each cause of disease was then converted to a predicted probability. The value was rescaled based on the estimated DW of “death” (1), with this rescaled value considered the DW. The DWs were rescaled using a normal distribution and natural logarithm in models 1 and 2, respectively.
Stata version 13.1 (StataCorp., College Station, TX, USA) was utilized for all statistical analyses. A p-value <0.05 was considered to indicate statistical significance.
Ethics Statement
The Korea University Institutional Review Board (IRB No. KUIRB-2022-0221-02) granted approval for this study. Prior to the survey, participants were informed about the study’s objectives and procedures. Only those who consented to the terms participated in the study and were given coffee coupons valued at 10 000 Korean won upon completion of the survey.
RESULTS
For this study, 211 participants began and completed the survey. Of these, 205 participants who correctly ranked “full health” first for the anchor point questions 5, 10, 15, and 20 were selected for analysis. As an add-on, 685 and 430 participants were chosen from the 2020 and 2019 studies [9,10], respectively. Table 1 displays the socio-demographic characteristics of the participants across the 3 years. Most participants during this period were male specialists in their 30s. In the current study and the 2019 study, most participants’ specialties were neither medical nor surgical, while participants from the 2020 study primarily specialized in medicine.
Characteristics of study participants
Table 2 displays the DWs for the 2 models. The mean DWs for model 1 and model 2 were 0.488 and 0.369, respectively. Both models identified the same disease as having the highest DW: “trachea, bronchus, and lung cancers (stage 4),” with DWs of 0.922 in model 1 and 0.696 in model 2. Similarly, the lowest DW in both models was attributed to the same disease: “acne vulgaris,” with DWs of 0.055 in model 1 and 0.223 in model 2. The 2 models also shared the same ranking of diseases by DW.
Disability weights for each analysis model by cause of disease
Following “trachea, bronchus, and lung cancers (stage 4),” the diseases with the highest DWs in descending order were “pancreatic cancer,” “kidney cancer (stage 4),” and “liver cancer secondary to alcohol use (stage 4).” Conversely, the diseases with the lowest DWs in ascending order were “acne vulgaris,” “caries of deciduous teeth,” “allergic rhinitis,” and “urticaria.”
Figure 1 illustrates the DW distributions for models 1 and 2. Model 1 displays a relatively normal distribution, whereas model 2 exhibits a left-skewed distribution. In model 1, the highest number of causes of disease, 61, was found in the DW range of 0.3 to 0.4. Meanwhile, in model 2, no causes of disease were identified with DW values less than 0.2 or greater than 0.7.
Figure 2 displays the correlation between the DWs for causes of disease in the current and previous models [10]. The causes of disease from the 2020 study [10] were compared word by word with those in the present study, and 300 causes of disease were selected for correlation analyses. Both model 1 and model 2 had a Pearson correlation coefficient of 0.994 with a p-value of 0.001. Among the 300 overlapping causes of disease, 155 DWs increased in model 1 relative to the DWs in the previous study, while 137 DWs decreased (Supplemental Material 2). Eight DWs remained the same as in the previous study: “other meningitis” (0.583), “liver cancer secondary to alcohol use (stage 1)” (0.598), “asthma” (0.409), “Alzheimer disease and other dementias” (0.660), “conduct disorder” (0.314), “pruritus” (0.104), “other skin and subcutaneous diseases” (0.135), and “drowning” (0.527). In model 2, 145 DWs increased and 148 DWs decreased relative to the DWs in the previous study. Seven DWs remained unchanged: “latent tuberculosis infection” (0.268), “breast cancer (stage 2)” (0.393), “other drug use disorders” (0.291), “glaucoma” (0.315), “age-related and other hearing loss” (0.277), “physical violence by firearms” (0.365), and “physical violence by other means” (0.274).
DISCUSSION
This study presents the findings of an add-on study approach for revising DWs. We combined the results of a present DW survey involving approximately 200 physicians with data from previous studies (430 and 685 participants in 2019 and 2020, respectively) to update the DWs for 380 causes of disease. In earlier DW studies, independent surveys were conducted to introduce new causes of disease or refine existing ones, and the outcomes were analyzed to generate DWs. The central importance of this study is its demonstration of the potential to revise DWs using an add-on study method.
The importance of an add-on study for determining DWs stems from the fact that recent DW studies have primarily employed ordinal methods, such as paired comparison and ranking methods [14]. Estimating the DW is relatively straightforward when using cardinal methods like person trade-off, time trade-off, and standard gamble, as they allow for direct comparison with an anchor point, such as death, and can easily incorporate newly added causes of diseases. However, to calculate DW using ordinal methods, a new cause of disease must be compared to an existing cause. Therefore, if additional causes of disease are introduced without a major reorganization of the disease classification system, it is feasible to use an add-on study method for calculating DWs with ordinal methods. This approach is also applicable to DW studies focusing on health states.
The strength of the add-on study method also underscores the difficulty in recruiting physicians, who frequently serve as participants for estimating DWs related to causes of disease. Numerous DW estimation studies have been conducted reflecting the preferences of the public [13,15,16]; however, this approach is limited, as this population can only evaluate the DW of health states. Consequently, if DWs are to be calculated based directly on the cause of disease, the opinions of health professionals must be incorporated. It is essential to adapt to the anticipated expertise of these professionals to ensure valid paired comparison results, which ultimately affects the sample size for analysis due to the low number of survey participants. In fact, DW studies involving experts tend to have fewer participants than those involving the public [17]. Therefore, updating DWs by merging the results of existing surveys with data from more recent ones, as in the add-on study method, is a promising approach to enhance the efficiency of the DW estimation process.
It is not uncommon for DWs to require revision, particularly when a new cause of disease emerges, such as COVID-19, which has recently led to a high global disease burden. The calculation of DWs for this cause of disease is in high demand. However, studies calculating DALYs, including those for COVID-19, have replaced DWs with existing causes of disease or health states rather than adding COVID-19 as a specific new disease [18–20]. In the present study, the severity of COVID-19 was subdivided into mild, moderate, and severe. The respective DWs were calculated as 0.110, 0.642, and 0.755 for model 1 and 0.235, 0.419, and 0.493 for model 2. The DWs for COVID-19 in this study were slightly higher than those in previous studies. However, the DW obtained in this study, derived from analyzing physicians’ responses through the direct comparison of COVID-19 to other diseases, is expected to have higher validity.
When comparing the revised DWs to those found in previous research, the values and patterns observed were generally similar (Pearson correlation, 0.994). The differences between the 2 values were mainly within 0.02, although some were model-specific. Extreme changes in DW can lead to major alterations in years lived with disability, ultimately compromising the ability to obtain a valid DALE measurement. This add-on study method demonstrated the benefit of utilizing existing survey results to obtain the DWs of new causes of disease without causing abrupt changes in the current cause of disease values during DW revision. This finding suggests that DWs can be fine-tuned based on the collective opinions of multiple health professionals, rather than implementing dramatic DW revisions influenced by the preferences or judgments of a limited number of experts.
Notably, the revised leading causes of disease in the present study were more likely to have DWs segmented by severity. Previous studies typically utilized 3 or 4 levels of severity for primary diseases such as cancer or chronic obstructive pulmonary disease [11]. In the present study, DWs were measured not only for COVID-19 but also by subdividing the severity of kidney and bladder cancer. For diabetes, DWs were calculated by categorizing the severity of each complication type. Preventing chronic diseases entirely is becoming increasingly difficult. It may be more rational to manage a disease at a lower severity and reduce the burden of a specific cause of disease, such as by preventing the development of complications. The severity-disaggregated DWs and severity distributions from this study can be used to calculate years lived with disability more accurately for specific causes of disease [21]. Additionally, monitoring will enable the evaluation of the effectiveness of interventions aimed at preventing disease complications [22,23].
The limitations of this study include the inherent challenges of surveying experts and the surveyed physicians’ inability to fully represent the views of all physicians in Korea. This recent survey involved approximately 200 physicians, whose insights may have been particularly valuable in determining the DWs for additional or revised disease causes. It is crucial to involve physicians with diverse expertise in future DW surveys to identify the valid causes of disease-related DWs.
CONCLUSION
This study presents a detailed add-on methodology for revising the DWs of 380 existing causes of disease and estimating DWs of additional causes. This research approach is applicable in Korea and other countries to generate timely DWs. The DWs obtained in this study can be utilized to determine a reasonable disease burden by choosing an appropriate DALE calculation method. Additionally, these DWs can serve as a fundamental variable in calculating healthy life expectancy.
SUPPLEMENTAL MATERIALS
Supplemental materials are available at https://doi.org/10.3961/jpmph.23.192.
Notes
CONFLICT OF INTEREST
The authors have no conflicts of interest associated with the material presented in this paper.
FUNDING
This study was supported by funds from the Korean Health Promotion Institute (KHEPI) in 2022.
AUTHOR CONTRIBUTIONS
Conceptualization: Im D, Mahmudah NA, Yoon SJ, Kim YE, Jung YS, Ock M, Lee DH, Kim Y. Data curation: Im D, Mahmudah NA, Ock M. Formal analysis: Im D, Ock M. Funding acquisition: Yoon SJ. Methodology: Im D, Ock M. Project administration: Im D, Ock M. Visualization: Im D, Ock M. Writing – original draft: Im D, Ock M. Writing – review & editing: Im D, Mahmudah NA, Yoon SJ, Kim YE, Jung YS, Ock M, Lee DH, Kim Y.
ACKNOWLEDGEMENTS
The authors would like to thank the survey respondents.