Correspondence 100216 Health-care worker mortality, which capture the relation 38% (95% CI 26–50) in Guinea, 74% between health-care workers in a (51–97) in Sierra Leone, and as large mortality and the legacy given country and different mortality as 111% (76–145) in Liberia, relative of the Ebola epidemic rates (ie, maternal, infant, and under-5 to pre-Ebola rates. Estimated effects mortality).3 on infant and under-5 mortality The recent outbreak of Ebola in West For each of the three countries, we ranged from an increase of 7–20% and Published Online Africa will leave a legacy significantly first calculated how many doctors, 10–28% across countries, respectively. July 9, 2015 http://dx.doi.org/10.1016/ deeper than the morbidity and nurses, and midwives combined have However, in both of the latter cases S2214-109X(15)00065-0 mortality caused directly by the died due to Ebola per 1000 of the the health-care worker mortality disease. Ebola deaths have been dis- population. We multiplied each pre- coefficients used were not statistically proportionately concentrated among Ebola mortality rate (maternal, infant, significant in the original study3 and health personnel. By May, 2015, 0·02% and under-5) by 1 minus this fraction, the range between the upper and of Guinea’s population had died due multiplied by the health-care worker lower bounds of the 95% CIs includes to Ebola, compared with 1·45% of mortality coefficient. We then trans- a zero effect (table). the country’s doctors, nurses, and lated this figure into the percentage Combining these estimates with midwives. In Liberia and Sierra Leone, change in mortality relative to pre- the most recent population numbers the differences are more dramatic, Ebola rates (appendix). and rate of livebirths in each country See Online for appendix with 0·11% and 0·06% of the general We constructed bounds based on the pre-Ebola2 suggests that an additional population killed by Ebola versus 95% CIs of the estimated coefficients 4022 women would die per year in 8·07% of the health-care workers in of health-care worker mortality. These childbirth as a result of doctors, nurses, Liberia, and 6·85% in Sierra Leone.1–4 incorporate the estimation uncertainty and midwives lost to Ebola. This would The fact that health-care workers are associated with the health-care bring the countries back to rates of at greater risk of contracting Ebola worker mortality coefficients and the maternal mortality last seen in 2000 will exacerbate existing skill shortages pre-Ebola mortality rates, under the in Guinea and Sierra Leone, and 1995 in countries that had few health assumption that the latter uncertainty in Liberia.2 personnel to begin with. is constant across countries and over These mortality estimates have We modelled how the loss of health- the period between the estimation limitations. The model’s use of cross- care workers—defined here as doctors, of the health-care worker mortality country mortality coefficients assumes nurses, and midwives—to Ebola coefficients (2006) and the present that the effect of health-care worker might affect maternal, infant, and (2015). However, we were unable supply on maternal, infant, and under-5 under-5 mortality in Guinea, Liberia, to account for the uncertainty mortality in Guinea, Liberia, and Sierra and Sierra Leone, with the aim of surrounding the measurement of Leone is similar to the cross-country characterising the order of magni- health-care worker mortality owing to average and has not changed since tude of likely effects, not providing a lack of data. those coefficients were estimated. This specific predictions. We combined As of late May, 2015, Guinea, Liberia, work further assumes that unmeasured data on: (1) health-care worker deaths and Sierra Leone, respectively, had lost elements of health systems (such an from Ebola;1 (2) the stock of health- 78, 83, and 79 doctors, nurses, and overall measure of quality), associated care workers pre-Ebola;5 (3) maternal, midwives to Ebola. The largest effects with both health-care worker density infant, and under-5 mortality rates of these health-care worker deaths for and mortality, are not driving the result. for each country, pre-Ebola;2 and (4) all three countries were on maternal Data limitations make it difficult to coefficients of health-care worker mortality (table), namely increases of account for these unmeasured factors, Doctors, nurses, and midwives Maternal mortality ratio Infant mortality rate Under-5 mortality rate (per 100 000 livebirths) (per 1000 livebirths) (per 1000 livebirths) Stock Stock % change Pre-Ebola May % change (95% CI) Pre-Ebola May % change (95% CI) Pre-Ebola May % change (95% CI) pre-Ebola post-Ebola (2013) 2015 (2013) 2015 (2013) 2015 Guinea 5395 5317 –1% 650 897 38% (26 to 50) 65 69 7% (–2 to 15) 101 110 10% (–2 to 21) Liberia 1029 946 –8% 640 1347 111% (76 to 145) 54 64 20% (–4 to 43) 71 91 28% (–5 to 61) Sierra Leone 1153 1074 –7% 1100 1916 74% (51 to 97) 107 121 13% (–3 to 29) 161 191 19% (–4 to 41) Data are from author calculations based on Ebola mortality data from WHO,1 population and maternal mortality data from World Development Indicators,2 and health worker-mortality coefficients from Speybroeck et al.3 Data on pre-Ebola stock of health workers is for the most recent years available for each country: 2004 (nurses and midwives) and 2005 (doctors) for Guinea, 2008 for Liberia, and 2010 for Sierra Leone. Table: Effects of health-care worker deaths from Ebola on maternal, infant, and child mortality www.thelancet.com/lancetgh Vol 3 August 2015 e439 Correspondence but one may consider that health-care 4 WHO. Ebola situation report, 20 May 2015. Geneva: World Health Organization, 2015. workers are a crucial element of all http://apps.who.int/ebola/en/current- other parts of an effectively functioning situation/ebola-situation-report-20- health-care system. However, these may-2015 (accessed May 22, 2015). 5 WHO. Health workforce density per 1000 numbers demonstrate the potentially population. http://apps.who.int/gho/data/ sizeable legacy that Ebola will leave. node.main.A1444 (accessed May 22, 2015). Ebola has weakened already fragile systems, and it should be the catalyst to strengthen the systems far beyond their pre-Ebola levels. Indeed, to reach the minimum 80% health coverage targeted by the Millennium Develop- ment Goals, 43 565 doctors, nurses, and midwives would need to be hired across the three countries. Our estimates suggest that substantial investment in health systems—and specifically in the health workforce—is urgently required not only to improve future epidemic preparedness and meet basic needs, but also to limit the secondary health effects of the current epidemic owing to the depletion of the health workforce. An extended version of this Correspondence can be found at http://documents.worldbank.org/curated/ en/24652897. We declare no competing interests. No external funding was received for this work. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the World Bank and its affiliated organisations, nor those of the Executive Directors of the World Bank or the governments they represent. We thank Trina Haque, Patricio Marquez, and Shiyong Wang for their help in securing the data without which this work would not have been possible, as well as Kathleen Beegle, Timothy Bulman, Francisco Ferreira, and two anonymous reviewers for their suggestions. Copyright © Evans et al. Open Access article published under the terms of CC BY. *David K Evans, Markus Goldstein, Anna Popova devans2@worldbank.org World Bank, Washington, DC 20433, USA 1 WHO. Health worker Ebola infections in Guinea, Liberia and Sierra Leone: a preliminary report. Geneva: World Health Organization, 2015. http://www.who.int/csr/resources/ publications/ebola/health-worker-infections/ en/ (accessed May 22, 2015). 2 World Bank. World development indicators 2015. http://data.worldbank.org/data-catalog/ world-development-indicators (accessed May 22, 2015). 3 Speybroeck N, Kinfu Y, Poz MD, Evans D. Reassessing the relationship between human resources for health, intervention coverage and health outcomes. Geneva: World Health Organization, 2006. http://www.who.int/hrh/ documents/reassessing_relationship.pdf (accessed May 22, 2015). e440 www.thelancet.com/lancetgh Vol 3 August 2015 Supplementary appendix This appendix formed part of the original submission and has been peer reviewed. We post it as supplied by the authors. Supplement to: Evans DK, Goldstein M, Popova A. Health-care worker mortality and the legacy of the Ebola epidemic. Lancet Glob Health 2015; published online July 9. http://dx.doi.org/10.1016/S2214-109X(15)00065-0. Supplementary appendix The Relationship between Healthcare Workers and Health Outcomes A number of studies have attempted to assess the relationship between healthcare workers and health outcomes. Almost all of these rely on regressions of cross-sectional data, but they vary greatly in which outcome variables (different mortality rates, vaccine coverage, or coverage of births by skilled attendants), explanatory variables (density of healthcare workers, doctors, or nurses and midwives), and controls (poverty, GDP, education) they include, as well as in the functional forms used in their econometric analysis (logit-log, log-linear, linear regressions with arcsin and log transformation of the dependent and independent variables, logit-log and arcsine- log model), not to mention in their results. 1 We focus our attention on those studies investigating the effect of healthcare worker density (i.e., the number of healthcare workers per 1,000 of the population) on mortality, as opposed to alternative health outcomes. The relationship between the healthcare workforce and mortality is more studied than other outcomes and serves as a proxy for the overall quality of the health sector. Early studies found no significant association between doctor density and infant mortality, 2, 3 or even an adverse association (i.e., positive) between the doctor density, and infant and perinatal mortality. 4 However, more recent studies, with access to more extensive and better quality data, have consistently found a negative and a significant association between the density of healthcare workers and mortality. In this analysis we focus on five of these recent studies. These studies take a range of approaches, which are summarized in Table A1. One key area of difference in the approaches is how they treat health workers: either as an aggregate, or looking at the effects of doctors, nurses, and midwives separately (possibly allowing for an interaction between doctors and nurses). Robinson and Wharrad use data from 155 countries and find a negative relationship between doctor density and maternal, infant, and under-five mortality. However, they find no statistically significant relationship for nurses once they are included with doctors. 5, 6 Anand and Bärninghausen use data from 117 countries and find a significant negative association between the density of aggregate healthcare workers (doctors, nurses, and midwives combined) and maternal, infant, and under-five mortality. They also find a significant negative relationship between doctor density and all mortality rates, while the coefficient for nurses is insignificant once the controls are included. 7 Speybroeck et al. use data for 192 countries. They find a significant negative relationship between aggregate healthcare worker density and maternal mortality, with a similar elasticity to that of Anand and Bärninghausen, but unlike the latter they find the coefficients for infant and under-five mortality to be insignificant. In the case of disaggregate densities – where they are unique in their inclusion of an interaction term between doctor density and the density of nurses and midwives – they again find a significant association 1 between doctor density and all mortality rates, while the relationship for nurses is significant (and negative) only in the case of maternal mortality. 8 Farahani et al. are the first to use panel data in their analysis of 99 countries, which looks at the effect of doctor density on infant mortality. They find that adding one doctor for every 1,000 population is consistent with a significant reduction in infant mortality by about 30%, or 45% in the long-run. 9 While these recent studies - with their various functional forms - tend to converge on a significant negative association of both aggregate healthcare worker density and doctor density with mortality rates, they also converge in their inability to sufficiently account for other factors that may be driving mortality rates. Notably, there may be a selection problem such that countries with health systems which are weak in ways other than simply having few healthcare workers (e.g., low health expenditure, high geographic concentration of services, limited access to external resources, or inappropriate incentive and decision-making structures) 7, 8 experience high mortality rates precisely due to these other weaknesses. Not only would a wider range of inputs to the production of health ideally be included in the models, but healthcare workers would preferably be separated from the factors likely to mediate the efficiency with which they are able to perform. 8 Data limitations make it difficult to account for these other factors, however, so while these studies acknowledge that the performance of healthcare workers will be dependent on these factors and note their exclusion as a shortcoming, they either argue that healthcare workers are the “glue” that allows the rest of the system to function, 10 or that the workers serve as a proxy for general health system resources. 9 Methods As discussed in the letter, we combine data from the following sources to model how the loss of healthcare workers to Ebola will affect non-Ebola mortality in Guinea, Liberia, and Sierra Leone: (1) current healthcare worker deaths from Ebola, disaggregated by country and occupation; (2) the stock of healthcare workers pre-Ebola, similarly disaggregated; (3) maternal, infant, and under-five mortality rates for each country, pre-Ebola; and (4) healthcare worker mortality coefficients, which capture the relationship between healthcare workers in a given country and different mortality rates (i.e., maternal, infant, and under-five mortality). Addressing the source of each of these in turn, disaggregated data on healthcare worker deaths from Ebola in Guinea, Liberia, and Sierra Leone come from the World Health Organization (WHO), based on the Viral Haemorrhagic Fever database for each country. 11 For doctors, we use the WHO numbers for “medical workers,” which include doctors and medical students. We use data on the stock of healthcare workers from the WHO Global Health Workforce Statistics.i 12 Pre-Ebola mortality rates for each country come from the World Development Indicators (WDI). 13 These define the maternal mortality ratio as the number of women who die from 2 pregnancy-related causes while pregnant or within 42 days of pregnancy termination per 100,000 live births, and infant and under-five mortality rates as the probability per 1,000 that a newborn baby will die before reaching the ages of one or five, respectively. We use coefficients from Speybroeck et al. 8 as our main estimates for the association between aggregate healthcare worker density (for doctors, nurses, and midwives, combined) and maternal, infant, and under- five mortality as our primary healthcare worker mortality coefficients. The coefficients for under-five mortality used in our chosen specification as well as all robustness tests are calculated using mortality rates for children aged between one and five years as per Speybroeck et al. 8 and Anand and Bärninghausen. 7 We rely principally on the coefficient of Speybroeck et al. because they calculate their healthcare worker mortality coefficients using data with the largest sample of countries, they use the same data source as we use for the stock of healthcare workers, and they provide coefficients for all three types of mortality (maternal, infant, and under-five). Also, in addition to including controls for income poverty, GDP per capita, and female literacy, they run a disaggregated specification, which reports coefficients for doctors and nurses-midwives separately, which we exploit as one of two robustness checks.ii Obviously, the difference in definition of under-five mortality between Speybroeck et al. and WDI is a limitation, but the results are still informative as to the likely order of magnitude of effects. To calculate the effect on mortality due to healthcare worker deaths from Ebola, for each of the three countries, we first calculate how many doctors, nurses, and midwives combined have died due to Ebola per 1,000 of the population to date. We then multiply each pre-Ebola mortality rate (maternal, infant, and under-five) by one minus this fraction multiplied by the healthcare worker mortality coefficient from Speybroeck et al., 8 multiplied by 100, as below.iii We then translate this into the percentage change relative to pre-Ebola mortality rates.  2015     =       ∗ 1 − (ℎℎ    ℎ    1,000   ∗ ℎℎ       ∗ 100)   We undertake two measures to assess the robustness of our estimates: (1) we calculate lower and upper bound estimates using the 95% confidence intervals for the healthcare worker mortality coefficients from Speybroeck et al.; 8 and (2) we calculate how much the estimates vary when we use mortality coefficients from the various models discussed in the previous section. For each study providing coefficients for either aggregated healthcare workers, or disaggregated doctors, and nurses-midwives, we choose the coefficients resulting from the authors’ preferred specification, for all available mortality rates. Where both aggregated and disaggregated coefficients are reported, we use both to check for robustness, provided that the latter includes nurses and midwives.iv Table A1 provides more details on the models underlying each of the coefficients used as robustness checks. 3 Table A1: Summary of Recent Methods to Calculate Healthcare Worker – Mortality Coefficients Speybroeck Anand and Robinson and Robinson and Farahani et al. 9 et al. 8 Bärninghausen 7 Wharrad 5 Wharrad 6 Independent variables Aggregate healthcare No Yes Yes No No workers Disaggregate doctors Doctors only Yes Yes Yes Yes & nurses Dependent variables Maternal mortality No Yes Yes Yes No Infant mortality Yes Yes Yes No Yes Under-five mortality No Yes Yes No Yes Model Log-level Log-linear Log-linear Multiple linear Multiple linear regression with regression regression regression with regression with (1) cross- log log country data, (2) transformations transformations panel data, (3) of doctor density, of doctor panel data with nurse density and density, nurse country fixed GNP, and arcsin density and effects and (4) transformations GNP, and arcsin panel data with of female literacy transformation time lags and births of female attended literacy Controls GDP per capita, GDP per GNI per capita, GNP, female GNP, female average years of capita, income poverty, literacy, births literacy schooling, income female literacy attended country fixed poverty, effects + lags of female all dependent literacy and independent variables for long-term analysis Data Longitudinal WHO WHO database UN database on UN database on panel data from database on on 117 countries 116 countries 116 countries 99 countries 192 or 83 countries when female when female from 1960 to countries when income is literacy is literacy is 2000 using data included included included from the WDI, Penn World Table, and the Barro–Lee dataset 4 Sensitivity Analysis Table A2 presents estimates for maternal mortality using healthcare worker mortality coefficients from other studies. All three alternative methods also produce large increases in maternal mortality for all countries. The most comparable effects arise from Method 3, which – similarly to Speybroeck et al. – uses an aggregate coefficient for doctors, nurses and midwives, and produces increases in maternal mortality of 31% in Guinea, 61% in Sierra Leone, and 92% in Liberia. The next most similar estimates arise from Method 2, which uses disaggregated coefficients for doctors, and nurses and midwives, plus an interaction term between them. The smallest estimates come from Method 4 which uses disaggregated coefficients but does not account for an interaction effect. This is a serious limitation because doctors and nurses are likely to be complementary: it is not difficult to imagine that a doctor is more likely to be effective at saving lives when there is a nurse present, and vice versa. Nonetheless, even using this method as an absolute lower bound, healthcare worker deaths to date would increase maternal mortality by between 12% and 23% across the three countries. Table A2: Robustness of Maternal Mortality Estimates to Different Coefficients Change in maternal mortality due to healthcare worker deaths from Ebola Guinea Liberia Sierra Leone Method 1: Speybroeck et al. (2006) aggregated doctors and nurses, controlling for GDP per capita, income poverty, female literacy (from Table 1) 38% 111% 74% Method 2: Speybroeck et al. (2006) disaggregated doctors and nurses, plus interaction between doctors & nurses, controlling for GDP per capita, income poverty, female literacy 27% 73% 49% Method 3: Anand and Bärninghausen (2004) aggregated doctors and nurses, controlling for GNI per capita, income poverty, female literacy 31% 92% 61% Method 4: Anand and Bärninghausen (2004) disaggregated doctors and nurses, controlling for GNI per capita, income poverty, female literacy 12% 23% 16% Note: Using coefficients from Robinson and Wharrad 6 yields smaller estimates of 5%, 3%, and 3% increases in maternal mortality for Guinea, Liberia, and Sierra Leone. However, this is explained by the fact that they only report a coefficient for doctors (although nurses are included in their specification, which also controls for GNP, female literacy, and births attended). 5 References for Supplementary Appendix 1. Castillo-Laborde C. Human resources for health and burden of disease: an econometric approach. Hum Resour Health 2011; 9(4). doi:10.1186/1478-4491-9-4 2. Kim K, Moody P. More resources better health? A cross-national perspective. Soc Sci Med 1992; 34:837-842. doi:10.1016/0277-9536(92)90253-M 3. Hertz E, Hebert J, Landon J. Social and environmental factors and life expectancy, infant mortality, and maternal mortality rates. Soc Sci Med 1994; 39:105-114. doi:10.1016/0277- 9536(94)90170-8 4. Cochrane A, Leger AS, Moore F. Health service ‘input’ and mortality ‘output’ in developed countries. J Epidemiol Community Health 1997; 51:344-348. doi:10.1136/jech.51.4.344 5. Robinson J, Wharrad H. Invisible nursing. J Adv Nurs 2000; 32(1):28-40. doi:10.1046/j.1365-2648.2000.01458.x 6. Robinson J, Wharrad H. The relationship between attendance at birth and maternal mortality rates. J Adv Nurs 2001;34:445-455. doi:10.1046/j.1365-2648.2001.01773.x 7. Anand S, Bärnighausen T. Human resources and health outcomes: cross-country econometric study. Lancet 2004; 364:1603-09. doi:10.1016/S0140-6736(04)17313-3 8. Speybroeck N, Kinfu Y, Poz MD, Evans D. Reassessing the relationship between human resources for health, intervention coverage and health outcomes. Geneva: World Health Organization; 2006. 9. Farahani M, Subramanian S, Canning D. The effect of changes in health sector resources on infant mortality in the short-run and the long-run. Soc Sci Med 2009; 68:1918–1925. doi:10.1016/j.socscimed.2009.03.023 10. Chen L, Evans T, Anand S, et al. Human resources for health: overcoming the crisis. Lancet 2004; 364:1984-90. doi:10.1016/S0140-6736(04)17482-5 11. WHO. Health worker Ebola infections in Guinea, Liberia and Sierra Leone: A preliminary report. World Health Organization; 2015. 12. WHO. Global Health Observatory Data Repository. http://apps.who.int/gho/data/node.main.A1444. Accessed February 25, 2015. 13. World Bank. World Development Indicators. 2015. http://data.worldbank.org/data- catalog/world-development-indicators. Accessed March 1, 2015. 6 i For robustness, we also ran our model with data on the stock of healthcare workers from the World Development Indicators database, 13 which are similar and produced identical effects on mortality. ii This is not our preferred specification because the distribution of doctors versus nurses and midwives may well be endogenous to local factors. iii This is because the coefficients from Speybroeck et al.’s log-linear regressions are elasticities, such that the estimated coefficient b on the log of healthcare worker density can be interpreted as a 1% increase in healthcare worker density, ceteris paribus, leading to a b% change in the mortality rate. 8 iv Robinson and Wharrad and Farahani et al. both report coefficients for doctors only, thus we do not use these as robustness checks as they are not strictly comparable to our model. 5, 6, 9 7