 Methodology
 Open Access
 Open Peer Review
 Published:
Assessing the short term impact of air pollution on mortality: a matching approach
Environmental Health volume 16, Article number: 7 (2017)
Abstract
Background
The opportunity to assess short term impact of air pollution relies on the causal interpretation of the exposureresponse association. However, up to now few studies explicitly faced this issue within a causal inference framework. In this paper, we reformulated the problem of assessing the short term impact of air pollution on health using the potential outcome approach to causal inference. We considered the impact of high daily levels of particulate matter ≤10 μm in diameter (PM_{10}) on mortality within two days from the exposure in the metropolitan area of Milan (Italy), during the period 2003–2006. Our research focus was the causal impact of a hypothetical intervention setting daily air pollution levels under a prefixed threshold.
Methods
We applied a matching procedure based on propensity score to estimate the total number of attributable deaths (AD) during the study period. After defining the number of attributable deaths in terms of difference between potential outcomes, we used the estimated propensity score to match each high exposure day, namely each day with a level of exposure higher than 40 μg/m^{3}, with a day with similar background characteristics but a level of exposure lower than 40 μg/m^{3}. Then, we estimated the impact by comparing mortality between matched days.
Results
During the study period daily exposures larger than 40 μg/m^{3} were responsible for 1079 deaths (90% CI: 116; 2042). The impact was more evident among the elderly than in the younger age classes. Exposures ≥ 40 μg/m^{3} were responsible, among the elderly, for 1102 deaths (90% CI: 388, 1816), of which 797 from cardiovascular causes and 243 from respiratory causes. Clear evidence of an impact on respiratory mortality was found also in the age class 65–74, with 87 AD (90% CI: 11, 163).
Conclusions
The propensity score matching turned out to be an appealing method to assess historical impacts in this field, which guarantees that the estimated total number of AD can be derived directly as sum of either agespecific or causespecific AD, unlike the standard modelbased procedure. For this reason, it is a promising approach to perform surveillance focusing on very specific causes of death or diseases, or on susceptible subpopulations. Finally, the propensity score matching is free from issues concerning the exposureconfoundersmortality modeling and does not involve extrapolation. On the one hand this enhances the internal validity of our results; on the other, it makes the approach scarcely appropriate for estimating future impacts.
Background
Since the year 2000, many epidemiological studies have quantified short term and long term impacts of air pollution on health in terms of the number of health events due to air pollutant exposures exceeding prefixed thresholds [1–5]. Short term impacts, i.e. the impacts observed within few days from the exposure, provide only a partial picture of the health damage attributable to air pollution, because they do not consider consequences of long term exposures, that are characterized by much stronger associations [6–8]. However, assessing short term impacts has the advantage of allowing an appraisal of the air pollution effect that is not affected by issues that are critical in long term evaluation, such as latency time definition and cumulative exposure assessment [9]. Also, short term impacts stress the beneficial effect of measures targeted to immediately improve air quality.
The standard approach to estimate the short term impact of air pollution relies on regression methods. Focusing on mortality, first, the curve describing the relationship between daily exposure and daily deaths is estimated through a Poisson regression model, adjusting for possible confounders; then, the estimated curve is combined with the observed mortality and air pollutant levels to calculate how many of the observed deaths are attributable to the exposures exceeding a fixed threshold.^{Footnote 1} Varying the threshold, different hypothetical scenarios of air pollution reduction are defined and the impact due to exceeding national or international air quality standards, or limits recommended by agencies for public health protection is quantified [10]. The shape of the exposureresponse function is usually assumed to be loglinear [11–14].
The opportunity to assess the short term impact of air pollution relies on the causal interpretation of the exposureresponse association. Up to now, this causal interpretation has been mainly supported by the fact that studies carried out in different countries and contexts provided consistent findings. Moreover, especially for airborne particulate matter, the evidence on the biological mechanisms tying exposure and health damage is consolidated, substantiating the plausibility of the observed associations [15]. Bellini et al. [16] read short term effect estimates in light of the Bradford Hill causation criteria [17], showing that they were largely fulfilled. However, also Hill made it explicit that decisions about causeeffect relations cannot be based on a set of rules [18]. The principal limitation of this reasoning is the lack of a formal and rigorous definition of causal effect and of the explicit definition of the assumptions needed for a causal interpretation of the epidemiological evidence [19–21].
The potential outcome approach to causal inference, commonly referred to as the Rubin’s Causal Model (RCM) [22, 23], encourages thinking in terms of causes and action’s consequences, within a formal mathematical framework. Despite its increasing popularity in many fields, including epidemiology and medical sciences, to the best of our knowledge it is relatively new in studies aimed at assessing the effects and the impact of air pollution on health. Wang et al. [24] addressed confounding adjustment in modelbased estimation of the exposureresponse relationship, arguing that their approach is related to causal inference although they do not take a causal inference perspective. They applied their method to daily time series data in order to estimate the shortterm effects of air pollution on emergency admissions for cardiovascular diseases in Nassau, NY. In a short commentary to their paper, Gutman and Rubin [25] suggested the use of RCM to estimate the causal effect of air pollution. However, they provided only a theoretical scheme for inference, without any example on real data. More recently, Zigler and Dominici [26] discussed the potential contribution of the potential outcome approach in the policy debate about air pollution regulatory interventions, and provided a classification to frame the studies in this field. In a second work, the same authors provided new analytic perspectives and statistical methods for drawing causal inferences on the longterm health effects of air quality regulations [27, 28]. They assessed causal effects of an actual intervention, which had the reduction of fine air born particles in the atmosphere and, thereby, improvement in health as outcomes; specifically, their aim was to disentangle causal effects of the intervention both through and not through the reduction of the air pollutant levels. An attempt to use the potential outcome approach to assess the short term effect of air pollution on mortality can be found also in Schwartz et al. [29]. They estimated the percent variation in mortality per increase in fine particles level, using two procedures which provided similar results. In the first procedure the estimate was obtained by stratifying days according to a score which summarized the distribution of the observed covariates (this score was different from the generalized propensity score used for continuous treatments [30]); the second procedure, which was applied in another recent paper as well [31], was based on an instrumental variable approach. Both these procedures are substantially different from the one we propose here.
In this paper, we reformulated the problem of assessing the short term impact of air pollution on health within the potential outcome approach to causal inference. We assessed the causal impact, expressed in terms of attributable deaths (AD), of high daily levels of particulate matter ≤ 10 μm in diameter (PM_{10}) on mortality in the metropolitan area of Milan (Italy), during the period 2003–2006. Specifically, we compared the number of deaths we observed in days with exposure levels higher than 40 μg/m^{3} with the number of deaths that we would have observed if in all those days exposure levels had been lower than 40 μg/m^{3}. Fixing the threshold to 40 μg/m^{3} assured that the resulting counterfactual time series largely respected the limit of 40 μg/m^{3} for PM_{10} annual average, which defines the legal obligation for European Union member states [32]. According to the classification proposed by Zigler and Dominici [26], the present work can be framed as a study aimed to evaluate the causal impact of a hypothetical intervention setting daily exposure levels under a prefixed threshold (assuming that the effect of this hypothetical intervention would occur only through the reduction of PM_{10} levels). This interpretation allows to relate causal effects to regulatory standards. It is worth to notice that assessing the impact of a hypothetical intervention setting daily exposure levels under 40 μg/m^{3} is different from assessing the impact (by using an exposureresponse function) setting the counterfactual exposure to a specific level, e.g. 40 μg/m^{3}, i.e. implicitly assuming an intervention, difficult to conceive, which is able to reduce daily exposure levels exactly to 40 μg/m^{3}.
An impact evaluation on the same city and period has been previously conducted following a standard procedure by Baccini et al. [10].
Methods
Data
We considered data for the city of Milan for the years 2003–2006. Milan (1,299,633 inhabitants in 2007) is the capital city of the Lombardy region, in northwestern Italy. It is located in the basin of the Po River, an area characterized by unfavorable geographical and climate conditions which induce frequent phenomena of thermal inversion. As a consequence, air pollution, mainly deriving from road transport, is trapped close to the ground and reaches very high daily concentrations.
The air quality monitoring network of the Regional Environmental Protection Agency provided daily measurements of PM_{10}, temperature, and relative humidity in the city. A unique daily time series of PM_{10} levels was obtained by averaging data over the available monitors [10]. According to large part of the literature, there exists an immediate effect of exposure on mortality which diminishes in few days [33, 34]. Therefore, in order to allow for comparison with previous results as well, we used the average of the currentday and previousday PM_{10} concentrations (lag 0–1) as exposure variable.
Death certificates were obtained from the Regional Mortality Register. We focused on deaths of the resident population occurring inside the city area. We considered daily mortality from all (except for external) causes (International Classification of Diseases, Ninth Revision, codes below 800), and mortality by cardiovascular diseases (ICD9: 390–459) and respiratory diseases (ICD9: 460–519), separately. Daily mortality counts were classified by age groups: 15–64 years, 65–74 years, ≥75 years.
Notation
Indicating with X _{ i } the lag 0–1 exposure in day i, i = 1, …, N, we defined the treatment indicator W _{ i }, equal to 1 if X _{ i } ≥ 40 μg/m^{3} (high exposure level) and zero otherwise (low exposure level). Then, according to the RCM, under the Stable Unit Treatment Value Assumption (SUTVA) [23], we associated to each day two potential outcomes: Y _{ i }(1), the number of deaths in i if exposure in i was ≥40 μg/m^{3}, and Y _{ i }(0), the number of deaths in i if exposure in i was < 40 μg/m^{3}. Obviously, we could only observe at most one of these potential outcomes for each day. Let Y _{ i } ^{obs} denote the observed count of deaths in i: Y _{ i } ^{obs} = Y _{ i }(0) if W _{ i } = 0, and Y _{ i } ^{obs} = Y _{ i }(1) if W _{ i } = 1. We refer to days with W _{ i } = 1 as “treated days” and to days with W _{ i } = 0 as “control days”.
Definition of attributable deaths
For each i, we defined the daylevel AD as the difference between the two potential outcomes:
Since we were interested in the total impact exposures ≥ 40 μg/m^{3} observed during the study period, we focused on treated days only and defined the total number of AD during the study period as the sum of the daylevel impacts in equation 1 for W _{ i } = 1:
Being Y _{ i }(0) always missing in equation 2, in order to estimate AD we applied a matching procedure to impute these missing potential outcomes: for each treated day i, we found one control day with similar background characteristics (matched control day), and we used the mortality level observed in this day to impute Y _{ i }(0). We based our matching procedure on the propensity score, clearly specifying the underlying assumptions.
Design phase: propensity score matching
Using a matching procedure requires the definition of a distance measure between units. Especially when the number of covariates is high, a convenient distance measure is based on the propensity score [35]. Let Z _{ i } be a vector of background variables for day i. We defined the propensity score as the daylevel probability of observing an exposure ≥ 40 μg/m^{3}, conditional on Z _{ i }:
According to Rosenbaum and Rubin [35], if there are no unobserved confounders (unconfoundedness condition) and if there is sufficient overlap in the distribution of the covariates between treated and control days (so that for each treated day we can find a control day with similar background characteristics), adjusting for (e.g. by matching on) the propensity score is sufficient to remove confounding. The two conditions mentioned above define the strong ignorability assumption.^{Footnote 2} A critical issue in the design phase of an observational study is us the choice of the background variables Z _{ i } conditionally on which strong ignorability is reasonable. We based this selection on a priori substantive knowledge of the phenomenon derived from the literature on short term effects of air pollution, which suggests that the air pollutionmortality relationship can be confounded by meteorological conditions, short and long term seasonality and other factors that could produce unusual peaks of mortality.
Propensity score estimation
The propensity score for each unit was estimated from a logistic model for W _{ i }, including terms for all the relevant background variables Z _{ i } :
where β was a vector of unknown coefficients and f a general function of covariates and coefficients. Then, indicating with \( \widehat{\boldsymbol{\upbeta}} \) the vector of the estimated coefficients, the estimated propensity score was obtained as:
Different specifications were possible for the model in equation 4 and some effort was needed to find an appropriate f. Being the propensity score a balancing score [35], the key criterion driving the specification of f consists in obtaining predicted values \( {\widehat{e}}_i \) conditionally on which the covariates distribution is the same in the treated and matched control groups.
We assessed the balancing property for each covariate, under different choices of f, by using suitable measures of differences of the covariates between treated and control days [36]: visual inspection of the distributions before and after matching, and comparison of pre and postmatching standardized mean differences^{Footnote 3}, when applicable. Regarding seasonality, we assessed the balance by comparing the distribution of the variable “day of year” between groups, accounting for its circular nature [37]. For this purpose, after converting days of year to angular measurements, we calculated, before and after matching, the nonparametric statistic proposed by Wheeler and Watson, which provides a measure of difference between two distributions in case of circular variable [38]. Taking into account that larger values of the statistic are indicative of larger discrepancies between the two distributions, we used them as descriptive measures of balance in “day of year” between treated and control/matched days. We did not check for the balance of the calendar year because the study period was limited to 4 years only. However, checking that earlier years are not matched with later ones and viceversa could be important in longer time series.
The propensity score model specification that led to the best balance in covariates distributions included seasonspecific indicators of day of the week and holiday, an indicator of days with influenza epidemics, a cubic regression spline with 5 of freedom per year on the calendar day to account for medium and long term seasonality, and a bivariate smooth term for temperature at lag 0–3 and humidity, defined by the tensor product of two marginal thin plate regression splines with basis dimensions 5 and 3, respectively [39]. We also included in the model an indicator for days with temperature exceeding 28 °C to capture the possible effect of extreme heat episodes, and an indicator for the JulyAugust period to account for the reduction in the number of city residents during summer holidays.
Nearest neighbor matching
For each treated day i, we selected as match the control day with estimated propensity score closest to i (nearest neighbor matching) [40]. We used matching with replacement, allowing for each control day to be used as a match more than once. Matching with replacement produces matches of higher quality than matching without replacement, reducing bias even at the cost of losing some precision [41].
Analysis phase: AD estimation
For each treated day i, we first imputed the missing potential outcome Y _{ i }(0) using the count of deaths observed in its matchedcontrol day Y _{ i } ^{C} . Then, we estimated the daylevel impact for each treated day as the difference:
Finally, we estimated AD:
The estimate of the variance of \( \widehat{AD} \) was derived from the sample variance reported in Abadie and Imbens [40] for the Sample Average effect of Treatment on the Treated estimator^{Footnote 4}.
All analyses were performed in R software (R Core Team; https://cran.rproject.org/).
Results
In Milan between 2003 and 2006 there were, on average, 31.2 natural deaths per day, 10.3 from cardiovascular causes and 2.5 from respiratory causes. The annual average level of exposure (PM_{10} at lag 0–1) was 52.5 μg/m^{3}; 812 days during the study period (55.7%) exceeded 40 μg/m^{3} and 593 days (40.7%) exceeded the daily limit of 50 μg/m^{3} which should not be exceeded more than 35 days per year according to the EU legislation [32]. The exposure levels were sometimes very high, with about 9% of days exceeding 100 μg/m^{3}.
Table 1 and Fig. 1 report the results of the balancing property check for the selected propensity score model. While the propensity score distributions in treated and control days were very different, the distribution in matched control days completely overlapped the distribution in treated days. Treated days were characterized by very different temperature and relative humidity with respect to control days. However, the distributions of the meteorological variables in the matched samples were similar, as confirmed by the standardized differences which were very small after matching. The percentage of heat episodes was similar among treated and control days both before and after matching. Days characterized by peaks of influenza were 12.8% in the treated group and only 0.9% in the control group. After matching, the standardized difference decreased by 34.7% but balancing remained unsatisfactory. This result deserves some consideration. In principle, influenza epidemics could be treated as an additional treatment rather than a covariate. In such a case, an assignment mechanism for a multivariate treatment should be specified, and a matching procedure based on a generalized propensity score approach for this multivariate treatment should be considered [30]. Being this extension beyond the scope of the paper, in order to investigate the role of influenza epidemics and check for the robustness of our results, we simply performed a sensitivity analysis by estimating the impact on the subset of days without influenza epidemics (see below).
In order to check balance for day of the week, we focused on the percentage of Saturdays and Sundays, which resulted very similar in treated and matched control days. In order to check seasonality balance, we focused on a warm season indicator, which was equal to 1 from May 1st to September 30th and 0 elsewhere, and on the variable day of year. Matching clearly reduced the percentage of summer days in favor of winter days (Fig. 2). Substantial balance after matching was found for the percentage of warm season days, with % bias reduction after matching equal to 93.8%. The Wheeler and Watson’s statistic, which was equal to 405.5 before matching, reduced by 96.1% after matching, indicating a substantial improvement of the balance in day of year.
Figure 3 shows the daily number of natural deaths during the study period, together with daily exposures and daylevel impacts by calendar day, among the elderly. Daylevel impacts appeared to be rather heterogeneous. Exposures ≥ 40 μg/m^{3} were observed mainly during winter, but we estimated relevant positive daylevel impacts also during summer, which could be indicative of a possible interaction between temperature and exposure. We could be surprised by the presence of negative estimates of the daylevel impacts (Fig. 3). This might lead to misleading conclusions if we do not consider that each \( {\widehat{AD}}_i \) depends on the imputed value of the missing potential outcome Y _{ i }(0). This imputation is naturally subject to variability, which may lead to negative estimated impacts, even for days where air pollution had indeed small or no impact. In this sense, negative \( {\widehat{AD}}_i \) are fully consistent with the existence of a harmful effect of the exposure.
Table 2 shows the estimated AD for each cause of death and age class, along with their 90% confidence intervals. These results should be interpreted as the number of deaths that would have been avoided on average, if had the daily level of exposure never exceeded 40 μg/m^{3} during the study period. The impact was concentrated among individuals over 75. Exposures ≥ 40 μg/m^{3} were responsible, among the elderly, for 1102 deaths (90% CI: 388, 1816), of which 797 from cardiovascular causes (90% CI: 305, 1288) and 243 from respiratory causes (90% CI: −22, 508).
Clear evidence of an impact of air pollution on respiratory mortality was found also in the age class 65–74, with 87 AD (90% CI: 11, 163). For the first age class (15–64) the confidence intervals were extremely wide, so that clear conclusions could not be drawn. It is worth noticing that the estimate of the total number of AD (1079) corresponded to the sum of the age and causespecific impacts; the confidence interval around this value was large, yet clearly far from zero (90% CI: 116, 2042).
The estimated AD from other causes were lower than the AD from cardiovascular and respiratory diseases (with the exception of the first age class), and the associated confidence intervals always included zero (the null hypothesis of no impact). This analysis on other causes of death, which can be interpreted as a proxy of a negative control analysis [42], showed that the estimated impacts would be negligible if deaths from cardiovascular and respiratory diseases were excluded.
Excluding control days never selected as matched controls (430), 46% of the remaining control days were selected once, 84% less than 5 times, 95% less than 15 times. Few days were selected a very large number of times (Fig. 4). The main consequence of using the same control day as a match for many times is an increase of the estimated variance, although with a benefit in terms of bias [41]. In order to get some insight on the influence of the control days used more than once as matches on the impact estimates, we investigated mortality and air pollution levels among those days, without finding any influential point. The control day that was used as a match for more than 60 treated days was characterized by a large number of deaths, thereby leading to a possible conservative lower impact.
Table 3 shows the results of the sensitivity analysis performed excluding the days of influenza epidemics from AD calculation. While AD for respiratory causes were substantially unchanged, the estimated impact on cardiovascular mortality among the elderly was lower, although still relevant (469 AD, 90% CI: 88, 850). We can conclude that our results were robust to possible bias derived from the confounding effect due to influenza epidemics.
Discussion
Our analysis confirmed that having restrained PM_{10} levels under the EU limits could have avoided a relevant number of deaths in Milan during the study period, with an estimated impact even larger than the one reported in Baccini et al. [10], which was obtained following the standard approach based on Poisson regression, assuming a linear effect of air pollution on a logarithmic scale. ^{1} While we estimated a total of 1079 AD, Baccini et al. [10] found that exceeding the limits of 40 and 20 μg/m^{3} for PM_{10} annual average was responsible for 358 and 925 deaths from natural causes (89.5 and 231.3 per year), respectively. However, for a fair comparison we need to consider not only that the estimation methods were different, but also that the counterfactual scenarios were defined in a different way. While in the present analysis the counterfactual scenario consisted in daily levels of exposure lower than 40 μg/m^{3}, with a resulting counterfactual annual PM_{10} average lower than 40 μg/m^{3} (31.6 μg/m^{3}), the counterfactual scenario in Baccini et al. [10] was defined by fixing the counterfactual annual average exactly to 40/20 μg/m^{3}.
Our approach relies on crucial assumptions. SUTVA requires that there are not hidden versions of the treatment and that the potential outcomes on one unit are unaffected by the specific treatment assigned to the other units (nointerference among units) [23]. In our context, this second condition could be critical, because the exposure in a day could affect mortality not only in the current day, but also in subsequent days. Focusing on the lag 0–1 exposure instead of on the current PM_{10} level makes the nointerference assumption more plausible. Obviously, enlarging the window of the moving average X _{ i } would empower the nointerference assumption, but at the price of a lower variability of the exposures and of a reduced possibility of detecting an impact, if any. The other relevant assumption is the unconfoundedness assumption [35]. Being this condition not directly testable from the data, we grounded its plausibility on subjectmatter knowledge derived from the literature. Note that we did not include individual level confounders in our analysis; as argued in Schwartz et al. [29], they are not relevant in this context, because we can reasonably assume their distribution to be rather stable on a daytoday basis. We also implicitly assumed that there was no measurement error in PM_{10} levels. For causal inference with propensity score in the presence of treatment misclassification see, for example, Babanezhad et al. [43].
The idea of using matching is not new in the analysis of the short term effects of air pollution on health. The most popular example of matching in this field is the casecrossover approach, proposed as an alternative to Poisson regression with the aim of adjusting for the confounding effect of seasonality by design [44]. However, it is worth noting that the rationale of the propensity score matching is different from the rationale of the casecrossover approach. In the present analysis, we matched on the exposure variable by choosing for each high exposure day, the low exposure day exhibiting the closest propensity score. On the contrary, the casecrossover approach matches on the outcome: an individual who died in a certain day is matched with her/himself in one or more days when she/he did not die. Moreover, despite the use of matching, the casecrossover approach is more similar to a standard analysis based on Poisson regression, thus sharing its drawbacks and advantages [45], than to the approach proposed in this paper.
The approach we proposed has several advantages over the standard approach based on regression. The first one stems from the fact that it clearly distinguishes between the design phase and the analysis phase. The design phase (from propensity score estimation to matching) does not involve outcome data, but only background information. As a consequence, the subsample of units arising from the design phase (treated units and corresponding matched controls) can be used in the analysis phase to estimate the causal effects of the treatment on one or more outcomes (e.g. causespecific and agespecific mortalities in our investigation). This also implies that results on different outcomes are fully consistent. For instance, the estimated total number of AD can be derived directly as sum of either ageor causespecific AD. This consistency is not guaranteed within the standard modelbased approach, as impact estimation by age and cause of death is usually obtained by fitting separate regression models for each outcome. For these characteristics, the proposed approach is promising to detect susceptible subpopulations and perform surveillance focusing on very specific causes of death or diseases.
A second advantage regards results interpretation. Our approach imposes to explicitly define the assumptions needed for drawing inference on the causal quantities of interest. On the contrary, results from regression rely on strong assumptions that are often not explicitly stated, thus making causal interpretation of the results controversial. Moreover, by clearly specifying the critical assumptions, we can assess the consequences of their violation; for instance, we could apply methods to evaluate robustness of the results to possible violation of unconfoundedness (see Chapter 21 and 22 in [23] for a comprehensive review).
A third advantage is that our approach is free from issues concerning the exposureconfoundersmortality modeling and does not involve extrapolation. Standard approaches based on regression models, where adjustment for confounders is achieved by including them in the regression function, can heavily rely on extrapolation if covariate distributions are substantially apart, i.e. if there are regions of the covariate space with relatively few treated or relatively few control units. This limited overlap between treated and control units can bring to poor model fit and inappropriate extrapolations. By using the approach proposed here, these problems can be detected and addressed more easily. Indeed, propensity score methods involve a careful description and implementation of the study design phase, which includes the construction of a group of matched controls with covariate distributions similar to those of the treated units. Although this may sacrifice some external validity, implying that inferences (for example attributable fractions) are less likely to be valid for populations with characteristics that are different from those observed in the sample, it awards a strong internal validity to impact estimates.
In order to correctly interpret the results of our analysis, some other points deserve discussion. The research question we focused on is different from the one of the studies which draw inference on the association (possibly interpreted as causal) between different “doses of exposure” and mortality/morbidity levels, with the aim to estimate a continuous exposureresponse curve. In this paper, we considered the treatment as binary after having defined an arbitrary, although substantive, threshold, as our aim was to estimate the causal impact attributable to air pollutant levels higher than the threshold versus hypothetical levels lower than the threshold, without imposing any specific restriction on the exposureresponse relationship.
It is worth to notice that, due to the absence of restrictions on the exposureresponse function, our approach, based on propensity score matching, is substantially different from estimating impacts from a regression model where the exposure effect is modelled by a dummy variable, i.e. assuming a piecewise constant exposureresponse relationship having a jump at the threshold. Also, unlike standard procedures for health impact assessment^{1}, the method proposed in this paper does not rely on the loglinearity of the exposureresponse relationship. This is an advantage, as the linearity assumption could bring to under or overestimated impacts, even in case of mild nonlinearity [11].
Our analysis did not provide an explicit estimate of the exposureresponse curve. However, investigating the shape of this relationship may be of interest. In particular, evaluating a continuous exposureresponse relationship and investigating the existence of a “safe threshold” under which the air pollutant would not affect health, could have important regulatory implications. Several studies in the epidemiological literature have investigated the shape of the exposureresponse curve in this field, indicating that the linear assumption usually provides a good approximation of the relation within the ranges of exposure observed in urban areas [11–14]. However, all these studies are based on regression approaches; thus, exploring the exposureresponse relationship through appropriate causal methods for continuous treatment, as those based on the generalized propensity score [30, 46], could be useful for comparison purposes and could provide estimates of the curve avoiding pitfalls due to inappropriate extrapolation.
Finally, our approach allowed us to consider counterfactual scenarios defined on daily exposures, but not in terms of annual average concentration, although these could be of interest from a legal and regulatory standpoint.
Conclusions
In this paper we focused on the causal impact that a hypothetical intervention setting PM_{10} levels under a prefixed threshold would have had on mortality in Milan during the time frame 2003–2004. The method we used allowed to explicitly infer the causal impact of this hypothetical intervention, thus changing to some extent the scientific question underlying the estimation of an exposureresponse function. It provided estimated impacts in terms of attributable deaths through a direct comparison of daily potential outcomes, relying on propensity score matching.
The proposed approach has various advantages over the standard regression methods. In particular, due to the clear distinction between the design phase and the estimation phase of the analysis, this approach assures consistency of the results between overall and subgroups analyses. It thus seems promising when the aim is performing surveillance focusing on very specific causes of death or diseases, or on susceptible subpopulations. Moreover, as the propensity score matching is free from issues concerning exposureconfoundersmortality modeling and does not imply extrapolation, the proposed method enhances robustness and internal validity of the results. For the same reason, although appealing for the assessment of historical impacts, it is not appropriate to estimate future impacts. Nevertheless, it should be considered as a tool to evaluate internal validity of the regressionbased results, before any use of the estimated associations for projections purposes.
Notes
 1.
According to the standard procedure, under the assumption of a linear effect of the air pollutant on a logarithmic scale, the number of attributable deaths (AD) can be calculated according to the following formula [10]:
$$ A D= y{y}_0= y\left(11/ exp\left( b\left( x T\right) I\left( x> T\right)\right)\right), $$where \( y \) is the observed number of deaths, \( x \) is the observed level of the air pollutant, \( b \) is the estimated coefficient expressing the air pollutant effect, \( T \) is the fixed threshold and \( I\left( x> T\right) \) is an indicator function which is equal to 1 if \( x> T \) and 0 elsewhere. The calculation can be performed at the daily level or at the annual level. In the first case, \( x \) and \( y \) are daily values and \( T \) is a fixed daily threshold; in the second case, \( x \) is the annual average level of the air pollutant, \( y \) is the annual number of deaths and \( T \) is a fixed threshold defined on \( x \).
 2.
Let Z _{ i } denote the vector of the observed covariates for day i. The treatment assignment mechanism is strongly ignorable if the following conditions hold [35]:
(i) Unconfoundedness: Treatment assignment is independent of the potential outcomes conditional on the observed covariates: W _{ i } ⊥ (Y _{ i }(0), Y _{ i }(1))Z _{ i };
(ii) Overlap: 0 < P(W _{ i } = 1Z _{ i } = z) < 1 for each i.
Because we are only interested in the impact for treated days, we can weaken the strong ignorability assumption as follows:
(i) Unconfoundedness for controls: Treatment assignment is independent of the potential outcome under control conditional on the observed covariates: W _{ i } ⊥ Y _{ i }(0)Z _{ i };
(ii) Weak overlap: P(W _{ i } = 1Z _{ i } = z) < 1 for each i.
Unconfoundedness requires that there are no unobserved confounders, so that conditioning on the observed covariates assures that an experimentallike context is reproduced. The overlap assumption requires that there is sufficient overlap in the joint distribution of the covariates between treated and control days. This second assumption is needed because, if all days with given background characteristics had exposure higher than the threshold (P(W _{ i } = 1Z _{ i } = z) = 1 for some z), then there would be no similar control days against which to compare them.
 3.
Preand postmatching standardized mean differences are defined as follows:
$$ {\delta}^{pre}=\frac{{\overline{x}}_{treated}{\overline{x}}_{control}}{\sqrt{\frac{s_{treated}^2+{s}_{control}^2}{2}}}\kern0.5em \mathrm{and}\kern0.5em {\delta}^{post}=\frac{{\overline{x}}_{treated}{\overline{x}}_{matched}}{\sqrt{\frac{s_{treated}^2+{s}_{control}^2}{2}}} $$where \( {\overline{x}}_{treated} \), \( {\overline{x}}_{control} \) and \( {\overline{x}}_{matched} \) are the sample averages of the covariate for treated units, controls and matched controls, and s _{ treated } and s _{ control } are the withingroup sample standard deviations for treated and control units.
 4.
The estimate of the variance of \( \widehat{AD} \) was derived from the sample variance proposed by Abadie and Imbens [40, 41] for the estimate of the Sample Average effect of Treatment on the Treated (SATT) estimator:
$$ {s}_{AD}^2={\displaystyle \sum_{i=1}^N{\left({W}_i\left(1{W}_i\right){K}_M(i)\right)}^2{\sigma}_{W_i}^2\left({\mathbf{Z}}_{\mathbf{i}}\right)}, $$where K _{ M }(i) is the number of times the unit i is used as a match, and \( {\sigma}_{W_i}^2\left({\mathbf{Z}}_i\right) \)is the conditional variance of the outcome. The conditional variance can be estimated accounting for possible heterogeneity according to the following equation:
$$ {\sigma}_{W_i}^2\left({\mathbf{Z}}_i\right)=\frac{1}{\#{\mathrm{H}}_M(i)}{{\displaystyle {\sum}_{j\in \left\{{H}_M(i){\displaystyle \cup ( i)}\right\}}\left({Y}_j{\overline{Y}}_{H_M(i){\displaystyle \cup ( i)}}\right)}}^2, $$where H _{ M }(i) is the set of indexes for the first M matches for unit i, # H _{ M }(i) is the number of elements of H _{ M }(i) and \( {\overline{Y}}_{H_M(i){\displaystyle \cup (i)}} \)is the mean of the outcome in the set including the unit i and its matches. It is worth noting that the variance estimator \( {s}_{AD}^2 \)does not account for the fact that the propensity score is estimated. The previous two equations are valid for each M ≥ 1; in our analysis we set M = 1.
Abbreviations
 AD:

Attributable deaths
 CI:

Confidence interval
 PM10:

Particulate matter ≤10 μm in diameter
 RCM:

Rubin’s Causal Model
 SUTVA:

Stable Unit Treatment Value Assumption
References
 1.
Künzli N, Kaiser R, Medina S, Studnicka M, Chanel O, Filliger P, et al. Publichealth impact of outdoor and trafficrelated air pollution: a European assessment. Lancet. 2000;356(9232):795–801.
 2.
Martuzzi M, Mitis F, Iavarone I, Serinelli M. Health Impact of PM10 and Ozone in 13 Italian Cities. Copenhagen: World Health Organization Regional Office for Europe; 2006. http://www.euro.who.int/__data/assets/pdf_file/0012/91110/E88700.pdf. Accessed 4 Feb 2016.
 3.
Ballester F, Medina S, Boldo E, Goodman P, Neuberger M, Iñiguez C, et al. Reducing ambient levels of fine particulates could substantially improve health: a mortality impact assessment for 26 European cities. J Epidemiol Community Health. 2008;62(2):98–105.
 4.
Heal MR, Heaviside C, Doherty RM, Vieno M, Stevenson DS, Vardoulakis S. Health burdens of surface ozone in the UK for a range of future scenarios. Environ Int. 2013;61:36–44.
 5.
Baccini M, Grisotto L, Catelan D, Consonni D, Bertazzi PA, Biggeri A. Commutingadjusted shortterm health impact assessment of airborne fine particles with uncertainty quantification via Monte Carlo simulation. Environ Health Perspect. 2015;123(1):27–33.
 6.
Brunekreef B, Beelen R, Hoek G, Schouten L, BauschGoldbohm S, Fischer P, et al. Effects of longterm exposure to trafficrelated air pollution on respiratory and cardiovascular mortality in the Netherlands: the NLCSAIR study. Res Rep Health Eff Inst. 2009;139:5–71.
 7.
Hoek G, Krishnan RM, Beelen R, Peters A, Ostro B, Brunekreef B, et al. Longterm air pollution exposure and cardio respiratory mortality: a review. Environ Health. 2013;12(1):43. doi:10.1186/1476069X1243.
 8.
Beelen R, RaaschouNielsen O, Stafoggia M, Andersen ZJ, Weinmayr G, Hoffmann B, et al. Effects of longterm exposure to air pollution on naturalcause mortality: an analysis of 22 European cohorts within the multicentre ESCAPE project. Lancet. 2014;383(9919):785–95.
 9.
Flachs EM, Sørensen J, Bønløkke J, BrønnumHansen H. Population dynamics and air pollution: the impact of demographics on health impact assessment of air pollution. J Environ Public Health. 2013;2013:760259. doi:10.1155/2013/760259.
 10.
Baccini M, Biggeri A, Grillo P, Consonni D, Bertazzi PA. Health impact assessment of fine particle pollution at the regional level. Am J Epidemiol. 2011;174(12):1396–405.
 11.
Daniels MJ, Dominici F, Zeger SL, Samet JM. The national morbidity, mortality, and air pollution study. Part III: PM10 concentrationresponse curves and thresholds for the 20 largest US cities. Res Rep Health Eff Inst. 2004;94 Pt 3:1–21. discussion 23–30.
 12.
Schwartz J, Zanobetti A. Using metasmoothing to estimate dose–response trends across multiple studies, with application to air pollution and daily death. Epidemiology. 2000;11(6):666–72.
 13.
Samoli E, Analitis A, Touloumi G, Schwartz J, Anderson HR, Sunyer J, et al. Estimating the exposureresponse relationships between particulate matter and mortality within the APHEA multicity project. Environ Health Perspect. 2005;113(1):88–95.
 14.
Stafoggia M, Samoli E, Alessandrini E, Cadum E, Ostro B, Berti G, et al. Shortterm associations between fine and coarse particulate matter and hospitalizations in Southern Europe: results from the MEDPARTICLES project. Environ Health Perspect. 2013;121(9):1026–33.
 15.
Anderson JO, Thundiyil JG, Stolbach A. Clearing the air: a review of the effects of particulate matter air pollution on human health. J Med Toxicol. 2012;8(2):166–75.
 16.
Bellini P, Baccini M, Biggeri A, Terracini B. The metaanalysis of the Italian studies on shortterm effects of air pollution (MISA): old and new issues on the interpretation of the statistical evidences. Environmetrics. 2007;18(3):219–29.
 17.
Hill AB. The environment and disease: association or causation? Proc R Soc Med. 1965;58:295–300.
 18.
Phillips CV, Goodman KJ. The missed lessons of Sir Austin Bradford Hill. Epidemiol Perspect Innov. 2004;1(1):3.
 19.
Greenland S. Epidemiologic measures and policy formulation: lessons from potential outcomes. Emerg Themes Epidemiol. 2005;2:5.
 20.
Höfler M. Causal inference based on counterfactuals. BMC Med Res Methodol. 2005;5:28. doi:10.1186/14712288528.
 21.
Glass TA, Goodman SN, Hernán MA, Samet JM. Causal inference in public health. Annu Rev Public Health. 2013;34:61–75.
 22.
Holland PW. Statistics and causal inference (with discussion). J Am Stat Assoc. 1986;81(396):945–70.
 23.
Imbens GW, Rubin DB. Causal inference: for statistics, social, and biomedical sciences: an introduction. 1st ed. New York: Cambridge University Press; 2015.
 24.
Wang C, Parmigiani G, Dominici F. Bayesian effect estimation accounting for adjustment uncertainty. Biometrics. 2012;68(3):661–71.
 25.
Gutman R, Rubin DB. Analyses that inform policy decisions. Biometrics. 2012;68(3):671–5. discussion 680–686.
 26.
Zigler CM, Dominici F. Point: clarifying policy evidence with potentialoutcomes thinking beyond exposureresponse estimation in air pollution epidemiology. Am J Epidemiol. 2014;180(12):1133–40.
 27.
Zigler CM, Dominici F, Wang Y. Estimating causal effects of air quality regulations using principal stratification for spatially correlated multivariate intermediate outcomes. Biostatistics. 2012;13(2):289–302.
 28.
Zigler CM, Choirat C, Hansen JB, Wang Y, Hund L, et al. Causal inference methods for estimating longterm health effects of air quality regulations. Res Rep Health Eff Inst. 2016;187:5–49.
 29.
Schwartz J, Austin E, Bind MA, Zanobetti A, Koutrakis P. Estimating causal associations of fine particles with daily deaths in Boston. Am J Epidemiol. 2015;182(7):644–50.
 30.
Imai K, van Dyk DA. Causal inference with general treatment regimens: generalizing the propensity score. J Am Stat Assoc. 2004;99(467):854–66.
 31.
Schwartz J, Bind MA, Koutrakis P. Estimating causal effects of local Air pollution on daily deaths: effect of low levels. Environ Health Perspect. 2017;125(1):23–9.
 32.
EU (European Union). Directive 2008/50/EC of the European Parliament and of the Council of 21 May 2008 on Ambient Air Quality and Cleaner Air for Europe. Off J Eur Union. 2008;51(6):L152/1–L152/44. http://eurlex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2008:152:0001:0044:EN:PDF. Accessed 4 Feb 2016.
 33.
Anderson HR, Atkinson RW, Peacock JL, Marston L, Konstantinou K. Metaanalysis of time series studies and panel studies of Particulate Matter (PM) and Ozone (O3). Report of a WHO task group. Copenhagen: World Health Organization Regional Office for Europe; 2004.
 34.
Health Effects Institute. Revised analyses of time series studies of air pollution and health. Special report. Boston: Health Effects Institute; 2003.
 35.
Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70(1):41–55.
 36.
Becker SO, Ichino A. Estimation of average treatment effects based on propensity scores. Stata J. 2002;4:358–77.
 37.
Fisher NI. Statistical analysis of circular data. 1st ed. Cambridge: Cambridge University Press; 1995.
 38.
Wheeler S, Watson GS. A distributionfree twosample test on a circle. Biometrika. 1964;51:256–7.
 39.
Wood SN. Generalized additive models: an introduction with R. 1st ed. Boca Raton: Chapman and Hall/CRC; 2006.
 40.
Abadie A, Imbens GW. Biascorrected matching estimators for average treatment effects. J Bus Econ Stat. 2011;29(1):1–11.
 41.
Abadie A, Imbens GW. Large sample properties of matching estimators for average treatment effects. Econometrica. 2006;74(1):235–67.
 42.
Lipsitch M, Tchetgen E, Cohen T. Negative controls: a tool for detecting confounding and bias in observational studies. Epidemiology. 2010;21(3):383–8.
 43.
Babanezhad M, Vansteelandt S, Goetghebeur E. Comparison of causal effect estimators under exposure misclassification. J Stat Planning Inference. 2010;140(5):1306–19.
 44.
Levy D, Sheppard L, Checkoway H, Kaufman J, Lumley T, Koenig J, et al. A case–crossover analysis of particulate matter air pollution and outofhospital primary cardiac arrest. Epidemiology. 2001;12(2):193–9.
 45.
Lu Y, Zeger SL. On the equivalence of casecrossover and time series methods in environmental epidemiology. Biostatistics. 2007;8(2):337–44.
 46.
Hirano K, Imbens GW. The propensity score with continuous treatments. In: Gelman A, Meng XL, editors. Applied Bayesian modeling and causal inference from incompletedata perspectives. West Sussex: Wiley InterScience; 2004. p. 73–84.
Acknowledgements
The authors thank Dr. Agnese Panzera for her advice on statistical tests for circular data.
Funding
This study was partially supported by local research funds (ex60% funding program, University of Florence) and by Futuro in Ricerca 2012 research project RBFR12SHVV_003 (funded by the Italian Ministero dell’Istruzione, Università e Ricerca).
Availability of data and materials
The datasets analysed during the current study are available from the corresponding author on reasonable request.
Authors’ contributions
MB and FM conceived the original idea behind this study; MB and AM performed the statistical analysis; MB, AM and FM wrote and thoroughly discussed the first draft of the paper; MC and PAB acquired data, controlled their quality and contributed in discussing the epidemiological results; all authors read, revised and approved the final version of the paper.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Author information
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Baccini, M., Mattei, A., Mealli, F. et al. Assessing the short term impact of air pollution on mortality: a matching approach. Environ Health 16, 7 (2017) doi:10.1186/s1294001702157
Received
Accepted
Published
DOI
Keywords
 Air pollution
 Attributable deaths
 Causal inference
 Health impact assessment
 Mortality
 Potential outcomes
 Propensity score
 Matching
 Short term effect
 Unconfoundedness
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.