Countries are increasingly implementing strategies to reduce antibiotic prescribing in an attempt to decrease antibiotic resistance. It should be possible to achieve relatively large reductions in antibiotic prescribing by focusing on prescribing events for acute and uncomplicated presentations for respiratory tract infections (Smieszek et al., 2018; Pouwels et al., 2018a). However, reducing antibiotic prescriptions in more complex cases, such as in patients receiving repeat prescriptions for chronic recurrent infections, may be more difficult. It is important to know whether focussing on unnecessary prescriptions for infectious syndromes where there is little chance of benefit from antibiotic treatment is sufficient to halt or lower antibiotic resistance levels. Olesen et al. recently reported that repeat (intensive) use had a weaker association with resistance than first (extensive) use, suggesting that it may indeed be sufficient to focus on the latter (Olesen et al., 2018).

Their analysis uses cross-sectional state-level data, which makes it difficult to draw conclusions. Causal inference based on such data is difficult because it requires several, often implausible, assumptions (Reichenheim and Coutinho, 2010). A fundamental requirement is that reverse causality should not play a role, i.e. antibiotic resistance should not influence antibiotic prescribing. This assumption is highly unlikely to hold. If there is a high prevalence of resistance against a specific antibiotic, or even perceived high prevalence, doctors are likely to prescribe that antibiotic only to patients that are at low risk of having a resistant infection, e.g. patients who have not been recently exposed to that antibiotic (first-time users). Under these circumstances, doctors are likely to avoid that particular antibiotic in patients who have a high risk of having a resistant infection, e.g. patients recently exposed to that antibiotic (repeat users). In case resistance against a commonly prescribed antibiotic is low, the pre-test probability of resistance will likely be low among all patients including those recently exposed to that antibiotic, making substitution less relevant. Of note, various other factors that correlate with antibiotic resistance, such as comorbidity and age, also influence antibiotic prescribing decisions.

Thus, reverse causality may influence repeat use more than first use, potentially contributing to the observed associations. While the choice of which antibiotic is needed is likely influenced by antibiotic resistance levels, the choice of whether or not to prescribe an antibiotic is to a much smaller extent influenced by antibiotic resistance. Therefore, an analysis focusing on overall antibiotic use is likely less susceptible to reverse causality. We therefore decided to evaluate whether repeat use had a stronger association with resistance when using any antibiotic use instead of one specific antibiotic to create the first-time and repeat use predictors. Here we report the results showing that repeat use has a stronger association with antibiotic resistance than first use when focusing on overall use. We also discuss why both the previous and our analysis should not be interpreted as being causal.

When using the data Olesen et al. (2018) used in their main analysis, but focusing on use of any antibiotic, instead of use of particular antibiotics (see Methods): intensive use is more often positively associated with high resistance than extensive use (Figure 1).

Figure 1

Download asset Open asset

By focusing solely on the point estimates one would conclude, if one would assume the associations from Figure 1 are causal, that overall repeat use is more often positively associated with resistance than first use. However, focusing on point estimates only, as Olesen et al. (2018) seem to have done, does not necessarily adequately take into account the relatively large variance. Multicollinearity is known to frequently cause implausible effect estimates and wrong signs of the coefficients. We agree that unbiased estimates can still be obtained despite the presence of multicollinearity: however, this does not mean that the point estimate of a specific study should be expected to be close to the 'true' value (Farrar and Glauber, 1967). Deviations from the true value are especially expected when using relatively small datasets, such as those used by Olesen et al. (2018). To evaluate whether reliance on point estimates alone is nevertheless reasonable we evaluated whether similar conclusions would be reached when performing 10,000 bootstrap replications. Supplementary file 1 shows that similar results were obtained when bootstrapping, with only five occasions where the mean of the bootstrap samples had a different sign.

Our results show that when evaluating the association between overall use of antibiotics and antibiotic resistances that repeat use has a stronger association with antibiotic resistance than first use. These results are in the opposite direction of the results of Olesen et al. (2018).

To better understand why these contrasting results may be obtained it is important to consider the relative contributions of forward and reverse causation. Use of one antibiotic may select for or even against resistance to another antibiotic via various mechanisms, such as co-selection, collateral resistance, collateral sensitivity, or by simply killing competing bacteria (Pouwels et al., 2018b; Imamovic and Sommer, 2013; Baym et al., 2016; Kahlmeter and Menday, 2003). Therefore, only considering use of one antibiotic may not be sufficient to obtain the effect of that antibiotic on resistance against that same antibiotic, even in the absence of other biases (Pouwels et al., 2018b). Moreover, resistance against sulphonamides remained high despite drastic reductions in sulphonamide prescribing, largely driven by co-selection via use of other antibiotics (Enne et al., 2001). While 'overall antibiotic use' does partly account for selection of resistance via other antibiotics, it likely includes antibiotics that do not select for antibiotic resistance, thereby potentially attenuating forward causation compared to an analysis with an exposure measure that only includes antibiotics that do select for antibiotic resistance. However, as explained above, overall antibiotic use may be less susceptible to reverse causality because antibiotic resistance has likely a stronger influence on which antibiotic to prescribe than on the decision to prescribe an antibiotic or not. It could be argued that with higher levels of resistance, more unique drugs will be required to cure an infection, making overall use susceptible to reverse causality, however treatment failures due to antibiotic resistance are likely underlying only a small proportion of treatment switches among repeat users in the outpatient setting (Coenen and Goossens, 2014).

Whether the results can be interpreted as the causal effects of first and repeat use of antibiotics on antibiotic resistance levels depends on several assumptions. We want to stress that both our as well as the previous analyses of Olesen et al. (2018) are likely affected by several other biases. Sicker patients require more antibiotics and are likely also be more prone to acquire resistant pathogens independent of antibiotic use in the community. Indeed, a substantial number of studies suggest that comorbidities are associated with increased antibiotic resistance levels, even after accounting for antibiotic use (Chatterjee et al., 2018). Furthermore, while on average a large proportion of antibiotics are being used in an outpatient setting, specific antibiotics may be much more frequently used in the inpatient setting, for which no data is included. For example, in the UK > 40% of cephalosporin prescriptions are among hospital in-patients (ESPAUR writing committee, 2018), questioning the validity of some of the analyses if similar patterns of use were to be observed in the US.

A potentially more fundamental problem is that the distribution of different specimen types across States is unclear. The prevalence of resistance likely differs between different types of specimens. For example, in England approximately 18% of Escherichia coli blood samples were resistant to ciprofloxacin, while approximately 11% of urinary E. coli samples were resistant to ciprofloxacin in England in 2015 (https://fingertips.phe.org.uk/). Analyses are likely further complicated by variation in the likelihood of sending specific specimens for susceptibility testing. It has previously been found that a substantial part of the variation in (apparent) antibiotic resistance prevalence against trimethoprim among Klebsiella Pneumoniae and Proteus mirabilis can be explained by variation of the number of urinary samples tested per population (Pouwels et al., 2018b). If patterns of antibiotic use correlate with the likelihood of taking samples, for example because doctors are more likely to send a sample for testing among patients that were already exposed to antibiotics multiple times, associations will suffer from substantial bias.

Given the facts that i) treatment failures and repeat use of antibiotics increase the chances that a clinician will send a sample for susceptibility testing; and ii) there is more repeat than first use of antibiotics (Olesen et al., 2018; Shallcross et al., 2017; Dolk et al., 2018), the majority of specimens are expected to be taken from patients exposed to repeat antibiotics and at higher risk of antibiotic resistance. It remains a question whether variation in resistance among specimens taken from such patients would be more driven by their own intensive use or extensive use of antibiotics by other patients.

In conclusion, given the limitations discussed and the observation that repeat use has a stronger association with resistance than first use when focusing on overall antibiotic use, the conclusion that first-use has a bigger impact on resistance than repeat use of antibiotics is not justified (yet).

We used the antibiotic use data and antibiotic resistance data that accompanied the by Olesen et al. Details about the data sources are described in Olesen et al. (2018). We replicated their main analysis with the exception that we focused on overall use of antibiotics instead of specific antibiotic use – antibiotic resistance pairs. For example, instead of evaluating the association between use of first and repeat use of quinolone and quinolone resistance among E. coli, we analysed the association between use of first and repeat use of any antibiotic and quinolone resistance among E. coli. Multiple linear regressions were performed for the different bug-drug combinations. We compared these results with results obtained when performing 10,000 bootstrap samples for each bug–drug combination. States were sampled with replacement and a linear regression was performed on each sample.

The data used for this work can be accessed via the paper of Olesen et al (2018): https://elifesciences.org/articles/39435.

1. 1. Baym M
   2. Stone LK
   3. Kishony R

   (2016) Multidrug evolutionary strategies to reverse antibiotic resistance

   Science 351:aad3293.

   https://doi.org/10.1126/science.aad3292

   • Google Scholar
2. 1. Chatterjee A
   2. Modarai M
   3. Naylor NR
   4. Boyd SE
   5. Atun R
   6. Barlow J
   7. Holmes AH
   8. Johnson A
   9. Robotham JV

   (2018) Quantifying drivers of antibiotic resistance in humans: a systematic review

   The Lancet Infectious Diseases 18:e368–e378.

   https://doi.org/10.1016/S1473-3099(18)30296-2

   • PubMed
   • Google Scholar
3. 1. Coenen S
   2. Goossens H

   (2014) Antibiotic treatment failure in primary care

   Bmj 349:g5970.

   https://doi.org/10.1136/bmj.g5970

   • PubMed
   • Google Scholar
4. 1. Dolk FCK
   2. Pouwels KB
   3. Smith DRM
   4. Robotham JV
   5. Smieszek T

   (2018) Antibiotics in primary care in England: which antibiotics are prescribed and for which conditions?

   Journal of Antimicrobial Chemotherapy 73:ii2–ii10.

   https://doi.org/10.1093/jac/dkx504

   • Google Scholar
5. 1. Enne VI
   2. Livermore DM
   3. Stephens P
   4. Hall LMC

   (2001) Persistence of sulphonamide resistance in Escherichia coli in the UK despite national prescribing restriction

   The Lancet 357:1325–1328.

   https://doi.org/10.1016/S0140-6736(00)04519-0

   • Google Scholar
6. Report

   1. ESPAUR writing committee

   (2018) English Surveillance Programme for Antimicrobial Utilisation and Resistance (ESPAUR) Report

   Public Health England.

   https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/759975/ESPAUR_2018_report.pdf

   • Google Scholar
7. 1. Farrar DE
   2. Glauber RR

   (1967) Multicollinearity in regression analysis: the problem revisited

   The Review of Economics and Statistics 49:92–107.

   https://doi.org/10.2307/1937887

   • Google Scholar
8. 1. Imamovic L
   2. Sommer MO

   (2013) Use of collateral sensitivity networks to design drug cycling protocols that avoid resistance development

   Science Translational Medicine 5:204ra132.

   https://doi.org/10.1126/scitranslmed.3006609

   • PubMed
   • Google Scholar
9. 1. Kahlmeter G
   2. Menday P

   (2003) Cross-resistance and associated resistance in 2478 Escherichia coli isolates from the Pan-European eco.sens project surveying the antimicrobial susceptibility of pathogens from uncomplicated urinary tract infections

   Journal of Antimicrobial Chemotherapy 52:128–131.

   https://doi.org/10.1093/jac/dkg280

   • PubMed
   • Google Scholar
10. 1. Olesen SW
    2. Barnett ML
    3. MacFadden DR
    4. Brownstein JS
    5. Hernández-Díaz S
    6. Lipsitch M
    7. Grad YH

    (2018) The distribution of antibiotic use and its association with antibiotic resistance

    eLife 7:e39435.

    https://doi.org/10.7554/eLife.39435

    • PubMed
    • Google Scholar
11. 1. Pouwels KB
    2. Dolk FCK
    3. Smith DRM
    4. Robotham JV
    5. Smieszek T

    (2018a) Actual versus 'ideal' antibiotic prescribing for common conditions in English primary care

    Journal of Antimicrobial Chemotherapy 73:19–26.

    https://doi.org/10.1093/jac/dkx502

    • PubMed
    • Google Scholar
12. 1. Pouwels KB
    2. Freeman R
    3. Muller-Pebody B
    4. Rooney G
    5. Henderson KL
    6. Robotham JV
    7. Smieszek T

    (2018b) Association between use of different antibiotics and trimethoprim resistance: going beyond the obvious crude association

    Journal of Antimicrobial Chemotherapy 73:1700–1707.

    https://doi.org/10.1093/jac/dky031

    • PubMed
    • Google Scholar
13. 1. Reichenheim ME
    2. Coutinho ES

    (2010) Measures and models for causal inference in cross-sectional studies: arguments for the appropriateness of the prevalence odds ratio and related logistic regression

    BMC Medical Research Methodology 10:66.

    https://doi.org/10.1186/1471-2288-10-66

    • PubMed
    • Google Scholar
14. 1. Shallcross L
    2. Beckley N
    3. Rait G
    4. Hayward A
    5. Petersen I

    (2017) Antibiotic prescribing frequency amongst patients in primary care: a cohort study using electronic health records

    Journal of Antimicrobial Chemotherapy 72:1818–1824.

    https://doi.org/10.1093/jac/dkx048

    • PubMed
    • Google Scholar
15. 1. Smieszek T
    2. Pouwels KB
    3. Dolk FCK
    4. Smith DRM
    5. Hopkins S
    6. Sharland M
    7. Hay AD
    8. Moore MV
    9. Robotham JV

    (2018) Potential for reducing inappropriate antibiotic prescribing in english primary care

    Journal of Antimicrobial Chemotherapy 73:ii36–ii43.

    https://doi.org/10.1093/jac/dkx500

    • PubMed
    • Google Scholar

Author details

1. Koen B Pouwels

   1. Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, United Kingdom
   2. Modelling and Economics Unit, National Infection Service, Public Health England, London, United Kingdom

   Contribution

   Conceptualization, Formal analysis, Visualization, Writing—original draft

   For correspondence

   k.b.pouwels@gmail.com

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0001-7097-8950

2. Christopher C Butler

   Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, United Kingdom

   Contribution

   Conceptualization, Investigation, Writing—review and editing, Clinical sense checking

   Competing interests

   No competing interests declared

3. Julie V Robotham

   1. Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, United Kingdom
   2. Modelling and Economics Unit, National Infection Service, Public Health England, London, United Kingdom

   Contribution

   Conceptualization, Supervision, Investigation, Writing—review and editing

   Competing interests

   No competing interests declared

• 1,265

  views

• 98

  downloads

• 6

  citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.