Send email for updates


Effectiveness bank home page. Opens new windowResearch analysis

This entry is our analysis of a study considered particularly relevant to improving outcomes from drug or alcohol interventions in the UK. The original study was not published by Findings; click Title to order a copy. Free reprints may be available from the authors – click prepared e-mail. The summary conveys the findings and views expressed in the study. Below is a commentary from Drug and Alcohol Findings.

Links to other documents. Hover over for notes. Click to highlight passage referred to. Unfold extra text Unfold supplementary text
Copy title and link | Comment/query |

Cost-effectiveness of strategies to improve delivery of brief interventions for heavy drinking in primary care: results from the ODHIN trial.

Angus C., Li J., Romero-Rodriguez E. et al.
European Journal of Public Health: 2018, 0(0), p. 1–6.
Unable to obtain a copy by clicking title? Try asking the author for a reprint by adapting this prepared e-mail or by writing to Dr Angus at c.r.angus@sheffield.ac.uk.

To address the ‘implementation gap’ of brief interventions in European primary care, the featured study examined the cost-effectiveness of three strategies intended to boost delivery: training and support, financial reimbursement, and the opportunity to refer patients to an online tool.

Summary Screening and brief interventions for heavy drinking are effective (1 2) and cost-effective (3) approaches to reducing alcohol-related harm. Yet delivery rates (eg, only 1 in 20 eligible patients being screened in Europe) remain low.

Key points icon

Key points
From summary and commentary

Current delivery of screening and brief interventions in primary care is low across Europe.

To address this ‘implementation gap’, the featured study examined the cost-effectiveness of strategies intended to boost delivery.

In England, the Netherlands and Poland, training and support, financial reimbursement, and the opportunity to refer patients to an online tool were found likely to be cost-effective strategies for increasing rates of delivery.

Using data collected in the Optimizing Delivery of Health Care Interventions (ODHIN) trial, in combination with the Sheffield Alcohol Policy Model, the featured study aimed to assess the cost-effectiveness of levers to improve the delivery of screening and brief interventions, enabling policymakers to make more informed decisions when allocating potentially scarce resources.

Described more fully in an analysis being prepared for the Effectiveness Bank, the ODHIN trial, which took place in 120 primary care settings, equally distributed across five countries (England, the Netherlands, Poland, Catalonia and Sweden), tested the effects of three different strategies on the delivery of screening and brief interventions by primary care services:

  1. Training and support: providers were offered two 1–2-hour, face-to-face educational training sessions on screening and brief interventions, and follow-up telephone support.
  2. Financial reimbursement: providers were offered financial incentives for the delivery of screening and brief interventions.
  3. Referral to an online brief intervention: providers were able to refer patients identified as risky drinkers to an online brief intervention.

There were eight arms to the trial in total. Primary care practices were randomly allocated to either a control group (where no support or incentives were provided to practitioners), one of the three strategies above, or to a combination of the three strategies. The control group of practices was used to estimate the results of not mounting any extra programmes to increase implementation of screening and brief intervention, providing a ‘no strategy’ or current strategy baseline against which to assess the three implementation options.

Delivery was estimated over three time pointsData was collected at three time points: baseline (ie, before the intervention); during a 12-week implementation period at which time the strategies were being implemented; and during a four-week follow-up period six months later (ie, post-intervention).. For the cost-effectiveness calculation the measure of effectiveness used was the proportion of all adult consultations with participating clinicians which resulted in a patient screening positive and being given brief advice – what we have called the ’population intervention rate’.

In the ODHIN trial, one of the options tried in 2013 was supplementing basic information for GPs on national safer drinking recommendations as well as a request to screen all adult patients, with per-patient payments for alcohol screening and advice. In England these payments were €6 per screening and €25 per patient advised, up to a ceiling of €2,200 per practice. Relative to basic information, across the five nationsEngland, the Netherlands, Poland, Catalonia and Sweden. payments significantly doubled the screening rate, feeding through to a non-significant doubling in the proportion of patients seen at the practices who were offered advice on their drinking. But still just 1 in 8 attendees were screened leading to about 2% being advised.

When the analysis assessed whether among all the combinations of intervention-promoters, certain elements seemed to make a difference, payments emerged as the most important component, one which allied with training and support nearly quadrupled the screening rate leading to a near-significant 2.3 times greater proportion of patients being advised. However, even this combination would across the entire sample have raised the proportion of risky drinkers who received advice from an estimated 3% before to only about 9%Before the programmes 11 out of 1000 patients were advised while 330 scored as risky drinkers on a screening test = 3.33% of risky drinkers advised. With training/support and financial incentives, the advice rate among those practices rose from 12.5 per 1000 patients to 34.6. Extrapolated to the whole sample, this would have had the effect of raising the advice rate to about 34.6/12.5 x 3.33, equating to 9.2%. afterwards. Without knowing if there were any impacts on the patients, the most the researchers could say was that jurisdictions “could consider” promoting brief alcohol advice in primary care through training and guidance, financial and performance management arrangements, and strategic leadership.

The analyses below estimate the long-term costs and effects of the trialled strategies for three out of the five countries – England, the Netherlands and Poland – over a 10-year period of investment, and presumed 30-year window of health outcomes (to account for the time lags which exist between changes in alcohol consumption and changes in the risk of alcohol-related harm).

To assess cost-effectiveness the researchers first estimated how many years of life (quality-adjusted life yearsOne quality-adjusted life year is equal to one year of life in perfect health. known as ‘QALYs’) each implementation strategy would save relative to implementing no strategy at all, a measure of the increased health gained by each strategy. Then the costs of each strategy were calculated, again relative to no strategy at all. Costs included the cost of the resultant screenings and brief intervention and healthcare costs associated with the treatment of alcohol-related health conditions; effective programmes should reduce these healthcare costs, potentially more than offsetting the cost of the programme. Dividing net extra costs by QALYs saved yielded an estimate of how much extra each strategy would cost the health service of each country per extra QALY it saved. The strategy was considered cost-effective if this figure was lower than what each country was (according to official policy) considered a cost they were prepared to pay to save a quality-adjusted year of life.

A key challenge in estimating the impact of the strategies on delivery was that, while online brief interventions and training and support are essentially ‘one-off’ policies – ie, practitioners are trained or introduced to the online tool at the outset and not subsequently re-trained – financial reimbursement requires continuous investment. The follow-up measures were therefore not directly comparable across all strategies. In order to overcome this issue, two different types of analyses were conducted: the first, providing a measure of exactly what was implemented in the trial (ie, financial reimbursement was withdrawn after 12 weeks); and the second, a measure of what would have happened if payments continued for the full 10 years.

Main findings

The most effective strategy at increasing the delivery of brief interventions was training and support combined with financial reimbursement, although this had one of the highest costs for each additional brief intervention delivered across all three countries. In contrast, online brief interventions appeared to offer the cheapest way to achieve delivery of additional brief interventions, however, this was among the least effective strategies overall.

In all three countries, training and support plus financial incentives yielded the greatest health gains, and gained these at a cost below each country’s yardstick for cost-effectiveness per extra year of life in perfect health:
• England (€3,257 vs. €22,918);
• The Netherlands (€3,953 vs. €20,000);
• Poland (€8,319 vs. €14,666).

In England, relative to no new strategy both financial incentives alone and financial incentives plus training and support generated health gains while actually reducing overall costs. In the Netherlands this was also the case for financial incentives, although the estimated scale of savings was very different between the two countries (€150 million and €7.8 million respectively). Both training and support, and training and support plus financial incentives, incurred a net cost to the healthcare system in Poland, with the most effective strategy (training and support plus financial incentives) costing €6.8 million extra over 30 years compared to the control group. Estimated health gains under training and support plus financial incentives were largest in England, at 15,400 QALYs over 30 years compared to 2,400 in the Netherlands and 2,600 in Poland.

When additional analyses were performed based on the assumptions that (1) financial incentives continued to be paid for a full 10-year period, and (2) that, as observed in previous studies, the effect of these on provider behaviour was maintained in the long term, the results were broadly similar. Training and support plus financial incentives was still the optimal strategy in England and Poland, but it was no longer cost-effective in the Netherlands compared to training and support alone. As in the previous analyses, the optimal strategies were estimated to be cost-saving in England and the Netherlands, but not Poland, and the health gains in England were significantly larger than in the other countries.

Based on assumptions that training had to be re-delivered every five or every two years in order to achieve any persistence of effect of other strategies, there were significant increases in the costs associated with anything involving training and support. For example, the cost over 10 years of delivering training and support in the Netherlands increased from €8.6 million to €15.9 million with re-training every five years, and €36.9 million with re-training every two years. However, these increased costs made little difference to the overall cost-effectiveness results and the overall conclusions of the analysis. The only significant change was that training and support ceased to be cost-effective in the Netherlands if re-training was required every two years, with referral to online brief interventions becoming the most cost-effective option under this scenario.

When the researchers assumed that the effect of brief interventions on alcohol consumption persisted for less time (three years), the overall cost-effectiveness was reduced for all strategies. While training and support plus financial incentives remained the most cost-effective option for both England and the Netherlands (€21,668 and €13,413 respectively per extra QALY gained), it was no longer cost-effective in Poland, with training and support alone offering the most cost-effective strategy at €2,609.

The authors’ conclusions

While delivery rates of screening and brief interventions in European primary care are currently low, several cost-effective strategies exist to increase these rates.

Training and support combined with financial incentives may offer the most cost-effective strategy for increasing delivery, and subsequently reducing alcohol-related harm and associated costs to society. However, this finding is sensitive to both the characteristics of the country and assumptions around the long-term effects of brief interventions. Furthermore, policymakers may need to be mindful of the potential ethical issues (1 2) associated with offering financial incentives to healthcare practitioners.


Findings logo commentary The level of alcohol consumption in Europe is high compared with the rest of the world, and although there is evidence that screening and brief interventions in primary healthcare may offer “a cost-effective policy option for tackling alcohol-related harms, at least in high-income countries”, their level of implementation in routine primary healthcare remains low. The featured study was part of a package of work seeking to address this problem – assessing the cost-effectiveness of levers to improve delivery. However, before discussing the ‘implementation gap’ raised in this study, and how brief interventions can be delivered “widely and well enough” to improve health across the entire population, it is necessary to examine the underlying assumptions including the assumption that brief interventions remain effective in real-world settings – arguably the ‘Achilles heel’ of the findings.

Were the strategies really cost-effective?

Cost per QALY calculations can only be valid only on the basis of the assumptions and data which fed into them and the influences on both cost and quality/length of life which were taken into account. In the case of the featured study these limitations are substantial enough to cast doubt on the whether the calculations are a reliable guide to policy and practice. Concerns include an over-estimate of the size of the effect of brief interventions on drinking and possibly too how long they last, doubts over whether such research-derived estimates apply to routine practice, uncertainty over what level of continued payments and training or support would be needed to sustain screening and brief intervention activity, the former magnified by the fact that the practitioners in the study were particularly motivated to respond to drinking, omission of the costs of monitoring screening and intervention volume and quality to substantiate eligibility for payments, and omission too of the value of what might have been done with the time devoted to training, screening and intervention. The projected healthcare savings which largely generated the cost-effectiveness findings were not based on reports from the patients themselves. Findings of significantly raised screening and brief intervention rates for some of the strategies would have been greatly aided by the unexplained steep fall in these rates in the control units which provided the benchmark against which the strategies were compared. Of concern too is that the featured analysis was conducted on an outcome (the proportion of all adult consultations with participating clinicians which resulted in a patient screening positive and being given brief advice) which was not specified in advance, opening the door to selecting an outcome which cast the implementation strategies in the best light. These considerations are expanded in the supplementary text: click to unfold Unfold supplementary text.

Incentives work but have their downsides

Studies reviewed in the Effectiveness Bank indicate that without material or reputational and possibly career-affecting sanctions/incentives, implementation drives based on educating, persuading and supporting practitioners have reached just a minority of the intended patients. Strong sanctions and incentives can generate the desired activity, but may be costly and tempt services and practitioners to short-change quality and ‘game’ the system.

The authors of the featured study made reference to the ethical questions surrounding financial incentives to healthcare practitioners. In the British Journal of General Practice, Dr Graham Kramer expressed the following about the implications of rewarding practices for the delivery of high quality care (in this case under the Quality and Outcomes Framework):

“I had worried that, by being paid to implement evidence-based guidelines, my work would become a restricted, target-driven exercise that shifted the balance of my consultations to a doctor and disease-centred agenda. I had been concerned that this created conflicts of interest and how that might undermine, not only trust by my patients in me as a doctor, but also the trustworthiness of the profession. I worried that in some domains I was taking money to engage in work that I felt had limited value for my patients, money that could possibly be spent in more useful areas. Was I colluding in a wholesale folly of medical practice and worse still, why wasn’t I doing anything about it? Had my mouth been effectively ‘stuffed with gold’?”

The Alcohol Treatment Matrix in the Effectiveness Bank (see cell E1) discusses this issue of incentives, including whether financial incentives indeed divert clinical practice in the desired direction, or risk confirming to staff that alcohol screening and brief interventions are not their core business.

Last revised 15 August 2019. First uploaded 09 January 2019

Comment/query
Give us your feedback on the site (two-minute survey)
Open Effectiveness Bank home page
Add your name to the mailing list to be alerted to new studies and other site updates


Top 10 most closely related documents on this site. For more try a subject or free text search

STUDY 2013 Effectiveness of screening and brief alcohol intervention in primary care (SIPS trial): pragmatic cluster randomised controlled trial

STUDY 2014 The effectiveness of alcohol screening and brief intervention in emergency departments: a multicentre pragmatic cluster randomized controlled trial

STUDY 2012 Alcohol screening and brief intervention in primary health care

STUDY 2012 Alcohol screening and brief intervention in emergency departments

REVIEW 2010 Alcohol-use disorders: Preventing the development of hazardous and harmful drinking

STUDY 2012 Alcohol screening and brief intervention in probation

STUDY 2013 Modelling the cost-effectiveness of alcohol screening and brief interventions in primary care in England

STUDY 2011 An evaluation to assess the implementation of NHS delivered alcohol brief interventions: final report

HOT TOPIC 2017 ‘My GP says I drink too much’: screening and brief intervention

STUDY 2013 Screening and brief intervention for alcohol and other drug use in primary care: associations between organizational climate and practice