Rita Faria’s journal round-up for 2nd September 2019

Every Monday our authors provide a round-up of some of the most recently published peer reviewed articles from the field. We don’t cover everything, or even what’s most important – just a few papers that have interested the author. Visit our Resources page for links to more journals or follow the HealthEconBot. If you’d like to write one of our weekly journal round-ups, get in touch.

RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ [PubMed] Published 28th August 2019

RCTs are the gold standard primary study to estimate the effect of treatments but are often far from perfect. The question is the extent to which their flaws make a difference to the results. Well, RoB 2 is your new best friend to help answer this question.

Developed by a star-studded team, the RoB 2 is the update to the original risk of bias tool by the Cochrane Collaboration. Bias is assessed by outcome, rather than for the whole RCT. For me, this makes sense.  For example, the primary outcome may be well reported, yet the secondary outcome, which may be the outcome of interest for a cost-effectiveness model, much less so.

Bias is considered in terms of 5 domains, with the overall risk of bias usually corresponding to the worst risk of bias in any of the domains. This overall risk of bias is then reflected in the evidence synthesis, with, for example, a stratified meta-analysis.

The paper is a great read! Jonathan Sterne and colleagues explain the reasons for the update and the process that was followed. Clearly, there was quite a lot of thought given to the types of bias and to develop questions to help reviewers assess it. The only downside is that it may require more time to apply, given that it needs to be done by outcome. Still, I think that’s a price worth paying for more reliable results. Looking forward to seeing it in use!

Characteristics and methods of incorporating randomised and nonrandomised evidence in network meta-analyses: a scoping review. Journal of Clinical Epidemiology [PubMed] Published 3rd May 2019

In keeping with the evidence synthesis theme, this paper by Kathryn Zhang and colleagues reviews how the applied literature has been combining randomised and non-randomised evidence. The headline findings are that combining these two types of study designs is rare and, when it does happen, naïve pooling is the most common method.

I imagine that the limited use of non-randomised evidence is due to its risk of bias. After all, it is difficult to ensure that the measure of association from a non-randomised study is an estimate of a causal effect. Hence, it is worrying that the majority of network meta-analyses that did combine non-randomised studies did so with naïve pooling.

This scoping review may kick start some discussions in the evidence synthesis world. When should we combine randomised and non-randomised evidence? How best to do so? And how to make sure that the right methods are used in practice? As a cost-effectiveness modeller, with limited knowledge of evidence synthesis, I’ve grappled with these questions myself. Do get in touch if you have any thoughts.

A cost-effectiveness analysis of shortened direct-acting antiviral treatment in genotype 1 noncirrhotic treatment-naive patients with chronic hepatitis C virus. Value in Health [PubMed] Published 17th May 2019

Rarely we see a cost-effectiveness paper where the proposed intervention is less costly and less effective, that is, in the controversial southwest quadrant. This exceptional paper by Christopher Fawsitt and colleagues is a welcome exception!

Christopher and colleagues looked at the cost-effectiveness of shorter treatment durations for chronic hepatitis C. Compared with the standard duration, the shorter treatment is not as effective, hence results in fewer QALYs. But it is much cheaper to treat patients over a shorter duration and re-treat those patients who were not cured, rather than treat everyone with the standard duration. Hence, for the base-case and for most scenarios, the shorter treatment is cost-effective.

I’m sure that labelling a less effective and less costly option as cost-effective may have been controversial in some quarters. Some may argue that it is unethical to offer a worse treatment than the standard even if it saves a lot of money. In my view, it is no different from funding better and more costlier treatments, given that the savings will be borne by other patients who will necessarily have access to fewer resources.

The paper is beautifully written and is another example of an outstanding cost-effectiveness analysis with important implications for policy and practice. The extensive sensitivity analysis should provide reassurance to the sceptics. And the discussion is clever in arguing for the value of a shorter duration in resource-constrained settings and for hard to reach populations. A must read!

Credits

Thesis Thursday: Kevin Momanyi

On the third Thursday of every month, we speak to a recent graduate about their thesis and their studies. This month’s guest is Dr Kevin Momanyi who has a PhD from the University of Aberdeen. If you would like to suggest a candidate for an upcoming Thesis Thursday, get in touch.

Title
Enhancing quality in social care through economic analysis
Supervisors
Paul McNamee
Repository link
http://digitool.abdn.ac.uk/webclient/DeliveryManager?pid=240815

What are reablement and telecare services and why should economists study them?

Reablement and telecare are two types of services within homecare that enable individuals to live independently in their own homes with little or no assistance from other people. Reablement focuses on helping individuals relearn the skills needed for independent living after an illness or injury. It is a short term intervention that lasts for about 6 to 12 weeks and usually involves several health care professionals and social care workers working together to meet some set objectives. Telecare, on the other hand, entails the use of devices (e.g. community alarms and linked pill dispensers) to facilitate communication between homecare clients and their care providers in the event of an accident or negative health shock. Economists should study reablement and telecare so as to determine whether or not the services have value for money and also develop policies that would reduce social care costs without compromising the welfare of the populace.

In what ways did your study reach beyond the scope of previous research?

My study extended the previous studies in three main ways. Firstly, I estimated the treatment effects in a non-experimental setting unlike the previous studies that used either randomised controlled trials or quasi-experiments. Secondly, I used linked administrative health and social care data in Scotland for the 2010/2011 financial year. The data covered the administrative records for the entire Scottish population and was larger and more robust than the data used by the previous studies. Thirdly, the previous studies were simply concerned with quantifying the treatment effects and thus did not provide a rationale as to how the interventions affect the outcomes of interest. My thesis addressed this knowledge gap by formulating an econometric model that links the demand for reablement/telecare to several outcomes.

How did you go about trying to estimate treatment effects from observational data?

I used a theory driven approach combined with specialised econometric techniques in order to estimate the treatment effects. The theoretical model drew from the Almost Ideal Demand System (AIDS), Andersen’s Behavioural Model of Health Services Use, the Grossman Model of the demand for health capital, and Samuelson’s Revealed Preference Theory; whereas the estimation strategy simultaneously controlled for unexplained trend variations, potential endogeneity of key variables, potential sample selection bias and potential unobserved heterogeneity. For a more substantive discussion of the theoretical model and estimation strategy, see Momanyi, 2018. Although the majority of the studies in the econometric literature advocate for the use of quasi-experimental study designs in estimating treatment effects using observational data, I provided several proofs in my thesis showing that these designs do not always yield consistent results, and that estimating the econometric models in the way that I did is preferable since it nests several study designs and estimation strategies as special cases.

Are there key groups of people that could benefit from greater use of reablement and telecare services?

According to the empirical results of my thesis, there is sufficient evidence to conclude that there are certain groups within the population that could benefit from greater use of telecare. For instance, one empirical study investigating the effect of telecare use on the expected length of stay in hospital showed that the community alarm users with physical disabilities are more likely than the other community alarm users to have a shorter length of stay in hospital, holding other factors constant. Correspondingly, the results also showed that the individuals who use more advanced telecare devices than the community alarm and who are also considered to be frail elderly are expected to have a relatively shorter length of stay in hospital as compared to the other telecare users in the population, all else equal. A discussion of various econometric models that can be used to link telecare use to the length of stay in hospital can be found in Momanyi, 2017.

What would be your main recommendation for policymakers in Scotland?

The main recommendation for policymakers is that they ought to subsidise the cost of telecare services, especially in regions that currently have relatively low utilisation levels, so as to increase the uptake of telecare in Scotland. This was informed by a decomposition analysis that I conducted in the first empirical study to shed light on what could be driving the observed direct relationship between telecare use and independent living at home. The analysis showed that the treatment effect was in part due to the underlying differences (both observable and unobservable) between telecare users and non-users, and thus policymakers could stimulate telecare use in the population by addressing these differences. In addition to that, policymakers should advise the local authorities to target telecare services at the groups of people that are most likely to benefit from them as well as sensitise the population on the benefits of using community alarms. This is because the econometric analyses in my thesis showed that the treatment effects are not homogenous across the population, and that the use of a community alarm is expected to reduce the likelihood of unplanned hospitalisation, whereas the use of the other telecare devices has the opposite effect all else equal.

Can you name one thing that you wish you could have done as part of your PhD, which you weren’t able to do?

I would have liked to include in my thesis an empirical study on the effects of reablement services. My analyses focused only on telecare use as the treatment variable due to data limitations. This additional study would have been vital in validating the econometric model that I developed in the first chapter of the thesis as well as addressing the gaps in knowledge that were identified by the literature review. In particular, it would have been worthwhile to determine whether reablement services should be offered to individuals discharged from hospital or to individuals who have been selected into the intervention directly from the community.

Meeting round-up: Health Economists’ Study Group (HESG) Winter 2019

2019 started with aplomb with the HESG Winter meeting, superbly organised by the Centre for Health Economics, University of York.

Andrew Jones kicked off proceedings with his brilliant course on data visualisation in health econometrics. The eager audience learnt about Edward Tufte’s and others’ ideas about how to create charts that help to make it much easier to understand information. The course was tremendously well received by the HESG audience. And I know that I’ll find it incredibly useful too, as there were lots of ideas that apply to my work. So I’m definitely going to be looking further into Andrew’s chapter on data visualisation to know more.

The conference proper started in the afternoon. I had the pleasure to chair the fascinating paper by Manuela Deidda et al on an economic evaluation using observational data on the Healthy Start Voucher, which was discussed by Anne Ludbrook. We had an engaging discussion, that not only delved into the technical aspects of the paper, such as the intricacies of implementing propensity score matching and regression discontinuity, but also about the policy implications of the results.

I continued with the observational data theme by enjoying the discussion led by Panos Kasteridis on the Andrew McCarthy et al paper. Then I quickly followed this by popping over to catch Attakrit Leckcivilize’s excellent discussion of Padraig Dixon’s et al paper on the effect of obesity on hospital costs. This impressive paper uses Mendelian randomisation, which is a fascinating approach using a type of instrumental variable analysis with individuals’ genetic variants as the instrument.

The meeting continued in the stunning setting of the Yorkshire Museum for the plenary session, which also proved a fitting location to pay tribute to the inspirational Alan Maynard, who sadly passed away in 2018. Unfortunately, I was unable to hear the tributes to Alan Maynard in person, but fellow attendees were able to paint a moving portrait of the event on Twitter, that kept me in touch.

The plenary was chaired by Karen Bloor and included presentations by Kalipso Chalkidou, Brian Ferguson, Becky Henderson and Danny PalnochJane Hall, Steve Birch and Maria Goddard gave personal tributes.

The health economics community was united in gratitude to Professor Alan Maynard, who did so much to advance and disseminate the discipline. It made for a wonderful way to finish day 1!

Day 2 started bright and was full of stimulating sessions to choose from.

I chose to zone in on the cost-effectiveness topic in particular. I started with the David Glynn et al paper about using “back of the envelope” calculations to inform funding and research decisions, discussed by Ed Wilson. This paper is an excellent step towards making value of information easy to use.

I then attended Matthew Quaife’s discussion of Matthew Taylor’s paper on the consequences of assuming independence of parameters to decision uncertainty. This is a relevant paper for the cost-effectiveness world, in particular for those tasked with building and appraising cost-effectiveness models.

Next up it was my turn in the hot seat, as I presented the Jose Robles-Zurita et al paper on the economic evaluation of diagnostic tests. This thought-provoking paper presents a method to account for the effect of accuracy on the uptake of the test, in the context of maximising health.

As always, we were spoilt for choice in the afternoon. The paper “Drop dead: is anchoring at ‘dead’ a theoretical requirement in health state valuation” by Chris Sampson et al, competed very strongly with “Is it really ‘Grim up North’? The causes and consequences of inequalities on health and wider outcomes” by Anna Wilding et al, for the most provocative title. “Predicting the unpredictable? Using discrete choice experiments in economic evaluation to characterise uncertainty and account for heterogeneity”, from Matthew Quaife et al, also gave them a run for their money! I’ll leave a sample here of the exciting papers in discussion, so you can make your own mind up:

Dinner was in the splendid Merchant Adventurers’ Hall. Built in 1357, it is one of the finest Medieval buildings in the UK. Another stunning setting that provided a beautiful backdrop for a wonderful evening!

Andrew Jones presented the ‘Health Economics’ PhD Poster Prize, sponsored by Health Economics Wiley. Rose Atkins took the top honours by winning the Wiley prize for best poster. With Ashleigh Kernohan’s poster being highly commended, given its brilliant use of technology. Congratulations both!

Unfortunately, the vagaries of public transport meant I had to go home straight after dinner, but I heard from many trustworthy sources, on the following day, that the party continued well into the early hours. Clearly, health economics is a most energising topic!

For me, day 3 was all about cost-effectiveness decision rules. I started with the paper by Mark Sculpher et al, discussed by Chris Sampson. This remarkable paper sums up the evidence on the marginal productivity of the NHS, discussing how to use it to inform decisions, and proposes an agenda for research. There were many questions and comments from the floor, showing how important and challenging this topic is. As are so many papers in HESG, this is clearly one to look out for when it appears in print!

The next paper was on a very different way to solve the problem of resource allocation in health care. Philip Clarke and Paul Frijters propose an interesting system of auctions to set prices. The paper was well discussed by James Lomas, which kick-started an animated discussion with the audience about practicalities and implications for investment decisions by drug companies. Great food for thought!

Last, but definitely not least, I took in the paper by Bernarda Zamora et al on the relationship between health outcomes and expenditure across geographical areas in England. David Glynn did a great job discussing the paper, and especially in explaining data envelopment analysis. As ever, the audience was highly engaged and put forward many questions and comments. Clearly, the productivity of the NHS is a central question for health economics and will keep us busy for some time to come.

As always, this was a fantastic HESG meeting that was superbly organised, providing an environment where authors, discussants and participants alike were able to excel.

I really felt a feeling of collegiality, warmth and energy permeate the event. We are part of such an amazing scientific community. Next stop, HESG Summer meeting, hosted by the University of East Anglia. I’m already looking forward to it!

Credit