In case you hadn’t noticed, we elves are keen on using this here electronic inter-web thingy, because we think it’s a good way to share information.
By extension, we wonder whether it might also be a good way to deliver therapy; quickly, easily, and cheaply, to lots of people all over the world. Other elves have blogged about the evidence for using such technology to help people stop smoking (Munafò), stop drinking (Jones & Field), treat depression (Newhouse), treat chronic somatic conditions (Cristea), and, indeed, treat eating disorders (Steele, paper by Dolemeyer et al, 2013).
Many people are surprised to hear how prevalent eating disorders are: one recent study found that they affect more than 1 in 20 female adolescents (Smink et al, 2014). Given this prevalence, it would be great if there were easily “scalable”, evidence-based e-therapies to treat them. Such therapies might make use of the Internet, “apps”, computers, tablets, phones, maybe even wearable tech.
This new paper isn’t the first systematic review and meta-analysis of such therapies, but it is worth a read – it is the first to use the same criteria that NICE uses when investigating new treatments (Loucas et al, 2014). These rigorous criteria result in a considerably less optimistic conclusion than the paper covered by the last blog on this subject (Steele, paper by Dolemeyer et al, 2013).
Methods
The authors used PRISMA guidelines to conduct a systematic review and meta-analysis of all RCTs of e-therapies designed to prevent, treat or prevent relapse to eating disorders. E-therapies were defined as “interventions that were primarily delivered via a computer, mobile phone or tablet” via “the Internet, downloadable software, CD-ROMs and mobile device apps”. They searched multiple databases, checked reference lists in included studies, and conducted a manual search for registered but unpublished trials.
They used the Cochrane risk of bias tool to assess risk of bias in each study and the structured “GRADE” approach to assess the quality of the evidence in each trial, to give a measure of confidence in the reported effect size.
Sadly they excluded trials not published in English.
Results
In all, 20 trials were eligible for inclusion, of which 14 could be appropriately combined in a meta-analysis:
- 17 studies were of cognitive behavioural interventions
- 16 used the Internet
- None used apps
- 13 were studies of prevention (8 of the Student Bodies program: a CBT program designed to reduce body dissatisfaction)
- 6 of treatment
- 1 of relapse-prevention
Confidence in the effect estimates is described as moderate to very low, largely due to risk of bias.
Prevention studies
- Compared to a waiting list control, Student Bodies showed small improvements in drive for thinness at the end of the intervention and for dietary restraint and global eating disorder pathology at follow up. In participants with baseline disordered eating, there were improvements in this, but low confidence in the effect estimates
- One study of motivation interviewing showed small improvements in shape concern, dietary restraint and vomiting, but with low confidence in the effect estimates
- Studies of other interventions showed little evidence of effectiveness for any outcome
Treatment studies
- Four studies of e-therapy for bulimia all had low or very low confidence in effect estimates. They showed some evidence for improvements in outcome in comparison with waiting list and were inconclusive in comparison to bibliotherapy
Relapse prevention study
- One study aimed to prevent relapse in anorexia nervosa using online CBT. Effect sizes for improvement were small and most included the possibility of no difference from treatment as usual. Confidence in effect sizes was low to moderate.
Discussion
The authors conclude that the evidence base is small and
there is certainly no basis for saying that e-therapy is a good alternative to face-to-face treatment
They suggested that the online prevention program “Student Bodies” is associated with a modest reduction in eating disorder symptoms, but whether this has a meaningful effect on subsequent prevention of eating disorders has yet to be established.
They bemoan the fact that none of the available treatments make use of the potential strengths of the Internet (over, for example, books): the ability to design treatments which are interactive and personalized. And they highlight the potential harm of people using non-evidence based apps thinking that they are treating their eating disorder, when really they should be seeking proper help.
Dull as it is to have to agree with the authors so completely, it is hard to find fault with this thorough critical appraisal of the evidence.
These new technologies have become part of our life in almost all areas (Trying to find a new house? There’s an app for that; Want to turn your oven on before you get home? Send it a text; Lost in an unfamiliar city?…See that blue dot on the map on your phone?) and e-therapies seem a bit behind the curve. Most of the interventions studied here have just put existing therapies onto a computer.
The authors bemoan the fact that none of the available evidence-based treatments make use of the potential strengths of the Internet: the ability to design treatments which are interactive and personalized. Another potential use of wearable technology and smart phones is the ability to gather lots of information about ourselves on a daily basis. This might help both patients and clinicians build a more accurate picture of, for example, meals eaten, activity levels, mood, and sleep.
Of course, a quick Google search tells us there are apps “for eating disorders” out there, and they may be effective; the trouble is we don’t know whether they are or not. The difficulty is that the Internet can move so quickly and so inexpensively, whereas properly conducted RCTs are expensive and rather slow. It’s clear that digital mental health entrepreneurs and researchers need to bridge the gap between agile development and evidence-based research methods. Is there a happy medium here?
The reviewers sound a note of caution by highlighting the potential risk of people using non-evidence based apps, thinking that they are treating their eating disorder, and this delaying them seeking evidence-based help.
We need to think about how we can develop novel e-therapies, and how we can check that they are safe and effective in a timely way. The only thing I’ve tried using any sort of new technology for in my practice is inviting adolescents and their families to bring in smartphone photos of meals if there is a disagreement about what constitutes a “normal” portion.
It would be fascinating to hear what other clinicians and families have tried, and your ideas for new interventions. Please use the comments feature below to share your thoughts.
Links
Loucas CE, Fairburn CG, Whittington C, Pennant ME, Stockton S, Kendall T. E-therapy in the treatment and prevention of eating disorders: A systematic review and meta-analysis. Behaviour research and therapy. 2014;63C:122-131.
Dolemeyer R, Tietjen A, Kersting A, Wagner B. Internet-based interventions for eating disorders in adults: a systematic review. BMC psychiatry. 2013;13:207.
Smink FR, van Hoeken D, Oldehinkel AJ, Hoek HW. Prevalence and severity of DSM-5 eating disorders in a community cohort of adolescents. The International journal of eating disorders. 2014;47(6):610-619.
RT @Mental_Elf: E-therapy for eating disorders http://t.co/6rp5OvCu50
E-therapy for eating disorders: review finds lack of evidence for digital treatment or prevention: Helen Bould… http://t.co/N62VQxmKFM
E-therapy for eating disorders: review finds lack of evidence for digital treatment or prevention http://t.co/m07yO158ao via @sharethis
Olivia Cialdi liked this on Facebook.
More work to be done before E-therapy for eating disorders can be recommended for treatment via @Mental_Elf http://t.co/YJTiJWEeN7
.@BelindaJPlatt @Mental_Elf we have some experience with Skype therapy for better access to #fbt
Sounds interesting! @IEDAction @BelindaJPlatt Please post a comment on the blog and tell us more? http://t.co/WX1U99Wiaj @DrBould
Bethan Davies liked this on Facebook.
It seems that we need clinicians to work with developers. http://t.co/9v3fQi458v
@mHealthHabitat have you seen today’s blog from @Mental_Elf? http://t.co/hBpKwr8lFF E-therapy (apps etc) for eating disorders
@lypftlib @Mental_Elf thank you for sharing lovely library peeps :-)
@mHealthHabitat @Mental_Elf you’re welcome!
Kirsten Corden liked this on Facebook.
.@VictoriaBetton @MarkOneinFour What kind of research should we be doing on digital mental health interventions? http://t.co/WX1U99Wiaj
MT @Mental_Elf What kind of research should we do on digital mental health interventions? http://t.co/M2AvAe0iEj < top Q! @NIHR_MindTech
@Mental_Elf ps we are currently developing an app to be used in our regional eating disorders service :-)
.@Mental_Elf @VictoriaBetton we need to start digital #mentalhealth research into a)possible active mechanisms b)models for applying them
.@Mental_Elf @VictoriaBetton For me, pipeline is broken between research into possible mechanisms and research into application of them
@MarkOneinFour @Mental_Elf @VictoriaBetton because research into mechanisms needs to take into account how they are applied?
@dr_know @Mental_Elf @VictoriaBetton yes and no, I think. There’s how they are applied and how they might be applied
@dr_know @Mental_Elf @VictoriaBetton In a meeting on Monday in Leeds someone mentioned wearables and biofeedback as potential mechanism
@dr_know @Mental_Elf @VictoriaBetton how might biofeedback via wearables find an application in #mentalhealth, for say, young people?
@dr_know @Mental_Elf @VictoriaBetton but then there’s looking at application as being study of how mechanism might be deployed ‘in service’
@dr_know @Mental_Elf @VictoriaBetton Example: ‘We know it’s possible to track lots of body data easily, don’t know what to do with it’
@MarkOneinFour @Mental_Elf @VictoriaBetton is this the ‘what we have’ vs ‘what we need’ gap? We have the technology, but not sure what for!
@dr_know @Mental_Elf @VictoriaBetton why my equation for digital is= ‘see cool stuff+properly surface user needs=new avenues to explore
@dr_know @Mental_Elf @VictoriaBetton talking to young people yesterday about providing info being good, but website not only way
@dr_know @Mental_Elf @VictoriaBetton and website is still paradigm of ‘look it up in directory’ while digital offers alternative mechanisms
.@Mental_Elf @VictoriaBetton too much focus on digital as information paradigm, too little of digital as medical device and dev implications
.@Mental_Elf @VictoriaBetton The point that, to date, we’ve often just tried to analogue offline services online is a very good one
@Mental_Elf @KittyCormack @VictoriaBetton @MarkOneinFour
@Mental_Elf @KittyCormack @VictoriaBetton @MarkOneinFour Great Handle, @Mental_Elf
Today @DrBould on a new SR that finds a lack of evidence for digital treatment or prevention of eating disorders http://t.co/WX1U99Wiaj
On-line therapy for #eatingdisorders: review finds lack of #evidence for digital treatment or prevention http://t.co/nOMiw8hMNs
The Mental Elf liked this on Facebook.
No evidence for present effectiveness; clinicians could work with digital providers for future progress @thementalelf http://t.co/q51ze5y2FA
E-therapy for eating disorders: review finds lack of evidence for digital treatment or prevention http://t.co/iPNi6pgWeD
Phoebe Collins liked this on Facebook.
RT @Mental_Elf: With so many #EatingDisorders websites & apps popping up, why is there little reliable evidence of positive effect? http://…
.@JCHannah77 @leorapinhas @DrIanDawe @OntarioShores @CentralEastLHIN Can you say more? In a blog comment if you like http://t.co/WX1U99Wiaj
@Mental_Elf @JCHannah77 @leorapinhas @CentralEastLHIN . She already has. See #mindvine for details. @OntarioShores Is doing it differently
@DrIanDawe @Mental_Elf @JCHannah77 @CentralEastLHIN @OntarioShores Thank you OSC for taking a “risk” innovating/individualizing ED Tx.
@Mental_Elf @JCHannah77 @CentralEastLHIN @OntarioShores. Thank you @leorapinhas for helping us do so and agreeing to measure it too.
@Mental_Elf @leorapinhas @DrIanDawe @OntarioShores @CentralEastLHIN @GJParry03 and @IHI leading the way on RCE
@Mental_Elf @leorapinhas @DrIanDawe @OntarioShores @CentralEastLHIN done, from a n iPhone so punctuation may not be great.
Why don’t online therapies actually make use of the novel benefits of being online? http://t.co/iDrl8wvqWu new blog on @Mental_Elf
@dr_know @Mental_Elf CBT is bad enough face to face,how is therapy helpful to ppl online worlds gone crazy
An interesting follow-up to the talk from @cbulik yesterday: @Mental_Elf blogs on e-therapy for eating disorder: http://t.co/N62VQxmKFM#sthash.cOoDofVI.dpuf
Interesting follow-up to @cbulik talk y’day: @Mental_Elf blog on e-therapy for eating disorder: http://t.co/FjfQLkEp4d
E-therapy for eating disorders: review finds lack of evidence for digital treatment or prevention – http://t.co/4bfUhuV5KA
RT @Mental_Elf: Eating disorders review finds lack of evidence for digital treatment or prevention. Are we designing the right apps? http:/…
So I think the précis of this study is unhelpful. It could just as easily have read ‘potential of e-therapies yet to be realised’. At it most basic it is saying there is lack of evidence as far because the available stuff is not well designed to realise the potential. Lack of evidence is not evidence of lack, however so I would have said that the fairest view is that it is inconclusive.
But really what it is demonstrating is the shortcomings of RCTs, they are just not well suited to this type of work, increasingly we are looking to use rapid cycles of evaluation as an alternative. The best way of thinking about this is as course correction (unless you are used to Bayes Stats) you start heading in a direction and regularly check your bearings, correcting course. By this means you develop your interventions, this fits much more effectively with the speed of our current world.
IHI are leading the way on this, expect to hear more in th future as the methodology develops.
Don’t miss: E-therapy for eating disorders http://t.co/WX1U99Wiaj #EBP
Nicola Davies liked this on Facebook.
RT @Mental_Elf – interesting article, something to think about re. E-therapy and M-health http://t.co/S7PgP82fzb #mHealth #MentalHealth
#MindTheGap
E-therapy for eating disorders http://t.co/OajnYj2QmS via @sharethis
Most popular blog this week? It’s @DrBould on E-therapy for eating disorders http://t.co/WX1U99Wiaj
When the body disappears from therapy the evidence for efficacy is thin: @DrBould on E-therapy for eating disorders http://t.co/SiPDPl3bEm
@PlymouthMind focus in Feb = eating disorders “@Mental_Elf popular blog – @DrBould on E-therapy for eating disorders http://t.co/M17bZ1EZU6“
[…] http://www.thementalelf.net/publication-types/systematic-review/e-therapy-for-eating-disorders-revie… […]
RT @Mental_Elf Most popular blog this week? It’s @DrBould on E-therapy for eating disorders http://t.co/IxnOE27Na5
[…] H. E-therapy for eating disorders: review finds lack of evidence for digital treatment or prevention. The Mental Elf. […]