We’ve talked in the woodlands before about the relative benefits of individual patient data meta analysis (IPDMA) compared to standard meta-analyses (Knowles, 2013). IPDMA, rather than pooling the reported average intervention effects like a typical meta-analysis, actually puts together all the original data from the included studies; hence the phrase “individual patient data”, because the analysis has the data for every individual participant in the original study rather than the summary statistics.
This makes IPD a very powerful tool for exploring differences in the effect between different patient groups, because we can actually analyse the data according to different patient characteristics (for example, age, gender, or severity of illness). In particular this lets us look at whether those differences act as moderators of outcome; do they make an effect bigger or smaller?
In this study (Weitz et al, 2015), the team wanted to find out whether baseline depression severity moderated the effect of pharmacotherapy (ADM – antidepressant medication) compared to cognitive behavioural therapy (CBT). Simply put, is one treatment better than the other depending on how severe depression is to begin with?
Guidelines both in the US and the UK recommend that for severe depression pharmacotherapy is used, but there hasn’t previously been an analysis with sufficient statistical power to look at whether patients with severe depression really do better with pharmacotherapy compared to CBT. The IPD analysis allowed them to do just this.
Methods
- Trials were included that compared CBT to pharmacotherapy in patients with a diagnosis of depression
- They excluded studies that looked at participants under 18, who were receiving inpatient care, which looked at relapse prevention (rather than treatment during depression), or that included patients with comorbid medical disorders
- They assessed study quality using the Cochrane Collaboration tool, and quality was assessed by two authors independently
- They ran the analyses looking at outcomes on two standardised symptom questionnaires, the HAM-D and the BDI, and also looking at response (classified as a 50% reduction in the HAM-D score after treatment) and remission (a score of less than or equal to 7 on the HAM-D after treatment).
Results
- The analysis included 1,700 patients, 906 receiving medication and 794 receiving CBT. This was data from 16 of the 24 trials identified as eligible.
- They checked if there was bias in terms of which studies provided data and which did not. The trials that provided data were not significantly different to those that didn’t in terms of effect size or outcomes.
- First they ran a ‘main effect’ analysis, just looking at the difference on outcomes between pharmacotherapy and CBT, without considering differences in baseline severity:
- They found that pharmacotherapy had better outcomes compared to CBT on the HAM-D symptom scale,
- But there wasn’t any difference when it came to rates of recovery or remission,
- And only a ‘non significant trend’ on the BDI.
- They then ran the analysis looking for a moderation effect, and didn’t find one:
- This means that whether the patient had more severe depression at baseline or not, didn’t make a difference in terms of the two treatments being more or less effective
- This finding contradicts guidelines that suggest more severely depressed patients should be given pharmacotherapy rather than CBT.
- They ran sensitivity analyses that showed the results held up when lower quality studies were removed. There was also no evidence of publication bias.
Conclusion
The authors say:
While this [analysis] shows that pharmacotherapy provides minor improvement in the treatment of depression relative to CBT in terms of the continuous measures, there is no indication that differences between the modalities were moderated by the degree of baseline depression severity. Therefore, the data are insufficient to recommend antidepressant medication over CBT in outpatients based on baseline severity alone.
The authors end their paper with the suggestion that further research should explore whether other clinical or demographic factors moderate the effectiveness of the two treatments. I wonder if alternatively individual preference for one treatment over another should be prioritised, if we fail to find hard and fast rules for determining which treatments are most effective for whom. Whilst this might lead to guidelines sounding rather vague, the recommendation “pick whichever you prefer” might actually help achieve those elusive goals of “personalised care” and, based on studies such as this, it’s supported by the evidence as well.
Limitations
- This is more a general question about the usefulness of these kind of studies, rather than being a criticism of this particular study, but it’s standard in trials to parse treatments into either/or, and I wonder if in routine care it’s more common for people with severe depression to receive both medication and therapy? Should research look more at additive effects of treatments rather than trying to compare effects in isolation?
- The authors note that the findings might not generalise to other forms of therapy or to medications not used in the included trials.
Links
Primary paper
Weitz ES, Hollon SD, Twisk J, et al. (2015) Baseline Depression Severity as Moderator of Depression Outcomes Between Cognitive Behavioral Therapy vs Pharmacotherapy: An Individual Patient Data Meta-analysis. JAMA Psychiatry. Published online September 23, 2015. doi:10.1001/jamapsychiatry.2015.1516. [Abstract]
Other references
Knowles S. (2013) Moderators of outcome in late-life depression: should we be prescribing antidepressants to older people? The Mental Elf, 26 Aug 2013.
About IPD meta-analyses. Cochrane Methods IPD meta analysis website, last accessed 14 Dec 2015.
Photo credits
CBT and antidepressants for depression not moderated by baseline severity https://t.co/X8hWtuh6LG #MentalHealth https://t.co/1rPwbYxf9Z
RT iVivekMisra CBT and antidepressants for depression not moderated by baseline severity https://t.co/fGR2LfFEHg … https://t.co/uo8XHS8NtV
Sorry about that Paul. Please try this instead: http://www.nationalelfservice.net/mental-health/depression/effect-cbt-pharmacotherapy-depression-not-moderated-baseline-severity/ Cheers, André
Thanks @ian_hamilton_ Please use this instead https://t.co/HmDmgNMn5C Cheers, André
Today @dr_know IPD meta-analysis on whether baseline depression severity moderated effect of CBT or antidepressants https://t.co/HmDmgNMn5C
CBT and antidepressants for depression not moderated by baseline severity https://t.co/25YORkEb3x
@Mental_Elf In the netherlands we seem to think differently: https://t.co/rhsHoQi39C concluded cbt was effective in schizofrenia?
@AntkeAn @Mental_Elf oh dear best metaanalysis shows CBTP has little effect on psychosis symptoms in blinded studies https://t.co/azf8lVcyti
@SameiHuda @Mental_Elf I am shocked: it is in our guideline, the FACT certification asks for it and I have seen good results!?
@AntkeAn @Mental_Elf if it’s Van Gaag he is a researcher in CBT for psychosis so may be not as objective of desired 1
@AntkeAn @Mental_Elf guidelines are often influenced by interests of those who write them 2
@SameiHuda @Mental_Elf yeah, but they rated it as class 1 evidence…
@AntkeAn @Mental_Elf what can you do ? At least you know it’s not class 1 now
@SameiHuda @Mental_Elf @AntkeAn much like diagnosis itself. CBT not working? Reclassify illness so it’s no longer considered a mood disorder
@BadHousesOfBrit @Mental_Elf @AntkeAn I did see an article in schizophrenia bulletin that tried to argue schizophrenia was a mood disorder
@AntkeAn @Mental_Elf the meta analysis is group effect. May get a few people whose symptoms are helped by CBTP or it may help w other things
@SameiHuda @Mental_Elf @AntkeAn good practice is about the best solution for the client NOT pathetic pissing contests amongst camps
@stueaton73 @SameiHuda @Mental_Elf ???..
@stueaton73 @Mental_Elf @AntkeAn yes but U need evidence to know what is best. The paper doesn’t tell us about severe depression
.@sameihuda That’s really great. has anyone asked the patients how they felt, or was it only about symptoms? @antkean @mental_elf
@d_galasinski @SameiHuda @Mental_Elf we wonder if cbt might work for people with schizofrenia, or possible for which subgroups
@antkean Sure. I just dislike reducing complex experiences 2reduction o/symptoms.u know,I’m on other side of table :) @sameihuda @mental_elf
@d_galasinski @SameiHuda @Mental_Elf i want to know what works. Dont care if i need sympoms or feelings.
@d_galasinski @AntkeAn @Mental_Elf measurement outcome was symptoms
Baseline #depression severity as moderator of depression outcomes between CBT and antidepressants https://t.co/HmDmgNMn5C
“@Mental_Elf: Baseline #depression severity as moderator of depression outcomes between CBT and antidepressants https://t.co/eO1QHzPhf6”
@Mental_Elf is your server down? Can’t access it? Could be because I’m in the country with crap 3G though
@Mental_Elf Very interesting – Pet theory here – Maybe 57 types of depression – the Meds or CBT helps some -but not all. Hence the results?
New blog – does baseline depression severity moderate effect of therapy vs medication? https://t.co/L05F8180TN tl;dr No.
CBT and antidepressants for depression not moderated by baseline severity https://t.co/bDmDFSoIwN via @sharethis
Suggests guidelines which favour medication as tx for severe depression over therapy may need to be revised https://t.co/L05F8180TN
Hi main problem with study is iirc they used a threshold on HAMD and BDI to say someone was severely depressed But this is fallacious – you can’t use a rating scale cutoff to diagnose severe depression. ( if you are severely depressed you would find it very hard to complete a BDI and short forms of HAMD often used in RCTs are also bad at reliably detecting severe depression). You need to do a clinical interview and confirm a diagnosis of severe depression according to the diagnostic criteria of ICD10 or DSM4/5. This would mean pronounced psychomotor agitation or retardation, marked problems with concentration and motivation, very negative thoughts difficult to shift etc Having seen many patients with severe depression I doubt many of them would be able to take part in these RCTs or engage in psychotherapy. This study is based on RCTS of people with mild- moderate depression. So the conclusions that can be taken from this paper only apply to someone who has mild- moderate depression then the range of severity within this type of depression in terms of rating scale scores. One final point, it’s often suspected that the severity rating scores are inflated in order to get people into studies as participants – yet another reason to suspect few people with severe depression are included in the RCTs examined
Sorry for long post hope it makes sense
Sorry I meant conclusions from this paper only apply to people with mild-moderate depression, taking into account the range of severity in this group as measured by rating scale scores
CBT and antidepressants for depression not moderated by baseline severity https://t.co/XL9PrS9LHR via @theoldreader
@steven_hollon @Zia_Julia @pimcuijpers Any thoughts on our blog of your IPDMA on Baseline Depression Severity? https://t.co/HmDmgNMn5C
IPD meta analysis finds baseline depression severity did not moderate differences between CBT & antidepressants https://t.co/HmDmgNMn5C
Effectiveness of CBT and antidepressants for depression not moderated by baseline severity https://t.co/NYzET6zR8P
Don’t miss: CBT and antidepressants for depression not moderated by baseline severity https://t.co/HmDmgNMn5C
“CBT and antidepressants for depression not moderated by baseline severity” #mentalhealth https://t.co/E2uX0RVhG4
RT mattmenear “CBT and antidepressants for depression not moderated by baseline severity” #mentalhealth https://t.co/4wmDyekBmQ
[…] http://www.nationalelfservice.net/mental-health/depression/effect-cbt-pharmacotherapy-depression-not… […]