I have been procrastinating about writing this blog for a while. This is, in part, caused by hesitancy about involving myself in the CBT for psychosis (CBTp) debate.
Regular readers of the Mental Elf will be aware that in recent months Jauhar and colleagues presented results of a meta-analysis that called into question the effectiveness of CBTp (Jauhar et al, 2014).
More recently, the findings of Morrison et al’s study of CBT for un-medicated psychosis were published in The Lancet (Morrison et al, 2014). Morrison and colleagues considered the results to be an endorsement of CBTp, but their conclusions were questioned by members of the Mental Elf team (Tomlin et al, 2014).
I was first trained in CBTp as a trainee clinical psychologist. Since then, I have seen people who seem to have benefitted from CBTp and some whom it does not seem to have helped. As a jobbing clinician, working regularly with people with psychosis, I currently find myself in a bit of a quandary. The evidence for CBTp is contested and debated yet recently updated NICE and SIGN guidelines continue to recommend its use. I had hoped that the paper I have been asked to review might help me to think about this aspect of my clinical practice since it seeks to explore service user perspectives on their experiences of individual CBTp, an extremely important group of stakeholders.
Methods
A systematic review of the qualitative literature (Wood et al, 2013) was conducted using “thematic synthesis”. This is a recognised method of synthesising qualitative research. Appropriate inclusion and exclusion criteria appear to have been used, along with appropriate search terms to find the research. Six studies were further analysed and the quality of studies was assessed. Complete results sections from the 6 papers were considered to be data.
A three stage process was used to synthesise the data:
- Free line-by-line coding. Codes were extracted if they were considered to represent service user perspective of CBTp
- Codes were translated across studies and grouped together so that “descriptive themes” were developed
- Codes were collapsed to develop “analytical” themes
Results
Three overarching analytical themes emerged from the analysis:
- Therapeutic Alliance: This theme emerged from five of the six studies included. The therapeutic relationship was considered to be an important part of CBTp. Service users also described the key components that a therapist required for therapy to be successful. Key characteristics appear to be warmth, genuineness, informality and other similar interpersonal characteristics.
- Facilitating Change: All studies included in the review seemed to suggest that individual CBTp facilitated change for people who experience psychosis. It was considered that CBT techniques were the change mechanisms and that CBTp seems to help with recovery from psychosis by changing the meaning of psychotic experiences for service users.
- Challenges of applying CBTp: The studies reviewed seemed to suggest that service users may find it difficult to adjust to the CBTp model and that aspects of it are emotionally and cognitively challenging. Therapy seems to be most difficult in inpatient settings or when service users have been detained. Disclosing personal difficulties also appears to have been difficult for many service users but these challenges can be overcome.
Discussion
The authors suggested that their paper builds on a previous thematic synthesis of service user experiences of CBTp.
They suggest that the emphasis service users place on the therapeutic alliance may support formal assessment of therapeutic alliance using self-report measures. “True collaboration” is emphasised by the authors.
The authors propose that the theme of facilitating change suggests that there is agreement between service users and CBTp clinicians about the active components of therapy:
These findings support the use of well explained and clearly outlined applications of change mechanisms in CBTp.
The theme “challenges of applying CBTp”, highlighted that a number of demands made of service users that CBTp therapists should be aware of. The authors suggest that adaptations should be made to mitigate the effect of these demands.
Limitations and Strengths
In my view, a key limitation of this review pertains to generalisability. In many qualitative traditions, small sample sizes are sought and an ideographic approach is used. Generalising from such small samples is explicitly discouraged in approaches such as interpretive phenomenological analysis (IPA). Synthesising data in the way in which the authors have, seems to imply that pooling of the data enables generalisability to a wider population. I am not sure that it does. Fifty-five service users contributed to the systematic review and there is likely to have been some kind of selection bias. Although the results are interesting I think it is important that they are treated with a degree of caution.
In addition, many qualitative approaches encourage the use of reflexive inquiry. That is, some kind of awareness of the researchers’ contribution of meaning to the research process. I think a reflexive account would have been most helpful in the present study as the authors (in my view) are not disinterested observers of the data; they are vocal proponents of CBTp. It is difficult to see how this stance could not have influenced their interpretation of the data.
A final limitation concerns transparency. It was difficult to determine how the studies were included in the review. It is normal practise to present some kind of flow diagram detailing the stage at which studies were excluded from the analysis and the reason why. This was absent from the review. Similarly, there was very little information about the quality ratings assigned to the papers and a very brief description about the synthesis process. The review would have been strengthened by greater transparency.
The authors highlight the greatest strength of the paper: that it explores service user experiences of CBTp. I agree that this is incredibly helpful information but I think that some caution needs to be exercised until similar qualitative studies are conducted with participants who have not benefitted from CBT.
I remain in my quandary about CBTp.
Links
Wood L, Burke E, Morrison A. Individual Cognitive Behavioural Therapy for Psychosis (CBTp): A Systematic Review of Qualitative Literature. Behav Cogn Psychother. 2013 Dec 5:1-13. [Epub ahead of print] [PubMed abstract]
Jauhar S, McKenna PJ, Radua J, Fung E, Salvador R, Laws KR. Cognitive-behavioural therapy for the symptoms of schizophrenia: systematic review and meta-analysis with examination of potential bias. Br J Psychiatry. 2014 Jan;204(1):20-9. doi: 10.1192/bjp.bp.112.116285. [PubMed abstract]
Morrison, AP. et al Cognitive therapy for people with schizophrenia spectrum disorders not taking antipsychotic drugs: a single-blind randomised controlled trial (PDF). The Lancet, Published online February 6, 2014 http://dx.doi.org/10.1016/S0140-6736(13)62246-1/ [Commentary PDF]
Tomlin A, Badenoch D. Pilot study suggests that CBT may be a viable alternative to antipsychotics for people with schizophrenia, or does it? Mental Elf, 6 Feb 2014.
@Mental_Elf excellent and balanced blog on CBTp by Joe Judge.
Service user perspectives on individual CBT for psychosis: I have been procrastinating about writing this blog… http://t.co/BUgf6fXM8b
@woodylisa Please read @JoeJudgePsy’s blog about your CBTp research: http://t.co/StQWcxSEXB and let us know your thoughts
My second blog for @Mental_Elf on CBT for psychosis – http://t.co/rODjde9qfr
Fair review, but perhaps understates bias IMO RT @JoeJudgePsy My second blog for @Mental_Elf on CBT for psychosis – http://t.co/6rHfl9bTbS …
Thanks @Keith_Laws Do comment on the blog and let us know more @JoeJudgePsy http://t.co/StQWcxSEXB
@Mental_Elf @JoeJudgePsy Hope to add a a few comments later today
@Mental_Elf @JoeJudgePsy thanks for balanced review. Agee that those who don’t benefit from CBTp need asking which we are doing currently.
@woodylisa @Mental_Elf Look forward to hearing more about it. Thanks.
Mental Elf: Service user perspectives on individual CBT for psychosis http://t.co/r9Kwmrvl3B
Service user perspective on CBT for psychosis in my latest @Mental_Elf blog – http://t.co/rODjde9qfr
@JoeJudgePsy summarises a new qualitative systematic review of individual CBT for psychosis (CBTp) http://t.co/StQWcxSEXB
Just for clarity…When I said this was a ‘fair review’ – I meant fair review by @JoeJudgePsy – NOT by the authors http://t.co/6rHfl9bTbS …
I think the clue lies in the sentence “I have seen people who seem to have benefitted from CBTp and some whom it does not seem to have helped”, i.e. taking a recovery oriented person centred approach to mental health care and support demonstrates that it’s not a ‘one size fits all’ but that different people need different things at different times.
@Mental_Elf I wonder if you have any service user researchers on your team? Would be interested to know.
@TheLancetPsych @Mental_Elf Busy with clinical work today but will have a look this evening. Cheers. At 1st glance, looks v interesting.
http://t.co/sTfcuVKepc
@JoeJudgePsy remains in a quandary about CBTp. How about you? Please share your thoughts here: http://t.co/StQWcxSEXB
@shrinking81 @dr_know @StephenWood8 @henrystrick @andrewwatson28 Would love to hear your thoughts on this: http://t.co/StQWcxSEXB #CBTp
Jo – a good, fair overview of the study.
I would raise a couple points:
1) You rightly raise questions about the ‘stance’ of pro-CBT advocates and how it might bias those doing this research; and you also mention their lack of clarity of study-selection (that would make it near impossible to publish a quantitative systematic review) – both are important questions, which I think have wider resonance in CBT for psychosis research
I note, however, an important feature that you don’t mention – the fact that Morrison (one of the authors of this review) was also an author on 50% of the studies included in this qualitative review. In effect, of the tiny number of 55 patients in this systematic review, 29 come from studies conducted by one author of this systematic review i.e. Morrison.
Does this reflect the possibility that most of the research in this area is conducted by so few (mostly it seems by members of the NICE committee advocating CBT for psychosis)? The lack of sufficient study selection detail (as noted by Joe) is thus crucial in such systematic reviews
2) There is also the issue of selectivity of example quotes in such a qualitative systematic review – a quick look at one or two quotes shows how its easy to be misled by the examples. For example Wood, Burke & Morrison quote McGowan et al (2005 ) as saying “It is also important to emphasize that the picture of the experience of therapeutic contact that merged from clients’ descriptions was broadly extremely positive” While this may seem to endorse CBT in clients – it does not –this quote refers to the “non-model specific benefits of therapy” (McGowan et al) – i.e. has nothing to do with CBT
3) Finally, Jo raises an interesting issue – he says he finds himself “in a bit of a quandary” about CBT for psychosis – given the evidence that has emerged recently (perhaps because increasing amounts of negative evidence has emerged – like our own meta analysis [Jauhar et al 2014] that Joe references)…And says he continues to be in a quandary after reading this systematic review. I think the question to ask oneself here is…do I even know what amount or type of ‘negative evidence’ is required before I would consider abandoning CBT for psychosis? I suspect that most people don’t ask themselves that question, but perhaps its time they did!
Service user perspectives on individual CBT for psychosis – The Mental Elf http://t.co/NcriZfUHcX
How generalisable are the results of this qualitative SR by Wood et al to other people with psychosis? http://t.co/StQWcxSEXB
@Mental_Elf Useful review; Wood et al state aim increasing knowledge of CBTp exp., rather than definitive generalisability & limits. stated.
‘Normal Science’ in CBT for psychosis – author of systematic review responsible for 50% of included studies http://t.co/6rHfl9bTbS …
@JoeJudgePsy has added to the CBT for schizophrenia debate today with his new blog: http://t.co/StQWcxSEXB #CBTp
Great piece by @JoeJudgePsy >> “@Mental_Elf: Service user perspectives on individual CBT for psychosis http://t.co/k01O4mmxxi”
@gordonmilson @Mental_Elf Many thanks Gordon.
@JoeJudgePsy @Mental_Elf you’re welcome. Really well written and reflective.
RT @Mental_Elf: Don’t miss: Service user perspectives on individual CBT for psychosis http://t.co/StQWcxSEXB by @JoeJudgePsy
Joe. is it possible to extract the value of the Therapeutic Alliance in this analysis?
“@Mental_Elf: Don’t miss: Service user perspectives on individual CBT for psychosis http://t.co/m0zsB8bWhv by @JoeJudgePsy”< interesting
Thank you @Keith_Laws “Fair review, but perhaps understates bias IMO” RT @JoeJudgePsy blog on CBT for psychosis – http://t.co/vE6zEKPTof …
Thanks again @Keith_Laws RT ” this was a ‘fair review’–but meant fair review by @JoeJudgePsy –NOT by the authors” http://t.co/vE6zEKPTof … …
Service user perspectives on individual CBT for #Psychosis http://t.co/15lg0918N4 from @Mental_Elf
Clear, balanced and thoughtful summary of another CBT for psychosis paper, by a practicing therapist http://t.co/BjbTRHij38 via @Mental_Elf
.@dr_know @Mental_Elf Re thoughtful summary of CBT study. What is learned from 6 studies totally 55 pts, some known biases, others unknown?
@CoyneoftheRealm @Mental_Elf from his summary, exactly that – that there is still an issue with the evidence and there may have been bias.
@dr_know @Mental_Elf very kind. Thank you.
I appreciate the limitations of thi sstudy, but I think obtaining more qualitative data is so important in light of emerging and evolving person-centred approaches to recovery… People and experiences over numbers and illnesses!!