The generalisability of depression trials to clinical practice
background Evidence-based therapies for major depression, as described in the clinical guidelines, are based on results from randomised controlled trials (rcts). So far, it is not known to what extent results of rcts on major depression can be generalised to ‘real life’ clinical practice.
aim To compare treatment results for major depression from rcts (efficacy) and results from daily practice (effectiveness); furthermore, to assess to what extent eligibility criteria and (un)intended selection by recruitment procedures influences treatment outcomes in daily practice.
method In a ‘real life’ patient population (n = 1653) suffering from major depression (established by the miniplus) and assessed in routine outcome monitoring at baseline, we explored how many patients met the eligibility criteria for antidepressant and psychotherapy efficacy trials. Furthermore we explored to what extent rct participants differed in socio-demographic and socio-economic status from ‘daily practice’ patients. 626 of the rom patients had at least one follow-up assessment. In this follow-up group we compared the treatment outcome (assessed by the madrs and bdi-ii) to the results of 15 meta-analyses of rcts. We also explored to what extent patient selection based on eligibility criteria and socio-demographic/socio-economic status influenced treatment outcome.
results Remission percentages (21-27% in rom versus 34-58% in rcts) and effect sizes (0.85 in rom versus 1.71 in rcts, within-group data) were lower in daily practice than in rcts. rom patients differed from rct participants in many disease-specific and socio-economic features. These differences are due to patient selection in rcts. However, the influence of patient selection based on eligibility criteria and socio-demographic differences in treatment outcome were very modest (explained variances 1-11%).
conclusion Treatment success for major depression is lower in daily practice than in rcts and ‘real life’ patients differ in many features from rct participants. However, these differences cannot explain the difference between efficacy and effectiveness. The generalisability of the results of depression trials to daily practice might not be jeopardised by the use of eligibility criteria and recruitment procedures to the extent suggested in earlier research.