TY - JOUR
T1 - Validity of data as precondition for evidence
T2 - a methodological analysis of what is taken to count as evidence in psychotherapy research
AU - Truijens, Femke
AU - De Smet, Melissa Miléna
AU - Desmet, Mattias
AU - Meganck, Reitske
N1 - Publisher Copyright:
© 2021 by Johns Hopkins University Press.
PY - 2021/6
Y1 - 2021/6
N2 - The evidence-based paradigm in mental health care emphasizes the use of the best available methods to provide a sound evidence-base for clinical practice. However, there is strikingly little consensus on what evidence is. Nonetheless, psychotherapy re-searchers conduct a vast amount of research in which the outcome is taken as evidence. To derive outcome, quantitative data are collected from samples of patient– participants by means of validated self-report measures. Clinical case vignettes from the Ghent Psychotherapy Study (Meganck et al., 2017) are used to exhibit that quantitative self-report data are hermeneutic in their basis. Although quantitative data are generally taken as straightforwardly comparable and trustworthy input for analysis of treatment effect, we show that these data can yield validity issues despite being collected by validated measures. As the gold standard methodological procedure does not prevent that these validity issues become inherent to the dataset, validity issues on the level of individual data collection form a threat to evidence on treatment effect. Therefore, we argue that validity of data is a precondition for evidence. For a sound psychotherapeutic evidence-base we need a proper definition of validity that is sensitive to actual data collection processes, and a theory of evidence that is clear on what should be evidenced to be useful and valid for psychological practice.
AB - The evidence-based paradigm in mental health care emphasizes the use of the best available methods to provide a sound evidence-base for clinical practice. However, there is strikingly little consensus on what evidence is. Nonetheless, psychotherapy re-searchers conduct a vast amount of research in which the outcome is taken as evidence. To derive outcome, quantitative data are collected from samples of patient– participants by means of validated self-report measures. Clinical case vignettes from the Ghent Psychotherapy Study (Meganck et al., 2017) are used to exhibit that quantitative self-report data are hermeneutic in their basis. Although quantitative data are generally taken as straightforwardly comparable and trustworthy input for analysis of treatment effect, we show that these data can yield validity issues despite being collected by validated measures. As the gold standard methodological procedure does not prevent that these validity issues become inherent to the dataset, validity issues on the level of individual data collection form a threat to evidence on treatment effect. Therefore, we argue that validity of data is a precondition for evidence. For a sound psychotherapeutic evidence-base we need a proper definition of validity that is sensitive to actual data collection processes, and a theory of evidence that is clear on what should be evidenced to be useful and valid for psychological practice.
UR - http://www.scopus.com/inward/record.url?scp=85108782380&partnerID=8YFLogxK
U2 - 10.1353/ppp.2021.0018
DO - 10.1353/ppp.2021.0018
M3 - Article
AN - SCOPUS:85108782380
SN - 1071-6076
VL - 28
SP - 115
EP - 128
JO - Philosophy, Psychiatry and Psychology
JF - Philosophy, Psychiatry and Psychology
IS - 2
ER -