Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence

Karlijn S.F.M. Hermans; Olivia J. Kirtley; Zuzana Kasanova; Robin Achterhof; Noëmi Hagemann; Anu P. Hiekkaranta; Aleksandra Lecei; Leonardo Zapata-Fonseca; Ginette Lafit; Ruben Fossion; Tom Froese; Inez Myin-Germeys

doi:10.1177/10731911221083613

Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence

Karlijn S.F.M. Hermans, Olivia J. Kirtley, Zuzana Kasanova, Robin Achterhof, Noëmi Hagemann, Anu P. Hiekkaranta, Aleksandra Lecei, Leonardo Zapata-Fonseca, Ginette Lafit, Ruben Fossion, Tom Froese, Inez Myin-Germeys^*

^*Corresponding author for this work

Developmental Neuroscience in Society

Research output: Contribution to journal › Article › Academic › peer-review

115 Downloads (Pure)

Abstract

The Perceptual Crossing Experiment (PCE) captures the capacity for social contingency detection using real-time social interaction dynamics but has not been externally validated. We tested ecological and convergent validity of the PCE in a sample of 208 adolescents from the general population, aged 11 to 19 years. We expected associations between PCE performance and (a) quantity and quality of social interaction in daily life, using Experience Sampling Methodology (ESM; ecological validity) and (b) self-reported social skills using a questionnaire (convergent validity). We also expected PCE performance to better explain variance in ESM social measures than self-reported social skills. Multilevel analyses showed that only self-reported social skills were positively associated with social experience of company in daily life. These initial results do not support ecological and convergent validity of the PCE. However, fueled by novel insights regarding the complexity of capturing social dynamics, we identified promising methodological advances for future validation efforts.

Original language	English
Pages (from-to)	1109-1124
Number of pages	16
Journal	Assessment
Volume	30
Issue number	4
Early online date	2 Apr 2022
DOIs	https://doi.org/10.1177/10731911221083613
Publication status	Published - 2 Apr 2022

Bibliographical note

Funding Information:
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the FWO Odysseus grant to I.M.-G. (G0F8416N), which includes the PhD studentship of K.S.F.M.H. O.J.K. is supported by a senior postdoctoral fellowship from Research Foundation Flanders (FWO: 1257821N). Z.K. was supported by the European Union’s Horizon 2020 research and innovation program under grant agreement no. 777084. R.F. and L.Z.-F. acknowledge financial support from the Universidad Nacional Autónoma de México (UNAM) through the DGAPA-PAPIIT project IA102619. L.Z.-F. is grateful for the scholarship 638215 granted by the CONACyT and a scholarship in the program Research Grants-Bi-nationally Supervised Doctoral Degrees, 2019/20 granted by the German Academic Exchange Service (DAAD, Deutscher Akademischer Austauschdienst).

Publisher Copyright: © The Author(s) 2022.

Access to Document

10.1177/10731911221083613

10731911221083613Final published version, 339 KBLicence: Article 25fa Dutch Copyright Act

Cite this

Hermans, K. S. F. M., Kirtley, O. J., Kasanova, Z., Achterhof, R., Hagemann, N., Hiekkaranta, A. P., Lecei, A., Zapata-Fonseca, L., Lafit, G., Fossion, R., Froese, T., & Myin-Germeys, I. (2022). Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence. Assessment, 30(4), 1109-1124. https://doi.org/10.1177/10731911221083613

@article{85d485a815ba4abaac72bb9a4fea1815,

title = "Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence",

abstract = "The Perceptual Crossing Experiment (PCE) captures the capacity for social contingency detection using real-time social interaction dynamics but has not been externally validated. We tested ecological and convergent validity of the PCE in a sample of 208 adolescents from the general population, aged 11 to 19 years. We expected associations between PCE performance and (a) quantity and quality of social interaction in daily life, using Experience Sampling Methodology (ESM; ecological validity) and (b) self-reported social skills using a questionnaire (convergent validity). We also expected PCE performance to better explain variance in ESM social measures than self-reported social skills. Multilevel analyses showed that only self-reported social skills were positively associated with social experience of company in daily life. These initial results do not support ecological and convergent validity of the PCE. However, fueled by novel insights regarding the complexity of capturing social dynamics, we identified promising methodological advances for future validation efforts.",

author = "Hermans, {Karlijn S.F.M.} and Kirtley, {Olivia J.} and Zuzana Kasanova and Robin Achterhof and No{\"e}mi Hagemann and Hiekkaranta, {Anu P.} and Aleksandra Lecei and Leonardo Zapata-Fonseca and Ginette Lafit and Ruben Fossion and Tom Froese and Inez Myin-Germeys",

note = "Funding Information: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the FWO Odysseus grant to I.M.-G. (G0F8416N), which includes the PhD studentship of K.S.F.M.H. O.J.K. is supported by a senior postdoctoral fellowship from Research Foundation Flanders (FWO: 1257821N). Z.K. was supported by the European Union{\textquoteright}s Horizon 2020 research and innovation program under grant agreement no. 777084. R.F. and L.Z.-F. acknowledge financial support from the Universidad Nacional Aut{\'o}noma de M{\'e}xico (UNAM) through the DGAPA-PAPIIT project IA102619. L.Z.-F. is grateful for the scholarship 638215 granted by the CONACyT and a scholarship in the program Research Grants-Bi-nationally Supervised Doctoral Degrees, 2019/20 granted by the German Academic Exchange Service (DAAD, Deutscher Akademischer Austauschdienst). Publisher Copyright: {\textcopyright} The Author(s) 2022.",

year = "2022",

month = apr,

day = "2",

doi = "10.1177/10731911221083613",

language = "English",

volume = "30",

pages = "1109--1124",

journal = "Assessment",

issn = "1073-1911",

publisher = "SAGE Publications",

number = "4",

}

Hermans, KSFM, Kirtley, OJ, Kasanova, Z, Achterhof, R, Hagemann, N, Hiekkaranta, AP, Lecei, A, Zapata-Fonseca, L, Lafit, G, Fossion, R, Froese, T & Myin-Germeys, I 2022, 'Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence', Assessment, vol. 30, no. 4, pp. 1109-1124. https://doi.org/10.1177/10731911221083613

Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence. / Hermans, Karlijn S.F.M.; Kirtley, Olivia J.; Kasanova, Zuzana et al.
In: Assessment, Vol. 30, No. 4, 02.04.2022, p. 1109-1124.

Research output: Contribution to journal › Article › Academic › peer-review

TY - JOUR

T1 - Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence

AU - Hermans, Karlijn S.F.M.

AU - Kirtley, Olivia J.

AU - Kasanova, Zuzana

AU - Achterhof, Robin

AU - Hagemann, Noëmi

AU - Hiekkaranta, Anu P.

AU - Lecei, Aleksandra

AU - Zapata-Fonseca, Leonardo

AU - Lafit, Ginette

AU - Fossion, Ruben

AU - Froese, Tom

AU - Myin-Germeys, Inez

N1 - Funding Information: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the FWO Odysseus grant to I.M.-G. (G0F8416N), which includes the PhD studentship of K.S.F.M.H. O.J.K. is supported by a senior postdoctoral fellowship from Research Foundation Flanders (FWO: 1257821N). Z.K. was supported by the European Union’s Horizon 2020 research and innovation program under grant agreement no. 777084. R.F. and L.Z.-F. acknowledge financial support from the Universidad Nacional Autónoma de México (UNAM) through the DGAPA-PAPIIT project IA102619. L.Z.-F. is grateful for the scholarship 638215 granted by the CONACyT and a scholarship in the program Research Grants-Bi-nationally Supervised Doctoral Degrees, 2019/20 granted by the German Academic Exchange Service (DAAD, Deutscher Akademischer Austauschdienst). Publisher Copyright: © The Author(s) 2022.

PY - 2022/4/2

Y1 - 2022/4/2

N2 - The Perceptual Crossing Experiment (PCE) captures the capacity for social contingency detection using real-time social interaction dynamics but has not been externally validated. We tested ecological and convergent validity of the PCE in a sample of 208 adolescents from the general population, aged 11 to 19 years. We expected associations between PCE performance and (a) quantity and quality of social interaction in daily life, using Experience Sampling Methodology (ESM; ecological validity) and (b) self-reported social skills using a questionnaire (convergent validity). We also expected PCE performance to better explain variance in ESM social measures than self-reported social skills. Multilevel analyses showed that only self-reported social skills were positively associated with social experience of company in daily life. These initial results do not support ecological and convergent validity of the PCE. However, fueled by novel insights regarding the complexity of capturing social dynamics, we identified promising methodological advances for future validation efforts.

AB - The Perceptual Crossing Experiment (PCE) captures the capacity for social contingency detection using real-time social interaction dynamics but has not been externally validated. We tested ecological and convergent validity of the PCE in a sample of 208 adolescents from the general population, aged 11 to 19 years. We expected associations between PCE performance and (a) quantity and quality of social interaction in daily life, using Experience Sampling Methodology (ESM; ecological validity) and (b) self-reported social skills using a questionnaire (convergent validity). We also expected PCE performance to better explain variance in ESM social measures than self-reported social skills. Multilevel analyses showed that only self-reported social skills were positively associated with social experience of company in daily life. These initial results do not support ecological and convergent validity of the PCE. However, fueled by novel insights regarding the complexity of capturing social dynamics, we identified promising methodological advances for future validation efforts.

UR - http://www.scopus.com/inward/record.url?scp=85129161914&partnerID=8YFLogxK

U2 - 10.1177/10731911221083613

DO - 10.1177/10731911221083613

M3 - Article

C2 - 35373600

AN - SCOPUS:85129161914

SN - 1073-1911

VL - 30

SP - 1109

EP - 1124

JO - Assessment

JF - Assessment

IS - 4

ER -

Ecological and convergent validity of experimentally and dynamically assessed capacity for social contingency detection using the perceptual crossing experiment in adolescence

Abstract

Bibliographical note

Access to Document

Other files and links

Fingerprint