Philips IntelliSpace Cognition digital test battery: equivalence and measurement invariance compared to traditional analog test versions (2024)

Vermeent, P. C. S., Spaltman, M., van Elswijk, G., Miller, J. B., & Schmand, B. A. (2022). Philips IntelliSpace Cognition digital test battery: equivalence and measurement invariance compared to traditional analog test versions. The Clinical Neuropsychologist, 36(8), 2278-2299. https://doi.org/10.1080/13854046.2021.1974565

Vermeent, P.C.S. ; Spaltman, M. ; van Elswijk, G. et al. / Philips IntelliSpace Cognition digital test battery : equivalence and measurement invariance compared to traditional analog test versions. In: The Clinical Neuropsychologist. 2022 ; Vol. 36, No. 8. pp. 2278-2299.

@article{18d66e7032d3429684de1491eee171ac,

title = "Philips IntelliSpace Cognition digital test battery: equivalence and measurement invariance compared to traditional analog test versions",

abstract = "Objective: To collect evidence of validity for a selection of digital tests on the Philips IntelliSpace Cognition (ISC) platform.Method: A total of 200 healthy participants (age 50-80) completed both the ISC battery and an analog version of the battery during separate visits. The battery included the following screeners and cognitive tests: Mini-Mental State Examination (2nd edition), Clock Drawing Test, Trail-Making Test (TMT), Rey Auditory Verbal Learning Test (RAVLT), Rey-Osterrieth Complex Figure Test (ROCFT), Letter Fluency, Star Cancellation Test, and Digit Span Test. The ISC tests were administered on an iPad Pro and were automatically scored using designated algorithms. The analog tests were administered in line with existing guidelines and scored by trained neuropsychologists. Criterion validity was established through relative agreement coefficients and raw score equivalence tests. In addition,measurement invariance analysis was used to compare the factor structures of both versions. Finally, we explored effects of demographics and experience with digital devices on performance.Results: We found fair to excellent relative agreement between test versions. Absolute equivalence was found for RAVLT, Letter Fluency, Star Cancellation Test, and Digit Span Test. Importantly, we demonstrated equal loadings of the digital and analog test versions on the same set of underlying cognitive domains. Demographic effects were mostly comparable between modalities, and people{\textquoteright}s experience with digital devices was found to only influence performance on TMT B.Conclusions: This study provides several sources of evidence for the validity of the ISC test battery, offering an important step in validating ISC for clinical use.Supplemental data for this article is available online at https://doi.org/10.1080/13854046.2021.1974565.",

keywords = "neuropsychology, psychological tests, cognition, digital technology, automation, measurement invariance",

author = "P.C.S. Vermeent and M. Spaltman and {van Elswijk}, G. and J.B. Miller and B.A. Schmand",

note = "Funding Information: The authors would like to thank the Digital Cognitive Diagnostics team at Philips Healthcare for their invaluable work in the development of the ISC tests as well as their practical support during data collection. Publisher Copyright: {\textcopyright} 2021 Koninklijke Philips N.V. Published by Informa UK Limited, trading as Taylor & Francis Group.",

year = "2022",

doi = "10.1080/13854046.2021.1974565",

language = "English",

volume = "36",

pages = "2278--2299",

journal = "The Clinical Neuropsychologist",

issn = "1385-4046",

publisher = "Taylor and Francis Ltd.",

number = "8",

}

Vermeent, PCS, Spaltman, M, van Elswijk, G, Miller, JB & Schmand, BA 2022, 'Philips IntelliSpace Cognition digital test battery: equivalence and measurement invariance compared to traditional analog test versions', The Clinical Neuropsychologist, vol. 36, no. 8, pp. 2278-2299. https://doi.org/10.1080/13854046.2021.1974565

Philips IntelliSpace Cognition digital test battery: equivalence and measurement invariance compared to traditional analog test versions. / Vermeent, P.C.S.; Spaltman, M.; van Elswijk, G. et al.
In: The Clinical Neuropsychologist, Vol. 36, No. 8, 2022, p. 2278-2299.

Research output: Contribution to journal › Article › Academic › peer-review

TY - JOUR

T1 - Philips IntelliSpace Cognition digital test battery

T2 - equivalence and measurement invariance compared to traditional analog test versions

AU - Vermeent, P.C.S.

AU - Spaltman, M.

AU - van Elswijk, G.

AU - Miller, J.B.

AU - Schmand, B.A.

N1 - Funding Information:The authors would like to thank the Digital Cognitive Diagnostics team at Philips Healthcare for their invaluable work in the development of the ISC tests as well as their practical support during data collection.Publisher Copyright:© 2021 Koninklijke Philips N.V. Published by Informa UK Limited, trading as Taylor & Francis Group.

PY - 2022

Y1 - 2022

N2 - Objective: To collect evidence of validity for a selection of digital tests on the Philips IntelliSpace Cognition (ISC) platform.Method: A total of 200 healthy participants (age 50-80) completed both the ISC battery and an analog version of the battery during separate visits. The battery included the following screeners and cognitive tests: Mini-Mental State Examination (2nd edition), Clock Drawing Test, Trail-Making Test (TMT), Rey Auditory Verbal Learning Test (RAVLT), Rey-Osterrieth Complex Figure Test (ROCFT), Letter Fluency, Star Cancellation Test, and Digit Span Test. The ISC tests were administered on an iPad Pro and were automatically scored using designated algorithms. The analog tests were administered in line with existing guidelines and scored by trained neuropsychologists. Criterion validity was established through relative agreement coefficients and raw score equivalence tests. In addition,measurement invariance analysis was used to compare the factor structures of both versions. Finally, we explored effects of demographics and experience with digital devices on performance.Results: We found fair to excellent relative agreement between test versions. Absolute equivalence was found for RAVLT, Letter Fluency, Star Cancellation Test, and Digit Span Test. Importantly, we demonstrated equal loadings of the digital and analog test versions on the same set of underlying cognitive domains. Demographic effects were mostly comparable between modalities, and people’s experience with digital devices was found to only influence performance on TMT B.Conclusions: This study provides several sources of evidence for the validity of the ISC test battery, offering an important step in validating ISC for clinical use.Supplemental data for this article is available online at https://doi.org/10.1080/13854046.2021.1974565.

AB - Objective: To collect evidence of validity for a selection of digital tests on the Philips IntelliSpace Cognition (ISC) platform.Method: A total of 200 healthy participants (age 50-80) completed both the ISC battery and an analog version of the battery during separate visits. The battery included the following screeners and cognitive tests: Mini-Mental State Examination (2nd edition), Clock Drawing Test, Trail-Making Test (TMT), Rey Auditory Verbal Learning Test (RAVLT), Rey-Osterrieth Complex Figure Test (ROCFT), Letter Fluency, Star Cancellation Test, and Digit Span Test. The ISC tests were administered on an iPad Pro and were automatically scored using designated algorithms. The analog tests were administered in line with existing guidelines and scored by trained neuropsychologists. Criterion validity was established through relative agreement coefficients and raw score equivalence tests. In addition,measurement invariance analysis was used to compare the factor structures of both versions. Finally, we explored effects of demographics and experience with digital devices on performance.Results: We found fair to excellent relative agreement between test versions. Absolute equivalence was found for RAVLT, Letter Fluency, Star Cancellation Test, and Digit Span Test. Importantly, we demonstrated equal loadings of the digital and analog test versions on the same set of underlying cognitive domains. Demographic effects were mostly comparable between modalities, and people’s experience with digital devices was found to only influence performance on TMT B.Conclusions: This study provides several sources of evidence for the validity of the ISC test battery, offering an important step in validating ISC for clinical use.Supplemental data for this article is available online at https://doi.org/10.1080/13854046.2021.1974565.

KW - neuropsychology

KW - psychological tests

KW - cognition

KW - digital technology

KW - automation

KW - measurement invariance

UR - http://www.scopus.com/inward/record.url?scp=85115138481&partnerID=8YFLogxK

U2 - 10.1080/13854046.2021.1974565

DO - 10.1080/13854046.2021.1974565

M3 - Article

SN - 1385-4046

VL - 36

SP - 2278

EP - 2299

JO - The Clinical Neuropsychologist

JF - The Clinical Neuropsychologist

IS - 8

ER -

Vermeent PCS, Spaltman M, van Elswijk G, Miller JB, Schmand BA. Philips IntelliSpace Cognition digital test battery: equivalence and measurement invariance compared to traditional analog test versions. The Clinical Neuropsychologist. 2022;36(8):2278-2299. Epub 2021 Sept 16. doi: 10.1080/13854046.2021.1974565