Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment

Pedro J. Rosa; Pedro Gamito; Jorge Oliveira; Diogo Morais; Matthew Pavlovic; Olivia Smyth

doi:10.1145/2838944.2838977

Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment

Pedro J. Rosa, Pedro Gamito, Jorge Oliveira, Diogo Morais, Matthew Pavlovic, Olivia Smyth

University of Michigan, Ann Arbor

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

12 Citations (Scopus)

Abstract

Attention and working memory are essential aspects of human cognitive abilities. When these capacities are impaired, virtual reality applications (VRAs) can be a tool to assess and rehabilitate. However, most VRAs use indirect manual reaction time measures to make inferences about visual attention processes. Since behavioral measures are quite indirect, eye tracking (ET) can offer a better alternative to probe more directly where and how attention is deployed. We propose two tasks with different levels of perceptual complexity for assessing visual attention and performance. Two comparative visual search tasks, as part of a set of cognitive tasks in the Systemic Lisbon Battery (SLB), a VRA designed to assess of cognitive impairments, were randomly presented to 39 healthy participants while the eye movements were continuously recorded. The total fixation duration, the number of visits in the areas of interest, along with the total execution time changed as a function of the overall score of cognitive ability. The present study demonstrates that the "spot the differences" tasks in SLB, combined with ET, are a reliable, sensitive and unobtrusive method to assess cognitive abilities in healthy individuals with a relevant potential use in clinical samples.

Original language	English
Title of host publication	Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015
Editors	Daniyal M. Alghazzawi, Habib M. Fardoun, Victor M. Ruiz Penichet, Pedro Gamito
Publisher	Association for Computing Machinery
Pages	135-138
Number of pages	4
ISBN (Electronic)	9781450338981
DOIs	https://doi.org/10.1145/2838944.2838977
Publication status	Published - 1 Oct 2015
Event	3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015 - Lisbon, Portugal Duration: 1 Oct 2015 → 2 Oct 2015

Publication series

Name	ACM International Conference Proceeding Series
Volume	01-02-October-2015

Conference

Conference	3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015
Country/Territory	Portugal
City	Lisbon
Period	1/10/15 → 2/10/15

Bibliographical note

Publisher Copyright:
© 2015 ACM.

Keywords

Cognitive abilities
Eye tracking
Virtual reality applications Systematic Lisbon Battery

Access to Document

10.1145/2838944.2838977

Cite this

Rosa, P. J., Gamito, P., Oliveira, J., Morais, D., Pavlovic, M., & Smyth, O. (2015). Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment. In D. M. Alghazzawi, H. M. Fardoun, V. M. R. Penichet, & P. Gamito (Eds.), Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015 (pp. 135-138). (ACM International Conference Proceeding Series; Vol. 01-02-October-2015). Association for Computing Machinery. https://doi.org/10.1145/2838944.2838977

Rosa, Pedro J. ; Gamito, Pedro ; Oliveira, Jorge et al. / Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment. Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015. editor / Daniyal M. Alghazzawi ; Habib M. Fardoun ; Victor M. Ruiz Penichet ; Pedro Gamito. Association for Computing Machinery, 2015. pp. 135-138 (ACM International Conference Proceeding Series).

@inproceedings{7c73c7eb53ed4f8998862886a9612764,

title = "Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment",

abstract = "Attention and working memory are essential aspects of human cognitive abilities. When these capacities are impaired, virtual reality applications (VRAs) can be a tool to assess and rehabilitate. However, most VRAs use indirect manual reaction time measures to make inferences about visual attention processes. Since behavioral measures are quite indirect, eye tracking (ET) can offer a better alternative to probe more directly where and how attention is deployed. We propose two tasks with different levels of perceptual complexity for assessing visual attention and performance. Two comparative visual search tasks, as part of a set of cognitive tasks in the Systemic Lisbon Battery (SLB), a VRA designed to assess of cognitive impairments, were randomly presented to 39 healthy participants while the eye movements were continuously recorded. The total fixation duration, the number of visits in the areas of interest, along with the total execution time changed as a function of the overall score of cognitive ability. The present study demonstrates that the {"}spot the differences{"} tasks in SLB, combined with ET, are a reliable, sensitive and unobtrusive method to assess cognitive abilities in healthy individuals with a relevant potential use in clinical samples.",

keywords = "Cognitive abilities, Eye tracking, Virtual reality applications Systematic Lisbon Battery",

author = "Rosa, {Pedro J.} and Pedro Gamito and Jorge Oliveira and Diogo Morais and Matthew Pavlovic and Olivia Smyth",

note = "Publisher Copyright: {\textcopyright} 2015 ACM.; 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015 ; Conference date: 01-10-2015 Through 02-10-2015",

year = "2015",

month = oct,

day = "1",

doi = "10.1145/2838944.2838977",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

pages = "135--138",

editor = "Alghazzawi, {Daniyal M.} and Fardoun, {Habib M.} and Penichet, {Victor M. Ruiz} and Pedro Gamito",

booktitle = "Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015",

address = "United States",

}

Rosa, PJ , Gamito, P , Oliveira, J , Morais, D, Pavlovic, M & Smyth, O 2015, Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment. in DM Alghazzawi, HM Fardoun, VMR Penichet & P Gamito (eds), Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015. ACM International Conference Proceeding Series, vol. 01-02-October-2015, Association for Computing Machinery, pp. 135-138, 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015, Lisbon, Portugal, 1/10/15. https://doi.org/10.1145/2838944.2838977

Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment. / Rosa, Pedro J.; Gamito, Pedro ; Oliveira, Jorge et al.
Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015. ed. / Daniyal M. Alghazzawi; Habib M. Fardoun; Victor M. Ruiz Penichet; Pedro Gamito. Association for Computing Machinery, 2015. p. 135-138 (ACM International Conference Proceeding Series; Vol. 01-02-October-2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment

AU - Rosa, Pedro J.

AU - Gamito, Pedro

AU - Oliveira, Jorge

AU - Morais, Diogo

AU - Pavlovic, Matthew

AU - Smyth, Olivia

PY - 2015/10/1

Y1 - 2015/10/1

N2 - Attention and working memory are essential aspects of human cognitive abilities. When these capacities are impaired, virtual reality applications (VRAs) can be a tool to assess and rehabilitate. However, most VRAs use indirect manual reaction time measures to make inferences about visual attention processes. Since behavioral measures are quite indirect, eye tracking (ET) can offer a better alternative to probe more directly where and how attention is deployed. We propose two tasks with different levels of perceptual complexity for assessing visual attention and performance. Two comparative visual search tasks, as part of a set of cognitive tasks in the Systemic Lisbon Battery (SLB), a VRA designed to assess of cognitive impairments, were randomly presented to 39 healthy participants while the eye movements were continuously recorded. The total fixation duration, the number of visits in the areas of interest, along with the total execution time changed as a function of the overall score of cognitive ability. The present study demonstrates that the "spot the differences" tasks in SLB, combined with ET, are a reliable, sensitive and unobtrusive method to assess cognitive abilities in healthy individuals with a relevant potential use in clinical samples.

AB - Attention and working memory are essential aspects of human cognitive abilities. When these capacities are impaired, virtual reality applications (VRAs) can be a tool to assess and rehabilitate. However, most VRAs use indirect manual reaction time measures to make inferences about visual attention processes. Since behavioral measures are quite indirect, eye tracking (ET) can offer a better alternative to probe more directly where and how attention is deployed. We propose two tasks with different levels of perceptual complexity for assessing visual attention and performance. Two comparative visual search tasks, as part of a set of cognitive tasks in the Systemic Lisbon Battery (SLB), a VRA designed to assess of cognitive impairments, were randomly presented to 39 healthy participants while the eye movements were continuously recorded. The total fixation duration, the number of visits in the areas of interest, along with the total execution time changed as a function of the overall score of cognitive ability. The present study demonstrates that the "spot the differences" tasks in SLB, combined with ET, are a reliable, sensitive and unobtrusive method to assess cognitive abilities in healthy individuals with a relevant potential use in clinical samples.

KW - Cognitive abilities

KW - Eye tracking

KW - Virtual reality applications Systematic Lisbon Battery

UR - http://www.scopus.com/inward/record.url?scp=84959303585&partnerID=8YFLogxK

U2 - 10.1145/2838944.2838977

DO - 10.1145/2838944.2838977

M3 - Conference contribution

AN - SCOPUS:84959303585

T3 - ACM International Conference Proceeding Series

SP - 135

EP - 138

BT - Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015

A2 - Alghazzawi, Daniyal M.

A2 - Fardoun, Habib M.

A2 - Penichet, Victor M. Ruiz

A2 - Gamito, Pedro

PB - Association for Computing Machinery

T2 - 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015

Y2 - 1 October 2015 through 2 October 2015

ER -

Rosa PJ , Gamito P , Oliveira J , Morais D, Pavlovic M, Smyth O. Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment. In Alghazzawi DM, Fardoun HM, Penichet VMR, Gamito P, editors, Proceedings of the 3rd Workshop on ICTs for improving Patients Rehabilitation Research Techniques, REHAB 2015. Association for Computing Machinery. 2015. p. 135-138. (ACM International Conference Proceeding Series). doi: 10.1145/2838944.2838977

Show me your eyes! the combined use of eye tracking and virtual reality applications for cognitive assessment

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this