People move their eyes to determine whether they have seen an image before, and these eye movement patterns can predict mistakes in memory, scientists at the Baycrest Centre for Geriatric Care found in a recent study. The results were obtained using an innovative new eye tracking technique they developed.
“Our findings indicate that eye movements play a functional role in memory retrieval. They can tell us a lot about someone’s memory,”
says Dr. Jennifer Ryan, senior scientist at Baycrest’s Rotman Research Institute (RRI) and Canada Research Chair in Cognitive Neuroscience of Memory.
Eye Movements And Memory
The study[1] builds on previous Baycrest research examining the link between eye movements and memory, including the role of our eye movements in memorization and the weakening connection between our eye movements and our brain activity as we age.
“When we see a picture, a face or something else that we have already seen, our eyes tend to look at the same locations as they did the first time. The brain compares important characteristics of what we are seeing to a mental picture in our memory, and it identifies the two as the same. The brain is pretty good at this, even in conditions of lower visibility,”
says Dr. Bradley Buchsbaum, senior scientist at the RRI.
“If we see someone in the distance, or if their face is partially hidden by branches, our brain will compare the features that are visible to a mental picture to determine whether we know that person,”
says Jordana Wynn, lead researcher on this study, former Ph.D. student at the RRI and current fellow at Harvard University.
This phenomenon is called pattern completion. When it goes wrong, we may end up mistakenly waving to a stranger if he or she has similar hair or a similar nose to someone we know.
Old Or New?
Study participants were first asked to memorize a series of 30 new images on a screen. Next, they viewed another series, this time containing both some of the previously seen images and some new-but-similar images.
They were then asked to indicate whether they had seen each one before. Their eye movements were tracked during both stages.
Each image was shown briefly, ranging from 250 milliseconds to 750 milliseconds, before the participants were instructed to visualize it while looking at a blank screen.
Participants were highly accurate in identifying previously seen images as old, scoring almost 90%. They were more likely to be correct if their eye movements were the same as when they initially saw the image.
On the other hand, they performed less well, at 70%, when faced with a new-but-similar image. In the latter case, the more participants repeated their initial viewing pattern instead of focusing on the different aspects of the image, the more likely they were to incorrectly identify the image as old.
To emulate real-world situations where we don’t have full information, the researchers also used incomplete, or “degraded,” versions of images. This ranged from 0 to 80% degradation, in the form of grey squares covering parts of the image.
Remarkably, even when the image was 80% degraded, performance was much better than pure guessing, reflecting the strength of pattern completion.
“Using our eye tracking technique, we were able to map the participants’ eye movements and observe that they were mentally picturing an image that they could not see. They were using pattern completion.”
says Wynn.
Pattern Completion Research
Many studies have examined pattern completion over the past decades, but with one critical weakness.
“These studies have all been based on the untested assumption that we can infer pattern completion is happening when participants mistakenly ‘recognize’ images that they have not seen before,” says Wynn. “Our study is the first to use eye movement analysis, rather than behaviour, to show that people are in fact retrieving a memory of an old image when they make this mistake.”
This study’s findings have important implications in terms of assessing memory.
“Some of the traditional tests used to diagnose memory impairments are quite verbal. They often require good command of the English language, which can be a problem in a multicultural city like Toronto,”
says Dr. Ryan.
“With eye tracking, you don’t have to ask people what they remember. You can just look at their eyes. This gives us a lot more information about their memory than we thought,”
says Dr. Buchsbaum.
[1] Jordana S. Wynn, Jennifer D. Ryan, Bradley R. Buchsbaum. Eye movements support behavioral pattern completion. Proceedings of the National Academy of Sciences Mar 2020, 201917586; DOI: 10.1073/pnas.1917586117
Related Posts:
- Found: Missing Link Between Memory Loss And Tau Protein
- Memory Replay Prioritizes High-reward Memories
- Different Memory Resolutions Map Onto Different Brain Locations
Last Updated on December 7, 2022