As many as one in five people may demonstrate signs of a synaesthesia-like phenomenon in which they hear silent flashes or movement, a new study from City, University of London indicates. Although the effect is barely known to science, the researchers found that this ‘visually-evoked auditory response’ (vEAR) is far more common than other types of synaesthesia - such when certain sounds elicit a specific colour - with flashing lights and motion evoking vivid sounds.
The survival of this association may also explain other links between sound and vision, such as why we like to listen to music synchronised with flashing lights or dance.
The effect also provides a good way to learn about what’s happening in the brain in people with synaesthesia, with vEAR’s high prevalence making it easier to investigate the mechanisms behind such cross-sensory perception.
Visually-evoked Auditory Response
While other typical synaesthesias are estimated to have an overall prevalence of 4.4 per cent, the vEAR effect has recently gained some prominence on social media following the rise of ‘noisy GIFs’, and in particular the ‘thudding pylon’ GIF which received thousands of retweets.
Its prevalence may be greater than other types because auditory and visual events are much more highly correlated in nature when compared to other types of synaesthesia associated with colour and visual forms.
To further investigate the prevalence of the phenomenon, the researchers carried out the first large-scale online study of this barely-known effect, and recruited 4,128 participants to answer a survey, with 1,058 of these also answering additional trait-related questions.
The survey included 24 silent video clips which depicted meaningful versus abstract subjects engagement in slow, fast, smooth or sudden movements. This included a ballet dancer performing a pirouette and a hammer hitting a nail.
The survey also included additional multiple choice questions asking about demographics, experience of vEAR and other traits.
As well as noting the significantly higher prevalence of the vEAR, with 21% of the 4,128 completing respondents saying that they had previously experienced vEAR, the researchers also found that even meaningless abstract visual stimuli can evoke vivid sounds.
It was seen that correspondents who had answered ‘yes’ to experiencing vEAR were specifically sensitive to the pure motion energy present in videos such as swirling or patterns that were not predictive of sounds. The researchers also saw that vEAR was associated with phenomena such as tinnitus and also musical imagery.
This suggests that physiological factors such as raised cortical excitability in the brain might jointly explain these phenomena.
“Some people hear what they see. Car indicator lights, flashing neon shop signs, and people’s movements as they walk may all trigger an auditory sensation. Ours is the first large-scale survey of this ability. We found that as many as 21% of people may experience forms of this phenomenon, which makes it considerably more prevalent than other synaesthesias.
We think that these sensations may sometimes reflect leakage of information from visual parts of the brain into areas that are more usually devoted to hearing. In extreme forms of this crosstalk, any abstract visual motion or flashing may be sufficient to trigger the sensation of hearing sounds,"
said Dr Elliot Freeman, author of the study and a Senior Lecturer in Psychology at City, University of London.
Christopher J. Fassnidge, Elliot D.Freeman Sounds from seeing silent motion: Who hears them, and what looks loudest? Cortex https://doi.org/10.1016/j.cortex.2018.02.019