Brain Links Facial and Vocal Cues When Reading Emotions
A new MRI study challenges the long-held view that the brain handles emotional information from faces and voices in separate systems. Participants heard and saw actors expressing emotions; audio-only clips activated face-processing areas, while video-only clips activated voice-processing areas. The findings suggest that the emotion being conveyed matters more than the sensory channel, and that the brain combines sight and sound in a more integrated way.
Researchers at Ghent University scanned 24 volunteers with MRI while they watched and/or listened to actors expressing emotions including happiness, disgust, and fear. Clips were presented as combined face-and-voice, video-only, or audio-only.
The results showed that hearing an emotion engaged areas traditionally tied to faces, while seeing one engaged areas tied to voices. Each emotion produced similar activity in both sets of regions across sensory conditions. The team concluded that emotion type, rather than input channel, shapes these responses, and that combined sight and sound involves integrated processing.
The findings could eventually inform support for people who have difficulty reading social cues, as the article notes, though no intervention was tested. Individuals with early deafness or blindness may be especially relevant because prior work suggests emotion-processing regions can adapt across senses. Assistive technologies, clinical assessments, and communication training may draw on this integrated view, but real-world benefits remain uncertain until further research confirms whether these brain patterns translate into better outcomes.