{"id":635592,"date":"2025-01-13T17:57:19","date_gmt":"2025-01-13T22:57:19","guid":{"rendered":"https:\/\/www.rochester.edu\/newscenter\/?p=635592"},"modified":"2025-11-19T15:27:26","modified_gmt":"2025-11-19T20:27:26","slug":"how-does-the-brain-cut-through-noise-to-understand-speech-635592","status":"publish","type":"post","link":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/","title":{"rendered":"How does the brain cut through noise to understand speech?"},"content":{"rendered":"

Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.<\/strong><\/h2>\n

In a loud, crowded room, how does the human brain use visual speech cues to augment muddled audio and help the listener better understand what a speaker is saying? While most people know intuitively to look at a speaker\u2019s lip movements and gestures to help fill in the gaps in speech comprehension, scientists do not yet know how that process works physiologically.<\/p>\n

\u201cYour visual cortex is at the back of your brain and your auditory cortex is on the temporal lobes,\u201d says Edmund Lalor<\/a>, an associate professor of biomedical engineering<\/a> and of neuroscience<\/a> at the University of Rochester<\/a>. \u201cHow that information merges together in the brain is not very well understood.\u201d<\/p>\n

Scientists have been chipping away at the problem, using noninvasive electroencephalography (EEG) brainwave measurements to study how people respond to basic sounds such as beeps, clicks, or simple syllables. Lalor and his team of researchers have made progress<\/a> by exploring how the specific shape of the articulators\u2014such as the lips and the tongue against the teeth\u2014help a listener determine whether somebody is saying \u201cF\u201d or \u201cS,\u201d or \u201cP\u201d or \u201cD,\u201d which in a noisy environment can sound similar.<\/p>\n

Now Lalor wants to take the research a step further and explore the problem in more naturalistic, continuous, multisensory speech. The National Institutes of Health (NIH) is providing him an estimated $2.3 million<\/a> over the next five years to pursue that research. The project builds on a previous NIH R01 grant<\/a> and was originally started by seed funding from the University\u2019s Del Monte Institute for Neuroscience<\/a>.<\/p>\n

To study the phenomena, Lalor\u2019s team will monitor the brainwaves of people for whom the auditory system is especially noisy\u2014people who are deaf or hard of hearing and who use cochlear implants. The researchers aim to recruit 250 participants with cochlear implants, who will be asked to watch and listen to multisensory speech while wearing EEG caps that will measure their brain responses.<\/p>\n

\"Close
TAKE IT FROM THE TOP:<\/strong> An electroencephalography (EEG) cap, which measures the electrical activity of the brain through the scalp, collects a mixture of signals coming from many different sources. (University of Rochester photo \/ J. Adam Fenster)<\/figcaption><\/figure>\n

\u201cThe big idea is that if people get cochlear implants implanted at age one, while maybe they\u2019ve missed out on a year of auditory input, perhaps their audio system will still wire up in a way that is fairly similar to a hearing individual,\u201d says Lalor. \u201cHowever, people who get implanted later, say at age 12, have missed out on critical periods of development for their auditory system. As such, we hypothesize that they may use visual information they get from a speaker\u2019s face differently or more, in some sense, because they need to rely on it more heavily to fill in information.\u201d<\/p>\n

Lalor is partnering on the study with co-principal investigator Professor Matthew Dye, who directs Rochester Institute of Technology\u2019s doctoral program in cognitive science and the National Technical Institute for the Deaf Sensory, Perceptual, and Cognitive Ecology Center, and also serves as an adjunct faculty member at the University of Rochester Medical Center<\/a>.<\/p>\n

Lalor says one of the biggest challenges is that the EEG cap, which measures the electrical activity of the brain through the scalp, collects a mixture of signals coming from many different sources. Measuring EEG signals in individuals with cochlear implants further complicates the process because the implants also generate electrical activity that further obscures EEG readings.<\/p>\n

\u201cIt will require some heavy lifting on the engineering side, but we have great students here at Rochester who can help us use signal processing, engineering analysis, and computational modeling to examine these data in a different way that makes it feasible for us to use,\u201d says Lalor.<\/p>\n

Ultimately, the team hopes that better understanding how the brain processes audiovisual information will lead to better technology to help people who are deaf or hard of hearing.<\/p>\n","protected":false},"excerpt":{"rendered":"

Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.<\/p>\n","protected":false},"author":1242,"featured_media":635782,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[116],"tags":[39482,18742,18632,9186],"class_list":["post-635592","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sci-tech","tag-del-monte-institute-for-neuroscience","tag-department-of-biomedical-engineering","tag-hajim-school-of-engineering-and-applied-sciences","tag-research-funding"],"acf":[],"yoast_head":"\nHow does the brain cut through noise to understand speech?<\/title>\n<meta name=\"description\" content=\"University of Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How does the brain cut through noise to understand speech?\" \/>\n<meta property=\"og:description\" content=\"University of Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/\" \/>\n<meta property=\"og:site_name\" content=\"News Center\" \/>\n<meta property=\"article:published_time\" content=\"2025-01-13T22:57:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-11-19T20:27:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2025\/01\/fea-audio-visual-speech-encoding-1200x630.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Luke Auburn\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Luke Auburn\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/\"},\"author\":{\"name\":\"Luke Auburn\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/e928dc2863b53a89ece6d40c7992a4e1\"},\"headline\":\"How does the brain cut through noise to understand speech?\",\"datePublished\":\"2025-01-13T22:57:19+00:00\",\"dateModified\":\"2025-11-19T20:27:26+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/\"},\"wordCount\":683,\"image\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/fea-audio-visual-speech-encoding.jpg\",\"keywords\":[\"Del Monte Institute for Neuroscience\",\"Department of Biomedical Engineering\",\"Hajim School of Engineering and Applied Sciences\",\"research funding\"],\"articleSection\":[\"Science & Technology\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/\",\"name\":\"How does the brain cut through noise to understand speech?\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/fea-audio-visual-speech-encoding.jpg\",\"datePublished\":\"2025-01-13T22:57:19+00:00\",\"dateModified\":\"2025-11-19T20:27:26+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/e928dc2863b53a89ece6d40c7992a4e1\"},\"description\":\"University of Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/fea-audio-visual-speech-encoding.jpg\",\"contentUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/fea-audio-visual-speech-encoding.jpg\",\"width\":2000,\"height\":1200,\"caption\":\"SURROUND SOUND: \u201cYour visual cortex is at the back of your brain and your auditory cortex is on the temporal lobes,\u201d says University of Rochester researcher Edmund Lalor. \u201cHow that information merges together in the brain is not very well understood.\u201d (Getty Images photo)\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How does the brain cut through noise to understand speech?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#website\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/\",\"name\":\"News Center\",\"description\":\"University of Rochester\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/e928dc2863b53a89ece6d40c7992a4e1\",\"name\":\"Luke Auburn\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/author\\\/lauburn\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How does the brain cut through noise to understand speech?","description":"University of Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/","og_locale":"en_US","og_type":"article","og_title":"How does the brain cut through noise to understand speech?","og_description":"University of Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.","og_url":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/","og_site_name":"News Center","article_published_time":"2025-01-13T22:57:19+00:00","article_modified_time":"2025-11-19T20:27:26+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2025\/01\/fea-audio-visual-speech-encoding-1200x630.jpg","type":"image\/jpeg"}],"author":"Luke Auburn","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Luke Auburn","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/#article","isPartOf":{"@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/"},"author":{"name":"Luke Auburn","@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/e928dc2863b53a89ece6d40c7992a4e1"},"headline":"How does the brain cut through noise to understand speech?","datePublished":"2025-01-13T22:57:19+00:00","dateModified":"2025-11-19T20:27:26+00:00","mainEntityOfPage":{"@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/"},"wordCount":683,"image":{"@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2025\/01\/fea-audio-visual-speech-encoding.jpg","keywords":["Del Monte Institute for Neuroscience","Department of Biomedical Engineering","Hajim School of Engineering and Applied Sciences","research funding"],"articleSection":["Science & Technology"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/","url":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/","name":"How does the brain cut through noise to understand speech?","isPartOf":{"@id":"https:\/\/www.rochester.edu\/newscenter\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/#primaryimage"},"image":{"@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2025\/01\/fea-audio-visual-speech-encoding.jpg","datePublished":"2025-01-13T22:57:19+00:00","dateModified":"2025-11-19T20:27:26+00:00","author":{"@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/e928dc2863b53a89ece6d40c7992a4e1"},"description":"University of Rochester researchers investigate how visual cues enhance the brain\u2019s ability to understand speech in noisy environments.","breadcrumb":{"@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/#primaryimage","url":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2025\/01\/fea-audio-visual-speech-encoding.jpg","contentUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2025\/01\/fea-audio-visual-speech-encoding.jpg","width":2000,"height":1200,"caption":"SURROUND SOUND: \u201cYour visual cortex is at the back of your brain and your auditory cortex is on the temporal lobes,\u201d says University of Rochester researcher Edmund Lalor. \u201cHow that information merges together in the brain is not very well understood.\u201d (Getty Images photo)"},{"@type":"BreadcrumbList","@id":"https:\/\/www.rochester.edu\/newscenter\/how-does-the-brain-cut-through-noise-to-understand-speech-635592\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.rochester.edu\/newscenter\/"},{"@type":"ListItem","position":2,"name":"How does the brain cut through noise to understand speech?"}]},{"@type":"WebSite","@id":"https:\/\/www.rochester.edu\/newscenter\/#website","url":"https:\/\/www.rochester.edu\/newscenter\/","name":"News Center","description":"University of Rochester","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.rochester.edu\/newscenter\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/e928dc2863b53a89ece6d40c7992a4e1","name":"Luke Auburn","url":"https:\/\/www.rochester.edu\/newscenter\/author\/lauburn\/"}]}},"_links":{"self":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/635592","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/users\/1242"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/comments?post=635592"}],"version-history":[{"count":4,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/635592\/revisions"}],"predecessor-version":[{"id":635762,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/635592\/revisions\/635762"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/media\/635782"}],"wp:attachment":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/media?parent=635592"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/categories?post=635592"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/tags?post=635592"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}