{"id":260762,"date":"2017-08-03T10:16:28","date_gmt":"2017-08-03T14:16:28","guid":{"rendered":"http:\/\/www.rochester.edu\/newscenter\/?p=260762"},"modified":"2024-10-29T14:22:57","modified_gmt":"2024-10-29T18:22:57","slug":"save-treble-automatic-music-transcription-260762","status":"publish","type":"post","link":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/","title":{"rendered":"With automatic transcription, musicians can save themselves the treble"},"content":{"rendered":"
\"retro<\/a>
Summer of Research: <\/a><\/strong>Our latest Newscenter series showcases a cross-section of summer research conducted by undergraduates at Rochester and beyond.<\/figcaption><\/figure>\n

Imagine listening to a live jazz improvisation. Moved by what you hear, you decide to try to reproduce the solo on your piano at home. To do so, you would have had to record the piece. Then you would have to listen to it over and over again, and transcribe the notes yourself.<\/p>\n

It\u2019s a painstaking process. That\u2019s one reason why Zhiyao Duan, an assistant professor of electrical and computer engineering at the Hajim School<\/a><\/strong>, his PhD student Andrea Cogliati, and David Temperley, a professor of music theory at Eastman, have been developing a computer program that could receive audio, extract data from it, and produce an accurate printed musical score.<\/p>\n

This summer they\u2019ve have two additional researchers working on the project. Two undergraduate students\u2014Arlen Fan \u201918, an electrical and computer engineering major, and rising senior Andrew Smith, a computer science major and music minor at the University of Central Florida\u2014joined the project as part of the NSF-funded Research Experience for Undergraduates (REU) program \u201cComputational Methods for Understanding Music, Media, and Minds.\u201d<\/p>\n

\"\"
The interface would allow users to fix any incorrect portions\u2014such as the red note in this organ music score\u2014of the automatic transcription generated by the computer. Using machine learning techniques, the computer would \u201clearn\u201d these mistakes and avoid similar errors in the future. (University of Rochester image \/ Duan lab)<\/em><\/figcaption><\/figure>\n

 <\/p>\n

According to Duan, \u201cMachine transcription is fast, but it isn\u2019t as accurate as a person. Human transcription is accurate, but not very fast. We want to combine these to have both an accurate and fast system.\u201d<\/p>\n

Fan and Smith have spent the summer creating an interface that would allow human users to fix portions of the transcription that the computer notated incorrectly and then input these changes into the computer. Using machine learning techniques, the computer would then \u201clearn\u201d from these mistakes in order to avoid similar errors in the future.<\/p>\n

Such an automatic music transcription program would help advance music education, retrieval, and research. For example, it would allow users to notate music for which a score is not readily available or to search for music with similar melodies and chord progressions.<\/p>\n

 <\/p>\n

\"four
From left, Arlen Fan ’18, professor Zhiyao Duan, Andrea Cogliati (PhD ’17), and Andrew Smith (University of Central Florida), demonstrating their computer-generated music transcription interface. \u201cMachine transcription is fast, but it isn\u2019t as accurate as a person. Human transcription is accurate, but not very fast,\u201d says Duan. \u201cWe want to combine these to have both an accurate and fast system.\u201d (University photo \/ Lindsey Valich)<\/figcaption><\/figure>\n

\u201cThere are musical traditions\u2014not just jazz, but types of Eastern or Indian music\u2014where there is not a written score,\u201d Cogliati says. \u201cThe program can bridge the gap between oral tradition and written notation.\u201d<\/p>\n

Smith says he is already interested in using the program to produce sheet music for improvisational musicians such as 20th-century comedian and pianist Victor Borge because \u201cyou can\u2019t find his sheet music anywhere.\u201d<\/p>\n

Reflecting on his decision to work at Rochester this summer, Smith says, \u201cI\u2019m interested in music theory and performance, as well as the technical aspects of computers, so this opportunity fit like a glove.\u201d<\/p>\n

Now he\u2019s considering pursuing a graduate degree at Rochester.\u201cNow that I\u2019ve worked in this lab and got to experience how interesting this project is, I might try to apply here next year.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

Two undergraduates have joined a summer research project focused on building a machine-learning interface that generates musical scores from audio files.<\/p>\n","protected":false},"author":912,"featured_media":261012,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[13092],"tags":[19382,29502,18632,18572,41362,20932,30532],"class_list":["post-260762","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-the-arts","tag-department-of-electrical-and-computer-engineering","tag-featured-post-side","tag-hajim-school-of-engineering-and-applied-sciences","tag-research-finding","tag-summer-of-research-2017","tag-undergraduate-research","tag-zhiyao-duan"],"acf":[],"yoast_head":"\nWith automatic transcription, musicians can save themselves the treble<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"With automatic transcription, musicians can save themselves the treble\" \/>\n<meta property=\"og:description\" content=\"Two undergraduates have joined a summer research project focused on building a machine-learning interface that generates musical scores from audio files.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/\" \/>\n<meta property=\"og:site_name\" content=\"News Center\" \/>\n<meta property=\"article:published_time\" content=\"2017-08-03T14:16:28+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-10-29T18:22:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2017\/08\/fea-treble-clef-sheet-music.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Lindsey Valich\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Lindsey Valich\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/\"},\"author\":{\"name\":\"Lindsey Valich\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/fcd7d29a5b8e855924bf73b764dcd827\"},\"headline\":\"With automatic transcription, musicians can save themselves the treble\",\"datePublished\":\"2017-08-03T14:16:28+00:00\",\"dateModified\":\"2024-10-29T18:22:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/\"},\"wordCount\":615,\"image\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2017\\\/08\\\/fea-treble-clef-sheet-music.jpg\",\"keywords\":[\"Department of Electrical and Computer Engineering\",\"featured-post-side\",\"Hajim School of Engineering and Applied Sciences\",\"research finding\",\"summer-of-research-2017\",\"undergraduate research\",\"Zhiyao Duan\"],\"articleSection\":[\"The Arts\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/\",\"name\":\"With automatic transcription, musicians can save themselves the treble\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2017\\\/08\\\/fea-treble-clef-sheet-music.jpg\",\"datePublished\":\"2017-08-03T14:16:28+00:00\",\"dateModified\":\"2024-10-29T18:22:57+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/fcd7d29a5b8e855924bf73b764dcd827\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2017\\\/08\\\/fea-treble-clef-sheet-music.jpg\",\"contentUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2017\\\/08\\\/fea-treble-clef-sheet-music.jpg\",\"width\":1000,\"height\":600,\"caption\":\"sheet music\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/save-treble-automatic-music-transcription-260762\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"With automatic transcription, musicians can save themselves the treble\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#website\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/\",\"name\":\"News Center\",\"description\":\"University of Rochester\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/fcd7d29a5b8e855924bf73b764dcd827\",\"name\":\"Lindsey Valich\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/author\\\/lvalich\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"With automatic transcription, musicians can save themselves the treble","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/","og_locale":"en_US","og_type":"article","og_title":"With automatic transcription, musicians can save themselves the treble","og_description":"Two undergraduates have joined a summer research project focused on building a machine-learning interface that generates musical scores from audio files.","og_url":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/","og_site_name":"News Center","article_published_time":"2017-08-03T14:16:28+00:00","article_modified_time":"2024-10-29T18:22:57+00:00","og_image":[{"url":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2017\/08\/fea-treble-clef-sheet-music.jpg","width":1000,"height":600,"type":"image\/jpeg"}],"author":"Lindsey Valich","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Lindsey Valich","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/#article","isPartOf":{"@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/"},"author":{"name":"Lindsey Valich","@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/fcd7d29a5b8e855924bf73b764dcd827"},"headline":"With automatic transcription, musicians can save themselves the treble","datePublished":"2017-08-03T14:16:28+00:00","dateModified":"2024-10-29T18:22:57+00:00","mainEntityOfPage":{"@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/"},"wordCount":615,"image":{"@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2017\/08\/fea-treble-clef-sheet-music.jpg","keywords":["Department of Electrical and Computer Engineering","featured-post-side","Hajim School of Engineering and Applied Sciences","research finding","summer-of-research-2017","undergraduate research","Zhiyao Duan"],"articleSection":["The Arts"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/","url":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/","name":"With automatic transcription, musicians can save themselves the treble","isPartOf":{"@id":"https:\/\/www.rochester.edu\/newscenter\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/#primaryimage"},"image":{"@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2017\/08\/fea-treble-clef-sheet-music.jpg","datePublished":"2017-08-03T14:16:28+00:00","dateModified":"2024-10-29T18:22:57+00:00","author":{"@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/fcd7d29a5b8e855924bf73b764dcd827"},"breadcrumb":{"@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/#primaryimage","url":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2017\/08\/fea-treble-clef-sheet-music.jpg","contentUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2017\/08\/fea-treble-clef-sheet-music.jpg","width":1000,"height":600,"caption":"sheet music"},{"@type":"BreadcrumbList","@id":"https:\/\/www.rochester.edu\/newscenter\/save-treble-automatic-music-transcription-260762\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.rochester.edu\/newscenter\/"},{"@type":"ListItem","position":2,"name":"With automatic transcription, musicians can save themselves the treble"}]},{"@type":"WebSite","@id":"https:\/\/www.rochester.edu\/newscenter\/#website","url":"https:\/\/www.rochester.edu\/newscenter\/","name":"News Center","description":"University of Rochester","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.rochester.edu\/newscenter\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/fcd7d29a5b8e855924bf73b764dcd827","name":"Lindsey Valich","url":"https:\/\/www.rochester.edu\/newscenter\/author\/lvalich\/"}]}},"_links":{"self":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/260762","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/users\/912"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/comments?post=260762"}],"version-history":[{"count":8,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/260762\/revisions"}],"predecessor-version":[{"id":261032,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/260762\/revisions\/261032"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/media\/261012"}],"wp:attachment":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/media?parent=260762"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/categories?post=260762"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/tags?post=260762"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}