{"id":218,"date":"2019-06-29T21:35:04","date_gmt":"2019-06-29T21:35:04","guid":{"rendered":"https:\/\/mikewinters.io\/?p=218"},"modified":"2025-03-21T05:33:53","modified_gmt":"2025-03-21T05:33:53","slug":"ai-sonification","status":"publish","type":"post","link":"https:\/\/mikewinters.io\/?p=218","title":{"rendered":"Hearing Skin Cancer"},"content":{"rendered":"\n<p>Artificial Intelligence (AI) is a fundamental building block of many new technologies. In the wild, many AI algorithms are designed to operate autonomously. But to communicate with humans, they need to <em>perceptualize <\/em>what they know. <\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mikewinters.io\/wp-content\/uploads\/2019\/09\/1852-Remove_Moles-732x549-thumbnail-1.jpg\" alt=\"The purpose of this image is to let the reader know that this is about skin cancer diagnosis by showing a doctor examining a suspicious region of skin.\" class=\"wp-image-227\" width=\"499\" height=\"300\" srcset=\"https:\/\/mikewinters.io\/wp-content\/uploads\/2019\/09\/1852-Remove_Moles-732x549-thumbnail-1.jpg 732w, https:\/\/mikewinters.io\/wp-content\/uploads\/2019\/09\/1852-Remove_Moles-732x549-thumbnail-1-300x180.jpg 300w, https:\/\/mikewinters.io\/wp-content\/uploads\/2019\/09\/1852-Remove_Moles-732x549-thumbnail-1-400x240.jpg 400w\" sizes=\"auto, (max-width: 499px) 100vw, 499px\" \/><figcaption>A dermatologist examines a suspicious skin growth. With AI, they can get a better idea of whether it is dangerous or not. <\/figcaption><\/figure>\n\n\n\n<p>One of the most rewarding projects I&#8217;ve worked on was designing an AI sonification system to help doctors with melanoma diagnosis. A dermatologist snaps a photo of a suspicious region of skin, triggering analysis by a computer vision system trained to detect skin cancer. The doctor gets a read out of the results and a brief sonic summary. If it the sound is scary, alarming or ugly&#8230; it&#8217;s probably coming off. <\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Design #3 - kMeans\" width=\"560\" height=\"420\" src=\"https:\/\/www.youtube.com\/embed\/4ZZKx9FhYBk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><figcaption>Hear samples of images classified as malignant and benign. Siren-like frequency modulation are causes for alarm. <\/figcaption><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\">Publications<\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>Winters, R. M., Kalra, A., &amp; Walker, B. (2019). <a href=\"https:\/\/smartech.gatech.edu\/handle\/1853\/61501\">Hearing Artificial Intelligence: Sonification Guidelines &amp; Results from a Case-Study in Melanoma Diagnosis<\/a>. <em>Proceedings of the 25th International Conference on Auditory Display<\/em>, 262\u2013267. Northumbria, UK.<\/li><li>Walker, B. N., Rehg, J. M., Kalra, A., Winters, R. M., Drews, P., Dascalu, J., David, E. O., &amp; Dascalu, A. (2019). <a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/30674442\">Dermoscopy diagnosis of cancerous lesions utilizing dual deep learning algorithms via visual and audio (sonification) outputs\u202f: Laboratory and prospective observational studies<\/a>. <em>EBioMedicine<\/em>, <em>40<\/em>, 176\u2013183. <\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Press<\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>Bostel Technologies (2019). <a href=\"https:\/\/www.marketwatch.com\/press-release\/the-sounds-of-nevi-diagnosing-skin-cancer-more-accurately-with-a-new-deep-learning-technology-and-telemedicine-2019-02-27\">The Sounds of Nevi: Diagnosing Skin Cancer More Accurately with a New Deep Learning Technology and Telemedicine<\/a>. <em>Market Watch<\/em>, Feb. 29, 2019.<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Artificial Intelligence (AI) is a fundamental building block of many new technologies. In the wild, many AI algorithms are designed to operate autonomously. But to communicate with humans, they need to perceptualize what they know. One of the most rewarding projects I&#8217;ve worked on was designing an AI sonification system to help doctors with melanoma [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":228,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[35,6,9,33,5,21,11,2,20],"tags":[],"class_list":["post-218","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-coding","category-collaboration","category-consulting","category-design","category-industry","category-publication","category-sonification","category-teams","has-thumbnail"],"_links":{"self":[{"href":"https:\/\/mikewinters.io\/index.php?rest_route=\/wp\/v2\/posts\/218","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mikewinters.io\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mikewinters.io\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mikewinters.io\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mikewinters.io\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=218"}],"version-history":[{"count":11,"href":"https:\/\/mikewinters.io\/index.php?rest_route=\/wp\/v2\/posts\/218\/revisions"}],"predecessor-version":[{"id":1076,"href":"https:\/\/mikewinters.io\/index.php?rest_route=\/wp\/v2\/posts\/218\/revisions\/1076"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mikewinters.io\/index.php?rest_route=\/wp\/v2\/media\/228"}],"wp:attachment":[{"href":"https:\/\/mikewinters.io\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=218"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mikewinters.io\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=218"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mikewinters.io\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=218"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}