Development and Implementation of a Perception Toolkit to Evaluate the Impact of Synthetic Speech on the Hearing Impaired

Development and Implementation of a Perception Toolkit to Evaluate the Impact of Synthetic Speech on the Hearing Impaired
Author :
Publisher :
Total Pages : 424
Release :
ISBN-10 : OCLC:962160698
ISBN-13 :
Rating : 4/5 ( Downloads)

Book Synopsis Development and Implementation of a Perception Toolkit to Evaluate the Impact of Synthetic Speech on the Hearing Impaired by : Chung Ting Justin Hui

Download or read book Development and Implementation of a Perception Toolkit to Evaluate the Impact of Synthetic Speech on the Hearing Impaired written by Chung Ting Justin Hui and published by . This book was released on 2016 with total page 424 pages. Available in PDF, EPUB and Kindle. Book excerpt: In our ageing society, healthcare is in demand. This gives rise to the healthcare robot solution to carry out simple tasks such as medication reminders. The robot communicates with its patients through its text-to-speech system, and therefore makes it imperative for the synthetic voice to be intelligible, especially for the hearing impaired. In this thesis, we have created 4 sets of new New Zealand English voices using statistical synthesis to be used on the healthcare robot, adding to the existing diphone voice. To make these voices more intelligible for the hearing impaired, we need to understand the sounds they have trouble with, and what sounds they hear instead. Three intelligibility tests in varying complexity of phonetic intelligibility have been designed to tease out how well the hearing impaired can identify frequent consonants in English as well as one quality test to see how they feel about the voices. The tests were carried out in the form of a web-based survey using the diphone voice, one of the statistical voices created using the HMM method and one or two natural voice depending on the test. We were able to gather 160 complete responses, more than half of which experience hearing loss. We found that while participants preferred the natural voice over the synthetic voices, intelligibility wise it depends on the complexity of the phonetic environment. The diphone synthetic voice seems to fare the best when the words are unfamiliar and complex, such as medication names, whereas the natural voice performs the worst in complex environment, but more easily recognisable in familiar context. For more in-depth analysis on the phonemic level, new visualisation tools were developed to evaluate the sounds and confusions made by the hearing impaired participants in comparison with their normal hearing counterparts. These tools and the tests designed to evaluate synthetic voices can give us insight to what can be done to enhance these voices and make them more intelligible.


Development and Implementation of a Perception Toolkit to Evaluate the Impact of Synthetic Speech on the Hearing Impaired Related Books

Development and Implementation of a Perception Toolkit to Evaluate the Impact of Synthetic Speech on the Hearing Impaired
Language: en
Pages: 424
Authors: Chung Ting Justin Hui
Categories: Audiometry, Speech
Type: BOOK - Published: 2016 - Publisher:

DOWNLOAD EBOOK

In our ageing society, healthcare is in demand. This gives rise to the healthcare robot solution to carry out simple tasks such as medication reminders. The rob
Speech Perception of Hearing-impaired Listeners in Challenging Listening Environments and Personalization of Hearing Assistive Devices Via Inverse Reinforcement Learning
Language: en
Pages: 0
Authors: Sara Akbarzadeh
Categories: Electrical engineering
Type: BOOK - Published: 2022 - Publisher:

DOWNLOAD EBOOK

Listening to a speech in presence of a noise has always been a challenge specially for individuals with hearing impairment. There are many aspects that needs to
Speech Perception By Ear and Eye
Language: en
Pages: 331
Authors: Dominic W. Massaro
Categories: Language Arts & Disciplines
Type: BOOK - Published: 2014-02-25 - Publisher: Psychology Press

DOWNLOAD EBOOK

First published in 1987. This book is about the processing of information. The central domain of interest is face-to-face communication in which the speaker mak
Hearing by Eye II
Language: en
Pages: 338
Authors: Ruth Campbell
Categories: Computers
Type: BOOK - Published: 1998 - Publisher: Psychology Press

DOWNLOAD EBOOK

This volume outlines developments in practical and theoretical research into speechreading lipreading.
Perceptual Cues of Consonant Sounds and Impact of Sensorineural Hearing Loss on Speech Perception
Language: en
Pages:
Authors: Feipeng Li
Categories:
Type: BOOK - Published: 2010 - Publisher:

DOWNLOAD EBOOK

This research investigates the impact of various types of cochlear hearing loss and mask- ing noise on the perception of basic speech sounds based on the inform