Which Phoneme-to-Viseme Maps Best Improve Visual-Only Computer Lip-Reading?

A critical assumption of all current visual speech recognition systems is that there are visual speech units called visemes which can be mapped to units of acoustic speech, the phonemes. Despite there being a number of published maps it is infrequent to see the effectiveness of these tested, particu...

Full description

Saved in:
Bibliographic Details
Published inAdvances in Visual Computing Vol. 8888; pp. 230 - 239
Main Authors Bear, Helen L., Harvey, Richard W., Theobald, Barry-John, Lan, Yuxuan
Format Book Chapter
LanguageEnglish
Published Switzerland Springer International Publishing AG 2014
Springer International Publishing
SeriesLecture Notes in Computer Science
Subjects
Graphics programming
Image processing
Pattern recognition
Online AccessGet full text

Cover

More Information
Summary:A critical assumption of all current visual speech recognition systems is that there are visual speech units called visemes which can be mapped to units of acoustic speech, the phonemes. Despite there being a number of published maps it is infrequent to see the effectiveness of these tested, particularly on visual-only lip-reading (many works use audio-visual speech). Here we examine 120 mappings and consider if any are stable across talkers. We show a method for devising maps based on phoneme confusions from an automated lip-reading system, and we present new mappings that show improvements for individual talkers.
ISBN:9783319143637
3319143638
ISSN:0302-9743
1611-3349
DOI:10.1007/978-3-319-14364-4_22