TY - JOUR
T1 - Decoder-Encoder LSTM for Lip Reading
AU - Fenghour, Souheil
AU - Chen, Daqing
AU - Xiao, Perry
PY - 2019/4/9
Y1 - 2019/4/9
N2 - The success of automated lip reading has been constrained by the inability to distinguish between homopheme words, which are words have different characters and produce the same lip movements (e.g. ”time” and ”some”), despite being intrinsically different. One word can often have different phonemes (units of sound) producing exactly the viseme or visual equivalent of phoneme for a unit of sound. Through the use of a Long-Short Term Memory Network with word embeddings, we can distinguish between homopheme words or words that produce identical lip movements. The neural network architecture achieved a character accuracy rate of 77.1% and a word accuracy rate of 72.2%.
AB - The success of automated lip reading has been constrained by the inability to distinguish between homopheme words, which are words have different characters and produce the same lip movements (e.g. ”time” and ”some”), despite being intrinsically different. One word can often have different phonemes (units of sound) producing exactly the viseme or visual equivalent of phoneme for a unit of sound. Through the use of a Long-Short Term Memory Network with word embeddings, we can distinguish between homopheme words or words that produce identical lip movements. The neural network architecture achieved a character accuracy rate of 77.1% and a word accuracy rate of 72.2%.
U2 - 10.1145/3328833.3328845
DO - 10.1145/3328833.3328845
M3 - Article
JO - Proceedings of the 2019 8th International Conference on Software and Information Engineering
JF - Proceedings of the 2019 8th International Conference on Software and Information Engineering
ER -