Lipreading Robot Proves More Accurate Than a Human in Deciphering Speech
From: Daily Mail (UK) - 11/09/2016
By: Ryan O'Hare

Researchers from the University of Oxford in the UK have developed LipNet, a
new program they say is more accurate at reading lips than human experts. The
researchers found LipNet can determine what people are saying by reading
their lips 93.4 percent of the time, while the average accuracy of an
experienced lipreader is about 52 percent. LipNet uses a neural network to
map mouth movements of people to a database of set sentences. The researchers
trained LipNet with nearly 29,000 videos of two men and two women giving a
strange series of commands, with cryptic phrases such as "set blue by A four
please." LipNet learned to match the movements of people's mouths with the
known commands by analyzing each individual video frame. Going forward, the
researchers want to train LipNet with more real-world examples. "Machine
lipreaders have enormous practical potential, with applications in improved
hearing aids, silent dictation in public spaces, covert conversations, speech
recognition in noisy environments, biometric identification, and silent-movie
processing," says University of Oxford doctoral researcher Yannis Assael.

Read the entire article and view a video (1:43) at:
http://www.dailymail.co.uk/sciencetech/article-3919762/Is-no-secret-safe-Lipreading-robot-proves-accurate-human-deciphering-speech.html

Links:
LipNet: Sentence-level Lipreading
https://arxiv.org/pdf/1611.01599v1.pdf

LipNet: End-to-End Senetence-level Lipreading
http://www.oxml.co.uk/publications/2016-Assael_Shillingford_LipNet.pdf

Scientists built a lipreading computer that's already more accurate than humans
http://www.mirror.co.uk/tech/scientists-built-lipreading-computer-thats-9221757

LipNet: Researchers develop AI that can read your lips better than any human
https://www.neowin.net/news/lipnet-researchers-develop-ai-that-can-read-your-lips-better-than-any-human

Researchers Just Created the Most Amazing Lip-Reading Software
http://gizmodo.com/researchers-just-created-the-most-amazing-lip-reading-s-1788748163

Google’s DeepMind AI can lip-read TV shows better than a pro
https://www.newscientist.com/article/2113299-googles-deepmind-ai-can-lip-read-tv-shows-better-than-a-pro

Researchers Improve Automated Lip Reading with System Based On Deep Learning https://www.computerpoweruser.com/article/23939/researchers-improve-automated-lip-reading-with-system-based-on-deep-learning