LipNet, intelligent system that accurately reads people's lips

LipNet is a robot created by scientists at the University of Oxford who can read lips better than men. Artificial intelligence system - LipNet - see video of a person who is speaking and sets the text according to their mouth movements with an accuracy of 93%, the researchers said.







Automation of this process could help millions of people, they suggested. Experts point out that the system still needs to be tested in real-life situations. Lip-reading is a very complex business, with professionals who are able to decipher what someone is saying only with an accuracy of 60%. They said the AI system enabled the full sentence that could learn which letter corresponded a certain lip movement. AI to train the team - from the AI lab at the University of Oxford - fed almost 29,000 video, subtitled with the correct text.

   

Each video was 3 seconds long and followed a similar sequence of grammar. While human testuesti who were given the same video had an error rate of 47.7%, he had only 6.6%. The fact that he learned from training videos to specialists led to criticism on Twitter, against research.