Visual System Interprets Sign Languages From: UAB Barcelona - 06/02/2010 Researchers at the Autonomous University of Barcelona's Computer Vision Center recently demonstrated a prototype of a new visual system that interprets sign language. The visual system has been programmed to interpret more than 20 Spanish signs, which would enable deaf users to hold a basic conversation. "For them it is a non-artificial way of communicating and at the same time they can engage with people who do not speak sign language since the system translates the symbols into words in real time," says researcher Sergio Escalera. The technology consists of a video camera for recording image sequences; a computer vision and automatic learning system for detecting face, hand, and arm movement as well as any screen rolling; and a classification system for identifying each movement with a corresponding word associated with the sign. The visual interpretation system is scalable, and could be adopted for other sign languages. Precision is critical in the identification phase due to the potential variables in surroundings, such as changes in light and shadow, different physiognomies, and the speed in which signs are formed. The team focused on establishing a fixed point where individuals formed the signs and avoiding different focus points when recording. Read the entire article at: http://www.uab.es/servlet/Satellite/latest-news/news-detail/visual-system-interprets-sign-languages-1096476786473.html?noticiaid=1275458325318 Links: Computer Vision Centre http://www.cvc.uab.es/index.asp?idioma=en Sergio Escalera http://www.cvc.uab.es/personal2.asp?id=90&escalerasergio http://www.maia.ub.es/~sergio/ Spanish Sign Language Recognition video sample http://www.maia.ub.es/~sergio/projects/DemoFCIM.wmv Alfabet recognition example http://www.maia.ub.es/~sergio/pfcs/played.wmv