"Our research in computer graphics and computer vision, it is easier to use computers, " said the scientist, the team from the University of Binghamton. "Can we find a comfortable, intuitive and intelligent computer? It should feel like you're talking to a friend. It could also help disabled people use computers like everyone else."
Yin-team opportunities, information on the computer on the basis that the user is looking to provide and through gestures or language development. One of the main challenges in this area is computer vision. This is how a simple web-camera that the human eye? Then the camera captured data to a real world object is to be understood? This data is used to "see" to "understand" the user wants to do the user?
In part this is already possible. Witnessed one of the graduates Yin are a PowerPoint presentation and only with their eyes, reveal the contents of several pages. If Yin this technology, the experts of the Air Force demonstrated last year, the only material that it was a webcam on a laptop.
emotional state. He works with six established basic emotions - anger, disgust, fear, joy, sadness and surprise - and experiment with different ways to allow the computer to distinguish between them. Is there enough data about how the lines to change the eyes? Could focus on the user's mouth, give plenty of clues? What if the user's face is only partly visible, maybe a page?
"Computers only understand zeroes and ones," Yin says. "Everything is about patterns. We want to find out how to recognize each emotion using only the most important features."
Is related to the Binghamton University psychologist Peter Gerhard stone paths on this work could benefit from exploring children with autism. Many people with autism have difficulty reading the emotions of others, therapists sometimes understand photographs of people to teach children when they are happy or sad, and so on are. Yin could produce not only photos but the three-dimensional avatars that is capable of a range of emotions. As the photos you have, could even produce the avatars of the Yin people of the family of a child for use in such therapy.
Yin and Gerhard Stein previous collaboration, the creation of a database of facial expression in 3D, 100 patients out of 2,500 models of facial expression includes. The database is freely available for research non-profit community and has become a world reference for work on projects in areas such as biomedicine law enforcement authorities and computer science.
Yin once in human-computer interaction, which was naturally interested and more excited by the possibilities of artificial intelligence.
"We are not just a virtual model of person, we understand the feelings and emotions of real people, " said Yin. "We want the computer to understand how you feel. It is difficult, even more than my other work."
Imagine, if a computer can understand when people are in pain. Some may ask a doctor for help. However, others - young children, for example - may not be able to speak or not speak for any reason. Yin would like an algorithm that a computer to determine whether someone in pain is based solely on a photograph develop allowed.
Yin describes the use of health care, and almost immediately, said the same system in order to identify the pain can also be used to determine when someone is lying are. Maybe a computer could provide as Tim Roth's character, Dr. Cal Lightman, in the TV show Lie to Me Enlighten The protagonist is a psychologist with experience in the surveillance of deception, is often associated with law enforcement authorities.
"This technology, " Yin said, "we could help shape the team for the analysis of facial recognition, instead of experts. "
Lijun Yin, associate professor of computer science and director of the Computer Graphics and Image Processing Laboratory, he joined the faculty of Binghamton University in 2001. He received a Ph.D. from the University of Alberta in 2000 after receiving a BA and an MA in Chinese schools. His work was supported by the National Science Foundation, the Air Force Research Laboratory and the New York State Office of Science, Technology and Academic Research.