Difference between revisions of "Proj-2013-2014-Sign2Speech-English"
(Created page with "300px|right|Map == Objectif == L'objectif de notre projet est de donner la possibilité à une personne muette d'interagir avec un ordinateur au m...") |
|||
Line 1: | Line 1: | ||
[[File:sign-language.jpeg|300px|right|Map]] |
[[File:sign-language.jpeg|300px|right|Map]] |
||
− | == |
+ | == Objective == |
+ | The goal of our project is to allow speechless people to communicate with a computer thanks to sign langage. Our programm should be able to understand sign langage in order to obey to orders given. Then orders should be displayed under literal form and transformed into vocal signal thanks to a speech synthesis technology. |
||
− | L'objectif de notre projet est de donner la possibilité à une personne muette d'interagir avec un ordinateur au moyen de la langue des signes. Notre application devra être capable de comprendre ce langage afin d'obéir aux ordres donnés, d'afficher sous forme textuelle ce qui a été dit par la personne et de dicter la phrase au moyen d'une technologie de synthèse vocale. |
||
+ | The programm should also be able to learn new hand movements to increase its database to recognize more ideas. |
||
− | L'application aura également la possibilité d'apprendre de nouveaux gestes pour augmenter sa connaissance sur le langage des signes et ainsi reconnaître plus d'idées. |
||
− | == |
+ | == The Team == |
− | * |
+ | *Tutor : Didier Donsez |
− | * |
+ | *Members: Arthur CLERC-GHERARDI, Patrick PEREA |
− | * |
+ | *Department : [http://www.polytech-grenoble.fr/ricm.html RICM 4], [[Polytech Grenoble]] |
− | == |
+ | == State of the Art == |
− | [http://www.youtube.com/watch?v=khM5zCKf8Oc#t=73 |
+ | [http://www.youtube.com/watch?v=khM5zCKf8Oc#t=73 Recognition of sign langage alphabet] |
− | [http://www.youtube.com/watch?v=ITeSHLVNXN8 |
+ | [http://www.youtube.com/watch?v=ITeSHLVNXN8 Recognition of particular hand movements which mean ideas (ZCam camera)] |
− | [http://www.youtube.com/watch?v=cxHMgl2_5zg |
+ | [http://www.youtube.com/watch?v=cxHMgl2_5zg ) Recognition of particular hand movements which mean ideas, and the traduction in spanish (OpenCV)] |
− | [http://www.youtube.com/watch?v=AwOWCYj9qKQ |
+ | [http://www.youtube.com/watch?v=AwOWCYj9qKQ Recognition of particular hand movements which mean ideas (Kinect)] |
− | == |
+ | == Tools == |
+ | We will use two different technologies : |
||
− | Les technologies de reconnaissance des gestes employées dans ce projet seront : |
||
*[https://www.leapmotion.com/ Leap Motion] |
*[https://www.leapmotion.com/ Leap Motion] |
Revision as of 14:19, 26 January 2014
Objective
The goal of our project is to allow speechless people to communicate with a computer thanks to sign langage. Our programm should be able to understand sign langage in order to obey to orders given. Then orders should be displayed under literal form and transformed into vocal signal thanks to a speech synthesis technology.
The programm should also be able to learn new hand movements to increase its database to recognize more ideas.
The Team
- Tutor : Didier Donsez
- Members: Arthur CLERC-GHERARDI, Patrick PEREA
- Department : RICM 4, Polytech Grenoble
State of the Art
Recognition of sign langage alphabet
Recognition of particular hand movements which mean ideas (ZCam camera)
) Recognition of particular hand movements which mean ideas, and the traduction in spanish (OpenCV)
Recognition of particular hand movements which mean ideas (Kinect)
Tools
We will use two different technologies :
The Leap motion is a device that allow you to control your computer with your hands. But there is no physical contact and the communication with the computer is based on hand movements. You put the Leap motion under your hands, next to the keyboard.
Compared to the Kinect, it is much smaller. The device has a size of 8 x 2,9 x 1,1 cm and a frame repetition rate of 200 Hz (the Kinect has a 30 Hz frame repetition rate). The Leap motion is composed of two webcams of 1,3 MP which film in stereoscopy and three infra-red light LED. It can detect the position of all ten fingers.
The official website has a section for developer. You can download the SDK 1.0 (almost 47 Mo) which contains API for following langages: C++, C#, Java, Python, Objective C and JavaScript. The SDK also contains examples for libraries and functions of the SDK.
- La camera Creative de Intel® Perceptual Computing SDK
La caméra Creative est également une caméra qui permettra de contrôler l'ordinateur à distance. Elle se place devant la personne qui veut s'en servir.
Cette caméra propose une reconnaissance de profondeur, ce qui permet de faire la différence entre les différents plans. Cette caméra propose environ 30 ips et peut filmer en 720p. De plus elle peut faire de la 3D en reconnaissant les contours de visages.
Intel propose également un SDK pour les développeurs : [1]. Avec des librairies qui nous aideront pour le tracking des mains et des doigts ainsi que pour la reconnaissance faciale.