Automated
Voice-Controlled Handspeak Prototype
Published Article:
"Voice-Controlled Artificial Handspeak System" (2014) by J. Gatti, C. Fonda, L. Tenze, E. Canessa
This open-source project establishes an automated voice to sign language translator for communication with the deaf using integrated open technologies. The prototype consists of a robotic hand -designed with OpenSCAD and manufactured with a low-cost 3D printer, which smoothly reproduces the alphabet of the sign language controlled by voice only.
The core automation consists of an Arduino UNO controller used to activate a set of servo motors that follow instructions from a Raspberry Pi mini-computer having installed the speech recognition engine Julius.
(1) See our demo video:
(2) Protype presentation at MakerFaire Roma 2013:
(3) Extended version 2014 (including
alternative PC screen to display still images or short videos
associated to the speaker input:
AVAILABLE MATERIAL
- Code for Arduino ONE: hyw.ino
- C-code for Raspberry PI: julius4hand.c, julius4screen.c (write us to "sdu@ictp.it" for info)
- OpenSCAD sources and STL files for our robotic 3D hand
