IBM unveils 'Speech to Sign Language' solution

IBM has unveiled a breakthrough solution that automatically converts speech into British Sign Language (BSL) which is then acted out on-screen by an animated character.

Dubbed SiSi (Say It Sign It), it has been pioneered by boffins at IBM Hursley. It uses speech recognition to translate words into text, which is then converted to gestures that are acted out by a computer-generated character, or avatar, in sign language.

The solution could be installed on PC or laptops used by deaf people, or in meeting room displays or auditoriums. When used in meetings, for instance, the avatar would pop-up in the corner of a laptop screen or meeting room display to relay in sign language what is being said.

"This technology has the potential to make life easier for the deaf community by providing automatic signing for television broadcasts, and making radio news and talk shows available to a new audience over the internet, or by providing automated voicemail transcription to allow them to
make better use of the mobile network," said Dr Andy Stanford-Clark, master inventor, IBM Hursley.

Guido Gybels, director of new technologies at Royal National Institute for Deaf (RNID) said: "RNID welcomes any development that would make the information society a more equal place for deaf and hard of hearing people. British Sign Language users are amongst the most disenfranchised citizens as a result of services and products not being designed with their needs in mind."

"There is clearly still a long way to go before such prototypes become fully capable, off-the-shelf products, but it is encouraging to see that mainstream research is contributing to this objective of a more inclusive society," he added.