Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Computer learns sign language
Boing Boing ^ | 7/9/09

Posted on 07/09/2009 8:25:53 PM PDT by FromLori

Researchers made progress enabling a computer to teach itself British Sign Language by analyzing video footage. The scientists from the University of Oxford and University of Leeds first programmed a machine vision algorithm so the computer could identify the shapes of hands in the video. From New Scientist: Once the team were confident the computer could identify different signs in this way, they exposed it to around 10 hours of TV footage that was both signed and subtitled. They tasked the software with learning the signs for a mixture of 210 nouns and adjectives that appeared multiple times during the footage.

The program did so by analysing the signs that accompanied each of those words whenever it appeared in the subtitles. Where it was not obvious which part of a signing sequence relates to the given keyword, the system compared multiple occurrences of a word to pinpoint the correct sign.

Starting without any knowledge of the signs for those 210 words, the software correctly learnt 136 of them, or 65 per cent, says Everingham. "Some words have different signs depending on the context – for example, cutting a tree has a different sign to cutting a rose." he says, so this is a high success rate given the complexity of the task. "Computer learns sign language by watching TV"


TOPICS: Miscellaneous; News/Current Events
KEYWORDS: technology

1 posted on 07/09/2009 8:25:53 PM PDT by FromLori
[ Post Reply | Private Reply | View Replies]

To: FromLori

Ugh. I’m so tired of this garbage being passed off as AI. It’s not AI.

If you teach the computer *how* to pay attention, *how* to see, *how* to read sub-titles, *how* to watch for sign language and *what* you want it to do with it, and simply rely on the computer to take your instructions and run with them, effectively “learning” sign language, you’ve done 99% of the work already.

You can’t take that (now educated) computer and ask it to work out a maze on its own. It doesn’t know the what, why, how, etc of the task without someone sitting down and keying in exact instructions on what is expected of the program.

/soapbox


2 posted on 07/09/2009 8:32:28 PM PDT by TheZMan ("I fear all we have done is to awaken a sleeping giant and fill him with a terrible resolve.")
[ Post Reply | Private Reply | To 1 | View Replies]

To: FromLori

I’m almost afraid to ask what is the difference between British Sign Language and American Sign Language?

*sigh* I just know I’m going to regret this...


3 posted on 07/09/2009 10:25:13 PM PDT by null and void (We are now in day 170 of our national holiday from reality.)
[ Post Reply | Private Reply | To 1 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson