< Back to previous page

Publication

Sign language recognition using convolutional neural networks

Book Contribution - Book Chapter Conference Contribution

There is an undeniable communication problem between the Deaf community and the hearing majority. Innovations in automatic sign language recognition try to tear down this communication barrier. Our contribution considers a recognition system using the Microsoft Kinect, convolutional neural networks (CNNs) and GPU acceleration. Instead of constructing complex handcrafted features, CNNs are able to auto- mate the process of feature construction. We are able to recognize 20 Italian gestures with high accuracy. The predictive model is able to gen- eralize on users and surroundings not occurring during training with a cross-validation accuracy of 91.7%. Our model achieves a mean Jaccard Index of 0.789 in the ChaLearn 2014 Looking at People gesture spotting competition.
Book: Lecture Notes in Computer Science
Pages: 572 - 578
ISBN:978-3-319-16177-8
Publication year:2015
BOF-keylabel:yes
IOF-keylabel:yes
Accessibility:Open