TY - GEN
T1 - Variable frame rate for low power mobile sign language communication
AU - Cherniavsky, Neva
AU - Cavender, Anna C.
AU - Ladner, Richard E.
AU - Riskin, Eve A.
PY - 2007
Y1 - 2007
N2 - The MobileASL project aims to increase accessibility by enabling Deaf people to communicate over video cell phones in their native language, American Sign Language (ASL). Real-time video over cell phones can be a computationally intensive task that quickly drains the battery, rendering the cell phone useless. Properties of conversational sign language allow us to save power and bits: namely, lower frame rates are possible when one person is not signing due to turn-taking, and signing can potentially employ a lower frame rate than fingerspelling. We conduct a user study with na,tive signers to examine the intelligibility of varying the frame rate based on activity in the video. We then describe several methods for automatically determining the activity of signing or not signing from the video stream in real-time. Our results show that varying the frame rate during turn-taking is a good way to save power without sacrificing intelligibility, and that automatic activity analysis is feasible.
AB - The MobileASL project aims to increase accessibility by enabling Deaf people to communicate over video cell phones in their native language, American Sign Language (ASL). Real-time video over cell phones can be a computationally intensive task that quickly drains the battery, rendering the cell phone useless. Properties of conversational sign language allow us to save power and bits: namely, lower frame rates are possible when one person is not signing due to turn-taking, and signing can potentially employ a lower frame rate than fingerspelling. We conduct a user study with na,tive signers to examine the intelligibility of varying the frame rate based on activity in the video. We then describe several methods for automatically determining the activity of signing or not signing from the video stream in real-time. Our results show that varying the frame rate during turn-taking is a good way to save power without sacrificing intelligibility, and that automatic activity analysis is feasible.
KW - Activity analysis
KW - Deaf community
KW - Low power
KW - Mobile telephone use
KW - Sign language
UR - http://www.scopus.com/inward/record.url?scp=42149115753&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=42149115753&partnerID=8YFLogxK
U2 - 10.1145/1296843.1296872
DO - 10.1145/1296843.1296872
M3 - Conference contribution
AN - SCOPUS:42149115753
SN - 9781595935731
T3 - ASSETS'07: Proceedings of the Ninth International ACM SIGACCESS Conference on Computers and Accessibility
SP - 163
EP - 170
BT - ASSETS'07
T2 - ASSETS'07: 9th International ACM SIGACCESS Conference on Computers and Accessibility
Y2 - 15 October 2007 through 17 October 2007
ER -