TY - GEN
T1 - Enabling access through real-time sign language communication over cell phones
AU - Chon, Jaehong
AU - Cherniavsky, Neva
AU - Riskin, Eve A.
AU - Ladner, Richard E.
PY - 2009
Y1 - 2009
N2 - The primary challenge to enabling real-time twoway video conferencing on a cell phone is overcoming the limited bandwidth, computation and power. The goal of the MobileASL project is to enable access for people who use American Sign Language (ASL) to an off-the-shelf mobile phone through the implementation of real-time mobile video communication. The enhancement of processor, bandwidth, and power efficiency is investigated through SIMD optimization; Region-of-interest encoding based on skin detection; Video resolution selection (used to determine the best trade off between frame rate and spatial resolution); And variable frame rates based on activity recognition. Our prototype system is able to compress, transmit, and decode 12-15 frames per second in real-time and produce intelligible ASL at 30 kbps. Furthermore, we can achieve up to 23 extra minutes of talk time, or a 8% gain over the battery life of the phone, through our frame dropping technique.
AB - The primary challenge to enabling real-time twoway video conferencing on a cell phone is overcoming the limited bandwidth, computation and power. The goal of the MobileASL project is to enable access for people who use American Sign Language (ASL) to an off-the-shelf mobile phone through the implementation of real-time mobile video communication. The enhancement of processor, bandwidth, and power efficiency is investigated through SIMD optimization; Region-of-interest encoding based on skin detection; Video resolution selection (used to determine the best trade off between frame rate and spatial resolution); And variable frame rates based on activity recognition. Our prototype system is able to compress, transmit, and decode 12-15 frames per second in real-time and produce intelligible ASL at 30 kbps. Furthermore, we can achieve up to 23 extra minutes of talk time, or a 8% gain over the battery life of the phone, through our frame dropping technique.
UR - http://www.scopus.com/inward/record.url?scp=77953830413&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77953830413&partnerID=8YFLogxK
U2 - 10.1109/ACSSC.2009.5469901
DO - 10.1109/ACSSC.2009.5469901
M3 - Conference contribution
AN - SCOPUS:77953830413
SN - 9781424458271
T3 - Conference Record - Asilomar Conference on Signals, Systems and Computers
SP - 588
EP - 592
BT - Conference Record - 43rd Asilomar Conference on Signals, Systems and Computers
T2 - 43rd Asilomar Conference on Signals, Systems and Computers
Y2 - 1 November 2009 through 4 November 2009
ER -