TY - GEN
T1 - From the Lab to People s Home
T2 - 19th International Web for All Conference, W4A 2022
AU - Lee, Kyungjun
AU - Hong, Jonggi
AU - Jarjue, Ebrima
AU - Mensah, Ernest Essuah
AU - Kacorri, Hernisa
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/4/25
Y1 - 2022/4/25
N2 - Researchers have adopted remote methods, such as online surveys and video conferencing, to overcome challenges in conducting in-person usability testing, such as participation, user representation, and safety. However, remote user evaluation on hardware testbeds is limited, especially for blind participants, as such methods restrict access to observations of user interactions. We employ smart glasses in usability testing with blind people and share our lessons from a case study conducted in blind participants' homes (N=12), where the experimenter can access participants' activities via dual video conferencing: A third-person view via a laptop camera and a first-person view via smart glasses worn by the participant. We show that smart glasses hold potential for observing participants' interactions with smartphone testbeds remotely; on average 58.7% of the interactions were fully captured via the first-person view compared to 3.7% via the third-person. However, this gain is not uniform across participants as it is susceptible to head movements orienting the ear towards a sound source, which highlights the need for a more inclusive camera form factor. We also share our lessons learned when it comes to dealing with lack of screen reader support in smart glasses, a rapidly draining battery, and Internet connectivity in remote studies with blind participants.
AB - Researchers have adopted remote methods, such as online surveys and video conferencing, to overcome challenges in conducting in-person usability testing, such as participation, user representation, and safety. However, remote user evaluation on hardware testbeds is limited, especially for blind participants, as such methods restrict access to observations of user interactions. We employ smart glasses in usability testing with blind people and share our lessons from a case study conducted in blind participants' homes (N=12), where the experimenter can access participants' activities via dual video conferencing: A third-person view via a laptop camera and a first-person view via smart glasses worn by the participant. We show that smart glasses hold potential for observing participants' interactions with smartphone testbeds remotely; on average 58.7% of the interactions were fully captured via the first-person view compared to 3.7% via the third-person. However, this gain is not uniform across participants as it is susceptible to head movements orienting the ear towards a sound source, which highlights the need for a more inclusive camera form factor. We also share our lessons learned when it comes to dealing with lack of screen reader support in smart glasses, a rapidly draining battery, and Internet connectivity in remote studies with blind participants.
KW - blind people
KW - remote method
KW - smart glasses
KW - user study
UR - http://www.scopus.com/inward/record.url?scp=85130216018&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85130216018&partnerID=8YFLogxK
U2 - 10.1145/3493612.3520448
DO - 10.1145/3493612.3520448
M3 - Conference contribution
AN - SCOPUS:85130216018
T3 - Proceedings of the 19th International Web for All Conference, W4A 2022
BT - Proceedings of the 19th International Web for All Conference, W4A 2022
Y2 - 25 April 2022 through 26 April 2022
ER -