Interactive Form Filling Assistant on Smart Glasses for Blind Users

Filling out paper forms remains a significant barrier for people who are blind or have low vision (BLV), as it requires both reading prompts and writing in precise locations - tasks heavily dependent on visual feedback. We present the Interactive Form Filling Assistant (IFFA), a smart glasses-based system that enables BLV users to independently read and complete paper forms. IFFA features two hands-free modes - Reading and Writing - that users can switch between using voice commands. In Reading mode, the system reads aloud lines pointed to by the user's finger and detects form fields. In Writing mode, it provides real-time audio guidance to align the pen with the target field. A preliminary study with four blind participants demonstrated that users could quickly learn the system, complete real-world forms with minimal training, and offered insights for improving field alignment and navigation. This work highlights the potential of wearable, multimodal interaction for accessible paper-based tasks.