TY - JOUR
T1 - SmallTAL
T2 - Real-Time Egocentric Online Temporal Action Localization for the Data-Impoverished
AU - Joyce, Eric C.
AU - Chen, Yao
AU - Neeter, Eduardo
AU - Mordohai, Philippos
N1 - Publisher Copyright:
© 2024 by the Massachusetts Institute of Technology.
PY - 2023
Y1 - 2023
N2 - We propose a real-time, online temporal action localization system that requires a small amount of annotated data. The main challenges we address are high intra-class variability and a large and diverse background class. We address these using a flexible frame descriptor, dynamic time warping, and a novel approach to database construction. Our solution receives egocentric RGB-D streams as input and makes predictions at regular temporal intervals. We validate our approach by localizing actions in a digital twin of an electrical substation, in which certain objects have been replaced by functional virtual replicas.
AB - We propose a real-time, online temporal action localization system that requires a small amount of annotated data. The main challenges we address are high intra-class variability and a large and diverse background class. We address these using a flexible frame descriptor, dynamic time warping, and a novel approach to database construction. Our solution receives egocentric RGB-D streams as input and makes predictions at regular temporal intervals. We validate our approach by localizing actions in a digital twin of an electrical substation, in which certain objects have been replaced by functional virtual replicas.
UR - http://www.scopus.com/inward/record.url?scp=85193237878&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85193237878&partnerID=8YFLogxK
U2 - 10.1162/pres_a_00408
DO - 10.1162/pres_a_00408
M3 - Article
AN - SCOPUS:85193237878
SN - 1054-7460
VL - 32
SP - 179
EP - 203
JO - Presence: Teleoperators and Virtual Environments
JF - Presence: Teleoperators and Virtual Environments
ER -