Combining skeletal pose with local motion for human activity recognition

Ran Xu, Priyanshu Agarwal, Suren Kumar, Venkat N. Krovi, Jason J. Corso

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

20 Scopus citations

Abstract

Recent work in human activity recognition has focused on bottom-up approaches that rely on spatiotemporal features, both dense and sparse. In contrast, articulated motion, which naturally incorporates explicit human action information, has not been heavily studied; a fact likely due to the inherent challenge in modeling and inferring articulated human motion from video. However, recent developments in data-driven human pose estimation have made it plausible. In this paper, we extend these developments with a new middle-level representation called dynamic pose that couples the local motion information directly and independently with human skeletal pose, and present an appropriate distance function on the dynamic poses. We demonstrate the representative power of dynamic pose over raw skeletal pose in an activity recognition setting, using simple codebook matching and support vector machines as the classifier. Our results conclusively demonstrate that dynamic pose is a more powerful representation of human action than skeletal pose.

Original languageEnglish
Title of host publicationArticulated Motion and Deformable Objects - 7th International Conference, AMDO 2012, Proceedings
Pages114-123
Number of pages10
DOIs
StatePublished - 2012
Event7th International Conference on Articulated Motion and Deformable Objects, AMDO 2012 - Port d'Andratx, Mallorca, Spain
Duration: 11 Jul 201213 Jul 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7378 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference7th International Conference on Articulated Motion and Deformable Objects, AMDO 2012
Country/TerritorySpain
CityPort d'Andratx, Mallorca
Period11/07/1213/07/12

Keywords

  • Activity Recognition
  • Dynamic Pose
  • Human Pose

Fingerprint

Dive into the research topics of 'Combining skeletal pose with local motion for human activity recognition'. Together they form a unique fingerprint.

Cite this