Gesture Modeling by Hanklet-based Hidden Markov Model

Marco La Cascia, Liliana Lo Presti, Octavia Camps, Stan Sclaroff

Risultato della ricerca: Paper

20 Citazioni (Scopus)

Abstract

In this paper we propose a novel approach for gesture modeling. We aim at decomposing a gesture into sub-trajectories that are the output of a sequence of atomic linear time invariant (LTI) systems, and we use a Hidden Markov Model to model the transitions from the LTI system to another. For this purpose, we represent the human body motion in a temporal window as a set of body joint trajectories that we assume are the output of an LTI system. We describe the set of trajectories in a temporal window by the corresponding Hankel matrix (Hanklet), which embeds the observability matrix of the LTI system that produced it. We train a set of HMMs (one for each gesture class) with a discriminative approach. To account for the sharing of body motion templates we allow the HMMs to share the same state space. We demonstrate by means of experiments on two publicly available datasets that, even with just considering the trajectories of the 3D joints, our method achieves state-of-the-art accuracy while competing well with methods that employ more complex models and feature representations.
Lingua originaleEnglish
Stato di pubblicazionePublished - 2015

Fingerprint

Hidden Markov models
Gesture
Markov Model
Linear Time
Trajectories
Trajectory
Invariant
Modeling
Hankel Matrix
Motion
Output
Observability
Template
State Space
Sharing
Model
Demonstrate
Experiment
Experiments

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cita questo

Gesture Modeling by Hanklet-based Hidden Markov Model. / La Cascia, Marco; Lo Presti, Liliana; Camps, Octavia; Sclaroff, Stan.

2015.

Risultato della ricerca: Paper

@conference{ac7411b7a7f24f4bab50d5d2c86df951,
title = "Gesture Modeling by Hanklet-based Hidden Markov Model",
abstract = "In this paper we propose a novel approach for gesture modeling. We aim at decomposing a gesture into sub-trajectories that are the output of a sequence of atomic linear time invariant (LTI) systems, and we use a Hidden Markov Model to model the transitions from the LTI system to another. For this purpose, we represent the human body motion in a temporal window as a set of body joint trajectories that we assume are the output of an LTI system. We describe the set of trajectories in a temporal window by the corresponding Hankel matrix (Hanklet), which embeds the observability matrix of the LTI system that produced it. We train a set of HMMs (one for each gesture class) with a discriminative approach. To account for the sharing of body motion templates we allow the HMMs to share the same state space. We demonstrate by means of experiments on two publicly available datasets that, even with just considering the trajectories of the 3D joints, our method achieves state-of-the-art accuracy while competing well with methods that employ more complex models and feature representations.",
author = "{La Cascia}, Marco and {Lo Presti}, Liliana and Octavia Camps and Stan Sclaroff",
year = "2015",
language = "English",

}

TY - CONF

T1 - Gesture Modeling by Hanklet-based Hidden Markov Model

AU - La Cascia, Marco

AU - Lo Presti, Liliana

AU - Camps, Octavia

AU - Sclaroff, Stan

PY - 2015

Y1 - 2015

N2 - In this paper we propose a novel approach for gesture modeling. We aim at decomposing a gesture into sub-trajectories that are the output of a sequence of atomic linear time invariant (LTI) systems, and we use a Hidden Markov Model to model the transitions from the LTI system to another. For this purpose, we represent the human body motion in a temporal window as a set of body joint trajectories that we assume are the output of an LTI system. We describe the set of trajectories in a temporal window by the corresponding Hankel matrix (Hanklet), which embeds the observability matrix of the LTI system that produced it. We train a set of HMMs (one for each gesture class) with a discriminative approach. To account for the sharing of body motion templates we allow the HMMs to share the same state space. We demonstrate by means of experiments on two publicly available datasets that, even with just considering the trajectories of the 3D joints, our method achieves state-of-the-art accuracy while competing well with methods that employ more complex models and feature representations.

AB - In this paper we propose a novel approach for gesture modeling. We aim at decomposing a gesture into sub-trajectories that are the output of a sequence of atomic linear time invariant (LTI) systems, and we use a Hidden Markov Model to model the transitions from the LTI system to another. For this purpose, we represent the human body motion in a temporal window as a set of body joint trajectories that we assume are the output of an LTI system. We describe the set of trajectories in a temporal window by the corresponding Hankel matrix (Hanklet), which embeds the observability matrix of the LTI system that produced it. We train a set of HMMs (one for each gesture class) with a discriminative approach. To account for the sharing of body motion templates we allow the HMMs to share the same state space. We demonstrate by means of experiments on two publicly available datasets that, even with just considering the trajectories of the 3D joints, our method achieves state-of-the-art accuracy while competing well with methods that employ more complex models and feature representations.

UR - http://hdl.handle.net/10447/128000

UR - http://www.dicgim.unipa.it/~cvip/pdf/ACCV2014.pdf

M3 - Paper

ER -