An automatic system for humanoid dance creation

Salvatore Gaglio, Ignazio Infantino, Filippo Vella, Filippo Vella, Ignazio Infantino

Risultato della ricerca: Article

12 Citazioni (Scopus)

Abstract

The paper describes a novel approach to allow a robot to dance following musical rhythm. The proposed system generates a dance for a humanoid robot through the combination of basic movements synchronized with the music. The system made up of three parts: the extraction of features from audio file, estimation of movements through the Hidden Markov Models and, finally, the generation of dance. Starting from a set of given movements, the robot choices sequence of movements a suitable Hidden Markov Model, and synchronize them processing musical input. The proposed approach has the advantage that movement execution probabilities could be changed according evaluation of the dance execution in order to have an artificial creative system. In the same way, a choreographer could give more importance to some movements and/or exclude others, using the system as a co-creation tool. The approach has been tested on Aldebaran NAO humanoid using different genres of music, and experimentations was conduct at presence of real human dancers to have feedback of the goodness of the robot execution. Three professional judges expressed their evaluations about the following points: appropriateness of movements for a given musical genre; the precision to track the rhythm; the aesthetic impact of the whole sequence of movements; and the overall judgment of the robot performance. All the evaluations are very satisfying, and confirm that robot dance is realistic and aesthetically acceptable. The robustness and flexibility of the system allow us to embed the system in artificial creative system in future work. In the discussion we introduce some issues to pursuit this aim, using a previous proposed cognitive architecture based on needs and motivations.
Lingua originaleEnglish
pagine (da-a)1-9
Numero di pagine9
RivistaBiologically Inspired Cognitive Architectures
Volume15
Stato di pubblicazionePublished - 2016

Fingerprint

Dancing
Robots
Music
Hidden Markov models
Esthetics
Motivation
Feedback
Processing

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Cognitive Neuroscience
  • Artificial Intelligence

Cita questo

Gaglio, S., Infantino, I., Vella, F., Vella, F., & Infantino, I. (2016). An automatic system for humanoid dance creation. Biologically Inspired Cognitive Architectures, 15, 1-9.

An automatic system for humanoid dance creation. / Gaglio, Salvatore; Infantino, Ignazio; Vella, Filippo; Vella, Filippo; Infantino, Ignazio.

In: Biologically Inspired Cognitive Architectures, Vol. 15, 2016, pag. 1-9.

Risultato della ricerca: Article

Gaglio, S, Infantino, I, Vella, F, Vella, F & Infantino, I 2016, 'An automatic system for humanoid dance creation', Biologically Inspired Cognitive Architectures, vol. 15, pagg. 1-9.
Gaglio, Salvatore ; Infantino, Ignazio ; Vella, Filippo ; Vella, Filippo ; Infantino, Ignazio. / An automatic system for humanoid dance creation. In: Biologically Inspired Cognitive Architectures. 2016 ; Vol. 15. pagg. 1-9.
@article{d2a28da64a4446d1a8cf26332c414b5a,
title = "An automatic system for humanoid dance creation",
abstract = "The paper describes a novel approach to allow a robot to dance following musical rhythm. The proposed system generates a dance for a humanoid robot through the combination of basic movements synchronized with the music. The system made up of three parts: the extraction of features from audio file, estimation of movements through the Hidden Markov Models and, finally, the generation of dance. Starting from a set of given movements, the robot choices sequence of movements a suitable Hidden Markov Model, and synchronize them processing musical input. The proposed approach has the advantage that movement execution probabilities could be changed according evaluation of the dance execution in order to have an artificial creative system. In the same way, a choreographer could give more importance to some movements and/or exclude others, using the system as a co-creation tool. The approach has been tested on Aldebaran NAO humanoid using different genres of music, and experimentations was conduct at presence of real human dancers to have feedback of the goodness of the robot execution. Three professional judges expressed their evaluations about the following points: appropriateness of movements for a given musical genre; the precision to track the rhythm; the aesthetic impact of the whole sequence of movements; and the overall judgment of the robot performance. All the evaluations are very satisfying, and confirm that robot dance is realistic and aesthetically acceptable. The robustness and flexibility of the system allow us to embed the system in artificial creative system in future work. In the discussion we introduce some issues to pursuit this aim, using a previous proposed cognitive architecture based on needs and motivations.",
keywords = "Artificial Intelligence, Co-creative tool, Cognitive Neuroscience, Computational creativity, Dance, Experimental and Cognitive Psychology, Music perception, Robot",
author = "Salvatore Gaglio and Ignazio Infantino and Filippo Vella and Filippo Vella and Ignazio Infantino",
year = "2016",
language = "English",
volume = "15",
pages = "1--9",
journal = "Biologically Inspired Cognitive Architectures",
issn = "2212-683X",
publisher = "Elsevier BV",

}

TY - JOUR

T1 - An automatic system for humanoid dance creation

AU - Gaglio, Salvatore

AU - Infantino, Ignazio

AU - Vella, Filippo

AU - Vella, Filippo

AU - Infantino, Ignazio

PY - 2016

Y1 - 2016

N2 - The paper describes a novel approach to allow a robot to dance following musical rhythm. The proposed system generates a dance for a humanoid robot through the combination of basic movements synchronized with the music. The system made up of three parts: the extraction of features from audio file, estimation of movements through the Hidden Markov Models and, finally, the generation of dance. Starting from a set of given movements, the robot choices sequence of movements a suitable Hidden Markov Model, and synchronize them processing musical input. The proposed approach has the advantage that movement execution probabilities could be changed according evaluation of the dance execution in order to have an artificial creative system. In the same way, a choreographer could give more importance to some movements and/or exclude others, using the system as a co-creation tool. The approach has been tested on Aldebaran NAO humanoid using different genres of music, and experimentations was conduct at presence of real human dancers to have feedback of the goodness of the robot execution. Three professional judges expressed their evaluations about the following points: appropriateness of movements for a given musical genre; the precision to track the rhythm; the aesthetic impact of the whole sequence of movements; and the overall judgment of the robot performance. All the evaluations are very satisfying, and confirm that robot dance is realistic and aesthetically acceptable. The robustness and flexibility of the system allow us to embed the system in artificial creative system in future work. In the discussion we introduce some issues to pursuit this aim, using a previous proposed cognitive architecture based on needs and motivations.

AB - The paper describes a novel approach to allow a robot to dance following musical rhythm. The proposed system generates a dance for a humanoid robot through the combination of basic movements synchronized with the music. The system made up of three parts: the extraction of features from audio file, estimation of movements through the Hidden Markov Models and, finally, the generation of dance. Starting from a set of given movements, the robot choices sequence of movements a suitable Hidden Markov Model, and synchronize them processing musical input. The proposed approach has the advantage that movement execution probabilities could be changed according evaluation of the dance execution in order to have an artificial creative system. In the same way, a choreographer could give more importance to some movements and/or exclude others, using the system as a co-creation tool. The approach has been tested on Aldebaran NAO humanoid using different genres of music, and experimentations was conduct at presence of real human dancers to have feedback of the goodness of the robot execution. Three professional judges expressed their evaluations about the following points: appropriateness of movements for a given musical genre; the precision to track the rhythm; the aesthetic impact of the whole sequence of movements; and the overall judgment of the robot performance. All the evaluations are very satisfying, and confirm that robot dance is realistic and aesthetically acceptable. The robustness and flexibility of the system allow us to embed the system in artificial creative system in future work. In the discussion we introduce some issues to pursuit this aim, using a previous proposed cognitive architecture based on needs and motivations.

KW - Artificial Intelligence

KW - Co-creative tool

KW - Cognitive Neuroscience

KW - Computational creativity

KW - Dance

KW - Experimental and Cognitive Psychology

KW - Music perception

KW - Robot

UR - http://hdl.handle.net/10447/191058

UR - http://www.journals.elsevier.com/biologically-inspired-cognitive-architectures/

M3 - Article

VL - 15

SP - 1

EP - 9

JO - Biologically Inspired Cognitive Architectures

JF - Biologically Inspired Cognitive Architectures

SN - 2212-683X

ER -