Sing with the Telenoid

Nishio, S; Ishiguro, I

Risultato della ricerca: Paper

Abstract

We introduce a novel research proposal project aimed to build a robotic setup in which the Telenoid learns to improvise jazz singing in a duet with a human singer. In the proposed application, the Telenoid acts in teleoperated mode during the learning phase, while it becomes more and more autonomous during the working phase. A goal of the research is to investigate the essence of human communication which is based on gestures and prosody. We will employ an architecture for imitation learning that incrementally learns from demonstrations sequences of internal model activations, based on the idea of coupled forward- inverse internal models for representing musical phrases and the body sequences of singer movements. Possible applications are in the field of entertainment, where the Telenoid setup system acts as a musical game like Guitar Hero or Rock Band; in the field of music learning; for the analysis of mental disorders as Autism, and to build a new generation of companion robots for elderly care.
Lingua originaleEnglish
Stato di pubblicazionePublished - 2012

Fingerprint

Robotics
Demonstrations
Chemical activation
Rocks
Robots
Communication

Cita questo

Nishio, S; Ishiguro, I (2012). Sing with the Telenoid.

Sing with the Telenoid. / Nishio, S; Ishiguro, I.

2012.

Risultato della ricerca: Paper

Nishio, S; Ishiguro, I 2012, 'Sing with the Telenoid'.
Nishio, S; Ishiguro, I. Sing with the Telenoid. 2012.
Nishio, S; Ishiguro, I. / Sing with the Telenoid.
@conference{2223a91f220a4c748c40f18692283ae9,
title = "Sing with the Telenoid",
abstract = "We introduce a novel research proposal project aimed to build a robotic setup in which the Telenoid learns to improvise jazz singing in a duet with a human singer. In the proposed application, the Telenoid acts in teleoperated mode during the learning phase, while it becomes more and more autonomous during the working phase. A goal of the research is to investigate the essence of human communication which is based on gestures and prosody. We will employ an architecture for imitation learning that incrementally learns from demonstrations sequences of internal model activations, based on the idea of coupled forward- inverse internal models for representing musical phrases and the body sequences of singer movements. Possible applications are in the field of entertainment, where the Telenoid setup system acts as a musical game like Guitar Hero or Rock Band; in the field of music learning; for the analysis of mental disorders as Autism, and to build a new generation of companion robots for elderly care.",
author = "{Nishio, S; Ishiguro, I} and Antonio Chella and Rosario Sorbello and Haris Dindo",
year = "2012",
language = "English",

}

TY - CONF

T1 - Sing with the Telenoid

AU - Nishio, S; Ishiguro, I

AU - Chella, Antonio

AU - Sorbello, Rosario

AU - Dindo, Haris

PY - 2012

Y1 - 2012

N2 - We introduce a novel research proposal project aimed to build a robotic setup in which the Telenoid learns to improvise jazz singing in a duet with a human singer. In the proposed application, the Telenoid acts in teleoperated mode during the learning phase, while it becomes more and more autonomous during the working phase. A goal of the research is to investigate the essence of human communication which is based on gestures and prosody. We will employ an architecture for imitation learning that incrementally learns from demonstrations sequences of internal model activations, based on the idea of coupled forward- inverse internal models for representing musical phrases and the body sequences of singer movements. Possible applications are in the field of entertainment, where the Telenoid setup system acts as a musical game like Guitar Hero or Rock Band; in the field of music learning; for the analysis of mental disorders as Autism, and to build a new generation of companion robots for elderly care.

AB - We introduce a novel research proposal project aimed to build a robotic setup in which the Telenoid learns to improvise jazz singing in a duet with a human singer. In the proposed application, the Telenoid acts in teleoperated mode during the learning phase, while it becomes more and more autonomous during the working phase. A goal of the research is to investigate the essence of human communication which is based on gestures and prosody. We will employ an architecture for imitation learning that incrementally learns from demonstrations sequences of internal model activations, based on the idea of coupled forward- inverse internal models for representing musical phrases and the body sequences of singer movements. Possible applications are in the field of entertainment, where the Telenoid setup system acts as a musical game like Guitar Hero or Rock Band; in the field of music learning; for the analysis of mental disorders as Autism, and to build a new generation of companion robots for elderly care.

UR - http://hdl.handle.net/10447/76845

M3 - Paper

ER -