Decoding Children’s Social Behavior

Liliana Lo Presti, Mark A. Clements, Gregory D. Abowd, Mario Romero, Jonathan C. Kim, Liliana Lo Presti, Hrishikesh Rao, Jianming Zhang, Zhefan Ye, Jonathan Bidwell, Chanho Kim, Denis Lantsman, Yin Li, Opal Y. Ousley, Irfan Essa, Stan Sclaroff, James M. Rehg, Agata Rozga

Risultato della ricerca: Other

88 Citazioni (Scopus)


We introduce a new problem domain for activity recog- nition: the analysis of children’s social and communica- tive behaviors based on video and audio data. We specif- ically target interactions between children aged 1–2 years and an adult. Such interactions arise naturally in the di- agnosis and treatment of developmental disorders such as autism. We introduce a new publicly-available dataset con- taining over 160 sessions of a 3–5 minute child-adult inter- action. In each session, the adult examiner followed a semi- structured play interaction protocol which was designed to elicit a broad range of social behaviors. We identify the key technical challenges in analyzing these behaviors, and de- scribe methods for decoding the interactions. We present experimental results that demonstrate the potential of the dataset to drive interesting research questions, and show preliminary results for multi-modal activity recognition.
Lingua originaleEnglish
Numero di pagine8
Stato di pubblicazionePublished - 2013


All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition

Cita questo

Lo Presti, L., Clements, M. A., Abowd, G. D., Romero, M., Kim, J. C., Presti, L. L., Rao, H., Zhang, J., Ye, Z., Bidwell, J., Kim, C., Lantsman, D., Li, Y., Ousley, O. Y., Essa, I., Sclaroff, S., Rehg, J. M., & Rozga, A. (2013). Decoding Children’s Social Behavior. 3414-3421.