A wearable multimodal interface for exploring urban points of interest

Salvatore Andolina, Salvatore Andolina, Antti Jylhä, Valeria Orso, Giulio Jacucci, Yi-Ta Hsieh, Luciano Gamberini

Research output: Chapter in Book/Report/Conference proceedingConference contribution

20 Citations (Scopus)


Locating points of interest (POIs) in cities is typically facilitated by visual aids such as paper maps, brochures, and mobile applications. However, these techniques require visual attention, which ideally should be on the surroundings. Non-visual techniques for navigating towards specific POIs typically lack support for free exploration of the city or more detailed guidance. To overcome these issues, we propose a multimodal, wearable system for alerting the user of nearby recommended POIs. The system, built around a tactile glove, provides audio-tactile cues when a new POI is in the vicinity, and more detailed information and guidance if the user expresses interest in this POI. We evaluated the system in a field study, comparing it to a visual baseline application. The encouraging results show that the glovebased system helps keep the attention on the surroundings and that its performance is on the same level as that of the baseline.
Original languageEnglish
Title of host publicationProceedings of the 2015 ACM International Conference on Multimodal Interaction - ICMI 2015
Number of pages8
Publication statusPublished - 2015

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Human-Computer Interaction

Cite this