Feel Effects: Enriching Storytelling with Haptic Feedback

Project Members

Ali Israr (Disney Research Pittsburgh)
Siyan (Susan) Zhao (Disney Research Pittsburgh)
Kaitlyn Schwalje (Disney Research Pittsburgh)
Roberta Klatzky (Carnegie Mellon University)
Jill F. Lehman (Disney Research Pittsburgh)

Ali Israr (Disney Research Pittsburgh)
Siyan Zhao (Disney Research Pittsburgh)
Kaitlyn Schwalje (Disney Research Pittsburgh)
Roberta Klatzky (Carnegie Mellon University)
Jill Lehman (Disney Research Pittsburgh)

Project_FeelEffects_SAP2014_teaser

[Press Release]

Despite a long history of use in communication, haptic feedback is a relatively new addition to the toolbox of special effects. Unlike artists who use sound or vision, haptic designers cannot simply access libraries of effects that map cleanly to media content, and they lack even guiding principles for creating such effects. In this paper, we make progress toward both capabilities: we generate a foundational library of usable haptic vocabulary and do so with a methodology that allows ongoing additions to the library in a principled and effective way. We define a feel effect as an explicit pairing between a meaningful linguistic phrase and a rendered haptic pattern. Our initial experiment demonstrates that users who have only their intrinsic language capacities, and no haptic expertise, can generate core set of feel effects that lend themselves via semantic inference to the design of additional effects. The resulting collection of more than forty effects covers a wide range of situations (including precipitation, animal locomotion, striking and pulsating events) and is empirically shown to produce the named sensation for the majority of our test users in a second experiment. Our experiments demonstrate a unique and systematic approach to designing a vocabulary of haptic sensations that are related in both the semantic and parametric spaces.

Project_Feel Effects_SAP2014_thumbnail
Feel Effects: Enriching Storytelling with Haptic Feedback
Ali Israr (DRP), Siyan Zhao (DRP), Kaitlyn Schwalje (DRP), Roberta Klatzky (CMU), Jill Lehman (DRP)
ACM Symposium on Applied Perception (SAP) [formerly APGV] – August 8-9, 2014
Paper [PDF, 4MB]

 

 

 


 

Gallery

A custom haptic hardware consists of 24 high quality C2 tactors and mounted on the back of the chair.

A custom haptic hardware consists of 24 high quality C2 tactors and mounted on the back of the chair.

 

Location and distribution of the parametric settings for FEs in a 3D haptic parametric space. Each light dot is the setting of one subject; the heavy dot represents the weighted mean value (CPS). (a) Parametric settings of FEs for antonyms are widely separated in the space, while (b) settings of semantically similar or synonymous FEs are in close vicinity with overlapping volumes, and (c) a family of semantically related FEs define a larger volume within which additional FEs (purple dot) can be inferred.

Location and distribution of the parametric settings for FEs in a 3D haptic parametric space. Each light dot is the
setting of one subject; the heavy dot represents the weighted mean value (CPS). (a) Parametric settings of FEs for antonyms are
widely separated in the space, while (b) settings of semantically similar or synonymous FEs are in close vicinity with overlapping
volumes, and (c) a family of semantically related FEs define a larger volume within which additional FEs (purple dot) can be
inferred.

 

A library of Feel Effects consists of six families and associated 50+ Feel Effects.

A library of Feel Effects consists of six families and associated 50+ Feel Effects.

 

A multiview authoring tool. Presets for “heavy rain” and “light rain” are shown in parametric space in the leftmost view, with the heavy dot indicating the current parameter settings as controlled by sliders in the middle view. The available library of presets for the family is listed in a meaningful order in the rightmost view.

A multiview authoring tool. Presets for “heavy rain” and “light rain” are shown in parametric space in the leftmost view,
with the heavy dot indicating the current parameter settings as controlled by sliders in the middle view. The available library
of presets for the family is listed in a meaningful order in the rightmost view.

 

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.