Human–Computer Interaction on the Skin

Author

JOANNA BERGSTRÖM and KASPER HORNBÆK, ACM Computing Surveys

Keywords

Skin input, on-body interaction, tracking technologies

WHAT

  • what skin input is,

  • which technologies can sense input on the skin,

  • how to give feedback to the user

WHY

  • enable new input types

  • free people from carrying mobile devices and extends input areas to support off-screen input

  • help to achieve better user experience and effectiveness

HOW

  • exact queries

  • forward chaining reference search

  • screening

  • inclusion

Results

  • Input on the skin

    • Types of input: tapping, touch gestures, deformation of the skin, varying the area of skin contact

    • Location of input: hands and the fingers, wrist and forearm and others

    • Evaluating input on the skin: user studies

  • Technology for skin input

    • Types of Sensing

      • Optical

        • Motion capture systems

        • Image processing

      • On-skin

        • sound or ultrasound

      • Touch

        • capacitive touch sensors, piezo-electrical sensors, and pressure sensors

    • Technical Performance

      • Recognition accuracies

      • Resolution

      • Movement of the user

  • Designing for the skin

    • Mapping Input to the Features of the Skin

      • Layout

        • Input performance

        • Untangle how the displayed targets are organized on the skin

      • Landmark

    • Feedback for Skin Input

      • Visual feedback

      • Audio feedback

Challenges

  • Toward Expressive Input

    • how to use the skin for expressive input

  • Real-Life Use of Skin-Based Interfaces

    • how to transfer on-skin interaction from the laboratory to real use

  • Designing Skin Input and Output

    • how to map user interfaces to the skin