Summary of some practical children-related HCI works

TACTORBOTS

WHAT

  • TactorBots, which is used to explore emotional robotic touch outside the lab

  • to complete ’expressive haptic storytelling’ to test the function

HOW

  • toolkit

  • semi- structured interview

  • open-ended questions

Tangible Immersive Trauma Simulation

WHAT

  • Mixed Reality (MR) in medical skills training

  • superimposing virtual avatars on physical modals of human body, enables trainees to interact haptically and tangibly with the injured in a virtual accident scene using hands and real tools

HOW

  • toolkit

  • MR

  • Avatar

  • Haptics

HCI Children Learning

Bungo CA

  • WHAT

    • Use Conversational Agent to guide children to transfer a linguistic routine they learned to another person
  • HOW

    • Joint-media Engagement

    • Conversational Agent

    • VUI

ACCembly

  • WHAT

    • Children use a coding coolkit containing programmable blocks, under the guidance of parents, complete the task including system setup, sequence programming, loop, independent creation etc.
  • HOW

    • Mixed-Ability Collaboration

    • Robotics

    • TUI

RoboMath

  • WHAT

    • Children tell by voice through remote video which number the robot should choose to complete the task, so as to train children’s math ability
  • HOW

    • Linear Representation of Numbers

    • Robotics

PopupBot

  • WHAT

    • An origami-based transformable robotic space can change shape according to the child’s intention to provide an independent learning space at home
  • HOW

    • Limited Space on Children Development

    • Robotics

    • TUI

Elinor

  • WHAT

    • A conversational agent that promotes active learning in children by casually asking questions and giving responses
  • HOW

    • Narrative and Interactive Programme

    • Conversational Agent

    • GUI

    • VUI

Opi

  • WHAT

    • The home is transformed into a learning space in the form of sticker punch cards, encouraging children to explore the environment for learning at home
  • HOW

    • Mobile Learning

    • AR

    • GUI

Marvy Learns

  • WHAT

    • Children will use gestures to complete geometric problems in MBEG and receive responses in order to obtain their cognitive, emotional and physiological state during the problem solving process
  • HOW

    • Motion-Based Educational Games

    • GUI

    • GesUI

Floppy

  • WHAT

    • An app can monitor keywords as parents read stories and provide timely tips and questions to children. This virtual agent will create a certain emotional connection with the child
  • HOW

    • Joint-media Engagement

    • Conversational Agent

    • GUI

    • VUI

Misty II

  • WHAT

    • A social robots promote reading behavior in children by providing knowledge information and social comments
  • HOW

    • Companion Learning Assistance

    • Robotics

Miko

  • WHAT

    • Promote children’s learning and collaboration with social robots by optimizing the unboxing experience
  • HOW

    • Unboxing Phenomenon

    • Robotics

Family AI Literacies

  • WHAT

    • 11 learning activities are designed to explore how activities support the role of parents from the aspects of speech, vision and AI design etc.
  • HOW

    • Joint-media Engagement

    • Family AI Literacies

    • GUI

    • VUI

    • AR

Luka

  • WHAT

    • A picture book reading robot provides multi-modal learning methods such as scrolling and reading, finger point reading, following reading, pronunciation evaluation, etc
  • HOW

    • Robotic

    • Long-Term Acceptance

StoryBuddy

  • WHAT

    • Ai-assisted interactive storyboards for generating content that meets parents’ needs
  • HOW

    • GUI

    • Child-Agent Interaction

    • Question-Answer Generation