Multimodal Communication in HRI

For forty years, the screen was the universal interface. If you wanted to communicate with a user, you put it on a glowing rectangle. Text, icons, modal dialogs. Designers mastered the art of managing what appeared on that surface and in what order.

Robots shatter this paradigm. The robots that actually matter (collaborative factory arms, hospital delivery bots, autonomous vehicles) operate in physical spaces where screens are useless. A worker carrying a fifty-pound load cannot stop to read a modal dialog. A surgeon cannot look away from a patient to check a robot's battery status.

Physical robots must communicate through the environment itself. They use sound, light, motion, and touch. Designing these channels deliberately is called multimodal communication. It is arguably the most technically creative area of HRI.