← Back

A 3D avatar you control by typing, talking, or showing it a photo. An LLM pipeline turns your prompt into real joint movement played back on the avatar, and in the full lab setup, mirrored onto a person wearing electrical muscle stimulation (EMS) electrodes.

hey Embodied AI, shake and spray this
hey Embodied AI, help with this
hey Embodied AI, help me drink from this

About the project

Embodied AI is a research prototype built at the Human Computer Integration Lab at the University of Chicago. It explores whether a large language model can plan physically plausible, biomechanically valid body movements from an open-ended instruction — recognizing the object or goal involved, planning a sequence of joint movements to achieve it, and converting that plan into precise joint-level commands — and have those commands played back on a 3D avatar in real time.

The same command format is designed to drive electrical muscle stimulation (EMS) hardware, letting the system physically guide a person's own arm through a motion rather than just showing it on screen — the lab's broader research direction on devices that integrate directly with the human body instead of just sitting alongside it.

Citations

Generative Muscle Stimulation: Providing Users with Physical Assistance by Constraining Multimodal-AI with Embodied Knowledge
Yun Ho*, Romain Nith*, Peili Jiang, Steven He, Bruno Felalaga, Shan-Yuan Teng, Pedro Lopes. Proceedings of CHI 2026. · PDF · project page
Human Computer Integration Lab
Directed by Prof. Pedro Lopes, Computer Science Department, University of Chicago. · lab.plopes.org