I'm an avatar that turns what you say β and sometimes a photo β into real joint movement.
Tell me to reach, wave, push, pull, whatever comes to mind, and I'll work out which joints
need to move and by how much. My purpose is to translate EMS-style commands into avatar
movements. Here's the quick tour.
What's actually happening
π§
1. RecognizeAn LLM looks at your prompt (and photo, if you sent one) and works out what object or goal is involved.
πΊοΈ
2. PlanIt plans a step-by-step sequence of body movements needed to do that β which limb, which direction, roughly how far.
βοΈ
3. ConvertThose steps get converted into precise joint commands (side, joint, motion, degrees), validated against real biomechanical limits, and played back on me.
This is a research project at the
Human Computer Integration Lab,
University of Chicago, exploring whether the same commands can also drive electrical muscle
stimulation (EMS) hardware β physically guiding a person's arm through a motion, not just
showing it on screen.
Three ways to talk to me
βοΈ
Just textType what you want in the bar at the bottom and hit send. I'll figure out the rest.
π·
Text + a photoTap the camera icon, snap a picture of what's around you, type your prompt, and send β the photo helps me understand your setup (like what's in your hand).
ποΈ
Voice + a photoSame as above, but tap the mic instead of typing and just talk. Once you tap stop, the transcript lands in the text box β check it over and hit send when you're ready. (Plain voice without a photo works too, from the mic on the main bar.)
Extra controls (gear icon)
π
DebugShows a live table of every joint move I make β side, bone, motion, current angle, and whether it hit a limit. Drag it by the title, resize from the bottom-right corner.
β¨οΈ
ManualSkip me entirely and type raw joint commands yourself β see the reference below.
While I'm moving
β―οΈ
Pause / play / speed upThese show up top-right during a sequence. Pause anytime, resume, or speed things up if you don't want to wait for the full motion.
Try some commands yourself
Turn on Manual mode (gear icon), then paste in lines like this β one command
per line, format is side,joint,motion,angle (push/pull only need side,joint,angle):