Programming

Rocky, a desk robot

Rocky is a small desk robot with a face, a voice, and a camera. Say "hey Rocky" and he turns his head, looks at you, and answers out loud in character. The body is a $24 microcontroller with an OLED screen on a pan-and-tilt neck. The brain is a Python program running on a nearby computer that handles wake-word detection, speech-to-text, a language model, and text-to-speech, and streams the result back to the robot's speaker over Wi-Fi.

Out of the box he is Rocky, the Eridian engineer from Project Hail Mary: short sentences, "question" and "answer," "amaze," and constant worry about whether you have slept.

  • Wakes on his name, listens, and replies in a cloned voice.
  • Shows seven expressions, blinks, and dozes off when ignored.
  • Turns and nods, follows your face, and looks where you ask.
  • Sees through his camera and tells you what is there.
  • Decides when you have finished talking the way a person does, instead of waiting for a fixed pause.

Source code, wiring, and parts list on GitHub

Game mods on the Steam Workshop

Playable characters, monsters, and buildings I've written for games I enjoy. Each one is free on the Steam Workshop.

Slay the Spire 2

Whiskerwood