Skip to content

Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.

563 B
Raw Blame

Changelog

Unreleased (main)

  • No computer: the ESP32 is the AirPlay receiver (ported from UxPlay) with its own hotspot, and talks to a new iPhone app over BLE. The app is the agent: planner/actor loop, pointer calibration, run replay, Live Activity, widgets, Siri and Shortcuts, self-healing when the board, hotspot or mirroring drops.
  • Prompts moved to prompts/.
  • Product name: ESP32 Agent.
  • server/ is legacy and no longer needed.

v0.1.0

  • Computer-side version: UxPlay + Python server + web UI; the ESP32 is a USB HID bridge over Wi-Fi.