disciplines
systems-design
ai-agents
ux
ui
prototyping

Designing the Persona System, a Local-First AI App

Client
Year
2026

Project Summary

The Persona System is a local-first, on-device AI app for iOS, built under Nupixl. Your data and your AI companion live on your phone, not on someone else's server. I designed the architecture, the rules the system can never break, and the interface, then packaged it all as a full spec and test suite so development starts on solid ground.

01
Phase One

Spec before code

The build started as a five-document spec package: the architecture, the invariants, a milestone implementation plan, and a UI handoff. The invariants define what must always be true, so every future feature gets checked against them instead of against someone's memory.

Retro sci-fi screenprint of a woman with a glowing AI companion inside a glass dome.
02
Phase Two

Proven before there's a screen

A Swift Package skeleton with separate PersonaKit and FileStore targets, a full invariant test suite, and fixture bundles, including a golden-path demo persona. The system's behavior is proven before the interface exists.

A scientist inspects a glowing companion figure on a test bench.
03
Phase Three

Voice that stays on the device

For speech I chose Marvis-TTS, a 250-million-parameter model under the Apache 2.0 license, running through mlx-audio-swift, over a larger model with tighter licensing. Voice runs locally and the licensing stays clean.

A man on a phone inside a glass dome, his voice staying inside.
04
Phase Four

An interface with momentum

A floating three-part bottom bar, a persona briefing card, a category-tick timeline, a narrative momentum widget, and a glass aesthetic over live camera passthrough. The interface was prototyped in Claude Design, which replaced the earlier Figma wireframes.

A woman swipes through floating glass panels shaped like a phone interface.
Sign Up For My Weekly Newsletter
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Back Top