wtf
Exploring genUI for agentic multimodal interaction (e.g. Opus 4.6 for OpenClaw)
YouTube Video
Project Description
Where To Flock (wtf) is a multiplayer day-trip planner that kills the group chat. Instead of endless “wdyt about this place?” messages, users claim temporal blocks on a shared timeline by dragging their avatars — Breakfast, Morning Activity, Afternoon — and the AI handles the rest.
But “handles the rest” isn’t a chat response. When you claim a block, Claude analyzes the group’s emerging preferences and the day’s shape so far, then decides what kind of decision this moment requires — and generates the interface for it. A vibe-driven choice gets a this-or-that image card. A tradeoff gets a 2D slider. A simple confirmation gets a single tap. The user never sees a text box. The interface is the conversation.
This is the core innovation: Claude doesn’t just generate answers, it generates the interaction itself. It reasons about what type of input it needs, selects from a catalog of Flutter widgets, and populates them contextually — all through structured JSON that drives a deterministic state machine through parallel planning, cross-approval, and finalization. No chat. No menus. No forms. Just the right surface at the right moment.
This is impossible without Claude specifically. The model must track multiple users’ evolving preferences, reason about which widget type fits each decision point, and produce strictly structured output that drives real UI — all while maintaining coherence across a multi-turn, multi-player flow. Generic LLMs lack the instruction-following precision and contextual reasoning to keep this system stable and adaptive simultaneously.
Prior Work
https://github.com/dart-technologies/genui forked (pin v0.9) from https://github.com/flutter/genui