Hackathon Portal
AI Tinkerers - New York City
Final round winners have been announced. View Results
Team

ZerahUI

Project Concept

Zerah — The Personal Assistant That Lives in a Sphere

We didn’t build another chat box. We built a living, breathing visual field that understands you, speaks to you, and organizes your entire life in three dimensions.


The Problem

Every productivity tool today is a list. A calendar grid. A kanban column. A flat surface that makes you feel like you’re managing spreadsheets, not living your life. You open five apps to see your week. You miss urgent items buried in a tab. You talk to an AI and get a wall of text back.

We asked a different question: what if your assistant could feel spatial? What if it could talk back?


What We Built

Zerah is an agentic personal assistant built around a 3D particle sphere. Your life — work, health, finances, personal tasks, learning, and urgent alerts — exists as six luminous clusters orbiting inside a single field. Nothing is hidden in a menu. Everything is present, always, in one glance.

The Sphere

Six categories of your life are represented as glowing dot clouds. Each cluster has its own color, its own position in 3D space, its own gravitational center. The sphere breathes. It rotates. When something is urgent, it pulses. When you select a cluster, it expands toward you and every task inside it becomes visible, floating in space, labeled in light.

The Orrery

At the top of the screen sits a miniature solar system — four concentric orbital rings, each representing a time scale. The innermost ring orbits fast: that’s your day. Moving outward: week, month, year. The center node resets everything.

There are no labels until you need them. Hover any ring and tick marks materialize — 24 for a day, 7 for a week, 12 for a year. Click a ring and the entire sphere reorganizes itself temporally, pulling tasks into orbital bands by when they’re scheduled. The visual metaphor is immediate: things close to the center are near in time. Things far out are far away. No reading required. Your brain understands it before your eyes finish moving.

Clusters That Talk Back

This is the feature that changes everything. When you select a cluster — by clicking, by touching, or by voice — Zerah speaks to you. Not a notification sound. A full natural-language summary of what’s in that cluster, delivered in your voice, in your language.

“Work. You have five items. First, team standup at nine AM. Next, client presentation on Wednesday. Also, the product roadmap is due in two weeks…”

Switch to the week view and Zerah reads a summary of everything scheduled across all clusters for the next seven days. The sphere becomes a spatial voice assistant. It doesn’t wait for you to ask. It tells you what you need to know the moment you look at it.


Technical Architecture

Zerah is a single HTML file. No framework. No build step. No node_modules. It runs anywhere.

  • Rendering: Canvas 2D, fully custom particle engine with 3D projection, depth sorting, and per-dot physics
  • Voice Input: Web Speech API (Chrome/Edge) with a clean external STT integration surface for Deepgram, Whisper, or any provider
  • Voice Output: SpeechSynthesis API with smart voice selection, designed to be swapped for ElevenLabs or Azure TTS in production
  • Bilingual: Full EN/ES support with automatic language detection from transcript content, character heuristics, and stopword analysis — no explicit language switch required
  • Agent API: window.Zerah exposes a complete programmatic surface for backend integration — push tasks, trigger pulses, respond from agents, drive voice state externally
  • Guardrails: A full claude.md governs every agent in the system — anti-hallucination rules, voice security, PII handling, confidence gating, prompt injection defense, and bilingual routing contracts

The backend hooks are three async functions in a CONFIG block at the top of the file. Point them at your API and the interface comes alive with real data.


Goals

Short term (hackathon)

  • Demonstrate the full voice loop: speak → sphere reacts → cluster responds → Zerah talks back
  • Show bilingual switching mid-conversation with no explicit command
  • Connect to a live Claude API backend that populates clusters in real time

Medium term

  • Replace Web Speech API with Deepgram for production-grade STT accuracy
  • Replace SpeechSynthesis with ElevenLabs for a voice that matches the aesthetic
  • Connect calendar, email, and health APIs to populate clusters automatically
  • Add persistent memory via a memory agent that learns your patterns

Long term

  • Make the sphere collaborative — a shared field for teams where each person’s tasks appear as a distinct orbital layer
  • Mobile-native with gesture controls replacing mouse interaction
  • AR layer so the sphere lives in your physical space

What Makes This Different

Most AI assistants are reactive. You type, they answer. You ask, they respond. The interaction is sequential, text-based, an

Entry

Status: Submitted

Last saved: February 21 at 5:39 PM EST

Team Roster

You must be registered for the event to view the team message board.

Navrioska Mateo Mejia Team Lead RSVP Approved

Senior Technical Program Manager at Contractor
Product Design, Team Lead, PM, VibeCoding with Claude Code, Demo voice off
Navrioska Mateo Mejía is a senior technical program leader with 14+ years of experience driving complex, cross-functional initiatives across AdTech, telecommunications, and large-scale infrastructure. She specializes in connecting people, systems, and strategy to deliver measurable impact at scale. With a career spanning global organizations and high-growth environments, Navrioska is known for translating ambiguity into execution, building trusted partnerships, and leading programs that move both technology and teams forward.
• Strategic Technical Leadership • Systems Architecture & Platform Readiness • AI for Social Impact • Mentorship & Women in Leadership
1. Publishing How Awesome Is My Hair Currently leading the end-to-end publishing process for How Awesome Is My Hair, a children’s book celebrating self-confidence, identity, and representation. This project spans concept development, storytelling, creative direction, production, and go-to-market planning, blending creativity with disciplined execution to bring a meaningful story to life. 2. AI-Enabled Startup for Elder Self-Sufficiency In the early stages of establishing a startup focused on he

Karen Kuo RSVP Approved

Senior Developer at Autodesk
Visual Animation Integration
Karen Kuo is a Senior Developer at Autodesk, focusing on Dynamo and Computational Design. With 10 years of experience, she has studied Design Technology and Architecture at institutions including Harvard University Graduate School of Design and MIT.
Exploring modern, next generation visual programming tool

Albert Lie RSVP Approved

Software Engineer at Albert Company
Claude Code and AI Engineering Promting
Building scale.ai for freight to help freight businesses catch up with tech in US and Asia. Prev: US Digital Service & Early Engineer @ YC startups Linkedin: https://www.linkedin.com/in/leeyingde
AI in freight, logistics technology, scale.ai, US and Asia freight business modernization, startup engineering, digital service technology
Currently working on scale.ai for freight, developing technology solutions to modernize freight businesses in the US and Asia. The project focuses on helping traditional freight companies adopt and integrate advanced technological systems, likely involving AI-driven platforms to improve logistics and transportation efficiency.

Siddhi Mhatre RSVP Approved

Student at New York University
AI Voice Integration, AI Voice Speach Recognition, Text to Speech Enginering
Siddhi Mhatre is a Lead Developer at New York University with 3 years of experience. They studied Computer Science and Computer Engineering at New York University and the University of Mumbai.