Riftmender
Your world is the inventory: borrow powers from everyday objects to cross a broken world and battle a boss in your camera feed.
About the project
Your world is the inventory
Riftmender combines a short platforming adventure with a camera-backed boss encounter. In The Broken Reach, a small hero crosses floating islands using spectral bridges borrowed from the shapes of everyday objects. A notebook or ruler represents a bridge, a broad surface a shield, a shiny object a reflector, and an elongated prop a stronger fantasy strike.
At the portal, the adventure becomes Reality Raid: the Rift Warden appears over the live camera backdrop. Players dodge or guard against orb volleys and beams, then counterattack during exposed-core windows. The encounter includes an accelerated second phase, retry and victory. This is camera compositing, not room-mapped AR.
How it is built
JavaScript ES modules, HTML/CSS, Canvas 2D, Node.js, browser MediaDevices and local MediaPipe hand tracking. The implementation supports sideways hand movement, pinch-to-jump, open-palm guarding and swipe attacks. The Gemini Decisions API integration checks captured images against fixed visibility and object-property criteria; deterministic game rules control ability unlocks, bridge placement and damage. Hydrogen provides optional cosmetic item names and descriptions.
Current prototype and validation
One traversal level and one boss are implemented. Keyboard controls and explicitly labelled practice items support play without an API key; a standalone HTML edition runs without a local server. Nineteen automated tests pass, covering gameplay, decision validation and simulated camera lifecycle checks. UI source checks cover 61 element references.
Live external-camera operation, a complete visual playthrough and successful Gemini API calls are not yet verified. Practice items are manual test inputs, not AI recognition. ChatGPT/Codex assisted with design, implementation, tests and documentation. Source repository and demo video links are pending.
Built with
AI tools
Prize Categories Entered
- Event prizeSubmitted
Best Overall Hack
A compact adventure turns everyday physical objects into bridges, shields and attacks, then brings the boss into the live camera backdrop. The prototype combines a traversal level, a boss encounter, local gesture controls and clearly labelled no-key practice mode. Live camera and Gemini validation are still pending.
- Event prizeSubmitted
Best Use of System One Models
The Gemini Decisions API integration asks independent yes/no questions about a captured object and gates abilities using explicit probability thresholds. Physics and combat stay deterministic and local. This integration is implemented in source; successful live model calls are not yet verified.
- Event prizeSubmitted
Cleanest Use of a Software Factory
The project includes a written roadmap, isolated deterministic game logic, explicit model-response validation, 19 passing automated tests, documented verification limits and reproducible standalone packaging. Codex assisted development; practice inputs and real model results are kept distinguishable.