Skip to main content

Riftmender

Your world is the inventory: borrow powers from everyday objects to cross a broken world and battle a boss in your camera feed.

About the project

Your world is the inventory

Riftmender combines a short platforming adventure with a camera-backed boss encounter. In The Broken Reach, a small hero crosses floating islands using spectral bridges borrowed from the shapes of everyday objects. A notebook or ruler represents a bridge, a broad surface a shield, a shiny object a reflector, and an elongated prop a stronger fantasy strike.

At the portal, the adventure becomes Reality Raid: the Rift Warden appears over the live camera backdrop. Players dodge or guard against orb volleys and beams, then counterattack during exposed-core windows. The encounter includes an accelerated second phase, retry and victory. This is camera compositing, not room-mapped AR.

How it is built

JavaScript ES modules, HTML/CSS, Canvas 2D, Node.js, browser MediaDevices and local MediaPipe hand tracking. The implementation supports sideways hand movement, pinch-to-jump, open-palm guarding and swipe attacks. The Gemini Decisions API integration checks captured images against fixed visibility and object-property criteria; deterministic game rules control ability unlocks, bridge placement and damage. Hydrogen provides optional cosmetic item names and descriptions.

Current prototype and validation

One traversal level and one boss are implemented. Keyboard controls and explicitly labelled practice items support play without an API key; a standalone HTML edition runs without a local server. Nineteen automated tests pass, covering gameplay, decision validation and simulated camera lifecycle checks. UI source checks cover 61 element references.

Live external-camera operation, a complete visual playthrough and successful Gemini API calls are not yet verified. Practice items are manual test inputs, not AI recognition. ChatGPT/Codex assisted with design, implementation, tests and documentation. Source repository and demo video links are pending.

Built with

gemini

AI tools

Coded withCodex

Prize Categories Entered

  • Event prize

    Best Overall Hack

    Submitted

    A compact adventure turns everyday physical objects into bridges, shields and attacks, then brings the boss into the live camera backdrop. The prototype combines a traversal level, a boss encounter, local gesture controls and clearly labelled no-key practice mode. Live camera and Gemini validation are still pending.

  • Event prize

    Best Use of System One Models

    Submitted

    The Gemini Decisions API integration asks independent yes/no questions about a captured object and gates abilities using explicit probability thresholds. Physics and combat stay deterministic and local. This integration is implemented in source; successful live model calls are not yet verified.

  • Event prize

    Cleanest Use of a Software Factory

    Submitted

    The project includes a written roadmap, isolated deterministic game logic, explicit model-response validation, 19 passing automated tests, documented verification limits and reproducible standalone packaging. Codex assisted development; practice inputs and real model results are kept distinguishable.