Skip to main content

About the project

raditional software testing checks whether add(2, 2) == 4 (exact outputs). Generative AI is non-deterministic and conversational.

Today, engineering teams deploy AI chatbots without knowing if they are truly safe to release. They rely on superficial prompt testing or ungrounded LLM judges. If a customer-support bot promises an illegal refund, leaks company secrets, or succumbs to prompt injection, the business pays the price.

AI TestBench introduces Behavior-First AI Assurance: We turn fuzzy human requirements into formal, human-approved Behavior Contracts, automatically generate boundary and adversarial attack scenarios, evaluate live responses with hybrid deterministic + LLM judges, detect regressions between prompt versions, measure test vigilance via Behavioral Mutation Testing, and deterministically gate releases to prevent bad AI from reaching production.”

Built with

pythonfastapinext.jsgeminiopenaipydanticllmopenrouter

AI tools

Coded withAntigravityGemini 3.8 Flash

Prize Categories Entered

  • DigitalOcean

    Best Open-Source AI Project

    Submitted