Skip to main content

About the project

OpenGuide AI is an open-source AI evaluation platform designed to help developers systematically test and compare AI models on real-world tasks.

The platform aims to evaluate models across multiple dimensions, including answer quality, factual accuracy, instruction following, consistency, latency, and resource usage. It uses a repeatable evaluation process and presents results in a structured format so developers can understand each model’s strengths and limitations.

Our goal is to make AI model evaluation more accessible, transparent, and reproducible. By providing a clear comparison of model performance, OpenGuide AI helps developers make better-informed decisions when selecting open models for their applications.

The project emphasizes reproducible testing, transparent scoring, and practical evaluation rather than relying solely on model benchmarks or marketing claims.

Built with

pythonGradioGoogle GemmaSentence TransformersScikit-learn and NumPypypdfPandas and Matplotlibgemini

AI tools

Coded withCodexClaude CodeAntigravityGemini 3.8 Flash

Prize Categories Entered

  • Event prize

    Theme 2: RAG Application with Gemma

    Submitted