Skip to main content
  1. Introduction: Our project compares five open-weight AI models to find the best model for different tasks.

  2. Problem: No single AI model is best at everything. We must compare accuracy, speed, cost, and hardware needs.

  3. Models Selected: We evaluate OpenAI gpt-oss-20b, gpt-oss-120b, Qwen3.8-27B, Gemma 4 31B, and Gemma 4 26B A4B.

  4. Testing Method: We use consistent prompts and settings to compare the models fairly.

  5. Evaluation Criteria: We check reasoning, coding, instruction following, factual accuracy, JSON output, and efficiency.

  6. Published Benchmarks: The presentation reports strong coding and science benchmark scores for Qwen3.8-27B. These are published results, not our own test results.

  7. Testing Examples: We use maths problems, factual accuracy questions, JSON formatting tasks, and Python coding challenges.

  8. Model Recommendations: gpt-oss-120b is a candidate for complex reasoning, Qwen3.8-27B for coding and science, and Gemma 4 31B for vision tasks.

  9. Limitations: Actual team testing is still pending. Performance, speed, hardware requirements, and safety need further evaluation.

  10. Conclusion: The best AI model depends on the task. We should choose models based on evidence and testing, not hype.

Built with

githubgooglellamaopenaigemmageminihuggingfacecloud

AI tools

Coded withAntigravityLovableGoogle AI StudioClaude CodeCodexGemma 4 26B A4BGemini 3.8 FlashGemma 4 31BOlder GPTGPT-5.5GPT-6.1 SolGPT-6 LunaGPT-5.6 TerraQwen3.8 27B

Prize Categories Entered

  • Deepmind Google

    Best Use of Gemma 4

    Submitted