Skip to main content

About the project

Read any bill with a fine-tuned Gemma 4 vision model, sort it into organised or unorganised, and keep a balance that only moves when you pay online.

Built for Hacktoberfest Hack Day 2026 · Theme 3 (Fine-tuning Gemma) · Problem 3B: Extract information from receipts.

Model Gemma 4 E2B (vision) + LoRA, trained with Unsloth FastVisionModel on a free Colab T4
Data ICDAR 2019 SROIE (626 train / 361 test, CC BY 4.0) + synthetic Indian bills + your own labelled photos
Backend FastAPI · SQLite · background training/eval workers · Server-Sent Events
Frontend React 19 · TypeScript · Tailwind CSS 4 · shadcn structure · Motion · interior.dev components

Built with

typescriptpythoncssJupyter Notebookhtmlreactfastapigithubopenaijson

AI tools

Coded withCodexGemini 3.8 FlashClaude Opus 5.5GPT-6.1 SolGemma 4 26B A4BGemma 4 31B

Prize Categories Entered

  • Deepmind Google

    Best Use of Gemma 4

    Submitted
  • DigitalOcean

    Best Open-Source AI Project

    Submitted
  • Event prize

    Theme 3: Fine-Tuning Gemma

    Submitted