RepoGauge: Open Tool for Benchmarking Coding Agents on Custom Repositories

Summary

RepoGauge is a newly launched open tool that allows engineering teams to evaluate AI coding agents against their own repositories rather than generic benchmarks. The platform turns a team's real commit history into a reproducible benchmark suite, measuring coding agents on pass rates, cost per solved bug, latency, and regression detection — with every metric tied to an actual fix from the codebase. The tool addresses a growing pain point as organizations adopt agentic coding assistants: how to