Skip to content

Benchmark

Every App Generator build, on real CI

When the App Generator verifies a project, it pushes it to a throwaway private repository, runs it on GitHub Actions, reads back what failed, fixes it and runs it again — until the build is green or the guardrails stop it. This page lists what actually happened, newest first. Failures stay on it.

No runs recorded yet

Recording started with this page, and nothing here is seeded or sampled — it fills as people verify builds with the App Generator. Check back, or run one yourself.

How to read this

  • Green first try passed on its first CI run. Fixed on retry failed, was repaired from the real CI output, and passed. Failed reached CI and could not be made to pass before the guardrails stopped the loop.
  • Harness error means CI never returned a verdict — a GitHub API failure or a timeout on our side. Those say nothing about the generated code, so they are listed but kept out of the pass rate.
  • There are no links to the runs themselves. Each project is someone’s own application, so the repository is private and deleted when verification ends. For the same reason this page records no descriptions, code or logs — only the stack, outcome and timings.
  • Nothing is filtered, sampled or seeded. Every verification that finishes is written here.

Start with the free review

Send us the Terraform or the architecture you are unsure about and we will review it and tell you what we would change — no charge, no call required. Or open the App Generator and watch it build something and prove it on CI.

We reply within one business day.