Just A Test Runner
.eval.ts is the new .test.ts. Write evals in TypeScript with an
instantly familiar API.
Test AI-powered apps in TypeScript
Evals are hard. Evalite makes them simple. Test your AI-powered apps with a local dev server.
Features
Instant Feedback
Explore your outputs, traces and logs in a beautiful, interactive UI that
runs on localhost.
Built on Vitest
Works out of the box with your stack. Use mocks, fixtures, and more to simulate real-world scenarios.
No Vendor Lock-In
Work with any LLM, and test outputs against each other seamlessly.
Great On CI
Export your evals as static HTML bundles for CI/CD. Use score thresholds to fail the build.