GitShow/mattpocock/evalite
mattpocock

evalite

Evaluate your LLM-powered apps with TypeScript

by mattpocock
aievalstypescript
Star on GitHubForkWebsitenpm

TypeScript

1.6k stars94 forks20 contributorsQuiet · 2mo agoSince 2024evalite@0.19.0MIT

Meet the team

See all 20 on GitHub →
mattpocock
mattpocock525 contributions
github-actions[bot]Bot
github-actions[bot]74 contributions
christianklotz
christianklotz13 contributions
DogPawHat
DogPawHat10 contributions
jacobparis
jacobparis10 contributions
tyom
tyom7 contributions
dschlabach
dschlabach4 contributions
vojtaholik
vojtaholik4 contributions

Languages

View on GitHub →
TypeScript89.8%
MDX7.9%
CSS1.1%
JavaScript0.8%
HTML0.2%
Astro0.2%

Commit activity

Last 12 weeks · 0 commits

Full graph →

Community health

3 of 6 standards met

Community profile →
57
✓README✓License✓Contributing○Code of Conduct○Issue Template○PR Template

Recent PRs & issues

Quiet · Last activity 2mo ago
See all on GitHub →
nicolas-besnard
Support for AI SDK v7 in peerDependenciesOpenIssue

The AI SDK v7 stable release is out, but evalite's range doesn't include it yet

nicolas-besnard · 4d ago
mattpocock
Global StatisticsOpenIssue

is there a way to provide global statistics at the end? For example let's say I have a total tokens or time spent generating for each task as metrics. I would like to have an avarage time spent generating and an avarage tokens used _Originally posted by @marcoripa96 in https://github.com/mattpocock/evalite/discussions/341_

mattpocock · 1w ago
itosa-kazu
chore: add evalite package license metadataOpenPR

Summary: Add MIT license metadata to the published evalite package manifest. Validation: node package metadata assertion npm pack --dry-run --json --ignore-scripts in packages/evalite git diff --check

itosa-kazu · 3w ago

Recent fixes

View closed PRs →
pattobrien
Migrate to a Vite plugin architecture (`vite-plugin-evalite`)ClosedIssue

With Vitest 3.1+'s plugin hook, it's possible to integrate Evalite directly as a Vite plugin rather than requiring a separate and custom CLI (, ). A could register the reporter, configure test patterns for , and spin up the UI server—all through standard Vite/Vitest primitives. Users would just add the plugin to their existing and run as normal. This would reduce surface area, eliminate the duplicated CLI, and let Evalite compose naturally with existing Vite/Vitest setups.

pattobrien · 1w ago
igorkamyshev
Support reasoning in OpenAI modelsMergedPR
igorkamyshev · 1mo ago
Structured data for AI agents

Repository: mattpocock/evalite. Description: Evaluate your LLM-powered apps with TypeScript Stars: 1610, Forks: 94. Primary language: TypeScript. Languages: TypeScript (89.8%), MDX (7.9%), CSS (1.1%), JavaScript (0.8%), HTML (0.2%). License: MIT. Homepage: https://www.evalite.dev/ Topics: ai, evals, typescript. Latest release: evalite@0.19.0 (7mo ago). Open PRs: 14, open issues: 45. Last activity: 2mo ago. Community health: 57%. Top contributors: mattpocock, github-actions[bot], christianklotz, DogPawHat, jacobparis, tyom, dschlabach, vojtaholik, cdavis1324, iamladi and others.

·@ofershap

Replace github.com with gitshow.dev