GitShow/BurntSushi/critcmp
BurntSushi

critcmp

A command line tool for comparing benchmarks run by Criterion.

by BurntSushi
Star on GitHubFork

Rust

265 stars21 forks5 contributorsQuiet · 1y agoSince 2018Unlicense

Meet the team

See all 5 on GitHub →
BurntSushi
BurntSushi36 contributions
atouchet
atouchet1 contribution
hkratz
hkratz1 contribution
tko
tko1 contribution
sharksforarms
sharksforarms1 contribution

Languages

View on GitHub →
Rust100%

Commit activity

Last 12 weeks · 0 commits

Full graph →

Community health

2 of 6 standards met

Community profile →
42
✓README✓License○Contributing○Code of Conduct○Issue Template○PR Template

Recent PRs & issues

Quiet · 2 in progress · Last activity 1y ago
See all on GitHub →
XAMPPRocky
Provide compiled binariesOpenIssue

Hello 👋 It would be nice if this project provided tagged binaries so that it could be quickly installed with tools like mise or cargo-binstall and not have to be compiled from source.

XAMPPRocky · 1w ago
wucke13
human sort the benchmarksOpenIssue

We have a set of micro benchmarks which we compare using . This would be an example benchmark result: Unfortunately, the order of the groups is lexically sorted (I believe?), but it would be way nicer for it to be human-readable numerically sorted: (this output was created using plus manual fixing of the first two lines).

wucke13 · 10mo ago
armfazh
feat: allow to define one argument as the baseline for comparisonOpenIssue

Feature request:** Define the first 'baseline' passed () to be the one used for calculating speedups. Example, this command compares speedup of the baselines called against the baseline. Currently, the output highlights with a color the fastest implementation in each group.

armfazh · 1y ago

Recent fixes

View closed PRs →
maksym-arutyunyan
screenshot of critcmp example is missingClosedIssue

!Image maybe add example as text snippet?

maksym-arutyunyan · 1y ago
lemmih
Inclusion in criterion.ClosedIssue

Hi @BurntSushi, I'd like for criterion to support this style of workflow but I'm not sure how to go about it. I see a few different options: 1. Write a specification for the data format and let external tools parse it on their own. 2. Write a library for loading and storing baselines. 3. Merge into or . I'm leaning towards option 2. What are your thoughts? Also, is there a better name for a collection of benchmark results than "baseline"?

lemmih · 3y ago
zhiburt
Incorrect alignment in case of big differences in nanosecondsClosedIssue

Hi @BurntSushi Thanks for . I just was going through the code and was wondering what will happen in case of big differences in nanoseconds. And as you see bellow it gets broken a bit. Is this something which should be addressed? (I mean at the end of the day the consistency of the data is still correct) The example uses in one column. Thanks. Take care.

zhiburt · 3y ago
Structured data for AI agents

Repository: BurntSushi/critcmp. Description: A command line tool for comparing benchmarks run by Criterion. Stars: 265, Forks: 21. Primary language: Rust. Languages: Rust (100%). License: Unlicense. Open PRs: 2, open issues: 5. Last activity: 1y ago. Community health: 42%. Top contributors: BurntSushi, atouchet, hkratz, tko, sharksforarms.

·@ofershap

Replace github.com with gitshow.dev