No AI summary available for this article.
Why It Matters
Hi HN!
Provenance
Discovered via Hacker News and published by benchmarkheaven.com.
Key Claims
Original description
Hi HN! I built JevBench because Jev kicks ass, and the world deserves to know how the serious open source and fake lookalike projects really perform in comparison. Jev-class models return bounded choices and probabilities instead of text, and are disruptively faster and cheaper than LLMs, while being similarly intelligent on the text input they operate on. JevBench allows looking at accuracy, latency and price all at once, in a weighted way - you can even configure the weighting. A full run asks 534 English decisions. The v1.3 score combines chance-corrected Intelligence, Calibration, Speed an...
Discovered via Hacker News
Community-ranked links and discussion from the HN front page.
Publisher: benchmarkheaven.com
ID: 49800574 · Indexed about 1 hour ago