← Browse tools

Observability & evaluation

EvalPlus

Expanded correctness tests designed to catch false positives in code-generation benchmarks.

Overview

Research summary

EvalPlus is a toolkit for evaluating code generated by language models. It augments established code-generation benchmarks with additional test cases to uncover solutions that pass limited original tests but still contain functional errors. The project supplies generation and evaluation workflows, reusable datasets, and support for multiple model backends. Related performance evaluations also examine the efficiency of generated programs. Because the workflow executes generated code, its documented isolated execution setup is part of reproducing an assessment responsibly. The repository code is Apache-2.0 licensed.

Repository summary

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Version
Unavailable

Recorded catalogue figures. View repository data and provenance →

Classification

Pricing & services

Paid services unknown

Whether the provider offers paid products or services has not been established.

Licence scope

Implementation

Recorded implementation details and interfaces for EvalPlus.

Implementation details

Python code-generation benchmark runner and expanded evaluation datasets

Languages
Python
Repository type
source

Recorded interfaces and capabilities

Licence scope

Repository

Repository snapshots, release information and recorded maintenance signals.

Repository snapshot

evalplus/evalplus ↗

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Archived
Not recorded

Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).

Maintenance and provenance

Catalogue snapshot
2026-10-06

Documentation

Recorded references and research provenance for this entry.

Recorded sources 4

Research metadata

Research date
2026-10-02
Catalogue snapshot
2026-10-06