← Browse tools

Observability & evaluation

Promptfoo

Declarative, reproducible evaluations and automated red teaming that fit local and CI development workflows.

Overview

Research summary

Promptfoo provides a command-line tool and library for testing LLM applications using declarative configurations, datasets and assertions. It compares prompts and model providers, grades results and offers a local web view for reviewing evaluations. Its red-teaming workflows generate adversarial cases to investigate application vulnerabilities before deployment.

The MIT-licensed project supports local and continuous-integration usage and is distinct from runtime enforcement tools that screen every production request. The maintainers state that Promptfoo is now part of OpenAI while continuing to support multiple providers and retaining its open-source licence.

Repository summary

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Version
Unavailable

Recorded catalogue figures. View repository data and provenance →

Classification

Pricing & services

Paid services available

The provider offers paid products or services. Free options may also be available.

View pricing & services ↗

Commercial offering checked 2026-10-02.

Licence scope

Implementation

Recorded implementation details and interfaces for Promptfoo.

Implementation details

TypeScript CLI, library and local web interface.

Languages
TypeScript
Repository type
source

Recorded interfaces and capabilities

Licence scope

Repository

Repository snapshots, release information and recorded maintenance signals.

Repository snapshot

promptfoo/promptfoo ↗

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Archived
Not recorded

Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).

Maintenance and provenance

Catalogue snapshot
2026-10-06

Documentation

Recorded references and research provenance for this entry.

Recorded sources 6

Research metadata

Research date
2026-10-01
Catalogue snapshot
2026-10-06

Community & social 2 channels

Communities

Social & updates