# Plugin Eval (ChatGPT Plugin)

> Start from chat, then evaluate or benchmark locally

- Type: plugin
- Publisher: OpenAI (official)
- Categories: Development, AI & ML
- Website: https://github.com/openai/plugins/tree/main/plugins/plugin-eval
- Docs: https://learn.chatgpt.com/docs/plugins
- Source: https://github.com/openai/plugins
- Open in ChatGPT: https://chatgpt.com/plugins/plugins~Plugin_a2d7fcc77268819187a5d61e6a1452eb
- GitHub stars: 7248
- Listed: 2026-04-16

## About

Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking. Skills for evaluating plugins and skills, improving skills and designing metric packs, with local-first reports and token budget explanations. Listed in OpenAI's curated Codex marketplace (openai-curated); the manifest declares skills.

## Install

1. **Add it in ChatGPT** Open Plugins in the ChatGPT sidebar (web or desktop), search for “Plugin Eval” and select +. You'll be asked to sign in to any connected service on first use. Then type @ in a chat to call it.

2. **Or install it in Codex**

   Codex CLI:

   ```bash
   codex plugin add plugin-eval@openai-curated
   ```

## Disconnect or uninstall

1. **In ChatGPT** Disconnect an account in Settings → Apps or Plugins. To remove the plugin itself, open Plugin Eval in the Plugin Directory and select Uninstall plugin. Uninstalling can disconnect every account connected through it, and plugins your workspace installs may not offer the option.

2. **In Codex**

   Codex CLI:

   ```bash
   codex plugin remove plugin-eval@openai-curated
   ```

## Skills

- **Evaluate Plugin**: Evaluate a local Codex plugin
- **Evaluate Skill**: Evaluate a local Codex skill
- **Improve Skill**: Turn plugin-eval findings into a rewrite brief
- **Metric Pack Designer**: Design custom metric packs for plugin-eval
- **Plugin Eval**: Choose the right local evaluation workflow

## Example prompts

- "Give me an analysis of the game studio plugin."
- "Evaluate this plugin."
- "Why did this score that way?"

## Also available as

- app: [MCP App Basics (Apps SDK example)](https://chatgptplugins.directory/apps/apps-sdk-mcp-app-basics.md)
- MCP server: [OpenAI Docs MCP](https://chatgptplugins.directory/mcp/openai-docs.md)

## Plugin Eval alternatives

- [Superpowers](https://chatgptplugins.directory/plugins/superpowers.md): Plan, develop, and debug code
- [Codex Security](https://chatgptplugins.directory/plugins/codex-security.md): Security scanning for your codebase
- [Build Web Apps](https://chatgptplugins.directory/plugins/build-web-apps.md): Build frontend-focused web apps with generated assets, browser testing, payments, and...
- [GitHub](https://chatgptplugins.directory/plugins/github.md): Triage PRs, issues, CI, and publish flows
- [Figma](https://chatgptplugins.directory/plugins/figma.md): Figma design-to-code workflows
- [Shopify](https://chatgptplugins.directory/plugins/shopify.md): Build and manage your store

---
Source: https://chatgptplugins.directory/plugins/plugin-eval · Index: https://chatgptplugins.directory/llms.txt · Independent and community-run. Not affiliated with or endorsed by OpenAI. ChatGPT is a trademark of OpenAI.