Promptfoo skills for configuring providers and targets, writing eval suites, and setting up or running red team workflows against LLM apps.
Install
- 1Add it in ChatGPT
Open Plugins in the ChatGPT sidebar (web or desktop), search for “Promptfoo” and select +. You'll be asked to sign in to any connected service on first use. Then type @ in a chat to call it.
Skills 4
- Promptfoo Evals
Write and QA Promptfoo eval suites
- Promptfoo Provider Setup
Connect Promptfoo to HTTP, Python, and JS
- Promptfoo Redteam Run
Run and triage red team scans
- Promptfoo Redteam Setup
Plan red team scans from endpoints or code
Things to ask
- “Write a Promptfoo eval for this behavior.”
- “Use Promptfoo to connect my HTTP endpoint to an eval.”
- “Set up or run Promptfoo red teaming for this API.”
Disconnect or uninstall
- 1In ChatGPT
Disconnect an account in Settings → Apps or Plugins. To remove the plugin itself, open Promptfoo in the Plugin Directory and select Uninstall plugin. Uninstalling can disconnect every account connected through it, and plugins your workspace installs may not offer the option.
- 2In Codex
Run /plugins in the Codex CLI, select the plugin and uninstall it, or press Space to turn it off.
Promptfoo alternatives
SuperpowersPlan, develop, and debug codeplugin · by Jesse Vincent · 294k stars