NVIDIA/garak vs promptfoo/promptfoo
Compare NVIDIA/garak and promptfoo/promptfoo using the current verified snapshot: positioning, license, deployment, use cases, limitations, and original sources.
NVIDIA/garak
Garak is a command-line tool that red-teams large language models and dialog systems by probing them for undesirable behaviors such as hallucination, data leakage, prompt injection, and jailbreaks. It runs configurable probes against a selected target model and outputs structured reports documenting detected failures.
- License
- Apache-2.0
- Deployment
- Refer to project documentation
- Use cases
- AI engineers and developers performing evaluation and observability tasks on text-based LLMs or dialog systems. · Teams that need structured JSONL reports and vulnerability hit logs documenting detected LLM failure modes.
- Updated
- 2026-07-18T07:50:17Z
promptfoo/promptfoo
promptfoo is a developer-first library and CLI for declarative testing, automated evaluation, and vulnerability scanning of LLM prompts, agents, and retrieval pipelines. It supports local orchestration and integrates with multiple LLM providers, including remote APIs and local runtimes.
- License
- MIT
- Deployment
- Refer to project documentation
- Use cases
- Developers, AI engineers, and operations teams who need to evaluate prompts, test models, and automate security checks via a CLI or library.
- Updated
- 2026-07-16T18:26:38Z
How to choose
First eliminate options that fail required deployment, license, or use-case constraints; then inspect each detail page for limitations and direct evidence.