agentic-eval
Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing self-critique and reflection loops - Building evaluator-optimizer pipelines for quality-critical generation - Creating test-driven code refinement workflows - Designing rubric-based or LLM-as-judge evaluation systems - Adding iterative improvement to agent outputs (code, reports, analysis) - Measuring and improving agent response quality
Before you install
- Last update
- Files in folder
- 1
- Scripts
- No script files found
- SKILL.md size
- 5.8 KB (about 1,485 tokens of context each time it loads)
- License
- MIT
- Source on GitHub
- github/awesome-copilot
Skills are plain text instructions the agent follows, sometimes with scripts. Check the source, prefer repositories with many installs and stars, and read any script it ships.
Install
npx skills add github/awesome-copilot@agentic-evalRuns in a terminal with Node.js 18 or newer. Add -y to skip the prompts and -g to install for every project instead of this one.
Install for your agent
npx skills add github/awesome-copilot@agentic-eval --agent claude-code -y- Project install writes to
.claude/skills/agentic-eval- Global install writes to
~/.claude/skills/agentic-eval
Start a new session afterwards so the agent picks the skill up. In Claude Code you can also call it directly with /agentic-eval.
What it does
Agentic Evaluation Patterns Patterns for self-improvement through iterative evaluation and refinement. Overview Evaluation patterns enable agents to assess and improve their own outputs, moving beyond single-shot generation to iterative refinement loops. When to Use - Quality-critical generation: Code, reports, analysis requiring high accuracy - Tasks with clear evaluation criteria: Defined success metrics exist - Content requiring specific standards: Style guides, compliance, formatting --- Pattern 1: Basic Reflection Agent evaluates and improves its own output through self-critique. Key…
Excerpt from the skill's own SKILL.md. Read the full file on GitHub before installing: skills run with your agent's permissions.
Categories
Related skills
- chrome-devtools
github/awesome-copilot
Expert-level browser automation, debugging, and performance analysis using Chrome DevTools MCP. Use for interacting with web pages, capturing screenshots, analyzing network traffic, and profiling performance.
- azure-devops-cli
github/awesome-copilot
Manage Azure DevOps resources via CLI including projects, repos, pipelines, builds, pull requests, work items, artifacts, and service endpoints. Use when working with Azure DevOps, az commands, devops automation, CI/CD, or when user mentions Azure DevOps CLI.
- architecture-blueprint-generator
github/awesome-copilot
Comprehensive project architecture blueprint generator that analyzes codebases to create detailed architectural documentation. Automatically detects technology stacks and architectural patterns, generates visual diagrams, documents implementation patterns, and provides extensible blueprints for maintaining architectural consistency and guiding new development.
- apple-appstore-reviewer
github/awesome-copilot
Serves as a reviewer of the codebase with instructions on looking for Apple App Store optimizations or rejection reasons.
- ai-prompt-engineering-safety-review
github/awesome-copilot
Comprehensive AI prompt engineering safety review and improvement prompt. Analyzes prompts for safety, bias, security vulnerabilities, and effectiveness while providing detailed improvement recommendations with extensive frameworks, testing methodologies, and educational content.
- breakdown-feature-prd
github/awesome-copilot
Prompt for creating Product Requirements Documents (PRDs) for new features, based on an Epic.