sickn33/agentic-awesome-skills

agent-evaluation

Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes, reproducing failures, or running agent regression tests.

967 installs 48K stars

Before you install

Last update
Files in folder
2
Scripts
No script files found
SKILL.md size
7.6 KB (about 1,953 tokens of context each time it loads)
License
MIT

Skills are plain text instructions the agent follows, sometimes with scripts. Check the source, prefer repositories with many installs and stars, and read any script it ships.

Install

npx skills add sickn33/agentic-awesome-skills@agent-evaluation

Runs in a terminal with Node.js 18 or newer. Add -y to skip the prompts and -g to install for every project instead of this one.

Install for your agent

npx skills add sickn33/agentic-awesome-skills@agent-evaluation --agent claude-code -y
Project install writes to
.claude/skills/agent-evaluation
Global install writes to
~/.claude/skills/agent-evaluation

Start a new session afterwards so the agent picks the skill up. In Claude Code you can also call it directly with /agent-evaluation.

What it does

Agent Evaluation Evaluate observable agent behavior against task-specific cases. Modified by AAS maintainers on 2026-09-05 to remove unsupported benchmark claims, correct uncertainty/error reporting and separate optional architecture sketches from the operating procedure. When to Use Use when comparing a changed agent, prompt or tool configuration, reproducing an observed failure, or estimating reliability on a declared task distribution. Do not infer product readiness from a public benchmark percentage or a generic score threshold. Prerequisites - A versioned case set with expected…

Excerpt from the skill's own SKILL.md. Read the full file on GitHub before installing: skills run with your agent's permissions.

Categories

Related skills

  • 3d-web-experience

    sickn33/agentic-awesome-skills

    Use when building or debugging web 3D scenes, product configurators or portfolios with Three.js, React Three Fiber or Spline; review assets, loading, controls, fallbacks and performance.

    5.1K installs 48KReact & Next.jsCode review
  • agent-memory-systems

    sickn33/agentic-awesome-skills

    Design tenant-scoped memory, retrieval and retention for agents. Use when planning RAG, conversation history, vector stores or remembering across sessions.

  • agent-tool-builder

    sickn33/agentic-awesome-skills

    Tools are how AI agents interact with the world. A well-designed

  • agent-manager-skill

    sickn33/agentic-awesome-skills

    Manage multiple local CLI agents via tmux sessions (start/stop/monitor/assign) in an explicitly authorized workspace.

    925 installs 48KAI & agentsCode review
  • agent-orchestration-multi-agent-optimize

    sickn33/agentic-awesome-skills

    Optimize multi-agent systems with coordinated profiling, workload distribution, and cost-aware orchestration. Use when improving agent performance, throughput, or reliability.

    848 installs 48KDataAI & agents
  • ab-test-setup

    sickn33/agentic-awesome-skills

    Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify tracking, and predeclare metrics and stopping rules.

    804 installs 48KTestingData

← Search skills

/skills/sickn33/agentic-awesome-skills/agent-evaluation/