Skip to content

Waza Quickstart

This quickstart shows the minimum workflow to evaluate a skill with Waza. Use this page when you want a fast setup without reading all details.

Overview

Goal:

  • Run readiness checks for a skill.
  • Run an evaluation suite from eval.yaml.

Prerequisites

  • Waza CLI is installed.
  • Target skill has SKILL.md.
  • Evaluation files exist:
    • eval.yaml
    • at least one file in evals/tasks/

Quick Steps

  1. Move to the skills root.
cd .github/skills
  1. Check readiness.
waza check <skill-name>
  1. Move to the target skill.
cd <skill-name>
  1. Run evaluation.
waza run eval.yaml

Minimal Success Criteria

  • waza check reports valid spec and no schema errors.
  • waza run eval.yaml finds at least one task and completes.

Common Failures

  1. No task files matched.

Symptom:

  • no test files matched patterns: [evals/tasks/*.yaml]

Fix:

  • Add at least one task file under evals/tasks/.
  • Confirm the glob in eval.yaml matches the file path.
  1. Eval schema error.

Fix:

Next Reading