Evaluation Skills
Evaluation skills focus on assessing quality, verifying facts, and ensuring compliance.
Available Skills
Section titled “Available Skills”| Skill | Purpose | Common Personas |
|---|---|---|
| Quality Check | Verify output quality against criteria | Ada, Drucker |
| Security Audit | Assess security posture and vulnerabilities | Rickover, Kestra |
| Compliance Review | Check adherence to standards/regulations | Rickover, Ada |
| Fact Verification | Verify claims and assertions | Watson, Ada, Franklin |
Quality Check
Section titled “Quality Check”Verify output quality against predefined success criteria.
When to Use:
- Before approving deliverables
- Acceptance testing
- QA reviews
- Milestone verification
Inputs Required:
- Output to evaluate
- Success criteria
- Scoring rubric (if any)
Outputs Produced:
- Criterion-by-criterion assessment
- Pass/fail/partial status
- Gap identification
- Improvement recommendations
Security Audit
Section titled “Security Audit”Assess security posture and identify vulnerabilities.
When to Use:
- Before production deployment
- After significant changes
- Periodic security reviews
- Incident response
Inputs Required:
- System or code to audit
- Threat model (if available)
- Compliance requirements
Outputs Produced:
- Vulnerability list with severity
- Risk assessment
- Remediation recommendations
- Compliance gaps
Compliance Review
Section titled “Compliance Review”Check adherence to standards, regulations, or policies.
When to Use:
- Regulatory requirements (HIPAA, GDPR, etc.)
- Industry standards (OWASP, NIST, etc.)
- Internal policy compliance
- Certification preparation
Inputs Required:
- Subject to review
- Applicable standards/regulations
- Previous audit findings (if any)
Outputs Produced:
- Compliance status per requirement
- Violation identification
- Remediation requirements
- Evidence documentation
Fact Verification
Section titled “Fact Verification”Verify claims and assertions for accuracy.
When to Use:
- Reviewing medical claims
- Checking financial data
- Validating research findings
- Quality assurance on content
Inputs Required:
- Claims to verify
- Source documents (if available)
- Verification standards
Outputs Produced:
- Verification status per claim
- Supporting evidence
- Confidence level
- Corrections needed