magic-linguistic-annotate

Pass

Audited by Gen Agent Trust Hub on Jul 3, 2026

Risk Level: SAFE
Full Analysis
  • [SAFE]: The skill provides Python scripts for annotation project planning and metric calculation (scripts/annotation_plan_advisor.py, scripts/iaa_calculator.py) that rely exclusively on Python's standard library modules such as argparse, json, and collections.
  • [SAFE]: The inter-annotator agreement (IAA) calculations for Cohen's Kappa, Fleiss' Kappa, and PABAK are implemented correctly and perform no dangerous operations, network requests, or sensitive file system access.
  • [SAFE]: Reference documentation links to well-known and trusted platforms in the linguistics community, including Label Studio, Prodigy, and INCEpTION, as well as academic sources like EMNLP and NAACL publications.
  • [SAFE]: No patterns of prompt injection, data exfiltration, or persistence mechanisms were detected in the instructions or script code.
Audit Metadata
Risk Level
SAFE
Analyzed
Jul 3, 2026, 07:00 AM
Security Audit — agent-trust-hub — magic-linguistic-annotate