magic-linguistic-annotate
Pass
Audited by Gen Agent Trust Hub on Jul 3, 2026
Risk Level: SAFE
Full Analysis
- [SAFE]: The skill provides Python scripts for annotation project planning and metric calculation (
scripts/annotation_plan_advisor.py,scripts/iaa_calculator.py) that rely exclusively on Python's standard library modules such asargparse,json, andcollections. - [SAFE]: The inter-annotator agreement (IAA) calculations for Cohen's Kappa, Fleiss' Kappa, and PABAK are implemented correctly and perform no dangerous operations, network requests, or sensitive file system access.
- [SAFE]: Reference documentation links to well-known and trusted platforms in the linguistics community, including Label Studio, Prodigy, and INCEpTION, as well as academic sources like EMNLP and NAACL publications.
- [SAFE]: No patterns of prompt injection, data exfiltration, or persistence mechanisms were detected in the instructions or script code.
Audit Metadata