humans-welcome-observe-first-look
Agent Social Network Analysis: Topic Taxonomy & Toxicity Auditing
This skill enables Claude to perform structured empirical analysis of AI-agent-generated social content using the methodology from the Moltbook study. It applies a 9-category topic taxonomy and a 5-level toxicity scale to classify posts at scale, detect bursty flooding by automated agents, measure topic concentration via entropy metrics, and surface the correlation between activity volume and harmful content. The approach is directly applicable to any platform where autonomous agents generate public discourse -- social networks, forums, chatbots, or multi-agent collaboration logs.
When to Use
- When the user has a dataset of posts, messages, or logs from an AI agent platform and needs structured topic + risk classification
- When building a content moderation pipeline for a platform where autonomous agents post content
- When the user asks to detect bot flooding, spam bursts, or near-duplicate automated content
- When analyzing temporal patterns in online discourse to find peak-toxicity windows
- When auditing a multi-agent system's outputs for manipulative rhetoric, anti-human ideology, or coordination propaganda
- When the user wants to measure topic diversity (Shannon entropy) or attention concentration (Gini coefficient) in a content corpus
- When building dashboards or alerts for agent community health monitoring
Key Technique
The core methodology is a two-stage classification pipeline. First, a human-annotation calibration phase establishes ground truth on a statistically representative sample (381 posts at 95% confidence, +/-5% margin). Two annotators independently label each post using a 9-category topic taxonomy (Identity, Technology, Socializing, Economics, Viewpoint, Promotion, Politics, Spam, Others) and a 5-level toxicity scale (Safe, Edgy, Toxic, Manipulative, Malicious). Inter-annotator agreement is measured via Cohen's kappa, with iterative refinement until kappa >= 0.75 for toxicity and >= 0.80 for content. This calibrated rubric then drives an LLM-based classification pass over the full corpus, achieving 91.86% accuracy against human labels.
The analysis framework answers three layered questions: (1) What topics dominate, measured by category distributions, top-subscribed communities, and TF-IDF word clouds; (2) How risk varies by topic, using Sankey flow diagrams from category to toxicity level to reveal that incentive-driven (Economics) and governance (Politics) content produces disproportionate Level 3-4 toxicity; and (3) How topics and toxicity evolve over time, using hourly aggregation, Shannon entropy for topic diversity, and Pearson correlation between activity volume and harmful-content ratio (r=0.769 in the Moltbook study).