information-theory

Installation
SKILL.md

What I do

  • Calculate entropy and information content
  • Design efficient encodings
  • Analyze channel capacity
  • Implement compression algorithms

When to use me

When working with data compression, encoding, or communication systems.

Entropy

Shannon Entropy

import math
from collections import Counter

class InformationTheory:
    """Information theory calculations"""
Installs
5
GitHub Stars
3
First Seen
May 16, 2026