Prompt Token Analyzer

Prompt Token Analyzer is a lightweight CLI tool that calculates how many tokens a prompt contains.
It uses the gpt-tokenizer package to approximate GPT-style tokenization.

This helps AI agents and developers:

• estimate prompt size
• reduce unnecessary token usage
• debug large prompts
• optimize RAG pipelines

Installation

Install the tokenizer: