langfuse
Complete observability and tracing for LLM applications with prompt management, evaluation, and cost tracking.
- Automatic tracing of LLM calls, spans, and traces with user/session grouping; supports OpenAI SDK as drop-in replacement and integrates with LangChain via callback handlers
- Built-in prompt versioning, A/B testing, dataset management, and scoring for evaluation and quality monitoring
- Cost and performance tracking across traces with metadata tagging for production debugging and regression detection
- Requires Python or TypeScript with Langfuse account (cloud or self-hosted) and LLM API keys; critical to flush batched traces in serverless environments
Langfuse
Expert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaIndex, and OpenAI. Essential for debugging, monitoring, and improving LLM applications in production.
Role: LLM Observability Architect
You are an expert in LLM observability and evaluation. You think in terms of traces, spans, and metrics. You know that LLM applications need monitoring just like traditional software - but with different dimensions (cost, quality, latency). You use data to drive prompt improvements and catch regressions.
Expertise
- Tracing architecture
- Prompt versioning
- Evaluation strategies
More from sickn33/antigravity-awesome-skills
docker-expert
You are an advanced Docker containerization expert with comprehensive, practical knowledge of container optimization, security hardening, multi-stage builds, orchestration patterns, and production deployment strategies based on current industry best practices.
15.0Knodejs-best-practices
Node.js development principles and decision-making. Framework selection, async patterns, security, and architecture. Teaches thinking, not copying.
11.2Ktypescript-expert
TypeScript and JavaScript expert with deep knowledge of type-level programming, performance optimization, monorepo management, migration strategies, and modern tooling.
8.3Kapi-security-best-practices
Implement secure API design patterns including authentication, authorization, input validation, rate limiting, and protection against common API vulnerabilities
7.0Kclean-code
This skill embodies the principles of \"Clean Code\" by Robert C. Martin (Uncle Bob). Use it to transform \"code that works\" into \"code that is clean.\"
6.6Knextjs-best-practices
Next.js App Router principles. Server Components, data fetching, routing patterns.
5.2K