RAG Architecture

Purpose

Design a Retrieval-Augmented Generation pipeline, including document processing, chunking strategy, embedding pipeline, vector database selection, retrieval optimization, and context assembly.

Scope Constraints

Reads source document metadata, query patterns, and infrastructure requirements for pipeline design analysis. Does not execute embedding operations, provision vector databases, or access production data directly.

Inputs

• Source documents (type, volume, update frequency)
• Query patterns (user questions, search terms, structured queries)
• Quality requirements (relevance threshold, hallucination tolerance)
• Latency requirements (real-time, near-real-time, batch)
• Cost constraints (embedding costs, storage costs, query costs)

Input Sanitization