yBlocks

RAG vs CAG

after an animated RAG-vs-CAG explainer (X)

RAG vs CAG

RAG

Retrieval Augmented Generation

Query

Data

Data

Data

Embedding Model

Vectors

Vectors

Vectors

Vector DB

Context

LLM

Final Response

RAG + CAG

Retrieval Augmented Generation + Cache Augmented Generation

Query

Data

Data

Data

Vector DB

LLM (Preprocessing)

Retrieved Context

KV cache of Context

LLM (Response Generation)

Final Response