What is retrieval-augmented generation (RAG)?

Retrieval-augmented generation (RAG) is a technique where an AI first retrieves the most relevant passages from a set of documents and then writes its answer from those passages, so answers are grounded in that content.

Retrieval-augmented generation (RAG), explained

A language model alone answers from what it memorized in training. RAG adds a lookup step: the question is used to search your content, the best passages are given to the model, and the model is told to answer from them.

The search usually combines meaning-based search (embeddings, which find passages about the same idea even with different words) with keyword search for exact names, numbers and codes.

RAG is what makes business chatbots accurate and current: update the documents and the next answer changes, with no retraining of the model.

In AgenBase

AgenBase uses RAG with hybrid search (meaning and exact words) across your pages, files and text, and links each answer to the passages it used. Connected Google Sheets are read live at answer time.

Questions, answered.

Can't find your answer? The team replies within one business day.

Does RAG train the AI model on my data?

No. Your content is searched at answer time; the model itself isn't retrained on it.

Why does RAG reduce wrong answers?

Because the model is given the relevant facts and told to answer from them, and the sources can be shown and checked.

Be first to build with AgenBase.

We're opening access in small groups. Tell us where to reach you, and we'll help you get started.

Request early access