# Build a document-based chat assistant with OpenAI RAG: n8n workflow

> Started by someone opening a chat with it, and works across in-memory vectors. It puts OpenAI behind a retrieval step, so answers are drawn from documents...

Source: https://millionrounds.com/workflow/build-a-document-based-chat-assistant-with-openai-rag (Millionrounds; every figure on the page links to its filing or article)

[Automation library](https://millionrounds.com/workflows) · [Documents and files](https://millionrounds.com/workflows?category=Documents+and+files#library)

# Build a document-based chat assistant with OpenAI RAG

Started by someone opening a chat with it, and works across in-memory vectors. It puts OpenAI behind a retrieval step, so answers are drawn from documents you supply rather than from the model alone. 8 steps: small enough to read in one sitting and change without fear.

Small Calls a model: OpenAI Retrieval

[Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Fbuild-a-document-based-chat-assistant-with-openai-rag)

**8 steps** Small: readable in one sitting

**0** Branches: places the flow splits

**0** Loops or waits

**1** Service it connects to

## The flow

Starts it 2 Model 6

The steps in the order they run, from what starts it.

- 1 **Upload your file here** Form trigger *Starts it*
- 2 **Embeddings OpenAI** Embeddings Open Ai *Model*
- 3 **Default Data Loader** Document Default Data Loader *Model*
- 4 **When chat message received** Chat trigger *Starts it*
- 5 **OpenAI Chat Model** Lm Chat Open Ai *Model*
- 6 **Insert Data to Store** Vector Store In Memory *Model*
- 7 **Query Data Tool** Vector Store In Memory *Model*
- 8 **AI Agent** Agent *Model*

## How it's built

- **Starts on:** Someone opening a chat with it
- **Steps:** 8
- **Size:** Small: readable in one sitting
- **Connects to:** in-memory vectors
- **Model:** OpenAI
- **Retrieval:** Answers are drawn from documents you supply, not from the model alone

## Questions

What does it need to run?

An n8n account, plus your own in-memory vectors account, and a key for OpenAI. You connect your own accounts after importing it; none are included.

What starts it?

It starts on someone opening a chat with it.

Does it use AI?

Yes. It calls OpenAI. Its answers draw on documents you give it, not on the model alone. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Not long. At 8 steps it can be read in one sitting and changed without fear.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

**Before you run it**

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 8 steps before you point it at anything that matters.

## Run it in n8n

- **Create your n8n account** Free to start. n8n is where the workflow runs. [Create an n8n account ↗](https://millionrounds.com/n8n)
- **Download the workflow** Free with a Millionrounds account. [Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Fbuild-a-document-based-chat-assistant-with-openai-rag)
- **Paste it into n8n** Open a new workflow in n8n and paste. Then connect your own accounts.

Stored with the author's traces removed: canvas notes, instance identifiers, saved credential names and any live document they had left behind.

## Connects to

Each opens the other workflows that use it.

[in-memory vectors](https://millionrounds.com/workflows?service=in-memory+vectors#library)

## Workflows like it

Also documents and files, with the same services where possible, closest in size first.

- [**Chat with PDF and CSV** 11 steps · calls a model · in-memory vectors](https://millionrounds.com/workflow/chat-with-pdf-and-csv)
- [**Document Q&A chatbot with Google Drive and Telegram** 11 steps · calls a model · Google Drive, Telegram](https://millionrounds.com/workflow/document-q-and-a-chatbot-with-google-drive-and-telegram)
- [**RAG OCR for PDFs with OpenAI and Google Drive** 11 steps · calls a model · Google Drive, in-memory vectors](https://millionrounds.com/workflow/rag-ocr-para-pdfs-with-openai-and-google-drive)
- [**AI-powered company documents Q&A assistant with Google Drive** 12 steps · calls a model · Google Drive, in-memory vectors](https://millionrounds.com/workflow/ai-powered-company-documents-q-and-a-assistant-with-google-d)
- [**Build a retrieval-based chatbot with Telegram and OpenAI** 13 steps · calls a model · Google Drive, Telegram](https://millionrounds.com/workflow/build-a-retrieval-based-chatbot-with-telegram-and-openai)
- [**Answer product queries with WhatsApp and OpenAI** 18 steps · calls a model · WhatsApp, in-memory vectors](https://millionrounds.com/workflow/answer-product-queries-with-whatsapp-and-openai)