Automation library · AI assistants

Implement on-prem RAG with Qdrant and Ollama

Started by someone opening a chat with it, and works across Qdrant. It puts a local model behind a retrieval step, so answers are drawn from documents you supply rather than from the model alone. 9 steps: a working afternoon to understand properly.

MediumCalls a model: a local modelRetrieval

9 stepsMedium: a working afternoon
0Branches: places the flow splits
0Loops or waits
1Service it connects to

The flow

Starts it 2Model 7

The steps in the order they run, from what starts it.

  1. 1Default Data LoaderDocument Default Data LoaderModel
  2. 2Embeddings OllamaEmbeddings OllamaModel
  3. 3When chat message receivedChat triggerStarts it
  4. 4Ollama Chat ModelLm Chat OllamaModel
  5. 5Simple MemoryMemory Buffer WindowModel
  6. 6Upload documentForm triggerStarts it
  7. 7Add to Qdrant Vector StoreVector Store QdrantModel
  8. 8Read from Qdrant Vector StoreVector Store QdrantModel
  9. 9AI AgentAgentModel

How it's built

Starts on
Someone opening a chat with it
Steps
9
Size
Medium: a working afternoon
Connects to
Qdrant
Model
a local model
Retrieval
Answers are drawn from documents you supply, not from the model alone

Questions

What does it need to run?

An n8n account, plus your own Qdrant account, and a key for a local model. You connect your own accounts after importing it; none are included.

What starts it?

It starts on someone opening a chat with it.

Does it use AI?

Yes. It calls a local model. Its answers draw on documents you give it, not on the model alone. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 9 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 9 steps before you point it at anything that matters.