Automation library · CRM

Production_RAG_Document_ingestion_pipeline with OpenAI

Started by an event in a connected app, and works across Google Drive and Pinecone. It puts OpenAI behind a retrieval step, so answers are drawn from documents you supply rather than from the model alone. 19 steps, 1 branch, 1 loop or waits: a working afternoon to understand properly.

MediumCalls a model: OpenAIRetrieval

Download free
19 stepsMedium: a working afternoon
1Branch: places the flow splits
1Loop or waits
2Services it connects to

The flow

Starts it 1Model 4Logic 7Service 7

The steps in the order they run, from what starts it.

  1. 1When clicking 'Execute workflow'Manual triggerStarts it
  2. 2Embeddings OpenAIEmbeddings Open AiModel
  3. 3Recursive Character Text SplitterText Splitter Recursive Character Text SplitterModel
  4. 4Clean Binary DataCodeLogic
  5. 5Extract Google Docs TextExtract From FileService
  6. 6Extract DOCX TextCodeLogic
  7. 7Search files and foldersGoogle DriveService
  8. 8Pinecone Vector StoreVector Store PineconeModel
  9. 9Default Data Loader1Document Default Data LoaderModel
  10. 10Set File IDSetLogic
  11. 11Get ContentGoogle DriveService
  12. 12SwitchSwitchLogic
  13. 13Extract PDF TextExtract From FileService
  14. 14Extract from ExcelExtract From FileService
  15. 15MergeMergeLogic
  16. 16AggregateAggregateLogic
  17. 17Loop Over ItemsSplit In BatchesLogic
  18. 18SummarizeSummarizeService
  19. 19HTTP RequestHttp RequestService

How it's built

Starts on
An event in a connected app
Steps
19, with 1 branch, 1 loop or waits
Size
Medium: a working afternoon
Connects to
Google Drive, Pinecone
Model
OpenAI
Retrieval
Answers are drawn from documents you supply, not from the model alone

Questions

What does it need to run?

An n8n account, plus your own Google Drive and Pinecone accounts, and a key for OpenAI. You connect your own accounts after importing it; none are included.

What starts it?

It starts on an event in a connected app.

Does it use AI?

Yes. It calls OpenAI. Its answers draw on documents you give it, not on the model alone. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 19 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 19 steps before you point it at anything that matters.