Automation library · Data collection

Scrape and ingest web pages into a Pinecone RAG stack

Started by someone opening a chat with it, and works across Pinecone. It puts OpenAI and OpenRouter behind a retrieval step, so answers are drawn from documents you supply rather than from the model alone. 15 steps: a working afternoon to understand properly.

MediumCalls a model: OpenAI, OpenRouterRetrieval

15 stepsMedium: a working afternoon
0Branches: places the flow splits
0Loops or waits
1Service it connects to

The flow

Starts it 4Model 9Logic 1Service 1

The steps in the order they run, from what starts it.

  1. 1Receive URLWebhookStarts it
  2. 2Generate OpenAI embeddingsEmbeddings Open AiModel
  3. 3Load scraped contentDocument Default Data LoaderModel
  4. 4Receive chat messageChat triggerStarts it
  5. 5OpenRouter LLMLm Chat Open RouterModel
  6. 6Chat memoryMemory Buffer WindowModel
  7. 7Generate OpenAI embeddings1Embeddings Open AiModel
  8. 8Rerank results with CohereReranker CohereModel
  9. 9Validate and normalize URLCodeLogic
  10. 10Store embeddings in PineconeVector Store PineconeModel
  11. 11Answer query from knowledge baseAgentModel
  12. 12Retrieve documents from PineconeVector Store PineconeModel
  13. 13Scrape page with FirecrawlFirecrawlService
  14. 14Return URL validation errorRespond To WebhookStarts it
  15. 15Return ingestion resultRespond To WebhookStarts it

How it's built

Starts on
Someone opening a chat with it
Steps
15
Size
Medium: a working afternoon
Connects to
Pinecone
Model
OpenAI, OpenRouter
Retrieval
Answers are drawn from documents you supply, not from the model alone

Questions

What does it need to run?

An n8n account, plus your own Pinecone account, and a key for OpenAI and OpenRouter. You connect your own accounts after importing it; none are included.

What starts it?

It starts on someone opening a chat with it.

Does it use AI?

Yes. It calls OpenAI and OpenRouter. Its answers draw on documents you give it, not on the model alone. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 15 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 15 steps before you point it at anything that matters.