# Scrape and ingest web content into Supabase pgvector: n8n workflow

> Started by someone opening a chat with it, and works across Supabase and Supabase vectors.

Source: https://millionrounds.com/workflow/scrape-and-ingest-web-content-into-supabase-pgvector (Millionrounds; every figure on the page links to its filing or article)

[Automation library](https://millionrounds.com/workflows) · [Content](https://millionrounds.com/workflows?category=Content#library)

# Scrape and ingest web content into Supabase pgvector

Started by someone opening a chat with it, and works across Supabase and Supabase vectors. It puts OpenAI and OpenRouter behind a retrieval step, so answers are drawn from documents you supply rather than from the model alone. 18 steps, 1 branch: a working afternoon to understand properly.

Medium Calls a model: OpenAI, OpenRouter Retrieval

[Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Fscrape-and-ingest-web-content-into-supabase-pgvector)

**18 steps** Medium: a working afternoon

**1** Branch: places the flow splits

**0** Loops or waits

**2** Services it connects to

## The flow

Starts it 5 Model 9 Logic 2 Service 2

The steps in the order they run, from what starts it.

- 1 **Receive company URL** Webhook *Starts it*
- 2 **Load scraped content** Document Default Data Loader *Model*
- 3 **Generate OpenAI embeddings** Embeddings Open Ai *Model*
- 4 **Receive chat message** Chat trigger *Starts it*
- 5 **OpenRouter LLM** Lm Chat Open Router *Model*
- 6 **Chat memory** Memory Buffer Window *Model*
- 7 **Generate OpenAI embeddings1** Embeddings Open Ai *Model*
- 8 **Rerank results with Cohere** Reranker Cohere *Model*
- 9 **Validate and normalize URL** Code *Logic*
- 10 **Store embeddings in Supabase** Vector Store Supabase *Model*
- 11 **Answer query from enriched leads** Agent *Model*
- 12 **Retrieve documents from Supabase** Vector Store Supabase *Model*
- 13 **Check for duplicate in Supabase** Supabase *Service*
- 14 **Return URL validation error** Respond To Webhook *Starts it*
- 15 **Return ingestion result** Respond To Webhook *Starts it*
- 16 **Skip if already ingested** If *Logic*
- 17 **Return duplicate notice** Respond To Webhook *Starts it*
- 18 **Scrape company website with Firecrawl** Firecrawl *Service*

## How it's built

- **Starts on:** Someone opening a chat with it
- **Steps:** 18, with 1 branch
- **Size:** Medium: a working afternoon
- **Connects to:** Supabase, Supabase vectors
- **Model:** OpenAI, OpenRouter
- **Retrieval:** Answers are drawn from documents you supply, not from the model alone

## Questions

What does it need to run?

An n8n account, plus your own Supabase and Supabase vectors accounts, and a key for OpenAI and OpenRouter. You connect your own accounts after importing it; none are included.

What starts it?

It starts on someone opening a chat with it.

Does it use AI?

Yes. It calls OpenAI and OpenRouter. Its answers draw on documents you give it, not on the model alone. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 18 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

**Before you run it**

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 18 steps before you point it at anything that matters.

## Run it in n8n

- **Create your n8n account** Free to start. n8n is where the workflow runs. [Create an n8n account ↗](https://millionrounds.com/n8n)
- **Download the workflow** Free with a Millionrounds account. [Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Fscrape-and-ingest-web-content-into-supabase-pgvector)
- **Paste it into n8n** Open a new workflow in n8n and paste. Then connect your own accounts.

Stored with the author's traces removed: canvas notes, instance identifiers, saved credential names and any live document they had left behind.

## Connects to

Each opens the other workflows that use it.

[Supabase](https://millionrounds.com/workflows?service=Supabase#library)[Supabase vectors](https://millionrounds.com/workflows?service=Supabase+vectors#library)

## Workflows like it

Also content, with the same services where possible, closest in size first.

- [**Summarize YouTube video transcripts in Discord with Gemini** 19 steps · calls a model · Discord, Supabase](https://millionrounds.com/workflow/summarize-youtube-video-transcripts-in-discord-with-gemini)
- [**Workflow function to summarize Reddit posts with Gemini** 20 steps · calls a model · Reddit, Supabase](https://millionrounds.com/workflow/workflow-function-to-summarize-reddit-posts-with-gemini)
- [**Process multiple requests in FIFO with OpenAI Batch API** 16 steps · Postgres, Supabase](https://millionrounds.com/workflow/process-multiple-requests-in-fifo-with-openai-batch-api)
- [**AI LinkedIn content agent with Claude and OpenAI** 15 steps · calls a model · Linear, Supabase vectors](https://millionrounds.com/workflow/ai-linkedin-content-agent-with-claude-and-openai)
- [**Faceless Social Media Factory: GPT-4o + ElevenLabs + Auto-Post** 15 steps · calls a model · Google Sheets, Slack](https://millionrounds.com/workflow/faceless-social-media-factory-gpt-4o-elevenlabs-auto-post)
- [**Ingest LinkedIn posts from Google Drive into Pinecone** 21 steps · calls a model · Google Drive, Pinecone](https://millionrounds.com/workflow/ingest-linkedin-posts-from-google-drive-into-pinecone)