# Web scraper: extract website content: n8n workflow template

> Started by an event in a connected app, and works across Google Drive. 12 steps, 2 loops or waits: a working afternoon to understand properly.

Source: https://millionrounds.com/workflow/web-scraper-extract-website-content (Millionrounds; every figure on the page links to its filing or article)

[Automation library](https://millionrounds.com/workflows) · [Lead generation](https://millionrounds.com/workflows?category=Lead+generation#library)

# Web scraper: extract website content

Started by an event in a connected app, and works across Google Drive. 12 steps, 2 loops or waits: a working afternoon to understand properly.

Medium

[Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Fweb-scraper-extract-website-content)

**12 steps** Medium: a working afternoon

**0** Branches: places the flow splits

**2** Loops or waits

**1** Service it connects to

## The flow

Starts it 1 Logic 8 Service 3

The steps in the order they run, from what starts it.

- 1 **Start Working Scraper** Manual trigger *Starts it*
- 2 **Set Sitemap URL** Set *Logic*
- 3 **Get Sitemap** Http Request *Service*
- 4 **Parse Sitemap XML** Xml *Logic*
- 5 **Split Sitemap URLs** Split Out *Logic*
- 6 **Limit URLs (Optional)** Limit *Logic*
- 7 **Loop URLs** Split In Batches *Logic*
- 8 **Scrape Page** Http Request *Service*
- 9 **Extract Content** Code *Logic*
- 10 **Format Content** Code *Logic*
- 11 **Save to Google Drive** Google Drive *Service*
- 12 **Wait Between Pages** Wait *Logic*

## How it's built

- **Starts on:** An event in a connected app
- **Steps:** 12, 2 loops or waits
- **Size:** Medium: a working afternoon
- **Connects to:** Google Drive
- **Model:** None. This is plumbing, not judgement

## Questions

What does it need to run?

An n8n account, plus your own Google Drive account. You connect your own accounts after importing it; none are included.

What starts it?

It starts on an event in a connected app.

Does it use AI?

No. Every step is fixed logic or a call to a service, so it does the same thing every time.

How long does it take to set up?

Plan an afternoon. 12 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

**Before you run it**

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 12 steps before you point it at anything that matters.

## Run it in n8n

- **Create your n8n account** Free to start. n8n is where the workflow runs. [Create an n8n account ↗](https://millionrounds.com/n8n)
- **Download the workflow** Free with a Millionrounds account. [Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Fweb-scraper-extract-website-content)
- **Paste it into n8n** Open a new workflow in n8n and paste. Then connect your own accounts.

Stored with the author's traces removed: canvas notes, instance identifiers, saved credential names and any live document they had left behind.

## Connects to

Each opens the other workflows that use it.

[Google Drive](https://millionrounds.com/workflows?service=Google+Drive#library)

## Workflows like it

Also lead generation, with the same services where possible, closest in size first.

- [**Create customized Google Slides presentations** 12 steps · Google Drive, Google Sheets](https://millionrounds.com/workflow/create-customized-google-slides-presentations)
- [**Upload leads from a CSV file to Pipedrive CRM** 12 steps · Google Drive, Pipedrive](https://millionrounds.com/workflow/upload-leads-from-a-csv-file-to-pipedrive-crm)
- [**Automate solar lead qualification & follow-ups** 13 steps · Gmail, Google Drive](https://millionrounds.com/workflow/automate-solar-lead-qualification-and-follow-ups)
- [**Automated workshop certificate system with JotForm** 11 steps · Gmail, Google Drive](https://millionrounds.com/workflow/automated-workshop-certificate-system-with-jotform)
- [**Route Tally affiliate leads to Google Sheets** 11 steps · Google Drive, Google Sheets](https://millionrounds.com/workflow/route-tally-affiliate-leads-to-google-sheets)
- [**Process business cards from Google Drive with OpenAI** 13 steps · calls a model · Airtable, Gmail](https://millionrounds.com/workflow/process-business-cards-from-google-drive-with-openai)
