Automation library · Data collection

Essential multipage website scraper with Jina.AI

Started by an event in a connected app, and works across Google Drive. 12 steps, 2 loops or waits: a working afternoon to understand properly.

Medium

12 stepsMedium: a working afternoon
0Branches: places the flow splits
2Loops or waits
1Service it connects to

The flow

Starts it 1Logic 8Service 3

The steps in the order they run, from what starts it.

  1. 1When clicking ‘Test workflow’Manual triggerStarts it
  2. 2Set Website URLSetLogic
  3. 3Get List of Website URLsHttp RequestService
  4. 4Convert to JSONXmlLogic
  5. 5Create List of Website URLsSplit OutLogic
  6. 6Filter By Topics or PagesFilterLogic
  7. 7LimitLimitLogic
  8. 8Loop Over ItemsSplit In BatchesLogic
  9. 9Jina.ai Web ScraperHttp RequestService
  10. 10Extract Title & Markdown ContentCodeLogic
  11. 11Save Webpage Contents to Google DriveGoogle DriveService
  12. 12WaitWaitLogic

How it's built

Starts on
An event in a connected app
Steps
12, 2 loops or waits
Size
Medium: a working afternoon
Connects to
Google Drive
Model
None. This is plumbing, not judgement

Questions

What does it need to run?

An n8n account, plus your own Google Drive account. You connect your own accounts after importing it; none are included.

What starts it?

It starts on an event in a connected app.

Does it use AI?

No. Every step is fixed logic or a call to a service, so it does the same thing every time.

How long does it take to set up?

Plan an afternoon. 12 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 12 steps before you point it at anything that matters.