The flow
Starts it 1Logic 6Service 6
The steps in the order they run, from what starts it.
- 1Domain to scrapeWebhookStarts it
- 2Scrape robots.txt fileScraping BeeService
- 3If sitemap links are foundIfLogic
- 4Scrape sitemap.xml fileScraping BeeService
- 5Extract xml linksCodeLogic
- 6If it's a binary fileIfLogic
- 7Scrape xml fileScraping BeeService
- 8If it's a .gz fileIfLogic
- 9Extract non-xml linksCodeLogic
- 10Decompress .gz fileCompressionService
- 11Load the xml file as JSONExtract From FileService
- 12Append links to sheetGoogle SheetsService
- 13Store the file to data key for easy handlingCodeLogic
How it's built
- Starts on
- Another system calling it
- Steps
- 13, with 3 branches
- Size
- Medium: a working afternoon
- Connects to
- Google Sheets
- Model
- None. This is plumbing, not judgement
Questions
What does it need to run?
An n8n account, plus your own Google Sheets account. You connect your own accounts after importing it; none are included.
What starts it?
It starts on another system calling it.
Does it use AI?
No. Every step is fixed logic or a call to a service, so it does the same thing every time.
How long does it take to set up?
Plan an afternoon. 13 steps is enough that you should read each one before running it.
How do I import it?
Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.
Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 13 steps before you point it at anything that matters.