Automation library · Lead generation

Indeed job scraper with Apify and Tavily

Started by another system calling it, and works across Apify and Google Sheets. It hands the judgement calls to OpenAI. 18 steps, 3 branches, 2 loops or waits: a working afternoon to understand properly.

MediumCalls a model: OpenAI

18 stepsMedium: a working afternoon
3Branches: places the flow splits
2Loops or waits
2Services it connects to

The flow

Starts it 1Model 1Logic 12Service 4

The steps in the order they run, from what starts it.

  1. 1WebhookWebhookStarts it
  2. 2Get dataset itemsApifyService
  3. 3Loop Over Items1Split In BatchesLogic
  4. 4Filter 1IfLogic
  5. 5Edit Fields1SetLogic
  6. 6MergeMergeLogic
  7. 7Filter 2FilterLogic
  8. 8Remove DuplicatesRemove DuplicatesLogic
  9. 9Get row(s) in sheetGoogle SheetsService
  10. 10Filter OutletMergeLogic
  11. 11Job FilterOpen AiModel
  12. 12True JobsMergeLogic
  13. 13Edit FieldsSetLogic
  14. 14Anything to add?IfLogic
  15. 15Relevant Job posting?IfLogic
  16. 16Find DMTavilyService
  17. 17Append row in sheetGoogle SheetsService
  18. 18WaitWaitLogic

How it's built

Starts on
Another system calling it
Steps
18, with 3 branches, 2 loops or waits
Size
Medium: a working afternoon
Connects to
Apify, Google Sheets
Model
OpenAI

Questions

What does it need to run?

An n8n account, plus your own Apify and Google Sheets accounts, and a key for OpenAI. You connect your own accounts after importing it; none are included.

What starts it?

It starts on another system calling it.

Does it use AI?

Yes. It calls OpenAI. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 18 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 18 steps before you point it at anything that matters.