Automation library · Data collection

Migrate large Hugging Face datasets to MongoDB

Started by an event in a connected app, and works across MongoDB. 15 steps, 2 branches: a working afternoon to understand properly.

Medium

15 stepsMedium: a working afternoon
2Branches: places the flow splits
0Loops or waits
1Service it connects to

The flow

Starts it 2Logic 11Service 2

The steps in the order they run, from what starts it.

  1. 1SubTriggerExecute Workflow triggerStarts it
  2. 2Trigger_ManualManual triggerStarts it
  3. 3HF_FetchRowsHttp RequestService
  4. 4Config_StartSetLogic
  5. 5Extract_RowsSetLogic
  6. 6InsertBatchExecute WorkflowLogic
  7. 7HasRows?IfLogic
  8. 8ContinueLoop?IfLogic
  9. 9Row_SplitterSplit OutLogic
  10. 10NoRows_OffsetSetLogic
  11. 11StopNo OpLogic
  12. 12Transform_RemoveId_AddMetaCodeLogic
  13. 13Mongo_InsertOrUpsertMongo DbService
  14. 14AggregateAggregateLogic
  15. 15setOffsetSetLogic

How it's built

Starts on
An event in a connected app
Steps
15, with 2 branches
Size
Medium: a working afternoon
Connects to
MongoDB
Model
None. This is plumbing, not judgement

Questions

What does it need to run?

An n8n account, plus your own MongoDB account. You connect your own accounts after importing it; none are included.

What starts it?

It starts on an event in a connected app.

Does it use AI?

No. Every step is fixed logic or a call to a service, so it does the same thing every time.

How long does it take to set up?

Plan an afternoon. 15 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 15 steps before you point it at anything that matters.