Automation library · Research and reporting

Evaluation metric: summarization with Gemini and OpenAI

Started by another system calling it, and works across Google Drive. It hands the judgement calls to Gemini and OpenAI. 14 steps: a working afternoon to understand properly.

MediumCalls a model: Gemini, OpenAI

14 stepsMedium: a working afternoon
0Branches: places the flow splits
0Loops or waits
1Service it connects to

The flow

Starts it 2Model 5Logic 2Service 5

The steps in the order they run, from what starts it.

  1. 1OpenAI Chat ModelLm Chat Open AiModel
  2. 2When fetching a dataset rowEvaluation triggerStarts it
  3. 3LLMLm Chat Google GeminiModel
  4. 4OutputOutput Parser StructuredModel
  5. 5WebhookWebhookStarts it
  6. 6Summarise AgentChain LlmModel
  7. 7Download TranscriptGoogle DriveService
  8. 8Evaluate SummarisationChain LlmModel
  9. 9Get Gdrive URLSetLogic
  10. 10Is Evaluating?EvaluationService
  11. 11Extract from FileExtract From FileService
  12. 12Set OutputsEvaluationService
  13. 13Respond to UserNo OpLogic
  14. 14Set MetricsEvaluationService

How it's built

Starts on
Another system calling it
Steps
14
Size
Medium: a working afternoon
Connects to
Google Drive
Model
Gemini, OpenAI

Questions

What does it need to run?

An n8n account, plus your own Google Drive account, and a key for Gemini and OpenAI. You connect your own accounts after importing it; none are included.

What starts it?

It starts on another system calling it.

Does it use AI?

Yes. It calls Gemini and OpenAI. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 14 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 14 steps before you point it at anything that matters.