Automation library · Data collection

Local multi-LLM testing & performance tracker with OpenAI

Started by someone opening a chat with it, and works across Google Sheets. It hands the judgement calls to OpenAI. 12 steps: a working afternoon to understand properly.

MediumCalls a model: OpenAI

12 stepsMedium: a working afternoon
0Branches: places the flow splits
0Loops or waits
1Service it connects to

The flow

Starts it 1Model 2Logic 7Service 2

The steps in the order they run, from what starts it.

  1. 1When chat message receivedChat triggerStarts it
  2. 2Run Model with Dunamic InputsLm Chat Open AiModel
  3. 3Get ModelsHttp RequestService
  4. 4LLM Response AnalysisChain LlmModel
  5. 5Extract Model IDsto Run SeparatelySplit OutLogic
  6. 6Capture End TimeDate TimeLogic
  7. 7Capture Start TimeDate TimeLogic
  8. 8Get timeDifferenceDate TimeLogic
  9. 9Add System PromptSetLogic
  10. 10Prepare Data for AnalysisSetLogic
  11. 11Analyze LLM Response MetricsCodeLogic
  12. 12Save Results to Google SheetsGoogle SheetsService

How it's built

Starts on
Someone opening a chat with it
Steps
12
Size
Medium: a working afternoon
Connects to
Google Sheets
Model
OpenAI

Questions

What does it need to run?

An n8n account, plus your own Google Sheets account, and a key for OpenAI. You connect your own accounts after importing it; none are included.

What starts it?

It starts on someone opening a chat with it.

Does it use AI?

Yes. It calls OpenAI. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 12 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 12 steps before you point it at anything that matters.