Automation library · Data collection

Compare different LLM responses side-by-side

Started by someone opening a chat with it, and works across Google Sheets. It puts OpenRouter behind a retrieval step, so answers are drawn from documents you supply rather than from the model alone. 14 steps, 1 loop or waits: a working afternoon to understand properly.

MediumCalls a model: OpenRouterRetrieval

14 stepsMedium: a working afternoon
0Branches: places the flow splits
1Loop or waits
1Service it connects to

The flow

Starts it 1Model 4Logic 7Service 2

The steps in the order they run, from what starts it.

  1. 1When chat message receivedChat triggerStarts it
  2. 2Simple MemoryMemory Buffer WindowModel
  3. 3OpenRouter Chat ModelLm Chat Open RouterModel
  4. 4Define Models to CompareSetLogic
  5. 5Chat Memory ManagerMemory ManagerModel
  6. 6AI AgentAgentModel
  7. 7Split Models into ItemsSplit OutLogic
  8. 8Prepare Data for Chat and Google SheetsSetLogic
  9. 9Set model, sessionId, chatInput, sessionIdBaseSetLogic
  10. 10Loop Over ItemsSplit In BatchesLogic
  11. 11Concatenate Chat AnswersSummarizeService
  12. 12Group Model Outputs for EvaluationAggregateLogic
  13. 13Set Output for Chat UISetLogic
  14. 14Add Model Results to Google SheetGoogle SheetsService

How it's built

Starts on
Someone opening a chat with it
Steps
14, 1 loop or waits
Size
Medium: a working afternoon
Connects to
Google Sheets
Model
OpenRouter
Retrieval
Answers are drawn from documents you supply, not from the model alone

Questions

What does it need to run?

An n8n account, plus your own Google Sheets account, and a key for OpenRouter. You connect your own accounts after importing it; none are included.

What starts it?

It starts on someone opening a chat with it.

Does it use AI?

Yes. It calls OpenRouter. Its answers draw on documents you give it, not on the model alone. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 14 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 14 steps before you point it at anything that matters.