Automation library · Customer support

Automate API FAQ quality testing with OpenAI and Google Sheets

Started by an event in a connected app, and works across Gmail, Google Sheets and Slack. It hands the judgement calls to Azure OpenAI. 14 steps, 1 branch: a working afternoon to understand properly.

MediumCalls a model: Azure OpenAI

14 stepsMedium: a working afternoon
1Branch: places the flow splits
0Loops or waits
3Services it connects to

The flow

Starts it 1Model 2Logic 6Service 5

The steps in the order they run, from what starts it.

  1. 1When clicking ‘Execute workflow’Manual triggerStarts it
  2. 2Azure OpenAI1Lm Chat Azure Open AiModel
  3. 3⚙️ Configuration1SetLogic
  4. 4🤖 AI Evaluator1AgentModel
  5. 5📖 Fetch FAQs1Google SheetsService
  6. 6📊 Parse & Enrich Results1CodeLogic
  7. 7🔍 Validate & Clean Data1CodeLogic
  8. 8💾 Save Detailed Results1Google SheetsService
  9. 9📈 Generate Summary Report1CodeLogic
  10. 10📊 Save to History1Google SheetsService
  11. 11⚠️ Check if Alerts Needed1IfLogic
  12. 12💬 Send Slack Alert1SlackService
  13. 13✅ Completion Summary1SetLogic
  14. 14Send a message1GmailService

How it's built

Starts on
An event in a connected app
Steps
14, with 1 branch
Size
Medium: a working afternoon
Connects to
Gmail, Google Sheets, Slack
Model
Azure OpenAI

Questions

What does it need to run?

An n8n account, plus your own Gmail, Google Sheets and Slack accounts, and a key for Azure OpenAI. You connect your own accounts after importing it; none are included.

What starts it?

It starts on an event in a connected app.

Does it use AI?

Yes. It calls Azure OpenAI. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 14 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

Before you run it

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 14 steps before you point it at anything that matters.