# Find and track flaky CI jobs in GitHub Actions with OpenAI: n8n workflow

> Started by a clock, and works across GitHub, Slack and n8n data table. It hands the judgement calls to OpenAI.

Source: https://millionrounds.com/workflow/find-and-track-flaky-ci-jobs-in-github-actions-with-openai (Millionrounds; every figure on the page links to its filing or article)

[Automation library](https://millionrounds.com/workflows) · [Data collection](https://millionrounds.com/workflows?category=Data+collection#library)

# Find and track flaky CI jobs in GitHub Actions with OpenAI

Started by a clock, and works across GitHub, Slack and n8n data table. It hands the judgement calls to OpenAI. 19 steps, 1 branch: a working afternoon to understand properly.

Medium Calls a model: OpenAI

[Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Ffind-and-track-flaky-ci-jobs-in-github-actions-with-openai)

**19 steps** Medium: a working afternoon

**1** Branch: places the flow splits

**0** Loops or waits

**3** Services it connects to

## The flow

Starts it 2 Model 2 Logic 9 Service 6

The steps in the order they run, from what starts it.

- 1 **Look For Flakes Each Morning** Schedule trigger *Starts it*
- 2 **Or Run It Now** Manual trigger *Starts it*
- 3 **Flake Reader** Lm Chat Open Ai *Model*
- 4 **Settings** Set *Logic*
- 5 **Group The Failures** Chain Llm *Model*
- 6 **Ask For The Recent Runs** Http Request *Service*
- 7 **Build The Report** Code *Logic*
- 8 **Pick The Runs Worth Reading** Code *Logic*
- 9 **Post The Report** Slack *Service*
- 10 **Read The Jobs In Each Run** Http Request *Service*
- 11 **Score Every Job** Code *Logic*
- 12 **Read What You Reported** Data Table *Service*
- 13 **Only The New Or Worse** Code *Logic*
- 14 **Anything Random?** If *Logic*
- 15 **One Row Per Job** Code *Logic*
- 16 **One Issue Per Confirmed Flake** Code *Logic*
- 17 **Nothing Random Today** No Op *Logic*
- 18 **Remember What You Reported** Data Table *Service*
- 19 **Open An Issue** Github *Service*

## How it's built

- **Starts on:** A clock
- **Steps:** 19, with 1 branch
- **Size:** Medium: a working afternoon
- **Connects to:** GitHub, Slack, n8n data table
- **Model:** OpenAI

## Questions

What does it need to run?

An n8n account, plus your own GitHub and Slack accounts, and a key for OpenAI. You connect your own accounts after importing it; none are included.

What starts it?

It starts on a clock.

Does it use AI?

Yes. It calls OpenAI. Model calls are billed by the provider, not by n8n.

How long does it take to set up?

Plan an afternoon. 19 steps is enough that you should read each one before running it.

How do I import it?

Copy the workflow, open a new workflow in n8n and paste. The steps appear on the canvas, ready for your own accounts.

**Before you run it**

Nothing here has been tested by us. It is somebody's working automation, read and described from its own steps. Treat the connections it wants as a list of accounts it will touch, and read the 19 steps before you point it at anything that matters.

## Run it in n8n

- **Create your n8n account** Free to start. n8n is where the workflow runs. [Create an n8n account ↗](https://millionrounds.com/n8n)
- **Download the workflow** Free with a Millionrounds account. [Download free](https://millionrounds.com/login?next=%2Fapp%2Fworkflow%2Ffind-and-track-flaky-ci-jobs-in-github-actions-with-openai)
- **Paste it into n8n** Open a new workflow in n8n and paste. Then connect your own accounts.

Stored with the author's traces removed: canvas notes, instance identifiers, saved credential names and any live document they had left behind.

## Connects to

Each opens the other workflows that use it.

[GitHub](https://millionrounds.com/workflows?service=GitHub#library)[Slack](https://millionrounds.com/workflows?service=Slack#library)[n8n data table](https://millionrounds.com/workflows?service=n8n+data+table#library)

## Workflows like it

Also data collection, with the same services where possible, closest in size first.

- [**Track personal finances in Google Sheets with Slack** 19 steps · calls a model · Google Sheets, Slack](https://millionrounds.com/workflow/track-personal-finances-in-google-sheets-with-slack)
- [**Track and visualize daily moods with OpenAI and Wolfram Alpha** 18 steps · calls a model · Google Sheets, Slack](https://millionrounds.com/workflow/track-and-visualize-daily-moods-with-openai-and-wolfram-alph)
- [**Track legal case deadlines and exceptions with Anthropic** 20 steps · calls a model · Gmail, n8n data table](https://millionrounds.com/workflow/track-legal-case-deadlines-and-exceptions-with-anthropic)
- [**Verify property ownership with OpenAI** 20 steps · calls a model · Google Sheets, n8n data table](https://millionrounds.com/workflow/verify-property-ownership-with-openai)
- [**Write weekly AI news digests with Gluecrawl and OpenAI** 18 steps · calls a model · n8n data table](https://millionrounds.com/workflow/write-weekly-ai-news-digests-with-gluecrawl-and-openai)
- [**Collect historical price data** 18 steps · Supabase, n8n data table](https://millionrounds.com/workflow/collect-historical-price-data)