The flow
Starts it 1Model 3Logic 11Service 17
The steps in the order they run, from what starts it.
- 1Generate Embeddings with GeminiEmbeddings Google GeminiModel
- 2Scheduled Trigger Every MinuteSchedule triggerStarts it
- 3Load and Chunk Default DataDocument Default Data LoaderModel
- 4Store Vectors in PineconeVector Store PineconeModel
- 5List Files from Google DriveGoogle DriveService
- 6Read Log for Overlap CheckGoogle SheetsService
- 7Merge by Missing or OverlapMergeLogic
- 8Check if File New or UpdatedIfLogic
- 9Split by IDSplit OutLogic
- 10Check if File DeletedIfLogic
- 11Post to VectorDB API - Remove FileHttp RequestService
- 12Split by File IDSplit OutLogic
- 13Download from Google DriveGoogle DriveService
- 14Post to VectorDB API for DeletionHttp RequestService
- 15Delete Log Rows in SheetsGoogle SheetsService
- 16Route by File TypeSwitchLogic
- 17Extract Text from PDFExtract From FileService
- 18Extract Data from XLSXExtract From FileService
- 19Extract from Specialized FileExtract From FileService
- 20Extract from General FileExtract From FileService
- 21Set Fields for PDF DataSetLogic
- 22Convert Data to File FormatConvert To FileService
- 23Set Fields for Specialized FileSetLogic
- 24Set Fields for General FileSetLogic
- 25Append or Update Log in SheetsGoogle SheetsService
- 26Extract Data Post-ConversionExtract From FileService
- 27Read Log Rows in SheetsGoogle SheetsService
- 28Retrieve Files for Log UpdateGoogle DriveService
- 29Set Fields for Converted DataSetLogic
- 30Combine Missing or Overlap FilesMergeLogic
- 31Remove File via VectorDB APIHttp RequestService
- 32Remove Rows in Log SheetsGoogle SheetsService