Implement AI pipeline auto worker functionality
continuous-integration/drone/push Build is passing

- Introduced AIPipelineAutoWorker to manage the execution of the AI pipeline auto run, including startup catch-up and scheduled tasks.
- Enhanced WorkerConfig to include AIPipelineAutoEnabled and AIPipelineAutoInterval settings for better control over AI pipeline execution.
- Added logging for AI pipeline auto run status, including success and error handling, to improve observability.
- Updated daily job tracker to include AIPipelineAutoJobName for tracking AI pipeline job completions.

This update enhances the system's capability to automate AI pipeline executions, improving efficiency and reliability in processing AI tasks.
This commit is contained in:
Mazyar
2026-07-01 19:42:36 +03:30
parent c46a8d54f4
commit 492f9ba3c8
4 changed files with 149 additions and 1 deletions
+2 -1
View File
@@ -18,7 +18,8 @@ const (
dailyJobRunsCollection = "daily_job_runs"
DailyJobStatusCompleted = "completed"
TEDScraperJobName = "ted_scraper"
TEDScraperJobName = "ted_scraper"
AIPipelineAutoJobName = "ai_pipeline_auto"
)
type dailyJobRun struct {