Airflow/Basics
Airflow Task Lifecycle
카스캔
2022. 6. 30. 15:12
Task Lifecycle
- No status
- scheduler created empty task instance
Scheduler
- Scheduled
- scheduler determined task instance needs to run
- upstream_failed
- the task’s upstream task failed
- skipped
- task is skipped
Executor
- Queued
- scheduler sent task to executor to run on the queue
Worker
- Running
- worker picked up a task and is now running it
- Up for retry
- return the task
- Up for reschedule
- reschedule task every certain time interval