airflow

阅读 77

2022-06-01

基于airflow官方镜像制作自己的镜像,如给镜像安装pymongo

FROM        10.60.10.119:5000/common/air_grpc:0.0.2
MAINTAINER  zhangchunyang@goldwind.com.cn

USER 0
RUN  pip install pymongo
USER airflow

镜像里都装了啥,可以通过docker history + 镜像来查看

airflow_sed

 

LocalExecutor executes tasks locally in parallel. It uses the multiprocessing Python library and queues to parallelize the execution of tasks.

​CeleryExecutor​​  is one of the ways you can scale out the number of workers. For this to work, you need to setup a Celery backend (RabbitMQRedis, …) and change your ​​airflow.cfg​​​ to point the executor parameter to ​​CeleryExecutor​​ and provide the related Celery settings

SequentialExecutor:This executor will only run one task instance at a time, can be used for debugging. It is also the only executor that can be used with sqlite since sqlite doesn’t support multiple connections

 

精彩评论(0)

0 0 举报