Skip to content

Example deployment of Kedro with Airflow using DockerOperator

Notifications You must be signed in to change notification settings

dodobird-ai/kedro-airflow-docker-operator

Repository files navigation

Iris

Compile the docker image

docker build . -t test-iris

Then using kedro-airflow ( install in a clean venv using pip install kedro-airflow) run the command:

kedro airflow create --params "docker_image=test-iris:latest,user=kedro_docker,current_dir=/Users/emmanuelthierrylincoln/Desktop/dodobird/Engineering/DataEngineering/iris/" -j templates/docker_operator.py

This will take the jinga template at templates/docker_operator.py, compile it as a dag file inside airflow_dags/ folder

About

Example deployment of Kedro with Airflow using DockerOperator

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published