Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing Airflow Images #3151

Open
dvaldivia opened this issue May 10, 2023 · 1 comment
Open

Missing Airflow Images #3151

dvaldivia opened this issue May 10, 2023 · 1 comment
Labels
kind:question Further information is requested platform: pipeline-Airflow Related to usage of Apache Airflow as pipeline runtime

Comments

@dvaldivia
Copy link

Hi, I'm trying to get Elyra to work with the latest Airflow chart, the instructions on the website are not up to date but that's not a problem I can send a PR with the updated chart changes, however the documentation suggest we use elyra/airflow image, but that image on Docker hub is about 2 years old and the Makefile on the repo doesn't build that container, only elyra and kf-notebooks.

What is the proper way to build the airflow container?

Right now attempting to submit an elyra pipeline to airflow causes the following exception:

Broken DAG: [/opt/airflow/dags/repo/sentiment_analysis-0509204952.py] Traceback (most recent call last):
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/opt/airflow/dags/repo/sentiment_analysis-0509204952.py", line 2, in <module>
    from airflow.contrib.kubernetes.volume_mount import VolumeMount
ModuleNotFoundError: No module named 'airflow.contrib.kubernetes'

I tried using the elyra/airflow:3.0.0rc1 and 2.3.0rc1 images, but they fail to start for migrations as the airflow binary is not up to date with airflow

@lresende lresende added kind:question Further information is requested platform: pipeline-Airflow Related to usage of Apache Airflow as pipeline runtime and removed status:Needs Triage labels May 10, 2023
@lresende
Copy link
Member

Could you please clarify? We are currently supporting Airflow 1.x at the moment with Elyra.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind:question Further information is requested platform: pipeline-Airflow Related to usage of Apache Airflow as pipeline runtime
Projects
None yet
Development

No branches or pull requests

2 participants