Complex conditional dataset scheduling does not displayed in DAG graph #46288
Labels
affected_version:2.10
Issues Reported for 2.10
area:core
area:datasets
Issues related to the datasets feature
area:UI
Related to UI/UX. For Frontend Developers.
kind:bug
This is a clearly a bug
Apache Airflow version
Other Airflow 2 version (please specify below)
If "Other Airflow 2 version" selected, which one?
2.10.2
What happened?
I am trying to schedule datasets with the
&
and|
condition to implement data lineage using Datasets. The list of datasets that depend on the DAG is as follows:The intention is that every day,
table1
,table2
, andtable3
will be updated, whiletableA
,tableB
, andtableC
will be updated on an ad-hoc basis -- and I do not want the DAG to be triggered.However, after deploying this DAG to Airflow, the DAG graph does not display the dependent datasets. It only displays tasks and outlet datasets.
I also tried other variations, such as:
and
Both of these display correctly. However, when using:
The DAG does not display the datasets. However, Dataset graph displays dataset relation correctly in every example.
What you think should happen instead?
No response
How to reproduce
Create a dag with conditonal dataset scheduling, complex &, | like in the description. Try deploying to Airflow and see DAG graph view.
Operating System
N/A
Versions of Apache Airflow Providers
No response
Deployment
Google Cloud Composer
Deployment details
No response
Anything else?
No response
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: