How do I implement column-level lineage tracking when integrating Great Expectations with Airflow and our existing dbt documentation pipeline?
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
How do I implement column-level lineage tracking when integrating Great Expectations with Airflow and our existing dbt documentation pipeline?
3 real searches · 1 real-search pass
Great Expectations OpenLineage integration documentation validation results Airflow dbt column lineage manifest catalog official docsGoogle ↗
OBSERVED
OpenLineage Airflow provider documentation column lineage dbt integration officialGoogle ↗
OBSERVED
dbt manifest.json column level lineage compiled SQL docsGoogle ↗
OBSERVED
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
Classifying 3 queries…
Searches and sources
ChatGPT3 real searches · gpt-6
Great Expectations OpenLineage integration documentation validation results Airflow dbt column lineage manifest catalog official docs Google ↗
OpenLineage Airflow provider documentation column lineage dbt integration official Google ↗
dbt manifest.json column level lineage compiled SQL docs Google ↗
- Column-level lineage · docs.getdbt.com
- OpenLineage/website/docs/integrations/dbt.md at main · OpenLineage/OpenLineage · github.com
- OpenLineage/integration/dbt/README.md at main · OpenLineage/OpenLineage · github.com
- Great Expectations · openlineage.io
- Collect OpenLineage metadata using an Action · docs.greatexpectations.io
- Use GX with dbt · docs.greatexpectations.io
- apache-airflow-providers-openlineage — apache-airflow-providers-openlineage Documentation · airflow.apache.org
- OpenLineage Airflow integration — apache-airflow-providers-openlineage Documentation · airflow.apache.org
Queries
3 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
Great Expectations OpenLineage integration documentation validation results Airflow dbt column lineage manifest catalog official docs OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
OpenLineage Airflow provider documentation column lineage dbt integration official OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
dbt manifest.json column level lineage compiled SQL docs OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 |