This page shows you how to resolve issues with Cloud Data FusionDataplex Universal Catalog asset lineage integrations.

Runtime errors

To find relevant logs for your data pipelines, go to your instance in theCloud Data Fusion web interface and clickSystem Admin>Management>Metadata Service.

The Data Lineage API isn't enabled or role isn't granted

The following issue occurs when the Data Lineage API hasn't been enabled inthe project or the Cloud Data Fusion service account hasn't been grantedthe Data Lineage Events Producer role:

Error calling the metadata consumer data-catalog-consumer:io.grpc.StatusRuntimeException: PERMISSION_DENIED: Data Lineage API has not beenused in project <project_id> before or it is disabled. Enable it by visitinghttps://console.developers.google.com/apis/api/datalineage.googleapis.com/overview?project=<project_id>then retry. If you enabled this API recently, wait a few minutes for the actionto propagate to our systems and retry.

To resolve this issue, enable the Data Lineage API and grant the DataLineage Events Producer role to the Cloud Data Fusion Service Agent. Formore information, seeView lineage in Dataplex Universal Catalog.

Pipeline runs in an unsupported Cloud Data Fusion version

The following issue occurs when the Cloud Data Fusion instance is upgradedto a version greater than 6.8.0, but the pipeline hasn't been upgraded:

Error calling the metadata consumer data-catalog-consumer:java.lang.IllegalArgumentException: FQN for the asset is null.

To resolve this issue,upgrade the pipelineto the latest version.

No messages in logs and no lineage in Dataplex Universal Catalog

The following issue occurs when one of the plugins used in the pipeline doesn'tsupport lineage egress to Dataplex Universal Catalog:

There aren't error or success messages in the logs and there's no lineage inDataplex Universal Catalog.

To resolve this issue, your pipeline must contain only theplugins that support data lineage in Dataplex Universal Catalog.