Monitor Dataplex Universal Catalog logs

Dataplex Universal Catalog job logs can be viewed, searched, filtered, and archived inCloud Logging.

To understand the costs, seeGoogle Cloud Observability pricing.

For more information about logging retention, seeLogs retention periods.

To disable all logs or exclude logs from Logging, seeExclusion filters.

To route logs from Logging to Cloud Storage,BigQuery, or Pub/Sub, seeRouting and storage overview.

Access Dataplex Universal Catalog service logs in Logging

Dataplex Universal Catalog publishes the following service logs to Cloud Logging.

Log typeLog namelogName queryLog description
Data scan event logsdataplex.googleapis.com/data_scanlogName=(projects/$PROJECT_ID/logs/dataplex.googleapis.com%2Fdata_scan)Event logs for data scan jobs indicating job state, results, and statistics
Data quality scan rule result logsdataplex.googleapis.com/data_quality_scan_rule_resultlogName=(projects/$PROJECT_ID/logs/dataplex.googleapis.com%2Fdata_quality_scan_rule_result)Results of data quality scan rules in a data quality job
Discovery logsdataplex.googleapis.com/discoverylogName=(projects/$PROJECT_ID/logs/dataplex.googleapis.com%2Fdiscovery)Discovery progress and updates over assets in a zone
Metadata job logsdataplex.googleapis.com/metadata_joblogName=(projects/$PROJECT_ID/logs/dataplex.googleapis.com%2Fmetadata_job)Logs about metadata import jobs and import items in the metadata import file
Process logsdataplex.googleapis.com/processlogName=(projects/$PROJECT_ID/logs/dataplex.googleapis.com%2Fprocess)Job runs resulting from data processing tasks

Replace the following:

  • PROJECT_ID: the ID of your project

To access Logging, you can use theLogs Explorer in theGoogle Cloud console, thegcloud logging commands, ortheLogging API.

Query data scan event logs

When you use Dataplex Universal Catalog tocreate and run a data scan, a data scanevent log is produced in Logging for the resulting job.

Console

  1. In the Google Cloud console, go to theLogs explorer page.

    Go to Logs explorer

  2. In theLogs Explorer view, find theQuery tab.

  3. Click theResource menu.

  4. SelectCloud Dataplex DataScan. ClickApply.

  5. Click theLog name menu.

  6. In theSearch log names field, enterdataplex.googleapis.com%2Fdata_scan. Selectdata_scan andclickApply.

  7. Optional: Filter the logs to a specific data scan ID or location byadding the following filters in the log query:

    resource.labels.location="LOCATION"resource.labels.datascan_id="DATA_SCAN_ID"

  8. ClickRun query.

gcloud

To read your data scan event log entries, use thegcloud logging read commandwith the following query:

gcloud logging read \    'resource.type="dataplex.googleapis.com/DataScan" AND    logName=projects/PROJECT_ID/logs/dataplex.googleapis.com%2Fdata_scan AND    resource.labels.location=LOCATION AND    resource.labels.datascan_id=DATA_SCAN_ID'    --limit 10

REST

To list log entries, use theentries.list method.

Query data quality scan rule result logs

When you use Dataplex Universal Catalog tocreate and run a data quality scan, adata quality scan rule result log is produced in Logging for theresulting job.

Console

  1. In the Google Cloud console, go to theLogs explorer page.

    Go to Logs explorer

  2. In theLogs Explorer view, find theQuery tab.

  3. Click theResource menu.

  4. SelectCloud Dataplex DataScan. ClickApply.

  5. Click theLog name menu.

  6. In theSearch log names field, enterdataplex.googleapis.com%2Fdata_quality_scan_rule_result. Selectdata_quality_scan_rule_result and clickApply.

  7. Optional: Filter the logs to a specific data scan ID or location byadding the following filters in the log query:

    resource.labels.location="LOCATION"resource.labels.datascan_id="DATA_SCAN_ID"

  8. ClickRun query.

gcloud

To read your data quality scan rule result log entries, use thegcloud logging read commandwith the following query:

gcloud logging read \    'resource.type="dataplex.googleapis.com/DataScan" AND    logName=projects/PROJECT_ID/logs/dataplex.googleapis.com%2Fdata_quality_scan_rule_result AND    resource.labels.location=LOCATION AND    resource.labels.datascan_id=DATA_SCAN_ID'    --limit 10

REST

To list log entries, use theentries.list method.

Query discovery logs

When you use Dataplex Universal Catalog to discover data in assets, a discovery logis produced in Logging.

Console

  1. In the Google Cloud console, go to theLogs explorer page.

    Go to Logs explorer

  2. In theLogs Explorer view, find theQuery tab.

  3. Click theResource menu.

  4. SelectCloud Dataplex Zone. ClickApply.

  5. Click theLog name menu.

  6. In theSearch log names field, enterdataplex.googleapis.com%2Fdiscovery. Selectdiscovery andclickApply.

  7. Optional: Filter the logs to a specific asset by adding the following filters in the log query:

    resource.labels.location="LOCATION"resource.labels.lake_id="LAKE_ID"resource.labels.zone_id="ZONE_ID"jsonPayload.assetId="ASSET_ID"

  8. ClickRun query.

gcloud

To read your discovery log entries, use thegcloud logging read commandwith the following query:

gcloud logging read \    'resource.type="dataplex.googleapis.com/Zone" AND    logName=projects/PROJECT_ID/logs/dataplex.googleapis.com%2Fdiscovery AND    resource.labels.location=LOCATION AND    resource.labels.lake_id=LAKE_ID AND    resource.labels.zone_id=ZONE_ID AND    jsonPayload.assetId=ASSET_ID'    --limit 10

REST

To list log entries, use theentries.list method.

Query metadata job logs

When yourun a metadata import job, metadatajob logs are produced in Logging.

Console

  1. In the Google Cloud console, go to theLogs explorer page.

    Go to Logs explorer

  2. In theLogs Explorer view, find theQuery tab.

  3. Click theResource menu.

  4. SelectCloud Dataplex Metadata Job.

  5. Optional: To filter the logs to a specific location or metadata job ID,select a location or job ID.

  6. ClickApply.

  7. Click theLog name menu.

  8. Typedataplex.googleapis.com%2Fmetadata_job and then selectmetadata_job.

  9. ClickApply.

gcloud

To read your metadata job log entries, use thegcloud logging read commandwith the following query:

gcloud logging read \    'resource.type="dataplex.googleapis.com/MetadataJob" AND    logName=projects/PROJECT_ID/logs/dataplex.googleapis.com%2Fmetadata_job AND    resource.labels.location=LOCATION AND    resource.labels.metadata_job_id=METADATA_JOB_ID    --limit 10

REST

To list log entries, use theentries.list method.

Query process logs

When you use Dataplex Universal Catalog toschedule and run tasks, a processlog is produced in Logging for the resulting job.

Console

  1. In the Google Cloud console, go to theLogs explorer page.

    Go to Logs explorer

  2. In theLogs Explorer view, find theQuery tab.

  3. Click theResource menu.

  4. SelectCloud Dataplex Task. ClickApply.

  5. Click theLog name menu.

  6. In theSearch log names field, enterdataplex.googleapis.com%2Fprocess. Selectprocess and clickApply.

  7. Optional: Filter the logs to a specific task by adding the followingfilters in the log query:

    resource.labels.location="LOCATION"resource.labels.lake_id="LAKE_ID"resource.labels.task_id="TASK_ID"

  8. ClickRun query.

gcloud

To read your process log entries, use thegcloud logging read commandwith the following query:

gcloud logging read \    'resource.type="dataplex.googleapis.com/Task" AND    logName=projects/PROJECT_ID/logs/dataplex.googleapis.com%2Fprocess AND    resource.labels.location=LOCATION AND    resource.labels.lake_id=LAKE_ID AND    resource.labels.task_id=TASK_ID'    --limit 10

REST

To list log entries, use theentries.list method.

What's next

Except as otherwise noted, the content of this page is licensed under theCreative Commons Attribution 4.0 License, and code samples are licensed under theApache 2.0 License. For details, see theGoogle Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2026-02-19 UTC.