Load data from other Google and Google Cloud services

You can use a number of Google Cloud services to load data into BigQuery where you can thenperform further analysis. These services typically require that you initiateextract jobs from the respective console or API of the service. Once enabled,data is loaded into BigQuery according to the cadence defined inthe service's extract job. Some extract jobs run in real time and others provide batch data loads.

For Google Cloud databases and services, including Google Drive and Google Sheets,data queries originate from BigQuery. For more information,seeexternal data sources.

If a service is not listed, you might still be able to export data from theservice, but this might require using additional functionality. For moreinformation about how to set up custom exports or how to create load jobs andqueries from BigQuery, seeIntroduction to loading data.

Cloud services that support data exports

Carbon Footprint

TheCarbon Footprint export captures gross estimated greenhouse gasemissions associated with the usage of covered Google Cloud services for theselected billing account.

You can export your Carbon Footprint data to BigQuery inorder to perform data analysis, or to create custom dashboards and reports.

To set up exports of your Carbon Footprint data, seeExport your carbon footprint.

Google Security Operations

You can exportGoogle Security Operations security logs to BigQuery foradditional data joins and analytics.

To set up exports of your Google Security Operations security logs, reach out to yourGoogle Security Operations support to set this up.

Cloud Asset Inventory

Cloud Asset Inventory lets you export the asset metadata for your organization,folder, or project to a BigQuery table, and then run dataanalysis on your inventory.

To set up exports of your Cloud Asset Inventory data, seeExporting to BigQuery.

Cloud Billing

Cloud Billing export to BigQuery lets you export detailedGoogle Cloud billing data (such as usage, cost estimates, and pricing data)automatically throughout the day.

Timing is important. To have access to a more comprehensive set of billingdata for your analysis needs, we recommend that you enable Cloud Billing dataexport to BigQuery at the same time that you create aCloud Billing account.

To set up exports of your Cloud Billing data, seeExport Cloud Billing data to BigQuery.

Cloud Logging

You can route logs fromCloud Logging to BigQuery tables foradditional analytics and joins. For Google Cloud services, log data becomesavailable for querying approximately 1 minute after it is generated.

To use BigQuery as a part of Log Analytics, seeLog Analytics.

To set up exports of your Cloud Logging data, seeRoute logs to supported sinks.

Conversational Insights

Conversational Insights lets you export your Conversational Insights conversation and analysisdata to BigQuery so that you can perform your own raw queries.

To configure exports of your Conversational Insights data, seeExport conversations to BigQuery.

Dialogflow CX

Dialogflow CX generates logs of the conversations between agents andyour customers.

To configure exports of conversations from Dialogflow CX, seeInteraction logging export to BigQuery.

Firebase

Firebase contains a number of analytics exports you can send to BigQuery.These include:

• Analytics
• Cloud messaging
• Crashlytics
• Performance monitoring
• A/B testing
• Remote configuration personalization

To configure exports of Firebase data, seeExport project data to BigQuery.

Google Analytics 4

To learn how to export your session data from aGoogle Analytics 4reporting view into BigQuery, seeBigQuery exportSet up BigQuery exportin the Analytics Help Center. After the Google Analytics4 data is in BigQuery, you can query it by using GoogleSQL.

If you are experiencing errors with your Google Analytics 4 export,seeReasons for linking failuresorReasons for export failures.

If you are experiencing data delays from Google Analytics4 exports, missing Google Analytics 4 data after an export, or otherissues, contactAnalytics support.

For BigQuery issues, like billing, contactGoogle Cloud Support.

Google Analytics 360

To learn how to export your session data from aGoogle Analytics 360reporting view into BigQuery, seeBigQuery exportin the Analytics Help Center. After the Google Analytics360 data is in BigQuery, you can query it by using GoogleSQL.

For examples of querying Analytics data inBigQuery, seeBigQuery cookbookin the Analytics Help.

For issues related to linking BigQuery andGoogle Analytics 360, missing Google Analytics 360 data afteran export, or issues related to data delays when exportingfrom Google Analytics 360, contactGoogle Analytics 360 support.

For BigQuery issues, like billing, contactGoogle Cloud Support.

Google Search Console data

You can schedule a daily export of yourGoogle Search Console performance datato BigQuery, where you can run complex queries over your data.

To set up exports of your data, seeAbout bulk data export of Search Console data to BigQuery.

Recommender

You can schedule daily snapshots of therecommendationsusing the BigQuery Data Transfer Service. Recommendations provide advice on optimizingyour usage of Google Cloud products and resources, and also provide insightsinto your resource usage patterns.

To set up snapshots of your data using the BigQuery Data Transfer Service, seeExport recommendations to BigQuery.

Vertex AI Batch Prediction

Vertex AI Batch Prediction creates a set of predictions based on aninput to a model. You can store these results in BigQuery foradditional analytics and joins.

To configure exports of batch prediction results, seeGet batch predictions and explanations.

Vertex AI Predictions

You can use Vertex AI Predictions to store prediction results fromonline endpoints in BigQuery for additional analysis.

To configure model prediction integration with BigQuery, seeOnline prediction logging.

What's next

• Learn about other integrations you can initiate in BigQuery usingBigQuery Data Transfer Service.
• Learn about connections to otherexternal data sources.