Schedule a Comparison Shopping Service Center Transfer

Preview

This product is subject to the "Pre-GA Offerings Terms" in the General Service Terms section of theService Specific Terms. Pre-GA products are available "as is" and might have limited support. For more information, see thelaunch stage descriptions.

Note: To get support or provide feedback for Comparison Shopping Service (CSS) Centertransfers with BigQuery Data Transfer Service, contactgmc-transfer-preview@google.com.

This document shows you how to schedule and manage recurring load jobs forCSS Center reporting data using the BigQuery Data Transfer Service.

Before you begin

Before you create a CSS Center data transfer:

  • Enable the BigQuery Data Transfer Service.
  • Create a BigQuery datasetto store the CSS Center data.
    • For dataset region, we support using the default option, Multi-region, ineither US or EU.
    • If you want to create a dataset in a specific region, the CSS Centerdata transfer is only supported in the following regions:
    • us-east4 (Northern Virginia),
    • asia-northeast1 (Tokyo),
    • asia-southeast1 (Singapore),
    • australia-southeast1 (Sydney),
    • europe-north1 (Findland),
    • europe-west2 (London),
    • europe-west6 (Zurich).
  • You must have your CSS domain ID in order to create a CSS Center data transfer.
  • If you intend to setup transfer run notifications for Pub/Sub, youmust havepubsub.topics.setIamPolicy permissions. Pub/Subpermissions are not required if you only set up email notifications. For moreinformation, seeBigQuery Data Transfer Service Run Notifications.

Required permissions

Ensure that you have granted the following permissions.

Required BigQuery roles

To get the permissions that you need to create a BigQuery Data Transfer Service data transfer, ask your administrator to grant you theBigQuery Admin (roles/bigquery.admin) IAM role on your project. For more information about granting roles, seeManage access to projects, folders, and organizations.

This predefined role contains the permissions required to create a BigQuery Data Transfer Service data transfer. To see the exact permissions that are required, expand theRequired permissions section:

Required permissions

The following permissions are required to create a BigQuery Data Transfer Service data transfer:

  • BigQuery Data Transfer Service permissions:
    • bigquery.transfers.update
    • bigquery.transfers.get
  • BigQuery permissions:
    • bigquery.datasets.get
    • bigquery.datasets.getIamPolicy
    • bigquery.datasets.update
    • bigquery.datasets.setIamPolicy
    • bigquery.jobs.create

You might also be able to get these permissions withcustom roles or otherpredefined roles.

For more information, seeGrantbigquery.admin access.

Required CSS Center roles

You must have access to the CSS Center account that is used in the transfer configuration.

Set up a CSS Center transfer

To create a data transfer for CSS Center reporting:

Console

  1. Go to the Data transfers page in the Google Cloud console.

    Go to Data transfers

  2. ClickCreate transfer.

  3. On theCreate Transfer page:

    • In theSource type section, forSource, chooseGoogle CSS Center.

    • In theTransfer config name section, forDisplay name, enter aname for the data transfer such asMy Transfer. The transfer name canbe any value that lets you identify the transfer if you need to modifyit later.

      Transfer name

    • TheSchedule options section is not configurable. CSS Centerdata transfers are scheduled to run once every 24 hours.

    • In theDestination settings section, forDestination dataset,choose the dataset that you created to store your data.

    • In theData source details section, forCSS ID, enter your CSSdomain ID.

    • Select the report(s) that you would like to transfer. SeeSupported reportsfor more details.

    • (Optional) In theNotification options section:

      • Click the toggle to enable email notifications. When you enable thisoption, the transfer administrator receives an email notificationwhen a transfer run fails.
      • ForSelect a Pub/Sub topic, choose yourtopic name or clickCreate a topic.This option configures Pub/Sub runnotifications for yourdata transfer.

    CSS Center transfer data.

  4. ClickSave.

bq

Enter thebq mk command and supply the transfer creation flag —--transfer_config. The following flags are also required:

  • --data_source
  • --target_dataset
  • --display_name
  • --params

You can also supply the--project_id flag to specify a particularproject. If--project_id isn't specified, the default project is used.

bqmk\--transfer_config\--project_id=project_id\--target_dataset=dataset\--display_name=name\--params='parameters'\--data_source=data_source

Where:

  • project_id is your project ID.
  • dataset is the target dataset for the data transfer configuration.
  • name is the display name for the data transfer configuration. Thetransfer name can be any value that lets you identify thetransfer if you need to modify it later.
  • parameters contains the parameters for the created data transferconfiguration in JSON format. For example:--params='{"param":"param_value"}'.
    • css_id: the CSS domain ID.
    • export_products: whether or not to transfer productand product issues data. This parameter is included by default, even ifyou don't specify theexport_products parameter. We recommendthat you include this parameter explicitly and set it totrue.
  • data_source is the data source —css_center.
Caution: You cannot configure notifications by using thecommand-line tool.

For example, the following command creates a CSS Center data transfernamedMy Transfer using CSS domain ID1234 and target datasetmydataset. The data transfer is created in your default project.

bqmk\--transfer_config\--target_dataset=mydataset\--display_name='My Transfer'\--params='{"css_id":"1234","export_products":"true","export_regional_inventories":"true","export_local_inventories":"true","export_price_benchmarks":"true","export_best_sellers":"true"}'\--data_source=css_center

The first time you run the command, you receive a message like thefollowing:

[URL omitted] Please copy and paste the above URL into your web browser andfollow the instructions to retrieve an authentication code.

Follow the instructions in the message and paste the authentication code onthe command line.

API

Use theprojects.locations.transferConfigs.createmethod and supply an instance of theTransferConfigresource.

Except as otherwise noted, the content of this page is licensed under theCreative Commons Attribution 4.0 License, and code samples are licensed under theApache 2.0 License. For details, see theGoogle Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2026-02-19 UTC.