gcloud beta dataflow yaml run Stay organized with collections Save and categorize content based on your preferences.
- NAME
- gcloud beta dataflow yaml run - runs a job from the specified path
- SYNOPSIS
gcloud beta dataflow yaml runJOB_NAME(--yaml-pipeline=YAML_PIPELINE|--yaml-pipeline-file=YAML_PIPELINE_FILE)[--jinja-variables=JSON_OBJECT][--network=NETWORK][--pipeline-options=[OPTIONS=VALUE;OPTION=VALUE,…]][--region=REGION_ID][--subnetwork=SUBNETWORK][--template-file-gcs-location=TEMPLATE_FILE_GCS_LOCATION][GCLOUD_WIDE_FLAG …]
- DESCRIPTION
(BETA)Runs a job from the specified YAML description or CloudStorage path.- EXAMPLES
- To run a job from YAML, run:
gcloudbetadataflowyamlrunmy-job--yaml-pipeline-file=gs://yaml-path--region=europe-west1 - POSITIONAL ARGUMENTS
JOB_NAME- Unique name to assign to the job.
- REQUIRED FLAGS
- Exactly one of these must be specified:
--yaml-pipeline=YAML_PIPELINE- Inline definition of the YAML pipeline to run.
--yaml-pipeline-file=YAML_PIPELINE_FILE- Path of a file defining the YAML pipeline to run. (Must be a local file or a URLbeginning with 'gs://'.)
- Exactly one of these must be specified:
- OPTIONAL FLAGS
--jinja-variables=JSON_OBJECT- Jinja2 variables to be used in reifying the yaml.
--network=NETWORK- Compute Engine network for launching worker instances to run the pipeline. Ifnot set, the default network is used.
--pipeline-options=[OPTIONS=VALUE;OPTION=VALUE,…]- Pipeline options to pass to the job.
--region=REGION_ID- Region ID of the job's regional endpoint. Defaults to 'us-central1'.
--subnetwork=SUBNETWORK- Compute Engine subnetwork for launching worker instances to run the pipeline. Ifnot set, the default subnetwork is used.
--template-file-gcs-location=TEMPLATE_FILE_GCS_LOCATION- Google Cloud Storage location of the YAML template to run. (Must be a URLbeginning with 'gs://'.)
- GCLOUD WIDE FLAGS
- These flags are available to all commands:
--access-token-file,--account,--billing-project,--configuration,--flags-file,--flatten,--format,--help,--impersonate-service-account,--log-http,--project,--quiet,--trace-token,--user-output-enabled,--verbosity.Run
$gcloud helpfor details. - NOTES
- This command is currently in beta and might change without notice. This variantis also available:
gclouddataflowyamlrun
Except as otherwise noted, the content of this page is licensed under theCreative Commons Attribution 4.0 License, and code samples are licensed under theApache 2.0 License. For details, see theGoogle Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2025-07-22 UTC.