gcloud dataproc jobs submit trino - submit a Trino job to a cluster

gcloud dataproc jobs submit trino(--cluster=CLUSTER    |--cluster-labels=[KEY=VALUE,…])(--execute=QUERY,-eQUERY    |--file=FILE,-fFILE)[--async][--bucket=BUCKET][--client-tags=[CLIENT_TAG,…]][--continue-on-failure][--driver-log-levels=[PACKAGE=LEVEL,…]][--driver-required-memory-mb=DRIVER_REQUIRED_MEMORY_MB][--driver-required-vcores=DRIVER_REQUIRED_VCORES][--labels=[KEY=VALUE,…]][--max-failures-per-hour=MAX_FAILURES_PER_HOUR][--max-failures-total=MAX_FAILURES_TOTAL][--properties=[PARAM=VALUE,…]][--properties-file=PROPERTIES_FILE][--query-output-format=QUERY_OUTPUT_FORMAT][--region=REGION][GCLOUD_WIDE_FLAG …]

gclouddataprocjobssubmittrino--cluster=my-cluster--file=my_script.R

To submit a Trino job with inline queries, run:

gclouddataprocjobssubmittrino--cluster=my-cluster-e="SELECT * FROM foo WHERE bar > 2"

Exactly one of these must be specified:

--cluster=CLUSTER

The Dataproc cluster to submit the job to.

--cluster-labels=[KEY=VALUE,…]

List of label KEY=VALUE pairs to add.

Keys must start with a lowercase character and contain only hyphens(-), underscores (_), lowercase characters, andnumbers. Values must contain only hyphens (-), underscores(_), lowercase characters, and numbers.

Labels of Dataproc cluster on which to place the job.

Exactly one of these must be specified:

--execute=QUERY,-eQUERY

A Trino query to execute.

--file=FILE,-fFILE

HCFS URI of file containing the Trino script to execute.

--async

Return immediately, without waiting for the operation in progress to complete.

--bucket=BUCKET

The Cloud Storage bucket to stage files in. Defaults to the cluster's configuredbucket.

--client-tags=[CLIENT_TAG,…]

A list of Trino client tags to attach to this query.

--continue-on-failure

Whether to continue if a query fails.

--driver-log-levels=[PACKAGE=LEVEL,…]

A list of package-to-log4j log level pairs to configure driver logging. Forexample: root=FATAL,com.example=INFO

--driver-required-memory-mb=DRIVER_REQUIRED_MEMORY_MB

The memory allocation requested by the job driver in megabytes (MB) forexecution on the driver node group (it is used only by clusters with a drivernode group).

--driver-required-vcores=DRIVER_REQUIRED_VCORES

The vCPU allocation requested by the job driver for execution on the driver nodegroup (it is used only by clusters with a driver node group).

--labels=[KEY=VALUE,…]

List of label KEY=VALUE pairs to add.

Keys must start with a lowercase character and contain only hyphens(-), underscores (_), lowercase characters, andnumbers. Values must contain only hyphens (-), underscores(_), lowercase characters, and numbers.

--max-failures-per-hour=MAX_FAILURES_PER_HOUR

Specifies the maximum number of times a job can be restarted per hour in eventof failure. Default is 0 (no retries after job failure).

--max-failures-total=MAX_FAILURES_TOTAL

Specifies the maximum total number of times a job can be restarted after the jobfails. Default is 0 (no retries after job failure).

--properties=[PARAM=VALUE,…]

A list of key value pairs to set Trino session properties.

--properties-file=PROPERTIES_FILE

Path to a local file or a file in a Cloud Storage bucket containingconfiguration properties for the job. The client machine running this commandmust have read permission to the file.

Specify properties in the form of property=value in the text file. For example:

# Properties to set for the job:key1=value1key2=value2# Comment out properties not used.# key3=value3

If a property is set in both--properties and--properties-file, the value defined in--propertiestakes precedence.

--query-output-format=QUERY_OUTPUT_FORMAT

The query output display format. See the Trino documentation for supportedoutput formats.

--region=REGION

Dataproc region to use. Each Dataproc region constitutes an independent resourcenamespace constrained to deploying instances into Compute Engine zones insidethe region. Overrides the defaultdataproc/region property valuefor this command invocation.

Run$gcloud help for details.