The API interface for managing autoscaling policies in theDataproc API.

The API interface for managing autoscaling policies in theDataproc API.

A pager for iterating throughlist_autoscaling_policies requests.

This class thinly wraps an initialListAutoscalingPoliciesResponse object, andprovides an__aiter__ method to iterate through itspolicies field.

If there are more pages, the__aiter__ method will make additionalListAutoscalingPolicies requests and continue to iteratethrough thepolicies field on thecorresponding responses.

All the usualListAutoscalingPoliciesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

A pager for iterating throughlist_autoscaling_policies requests.

This class thinly wraps an initialListAutoscalingPoliciesResponse object, andprovides an__iter__ method to iterate through itspolicies field.

If there are more pages, the__iter__ method will make additionalListAutoscalingPolicies requests and continue to iteratethrough thepolicies field on thecorresponding responses.

All the usualListAutoscalingPoliciesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

The BatchController provides methods to manage batchworkloads.

The BatchController provides methods to manage batchworkloads.

A pager for iterating throughlist_batches requests.

This class thinly wraps an initialListBatchesResponse object, andprovides an__aiter__ method to iterate through itsbatches field.

If there are more pages, the__aiter__ method will make additionalListBatches requests and continue to iteratethrough thebatches field on thecorresponding responses.

All the usualListBatchesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

A pager for iterating throughlist_batches requests.

This class thinly wraps an initialListBatchesResponse object, andprovides an__iter__ method to iterate through itsbatches field.

If there are more pages, the__iter__ method will make additionalListBatches requests and continue to iteratethrough thebatches field on thecorresponding responses.

All the usualListBatchesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

The ClusterControllerService provides methods to manageclusters of Compute Engine instances.

The ClusterControllerService provides methods to manageclusters of Compute Engine instances.

A pager for iterating throughlist_clusters requests.

This class thinly wraps an initialListClustersResponse object, andprovides an__aiter__ method to iterate through itsclusters field.

If there are more pages, the__aiter__ method will make additionalListClusters requests and continue to iteratethrough theclusters field on thecorresponding responses.

All the usualListClustersResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

A pager for iterating throughlist_clusters requests.

This class thinly wraps an initialListClustersResponse object, andprovides an__iter__ method to iterate through itsclusters field.

If there are more pages, the__iter__ method will make additionalListClusters requests and continue to iteratethrough theclusters field on thecorresponding responses.

All the usualListClustersResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

The JobController provides methods to manage jobs.

The JobController provides methods to manage jobs.

A pager for iterating throughlist_jobs requests.

This class thinly wraps an initialListJobsResponse object, andprovides an__aiter__ method to iterate through itsjobs field.

If there are more pages, the__aiter__ method will make additionalListJobs requests and continue to iteratethrough thejobs field on thecorresponding responses.

All the usualListJobsResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

A pager for iterating throughlist_jobs requests.

This class thinly wraps an initialListJobsResponse object, andprovides an__iter__ method to iterate through itsjobs field.

If there are more pages, the__iter__ method will make additionalListJobs requests and continue to iteratethrough thejobs field on thecorresponding responses.

All the usualListJobsResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

TheNodeGroupControllerService provides methods to manage nodegroups of Compute Engine managed instances.

TheNodeGroupControllerService provides methods to manage nodegroups of Compute Engine managed instances.

TheSessionController provides methods to manage interactivesessions.

TheSessionController provides methods to manage interactivesessions.

A pager for iterating throughlist_sessions requests.

This class thinly wraps an initialListSessionsResponse object, andprovides an__aiter__ method to iterate through itssessions field.

If there are more pages, the__aiter__ method will make additionalListSessions requests and continue to iteratethrough thesessions field on thecorresponding responses.

All the usualListSessionsResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

A pager for iterating throughlist_sessions requests.

This class thinly wraps an initialListSessionsResponse object, andprovides an__iter__ method to iterate through itssessions field.

If there are more pages, the__iter__ method will make additionalListSessions requests and continue to iteratethrough thesessions field on thecorresponding responses.

All the usualListSessionsResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

The SessionTemplateController provides methods to managesession templates.

The SessionTemplateController provides methods to managesession templates.

A pager for iterating throughlist_session_templates requests.

This class thinly wraps an initialListSessionTemplatesResponse object, andprovides an__aiter__ method to iterate through itssession_templates field.

If there are more pages, the__aiter__ method will make additionalListSessionTemplates requests and continue to iteratethrough thesession_templates field on thecorresponding responses.

All the usualListSessionTemplatesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

A pager for iterating throughlist_session_templates requests.

This class thinly wraps an initialListSessionTemplatesResponse object, andprovides an__iter__ method to iterate through itssession_templates field.

If there are more pages, the__iter__ method will make additionalListSessionTemplates requests and continue to iteratethrough thesession_templates field on thecorresponding responses.

All the usualListSessionTemplatesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

The API interface for managing Workflow Templates in theDataproc API.

The API interface for managing Workflow Templates in theDataproc API.

A pager for iterating throughlist_workflow_templates requests.

This class thinly wraps an initialListWorkflowTemplatesResponse object, andprovides an__aiter__ method to iterate through itstemplates field.

If there are more pages, the__aiter__ method will make additionalListWorkflowTemplates requests and continue to iteratethrough thetemplates field on thecorresponding responses.

All the usualListWorkflowTemplatesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

A pager for iterating throughlist_workflow_templates requests.

This class thinly wraps an initialListWorkflowTemplatesResponse object, andprovides an__iter__ method to iterate through itstemplates field.

If there are more pages, the__iter__ method will make additionalListWorkflowTemplates requests and continue to iteratethrough thetemplates field on thecorresponding responses.

All the usualListWorkflowTemplatesResponseattributes are available on the pager. If multiple requests are made, onlythe most recent response is retained, and thus used for attribute lookup.

Specifies the type and number of accelerator cards attached to theinstances of an instance. SeeGPUs on ComputeEngine <https://cloud.google.com/compute/docs/gpus/>__.

Authentication configuration for a workload is used to setthe default identity for the workload execution.The config specifies the type of identity (service account oruser) that will be used by workloads to access resources on theproject(s).

Authentication types for workload execution.

Autoscaling Policy config associated with the cluster.

Describes an autoscaling policy for Dataproc clusterautoscaler.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Autotuning configuration of the workload.

Scenario represents a specific goal that autotuning willattempt to achieve by modifying workloads.

Node group identification and configuration information.

Auxiliary services configuration for a Cluster.

Basic algorithm for autoscaling.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Basic autoscaling configurations for YARN.

A representation of a batch workload in the service.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The batch state.

Historical state information.

Metadata describing the Batch operation.

Operation type for Batch resources

The abstract base class for a message.

A request to cancel a job.

Describes the identifying information, config, and status ofa Dataproc cluster

The abstract base class for a message.

The cluster config.

The cluster tier.

Contains cluster daemon metrics, such as HDFS and YARN stats.

Beta Feature: This report is available for testing purposesonly. It may be changed before final release.

The abstract base class for a message.

The abstract base class for a message.

The cluster operation triggered by a workflow.

Metadata describing the operation.

The abstract base class for a message.

The status of the operation.

The operation state.

A selector that chooses target cluster for jobs based onmetadata.

The abstract base class for a message.

The status of a cluster and its instances.

The cluster state.

    **Note:** The cluster state changes from "creating" to    "running" status after the master node(s), first two primary    worker nodes (and the last primary worker node if primary    workers > 2) are running.ERROR (3):    The cluster encountered an error. It is not    ready for use.ERROR_DUE_TO_UPDATE (9):    The cluster has encountered an error while    being updated. Jobs can be submitted to the    cluster, but the cluster cannot be updated.DELETING (4):    The cluster is being deleted. It cannot be    used.UPDATING (5):    The cluster is being updated. It continues to    accept and process jobs.STOPPING (6):    The cluster is being stopped. It cannot be    used.STOPPED (7):    The cluster is currently stopped. It is not    ready for use.STARTING (8):    The cluster is being started. It is not ready    for use.REPAIRING (10):    The cluster is being repaired. It is not    ready for use.

The cluster substate.

    Applies to RUNNING state.STALE_STATUS (2):    The agent-reported status is out of date (may    occur if Dataproc loses communication with    Agent).    Applies to RUNNING state.

Cluster components that can be activated.

Confidential Instance Config for clusters usingConfidentialVMs <https://cloud.google.com/compute/confidential-vm/docs>__

A request to create an autoscaling policy.

A request to create a batch workload.

A request to create a cluster.

A request to create a node group.

A request to create a session.

A request to create a session template.

A request to create a workflow template.

Dataproc metric config.

A Dataproc custom metric.

A source for the collection of Dataproc custom metrics (seeCustommetrics).

A request to delete an autoscaling policy.

Autoscaling policies in use by one or more clusters will not bedeleted.

A request to delete a batch workload.

A request to delete a cluster.

A request to delete a job.

A request to delete a session.

A request to delete a session template.

A request to delete a workflow template.

Currently started workflows will remain running.

A request to collect cluster diagnostic information.

Defines who has access to the diagnostic tarball

The location of diagnostic output.

Specifies the config of disk options for a group of VMinstances.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Driver scheduling configuration.

Encryption settings for the cluster.

Endpoint config for this cluster

The abstract base class for a message.

Environment configuration for a workload.

Execution configuration for a workload.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Actions in response to failure of a resource associated witha cluster.

A Dataproc job for running Apache Flink applications on YARN.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Common config settings for resources of Compute Enginecluster instances, applicable to all instances in the cluster.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

PrivateIpv6GoogleAccess controls whether and how Dataproccluster nodes can communicate with Google Services through gRPC overIPv6. These values are directly mapped to corresponding values intheCompute Engine Instancefields <https://cloud.google.com/compute/docs/reference/rest/v1/instances>__.

A request to fetch an autoscaling policy.

A request to get the resource representation for a batchworkload.

Request to get the resource representation for a cluster in aproject.

A request to get the resource representation for a job in aproject.

A request to get a node group .

A request to get the resource representation for a session.

A request to get the resource representation for a sessiontemplate.

A request to fetch a workflow template.

The cluster's GKE config.

The configuration of a GKE node pool used by aDataproc-on-GKEcluster <https://cloud.google.com/dataproc/docs/concepts/jobs/dataproc-gke#create-a-dataproc-on-gke-cluster>__.

Parameters that describe cluster nodes.

A GkeNodeConfigAcceleratorConfig represents a HardwareAccelerator request for a node pool.

GkeNodePoolAutoscaling contains information the clusterautoscaler needs to adjust the size of the node pool to thecurrent cluster usage.

GKE node pools that Dataproc workloads run on.

Role specifies the tasks that will run on the node pool. Rolescan be specific to workloads. Exactly oneGkeNodePoolTargetwithin the virtual cluster must have theDEFAULT role, which isused to run all workloads that are not associated with a node pool.

A Dataproc job for runningApache HadoopMapReduce <https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html>jobs onApache HadoopYARN <https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/YARN.html>.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

A Dataproc job for runningApacheHive <https://hive.apache.org/>__ queries on YARN.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The abstract base class for a message.

Identity related configuration, including service accountbased secure multi-tenancy user mappings.

The abstract base class for a message.

Instance flexibility Policy allowing a mixture of VM shapesand provisioning models.

Defines machines types and a rank to which the machines typesbelong.

Defines a mapping from machine types to the number of VMsthat are created with each machine type.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Defines how Dataproc should create VMs with a mixture ofprovisioning models.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Configuration for the size bounds of an instance group,including its proportional size to other groups.

The config settings for Compute Engine resources inan instance group, such as a master or worker group.

Controls the use of preemptible instances within the group.

    This option is allowed for all instance groups    and is the only valid value for Master and    Worker instance groups.PREEMPTIBLE (2):    Instances are [preemptible]    (https://cloud.google.com/compute/docs/instances/preemptible).    This option is allowed only for [secondary worker]    (https://cloud.google.com/dataproc/docs/concepts/compute/secondary-vms)    groups.SPOT (3):    Instances are [Spot VMs]    (https://cloud.google.com/compute/docs/instances/spot).    This option is allowed only for [secondary worker]    (https://cloud.google.com/dataproc/docs/concepts/compute/secondary-vms)    groups. Spot VMs are the latest version of [preemptible VMs]    (https://cloud.google.com/compute/docs/instances/preemptible),    and provide additional features.

A reference to a Compute Engine instance.

A request to instantiate an inline workflow template.

A request to instantiate a workflow template.

The abstract base class for a message.

A Dataproc job resource.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Job Operation metadata.

Dataproc job config.

The abstract base class for a message.

Encapsulates the full scoping used to reference a job.

Job scheduling options.

Dataproc job status.

The job state.

    Applies to restartable jobs only.

The job substate.

    Applies to RUNNING state.QUEUED (2):    The Job has been received and is awaiting    execution (it might be waiting for a condition    to be met). See the "details" field for the    reason for the delay.    Applies to RUNNING state.STALE_STATUS (3):    The agent-reported status is out of date,    which can be caused by a loss of communication    between the agent and Dataproc. If the agent    does not send a timely update, the job will    fail.    Applies to RUNNING state.

Jupyter configuration for an interactive session.

Jupyter kernel types.

Specifies Kerberos related configuration.

The configuration for running the Dataproc cluster onKubernetes.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The software configuration for this Dataproc cluster runningon Kubernetes.

The abstract base class for a message.

The abstract base class for a message.

Specifies the cluster auto-delete schedule configuration.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

A request to list autoscaling policies in a project.

A response to a request to list autoscaling policies in aproject.

A request to list batch workloads in a project.

A list of batch workloads.

A request to list the clusters in a project.

The list of all clusters in a project.

A request to list jobs in a project.

A matcher that specifies categories of job states.

A list of jobs in a project.

A request to list session templates in a project.

A list of session templates.

A request to list sessions in a project.

A list of interactive sessions.

A request to list workflow templates in a project.

A response to a request to list workflow templates in aproject.

The runtime logging config of the job.

The abstract base class for a message.

The Log4j level for job execution. When running anApacheHive <https://hive.apache.org/>__ job, Cloud Dataproc configuresthe Hive client to an equivalent verbosity level.

Cluster that is managed by the workflow.

The abstract base class for a message.

Specifies the resources used to actively manage an instancegroup.

Specifies a Metastore configuration.

Dataproc Node Group.The DataprocNodeGroup resource is notrelated to the DataprocNodeGroupAffinityresource.

The abstract base class for a message.

Node pool roles.

Node Group Affinity for clusters using sole-tenant node groups.The DataprocNodeGroupAffinity resource is not related to theDataprocNodeGroup resource.

Metadata describing the node group operation.

The abstract base class for a message.

Operation type for node group resources.

Specifies an executable to run on a fully configured node anda timeout period for executable completion.

A job executed by the workflow.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Configuration for parameter validation.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Auxiliary services configuration for a workload.

A Dataproc job for runningApache Pig <https://pig.apache.org/>__queries on YARN.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The abstract base class for a message.

A Dataproc job for runningPresto <https://prestosql.io/>queries.IMPORTANT: TheDataproc Presto OptionalComponent <https://cloud.google.com/dataproc/docs/concepts/components/presto>must be enabled when the cluster is created to submit a Presto jobto the cluster.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Configuration for PyPi repository

A configuration for running anApachePySpark <https://spark.apache.org/docs/latest/api/python/getting_started/quickstart.html>__batch workload.

A Dataproc job for runningApachePySpark <https://spark.apache.org/docs/0.9.0/python-programming-guide.html>__applications on YARN.

The abstract base class for a message.

A list of queries to run on a cluster.

Validation based on regular expressions.

Configuration for dependency repositories

Reservation Affinity for consuming Zonal reservation.

Indicates whether to consume capacity from an reservation ornot.

A request to resize a node group.

Runtime configuration for a workload.

The abstract base class for a message.

Runtime information about workload execution.

The abstract base class for a message.

Security related configuration, including encryption,Kerberos, etc.

A representation of a session.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Historical state information.

The session state.

Metadata describing the Session operation.

The abstract base class for a message.

Operation type for Session resources

A representation of a session template.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Shielded Instance Config for clusters usingCompute Engine ShieldedVMs <https://cloud.google.com/security/shielded-cloud/shielded-vm>__.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Specifies the selection and config of software inside thecluster.

The abstract base class for a message.

A configuration for running anApacheSpark <https://spark.apache.org/>__ batch workload.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Spark Connect configuration for an interactive session.

Spark History Server configuration for the workload.

A Dataproc job for runningApacheSpark <https://spark.apache.org/>__ applications on YARN.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

A configuration for running anApacheSparkR <https://spark.apache.org/docs/latest/sparkr.html>__ batchworkload.

A Dataproc job for runningApacheSparkR <https://spark.apache.org/docs/latest/sparkr.html>__applications on YARN.

The abstract base class for a message.

A configuration for runningApache SparkSQL <https://spark.apache.org/sql/>__ queries as a batch workload.

The abstract base class for a message.

A Dataproc job for runningApache SparkSQL <https://spark.apache.org/sql/>__ queries.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The abstract base class for a message.

A request to start a cluster.

Configuration to handle the startup of instances duringcluster create and update process.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

A request to stop a cluster.

A request to submit a job.

A configurable parameter that replaces one or more fields inthe template. Parameterizable fields:

• Labels
• File uris
• Job properties
• Job arguments
• Script variables
• Main class (in HadoopJob and SparkJob)
• Zone (in ClusterSelector)

A request to terminate an interactive session.

A Dataproc job for runningTrino <https://trino.io/> queries.IMPORTANT: TheDataproc Trino OptionalComponent <https://cloud.google.com/dataproc/docs/concepts/components/trino>must be enabled when the cluster is created to submit a Trino job tothe cluster.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

A request to update an autoscaling policy.

A request to update a cluster.

A request to update a job.

A request to update a session template.

A request to update a workflow template.

Usage metrics represent approximate total resources consumedby a workload.

The usage snapshot represents the resources consumed by aworkload at a specified time.

Validation based on a list of allowed values.

The Dataproc cluster config for a cluster that does not directlycontrol the underlying compute resources, such as aDataproc-on-GKEcluster <https://cloud.google.com/dataproc/docs/guides/dpgke/dataproc-gke-overview>__.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The workflow graph.

A Dataproc workflow template resource.

The abstract base class for a message.

The operation state.

The workflow node.

The workflow node state.

A Dataproc workflow template resource.

Encryption settings for encrypting workflow template jobarguments.

The abstract base class for a message.

Specifies workflow execution target.

Eithermanaged_cluster orcluster_selector is required.

This message hasoneof_ fields (mutually exclusive fields).For each oneof, at most one member field can be set at the same time.Setting any member of the oneof automatically clears all othermembers.

.. _oneof:https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

A YARN application created by a job. Application information is asubset oforg.apache.hadoop.yarn.proto.YarnProtos.ApplicationReportProto.

Beta Feature: This report is available for testing purposesonly. It may be changed before final release.

The application state, corresponding toYarnProtos.YarnApplicationStateProto.

API documentation fordataproc_v1.services.autoscaling_policy_service.pagers module.

API documentation fordataproc_v1.services.batch_controller.pagers module.

API documentation fordataproc_v1.services.cluster_controller.pagers module.

API documentation fordataproc_v1.services.job_controller.pagers module.

API documentation fordataproc_v1.services.session_controller.pagers module.

API documentation fordataproc_v1.services.session_template_controller.pagers module.

API documentation fordataproc_v1.services.workflow_template_service.pagers module.