Job identifier.

ID of the project which owns the job (defaults to the client's project).

Location where the job was run. Ignored ifjob_id is a job object.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Table or tables to be copied.

Table into which data is to be copied.

The ID of the job.

The user-provided prefix for a randomly generated job ID. This parameter will be ignored if ajob_id is also given.

Location where to run the job. Must match the location of any source table as well as the destination table.

Project ID of the project of where to run the job. Defaults to the client's project.

Extra configuration options for the job.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

ADataset to create. Ifdataset is a reference, an empty dataset is created with the specified ID and client's default location.

Defaults toFalse. IfTrue, ignore "already exists" errors when creating the dataset.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

configuration job representation returned from the API.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

ARoutine to create. The dataset that the routine belongs to must already exist.

Defaults toFalse. IfTrue, ignore "already exists" errors when creating the routine.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

ATable to create. Iftable is a reference, an empty table is created with the specified ID. The dataset that the table belongs to must already exist.

Defaults toFalse. IfTrue, ignore "already exists" errors when creating the table.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

ID of the dataset.

Project ID for the dataset (defaults to the project of the client).

A reference to the dataset to delete. If a string is passed in, this method attempts to create a dataset reference from a string usingfrom_string.

If True, delete all the tables in the dataset. If False and the dataset contains tables, the request will fail. Default is False.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Defaults toFalse. IfTrue, ignore "not found" errors when deleting the dataset.

Job or job identifier.

ID of the project which owns the job (defaults to the client's project).

Location where the job was run. Ignored ifjob_id is a job object.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Defaults toFalse. IfTrue, ignore "not found" errors when deleting the job.

A reference to the model to delete. If a string is passed in, this method attempts to create a model reference from a string usingfrom_string.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Defaults toFalse. IfTrue, ignore "not found" errors when deleting the model.

A reference to the routine to delete. If a string is passed in, this method attempts to create a routine reference from a string usingfrom_string.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Defaults toFalse. IfTrue, ignore "not found" errors when deleting the routine.

A reference to the table to delete. If a string is passed in, this method attempts to create a table reference from a string usingfrom_string.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Defaults toFalse. IfTrue, ignore "not found" errors when deleting the table.

Table or Model to be extracted.

URIs of Cloud Storage file(s) into which table data is to be extracted; in formatgs://<bucket_name>/<object_name_or_glob>.

The ID of the job.

The user-provided prefix for a randomly generated job ID. This parameter will be ignored if ajob_id is also given.

Location where to run the job. Must match the location of the source table.

Project ID of the project of where to run the job. Defaults to the client's project.

Extra configuration options for the job.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Type of source to be extracted.Table orModel. Defaults toTable.

A reference to the dataset to fetch from the BigQuery API. If a string is passed in, this method attempts to create a dataset reference from a string usingfrom_string.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Specifies the view that determines which dataset information is returned. By default, dataset metadata (e.g. friendlyName, description, labels, etc) and ACL information are returned. This argument can take on the following possible enum values. *ACL: Includes dataset metadata and the ACL. *FULL: Includes all dataset metadata, including the ACL and table metadata. This view is not supported by thedatasets.list API method. *METADATA: Includes basic dataset metadata, but not the ACL. *DATASET_VIEW_UNSPECIFIED: The server will decide which view to use. Currently defaults to FULL.

The table to get the access control policy for. If a string is passed in, this method attempts to create a table reference from a string usingfrom_string.

Optional. The maximum policy version that will be used to format the policy. Only version1 is currently supported. See:https://cloud.google.com/bigquery/docs/reference/rest/v2/GetPolicyOptions

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Job identifier.

ID of the project which owns the job (defaults to the client's project).

Location where the job was run. Ignored ifjob_id is a job object.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

A reference to the model to fetch from the BigQuery API. If a string is passed in, this method attempts to create a model reference from a string usingfrom_string.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

A reference to the routine to fetch from the BigQuery API. If a string is passed in, this method attempts to create a reference from a string usingfrom_string.

How to retry the API call.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Project ID to use for retreiving service account email. Defaults to the client's project.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

A reference to the table to fetch from the BigQuery API. If a string is passed in, this method attempts to create a table reference from a string usingfrom_string.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Keyword arguments toinsert_rows_json.

The destination table for the row data, or a reference to it.

Row data to be inserted. If a list of tuples is given, each tuple should contain data for each schema field on the current table and in the same order as the schema fields. If a list of dictionaries is given, the keys must include all required fields in the schema. Keys which do not correspond to a field in the schema are ignored.

The fields to return. Required iftable is aTableReference.

Keyword arguments toinsert_rows_json.

The destination table for the row data, or a reference to it.

Apandas.DataFrame containing the data to load. AnyNaN values present in the dataframe are omitted from the streaming API request(s).

The fields to return. Required iftable is aTableReference.

The number of rows to stream in a single chunk. Must be positive.

The destination table for the row data, or a reference to it.

Row data to be inserted. Keys must match the table schema fields and values must be JSON-compatible representations.

Unique IDs, one per row being inserted. An ID can also beNone, indicating that an explicit insert ID shouldnot be used for that row. If the argument is omitted altogether, unique IDs are created automatically. .. versionchanged:: 2.21.0 Can also be an iterable, not just a sequence, or anAutoRowIDs enum member. .. deprecated:: 2.21.0 PassingNone to explicitly request autogenerating insert IDs is deprecated, useAutoRowIDs.GENERATE_UUID instead.

Insert all valid rows of a request, even if invalid rows exist. The default value isFalse, which causes the entire request to fail if any invalid rows exist.

Accept rows that contain values that do not match the schema. The unknown values are ignored. Default isFalse, which treats unknown values as errors.

Treatname as a template table and provide a suffix. BigQuery will create the table based on the schema of the template table. Seehttps://cloud.google.com/bigquery/streaming-data-into-bigquery#template-tables

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

one job resource from API response

Project ID to use for retreiving datasets. Defaults to the client's project.

True if results include hidden datasets. Defaults to False.

An expression for filtering the results by label. For syntax, seehttps://cloud.google.com/bigquery/docs/reference/rest/v2/datasets/list#body.QUERY_PARAMETERS.filter

Maximum number of datasets to return.

Token representing a cursor into the datasets. If not passed, the API will return the first page of datasets. The token marks the beginning of the iterator to be returned and the value of thepage_token can be accessed atnext_page_token of thegoogle.api_core.page_iterator.HTTPIterator.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Maximum number of datasets to return per page.

Project ID to use for retreiving datasets. Defaults to the client's project.

If set, retrieve only child jobs of the specified parent.

Maximum number of jobs to return.

Opaque marker for the next "page" of jobs. If not passed, the API will return the first page of jobs. The token marks the beginning of the iterator to be returned and the value of thepage_token can be accessed atnext_page_token ofgoogle.api_core.page_iterator.HTTPIterator.

If true, include jobs owned by all users in the project. Defaults to :data:False.

If set, include only jobs matching the given state. One of: *"done" *"pending" *"running"

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Min value for job creation time. If set, only jobs created after or at this timestamp are returned. If the datetime has no time zone assumes UTC time.

Max value for job creation time. If set, only jobs created before or at this timestamp are returned. If the datetime has no time zone assumes UTC time.

Maximum number of jobs to return per page.

A reference to the dataset whose models to list from the BigQuery API. If a string is passed in, this method attempts to create a dataset reference from a string usingfrom_string.

Maximum number of models to return. Defaults to a value set by the API.

Token representing a cursor into the models. If not passed, the API will return the first page of models. The token marks the beginning of the iterator to be returned and the value of thepage_token can be accessed atnext_page_token of thegoogle.api_core.page_iterator.HTTPIterator.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Maximum number of models to return per page. Defaults to a value set by the API.

The table or reference from which to get partition info

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry. If multiple requests are made under the hood,timeout applies to each individual request.

Maximum number of projects to return. Defaults to a value set by the API.

Token representing a cursor into the projects. If not passed, the API will return the first page of projects. The token marks the beginning of the iterator to be returned and the value of thepage_token can be accessed atnext_page_token of thegoogle.api_core.page_iterator.HTTPIterator.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Maximum number of projects to return in each page. Defaults to a value set by the API.

A reference to the dataset whose routines to list from the BigQuery API. If a string is passed in, this method attempts to create a dataset reference from a string usingfrom_string.

Maximum number of routines to return. Defaults to a value set by the API.

Token representing a cursor into the routines. If not passed, the API will return the first page of routines. The token marks the beginning of the iterator to be returned and the value of thepage_token can be accessed atnext_page_token of thegoogle.api_core.page_iterator.HTTPIterator.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Maximum number of routines to return per page. Defaults to a value set by the API.

The table to list, or a reference to it. When the table object does not contain a schema andselected_fields is not supplied, this method callsget_table to fetch the table schema.

The fields to return. If not supplied, data for all columns are downloaded.

Maximum number of rows to return.

Token representing a cursor into the table's rows. If not passed, the API will return the first page of the rows. The token marks the beginning of the iterator to be returned and the value of thepage_token can be accessed atnext_page_token of theRowIterator.

The zero-based index of the starting row to read.

The maximum number of rows in each page of results from this request. Non-positive values are ignored. Defaults to a sensible value set by the API.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry. If multiple requests are made under the hood,timeout applies to each individual request.

A reference to the dataset whose tables to list from the BigQuery API. If a string is passed in, this method attempts to create a dataset reference from a string usingfrom_string.

Maximum number of tables to return. Defaults to a value set by the API.

Token representing a cursor into the tables. If not passed, the API will return the first page of tables. The token marks the beginning of the iterator to be returned and the value of thepage_token can be accessed atnext_page_token of thegoogle.api_core.page_iterator.HTTPIterator.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

Maximum number of tables to return per page. Defaults to a value set by the API.

Apandas.DataFrame containing the data to load.

The destination table to use for loading the data. If it is an existing table, the schema of thepandas.DataFrame must match the schema of the destination table. If the table does not yet exist, the schema is inferred from thepandas.DataFrame. If a string is passed in, this method attempts to create a table reference from a string usingfrom_string.

Number of upload retries. Defaults to 6.

Name of the job.

The user-provided prefix for a randomly generated job ID. This parameter will be ignored if ajob_id is also given.

Location where to run the job. Must match the location of the destination table.

Project ID of the project of where to run the job. Defaults to the client's project.

Extra configuration options for the job. To override the default pandas data type conversions, supply a value forschema with column names matching those of the dataframe. The BigQuery schema is used to determine the correct data type conversion. Indexes are not loaded. By default, this method uses the parquet source format. To override this, supply a value forsource_format with the format name. Currently onlyCSV andPARQUET are supported.

[Beta] The compression method to use if intermittently serializingdataframe to a parquet file. Defaults to "snappy". The argument is directly passed as thecompression argument to the underlyingpyarrow.parquet.write_table() method (the default value "snappy" gets converted to uppercase).https://arrow.apache.org/docs/python/generated/pyarrow.parquet.write_table.html#pyarrow-parquet-write-table If the job config schema is missing, the argument is directly passed as thecompression argument to the underlyingDataFrame.to_parquet() method.https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_parquet.html#pandas.DataFrame.to_parquet

The number of seconds to wait for the underlying HTTP transport before usingretry. Depending on the retry strategy, a request may be repeated several times using the same timeout each time. Defaults to None. Can also be passed as a tuple (connect_timeout, read_timeout). Seerequests.Session.request documentation for details.

A file handle opened in binary mode for reading.

Table into which data is to be loaded. If a string is passed in, this method attempts to create a table reference from a string usingfrom_string.

If True, seek to the beginning of the file handle before reading the file. Defaults to False.

The number of bytes to read from the file handle. If size isNone or large, resumable upload will be used. Otherwise, multipart upload will be used.

Number of upload retries. Defaults to 6.

Name of the job.

The user-provided prefix for a randomly generated job ID. This parameter will be ignored if ajob_id is also given.

Location where to run the job. Must match the location of the destination table.

Project ID of the project of where to run the job. Defaults to the client's project.

Extra configuration options for the job.

The number of seconds to wait for the underlying HTTP transport before usingretry. Depending on the retry strategy, a request may be repeated several times using the same timeout each time. Defaults to None. Can also be passed as a tuple (connect_timeout, read_timeout). Seerequests.Session.request documentation for details.

Row data to be inserted. Keys must match the table schema fields and values must be JSON-compatible representations. .. note:: If your data is already a newline-delimited JSON string, it is best to wrap it into a file-like object and pass it toload_table_from_file:: import io from google.cloud import bigquery data = u'{"foo": "bar"}' data_as_file = io.StringIO(data) client = bigquery.Client() client.load_table_from_file(data_as_file, ...)

Table into which data is to be loaded. If a string is passed in, this method attempts to create a table reference from a string usingfrom_string.

Number of upload retries. Defaults to 6.

Name of the job.

The user-provided prefix for a randomly generated job ID. This parameter will be ignored if ajob_id is also given.

Location where to run the job. Must match the location of the destination table.

Project ID of the project of where to run the job. Defaults to the client's project.

Extra configuration options for the job. Thesource_format setting is always set toNEWLINE_DELIMITED_JSON.

The number of seconds to wait for the underlying HTTP transport before usingretry. Depending on the retry strategy, a request may be repeated several times using the same timeout each time. Defaults to None. Can also be passed as a tuple (connect_timeout, read_timeout). Seerequests.Session.request documentation for details.

URIs of data files to be loaded; in formatgs://<bucket_name>/<object_name_or_glob>.

Table into which data is to be loaded. If a string is passed in, this method attempts to create a table reference from a string usingfrom_string.

Name of the job.

The user-provided prefix for a randomly generated job ID. This parameter will be ignored if ajob_id is also given.

Location where to run the job. Must match the location of the destination table.

Project ID of the project of where to run the job. Defaults to the client's project.

Extra configuration options for the job.

How to retry the RPC.

The number of seconds to wait for the underlying HTTP transport before usingretry.

SQL query to be executed. Defaults to the standard SQL dialect. Use thejob_config parameter to change dialects.

Extra configuration options for the job. To override any options that were previously set in thedefault_query_job_config given to theClient constructor, manually set those options toNone, or whatever value is preferred.

ID to use for the query job.

The prefix to use for a randomly generated job ID. This parameter will be ignored if ajob_id is also given.

Location where to run the job. Must match the location of the table used in the query as well as the destination table.

Project ID of the project of where to run the job. Defaults to the client's project.

How to retry the RPC. This only applies to making RPC calls. It isn't used to retry failed jobs. This has a reasonable default that should only be overridden with care.

The number of seconds to wait for the underlying HTTP transport before usingretry.

How to retry failed jobs. The default retries rate-limit-exceeded errors. PassingNone disables job retry. Not all jobs can be retried. Ifjob_id is provided, then the job returned by the query will not be retryable, and an exception will be raised if a non-None (and non-default) value forjob_retry is also provided. Note that errors aren't detected untilresult() is called on the job returned. Thejob_retry specified here becomes the defaultjob_retry forresult(), where it can also be specified.

Method with which to start the query job. By default, the jobs.insert API is used for starting a query. SeeQueryApiMethod for details on the difference between the query start methods.

SQL query to be executed. Defaults to the standard SQL dialect. Use thejob_config parameter to change dialects.

Extra configuration options for the job. To override any options that were previously set in thedefault_query_job_config given to theClient constructor, manually set those options toNone, or whatever value is preferred.

Location where to run the job. Must match the location of the table used in the query as well as the destination table.

Project ID of the project of where to run the job. Defaults to the client's project.

The number of seconds to wait for the underlying HTTP transport before usingretry.

The number of seconds to wait for the query to finish. If the query doesn't finish before this timeout, the client attempts to cancel the query. If unset, the underlying REST API calls have timeouts, but we still wait indefinitely for the job to finish.

How to retry the RPC. This only applies to making RPC calls. It isn't used to retry failed jobs. This has a reasonable default that should only be overridden with care.

How to retry failed jobs. The default retries rate-limit-exceeded errors. PassingNone disables job retry. Not all jobs can be retried.

The maximum number of rows in each page of results from the initial jobs.query request. Non-positive values are ignored.

The maximum total number of rows from this request.