gcloud alpha container ai profiles accelerators list - list compatible accelerator profiles

gcloud alpha container ai profiles accelerators list--model=MODEL[--format=FORMAT][--max-ntpot-milliseconds=MAX_NTPOT_MILLISECONDS][--model-server=MODEL_SERVER][--model-server-version=MODEL_SERVER_VERSION][--filter=EXPRESSION][--limit=LIMIT][--page-size=PAGE_SIZE][--sort-by=[FIELD,…]][--uri][GCLOUD_WIDE_FLAG …]

To get supported model, model servers, and model server versions, rungcloud alpha container ai profiles models list,gcloud alphacontainer ai profiles model-servers list, andgcloud alphacontainer ai profiles model-server-versions list. Alternatively, rungcloud alpha container ai profiles model-and-server-combinationslist to get all supported model and server combinations.

--model=MODEL

The model.

--format=FORMAT

The format to use for the output. Default is table. yaml|table

--max-ntpot-milliseconds=MAX_NTPOT_MILLISECONDS

The maximum normalized time per output token (NTPOT) in milliseconds. NTPOT ismeasured as the request_latency / output_tokens. If this field is set, thecommand will only return accelerators that can meet the target ntpotmilliseconds and display their throughput performance at the target latency.Otherwise, the command will return all accelerators and display their highestthroughput performance.

--model-server=MODEL_SERVER

The model server. If not specified, this defaults to any model server.

--model-server-version=MODEL_SERVER_VERSION

The model server version. If not specified, this defaults to the latest version.

--filter=EXPRESSION

Apply a Boolean filterEXPRESSION to each resource itemto be listed. If the expression evaluatesTrue, then that item islisted. For more details and examples of filter expressions, run $gcloud topic filters. This flaginteracts with other flags that are applied in this order:--flatten,--sort-by,--filter,--limit.

--limit=LIMIT

Maximum number of resources to list. The default isunlimited. Thisflag interacts with other flags that are applied in this order:--flatten,--sort-by,--filter,--limit.

--page-size=PAGE_SIZE

Some services group resource list output into pages. This flag specifies themaximum number of resources per page. The default is determined by the serviceif it supports paging, otherwise it isunlimited (no paging).Paging may be applied before or after--filter and--limit depending on the service.

--sort-by=[FIELD,…]

Comma-separated list of resource field key names to sort by. The default orderis ascending. Prefix a field with ``~´´ for descending order on thatfield. This flag interacts with other flags that are applied in this order:--flatten,--sort-by,--filter,--limit.

--uri

Print a list of resource URIs instead of the default output, and change thecommand output to a list of URIs. If this flag is used with--format, the formatting is applied on this URI list. To displayURIs alongside other keys instead, use theuri() transform.

Run$gcloud help for details.