gcloud beta ai endpoints stream-raw-predict - run Vertex AI online stream raw prediction

gcloud beta ai endpoints stream-raw-predict(ENDPOINT :--region=REGION)--request=REQUEST[--http-headers=[HEADER=VALUE,…]][GCLOUD_WIDE_FLAG …]

gcloudbetaaiendpointsstream-raw-predict123--project=example--region=us-central1--request='{    "instances": [      { "values": [1, 2, 3, 4], "key": 1 },      { "values": [5, 6, 7, 8], "key": 2 }    ]  }'

If the request body was in the fileinput.json, run:

gcloudbetaaiendpointsstream-raw-predict123--project=example--region=us-central1--request=@input.json

To send the image fileimage.jpeg and setthecontent type, run:

gcloudbetaaiendpointsstream-raw-predict123--project=example--region=us-central1--http-headers=Content-Type=image/jpeg--request=@image.jpeg

Endpoint resource - The endpoint to do online stream raw prediction. Thearguments in this group can be used to specify the attributes of this resource.(NOTE) Some attributes are not given arguments in this group but can be set inother ways.

To set theproject attribute:

• provide the argumentendpoint on the command line with a fullyspecified name;
• provide the argument--project on the command line;
• set the propertycore/project.

This must be specified.

ENDPOINT

ID of the endpoint or fully qualified identifier for the endpoint.

To set thename attribute:

• provide the argumentendpoint on the command line.

This positional argument must be specified if any of the other arguments in thisgroup are specified.

--region=REGION

Cloud region for the endpoint.

To set theregion attribute:

• provide the argumentendpoint on the command line with a fullyspecified name;
• provide the argument--region on the command line;
• set the propertyai/region;
• choose one from the prompted list of available regions.

--request=REQUEST

The request to send to the endpoint.

If the request starts with the letter '@', the rest should be afile name to read the request from, or '@-' to read fromstdin. If the request body actually starts with '@',it must be placed in a file.

If required, theContent-Type header should also be setappropriately, particularly for binary data.

--http-headers=[HEADER=VALUE,…]

List of header and value pairs to send as part of the request. For example, toset theContent-Type andX-Header:

--http-headers=Content-Type="application/json",X-Header=Value

Run$gcloud help for details.