Streaming responses from Vertex AI endpoints

321 views Asked by At

Is it possible to STREAM a response from a Vertex AI endpoint?

e.g. i want to do something like this in python

from google.cloud import aiplatform

endpoint = aiplatform.Endpoint(endpoint_name)

predictions_stream = endpoint.predict(instances=[myinputs])

for batch in predictions_stream: 
   print("streamed batch", batch)

0

There are 0 answers