Team,

Looks like the Google Cloud Vertex AI API used might be outdated.

Below is the current api in code
https://{region}-aiplatform.googleapis.com/v1/projects/{project_id}/locations/{region}/endpoints/{endpoint_id}:predict

Below is the latest API that works [have tested by updating code on my end]
https://{region}-aiplatform.googleapis.com/v1/projects/{project_id}/locations/{region}/publishers/google/models/{model}:predict

File: src/llmperf/ray_clients/vertexai_client.py

Thanks