Gen AI evaluation service on Vertex AI Gemini Enterprise Agent Platform Evals
Legacy names Gen AI evaluation service on Vertex AI, Gen AI Evaluation Service, Vertex AI Rapid Evaluation, Vertex AI Model Evaluation
Rubric-based and computation-based evaluation service for assessing generative AI models, agents, and predictive ML models.
Naming timeline
- Vertex AI Model Evaluation & Gen AI Evaluation Service
Gen AI Evaluation Service launched in Preview at Next '24 (alongside Rapid Evaluation) and reached General Availability on August 30, 2024, complementing predictive Vertex AI Model Evaluation.
- Gemini Enterprise Agent Platform Evals (Gen AI evals)Current name
Rebranded under Gemini Enterprise Agent Platform (Agent Platform) as 'Gemini Enterprise Agent Platform Evals' / 'Gen AI evals' ('Agent Platform Gen AI evaluation service') and 'Agent Platform Model Evaluation'.
What is Gen AI evaluation service on Vertex AI called now?
Gen AI evaluation service on Vertex AI is now called Gemini Enterprise Agent Platform Evals, with the latest change in October 2025 (Gemini Enterprise Launch (Release Notes Table Apr 22, 2026)). Earlier names covered by this entry also include Gen AI Evaluation Service, Vertex AI Rapid Evaluation, Vertex AI Model Evaluation. Rubric-based and computation-based evaluation service for assessing generative AI models, agents, and predictive ML models. Only the customer-facing name changed; the underlying technical identifiers remain backward compatible.
Also known as
- Gen AI evals
- Agent Platform Gen AI evaluation service
- Gen AI evaluation service
- Agent Platform Model Evaluation
- Model Evaluation on Gemini Enterprise Agent Platform
- Agent evaluation
Technical identifiers
Technical identifiers unchanged. Only the customer-facing product name changed; the APIs, CLI commands, IAM roles and Terraform resources below keep their legacy identifiers for backward compatibility.
| REST / gRPC APIs | aiplatform.googleapis.com |
|---|---|
| gcloud / CLI Commands | gcloud ai |
| IAM Predefined Roles | roles/aiplatform.* |
Uses the evaluation methods on aiplatform.googleapis.com and the GenAI Client in the Agent Platform SDK for Python.
Notes & disambiguation
- In the vertex-ai-name-changes table, 'Gen AI evaluation service on Vertex AI' maps to 'Gemini Enterprise Agent Platform Evals' (and 'Vertex AI Model Evaluation' maps to 'Model Evaluation on Gemini Enterprise Agent Platform'), while the April 22, 2026 release notes table uses 'Gen AI evals' and 'Agent Platform Model Evaluation'.
- Documentation headers and certification exams also use the phrasing 'Agent Platform Gen AI evaluation service' or 'Gen AI evaluation service overview | Gemini Enterprise Agent Platform'.
- Covers adaptive/static rubric evaluations for generative models, trajectory/response evaluations for agents, and classification/regression metrics for predictive models in Model Registry.
Sources & official documentation
- Official documentation ↗
- Product page ↗
- Gen AI Evaluation Service Overview — Gemini Enterprise Agent Platform Documentation
- Gemini Enterprise Agent Platform Name Changes (Gemini Enterprise Agent Platform Evals & Model Evaluation)
- Gemini Enterprise Agent Platform Release Notes (April 22, 2026 Naming Changes Table)
- Vertex AI Release Notes (August 30, 2024 Gen AI Evaluation Service GA)
Catalog last updated . Spotted an error? Suggest an edit