Vertex AI Experiments is supported by the Vertex AI SDK for Python andGoogle Cloud console. Vertex AI Experiments requires and depends onVertex ML Metadata.

Set up

Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project: To create a project, you need the Project Creator role (roles/resourcemanager.projectCreator), which contains theresourcemanager.projects.create permission.Learn how to grant roles.

Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

Go to project selector

Verify that billing is enabled for your Google Cloud project.

Enable the required API.

Roles required to enable APIs

To enable APIs, you need the Service Usage Admin IAM role (roles/serviceusage.serviceUsageAdmin), which contains theserviceusage.services.enable permission.Learn how to grant roles.

Enable the API

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project: To create a project, you need the Project Creator role (roles/resourcemanager.projectCreator), which contains theresourcemanager.projects.create permission.Learn how to grant roles.

Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

Go to project selector

Verify that billing is enabled for your Google Cloud project.

Enable the required API.

Roles required to enable APIs

To enable APIs, you need the Service Usage Admin IAM role (roles/serviceusage.serviceUsageAdmin), which contains theserviceusage.services.enable permission.Learn how to grant roles.

Enable the API

1. Create a Service account. SeeCreate a service account with required permissions.
2. Install theVertex AI SDK for Python.
3. Check for existence of thedefault Metadata Store in your project. (required)
   • To see if your project has thedefault Metadata Store, go to theMetadata page in the Google Cloud console.
   • If thedefault Metadata Store doesn't exist, it's created when
     • you run the firstPipelineJob,
     • or, create your first experiment in the Vertex AI SDK for Python.
       Optional: To configure with CMEK, seeConfigure your project's metadata store.

Supported Locations

TheFeature availability table lists the available locations for Vertex AI Experiments. When usingVertex AI Pipelines or Vertex AI TensorBoard,they must be in the same location as your Vertex AI experiment.

What's next

• Create an experiment

Relevant notebook tutorials

1. Compare trained and evaluated models
2. Model training with prebuilt data pre-processing code
3. Compare pipeline runs
4. Autologging