Deploying a Model Group

Deploy a model group in Data Science.

See Before You Begin.
1. On the Projects list page, select the project that you want to add the model group to. If you need help finding the list page or the project, see Listing Projects.
2. On the project details page, select Model Group.
  All model groups in the selected project are displayed in a table.
3. Select the model group.
4. From Actions on the upper right of the model group details page, select Create model deployment.
5. On the Create model deployment page, enter information as prompted.
  For field descriptions, see Creating a Model Deployment.
6. Select Create.

Create the model group deployment:

# 1. Create model group configuration details object
    model_group_config_details = ModelGroupConfigurationDetails(
    model_group_id="ocid1.modelgroup.oc1..exampleuniqueID"
    bandwidth_mbps=<bandwidth-mbps>,
    instance_configuration=<instance-configuration>,
    scaling_policy=<scaling-policy>
    )
 
 
# 2. Create infrastructure configuration details object
    infrastructure_config_details = InstancePoolInfrastructureConfigurationDetails(
    infrastructure_type="INSTANCE_POOL",
    instance_configuration=instance_config,
    scaling_policy=scaling_policy
    )
 
# 3. Create environment configuration
    environment_config_details = ModelDeploymentEnvironmentConfigurationDetails(
    environment_configuration_type="DEFAULT",
    environment_variables={"WEB_CONCURRENCY": "1"}
    )
  
# 4. Create category log details
    category_log_details = CategoryLogDetails(
    access=LogDetails(
        log_group_id=<log-group-id>,
        log_id=<log-id>
    ),
    predict=LogDetails(
        log_group_id=<log-group-id>,
        log_id=<log-id>
    )
    )
 
# 5. Bundle into deployment configuration
    model_group_deployment_config_details = ModelGroupDeploymentConfigurationDetails(
    deployment_type="MODEL_GROUP",
    model_group_configuration_details=model_group_config,
    infrastructure_configuration_details=infrastructure_config_details,
    environment_configuration_details=environment_config_details
    )
 
# 6. Set up parameters required to create a new model deployment.
    create_model_deployment_details = CreateModelDeploymentDetails(
    display_name=<deployment_name>,
    description=<description>,
    compartment_id=<compartment-id>,
    project_id=<project-id>,
    model_deployment_configuration_details=model_group_deployment_config_details,
    category_log_details=category_log_details
    )
 
# 7. Create deployment using SDK client
    response = data_science_client.create_model_deployment(
    create_model_deployment_details=create_model_deployment_details
    )
 
print("Model Deployment OCID:", response.data.id)

Create the model group deployment:

{
        "displayName": "MMS Model Group Deployment",
        "description": "mms",
        "compartmentId": compartment_id,
        "projectId": project_id,
        "modelDeploymentConfigurationDetails": {
            "deploymentType": "MODEL_GROUP",
            "modelGroupConfigurationDetails": {
                "modelGroupId": model_group_id
            },
            "infrastructureConfigurationDetails": {
                "infrastructureType": "INSTANCE_POOL",
                "instanceConfiguration": {
                    "instanceShapeName": "VM.Standard.E4.Flex",
                    "modelDeploymentInstanceShapeConfigDetails": {
                        "ocpus": 8,
                        "memoryInGBs": 128
                    }
                },
                "scalingPolicy": {
                    "policyType": "FIXED_SIZE",
                    "instanceCount": 1
                }
            },
            "environmentConfigurationDetails": {
                "environmentConfigurationType": "DEFAULT",
                "environmentVariables": {
                    "WEB_CONCURRENCY": "1"
                }
            }
        },
        "categoryLogDetails": {
            "access": {
                "logGroupId": "ocid1.loggroup.oc1.iad.amaaaaaav66vvniaygnbicsbzb4anlmf7zg2gsisly3ychusjlwuq34pvjba",
                "logId": "ocid1.log.oc1.iad.amaaaaaav66vvniavsuh34ijk46uhjgsn3ddzienfgquwrr7dwa4dzt4pirq"
            },
            "predict": {
                "logGroupId": "ocid1.loggroup.oc1.iad.amaaaaaav66vvniaygnbicsbzb4anlmf7zg2gsisly3ychusjlwuq34pvjba",
                "logId": "ocid1.log.oc1.iad.amaaaaaav66vvniavsuh34ijk46uhjgsn3ddzienfgquwrr7dwa4dzt4pirq"
            }
        }
    }
}

Oracle Cloud Infrastructure Documentation

Deploying a Model Group