Creating an Autoscale Configuration

You can have one autoscale configuration per supported node type. Therefore, on a cluster with both worker and compute only worker nodes, you can have up to two autoscale policies.

  • For detailed information all fields available for Horizontal scaling, see Autoscale Configuration Fields.
    1. Open the navigation menu and click Analytics & AI. Under Data Lake, click Big Data Service.
    2. Under Compartment, select the compartment that contains the cluster.
    3. In the list of clusters, click the name of the cluster.
    4. On the Cluster details page, under Resources click Autoscale configurations.
    5. Click Create autoscale configuration.
    6. For Autoscale configuration name, enter a name for this configuration.
    7. For Cluster admin password, enter the admin password for the cluster.
    8. For Node type, select the node type.
    9. For Autoscale type, select one of the following:
      • Horizontal: Adds or removes nodes from the cluster.
      • Vertical: Changes the shape of the cluster.
    10. For Trigger type, select one of the following:
      • Metrics: Triggers when a specific performance metric exceeds the threshold.
      • Schedule Triggers at a scheduled time.
    11. For Performance metrics, select CPU utilization or Memory utilization. This field is available only if metrics was previously selected.
    12. For Time zone, select the correct time zone. This field is available only if schedule was previously selected.
    13. For Vertical autoscaling, the following fields might be available depending on what you selected in previous steps. For more information on each field, see Autoscale Configuration Fields.
      • Scale-up rule
      • Scale-down rule
      • Conditions
    14. For Horizontal autoscaling, the following fields might be available depending on what you selected in previous steps. For more information on each field, see Autoscale Configuration Fields.
      • Scale-in rules
      • Scale-out rules
      • Conditions
    15. Click Create.

      It takes a few minutes for the configuration to take effect. During this time, the cluster is in the Updating state.

      When an autoscale event is triggered, the worker nodes are updated on a rolling basis. One node is updated at a time.

  • Use the oci bds auto-scale-config create command and required parameters to create an autoscale configuration.

    oci bds auto-scale-config create --bds-instance-id <bds_instance_id> --cluster-admin-password <cluster_admin_password> --is-enabled <is_enabled> --node-type <node_type> [OPTIONS]

    For a complete list of flags and variable options for CLI commands, see the Command Line Reference for Big Data.

  • Use the AddAutoScalingConfiguration operation to configure autoscaling.