Virtual Machine Groups (VM Groups)

A VM Group defines a set of related VMs, and associated placement constraints for the VMs in the group. A VM Group allows you to place together (or separately) ceartain VMs (or VM classes, roles). VMGroups will help you to optimize the performance (e.g. not placing all the cpu bound VMs in the same host) or improve the fault tolerance (e.g. not placing all your front-ends in the same host) of your multi-VM applications.

Defining a VM Group

A VM Group consists of two parts: a set of roles, and a set of placement constraints for the roles. In a VM Group, a role defines a class of virtual machines that are subject to the same placement constraints and rules. Usually, you will put in the same role VMs implementing a given functionality of a multi-VM application, e.g. the front-ends or the database VMs. Additonally, you can define placement constraints for the VMs in the VM-Group, this placement rules can refer to the VMs within a role or VMs across roles.

A role is defined with the following attributes:

Attribute Type Meaning
NAME Mandatory The name of the role, it needs to be unique within the VM Group
POLICY Optional Placement policy for the VMs of the role. Possible values are: AFFINED and ANTI_AFFINED
HOST_AFFINED Optional Defines a set of hosts (by their ID) where the VMs of the role can be executed
HOST_ANTI_AFFINED Optional Defines a set of hosts (by their ID) where the VMs of the role cannot be executed

Additional placement constraints can be imposed to the VMs of a role with the following attributes:

Attribute Type Meaning
AFFINED Optional List of roles (comma separated) whose VMs has to be placed in the same host
ANTI_AFFINED Optional List of roles (comma separated) whose VMs cannot be placed in the same host

To create a VM Group, use the Sunstone web interface, or create a template file following this example:

$ cat ./vmg.txt

NAME = "multi-tier server"

ROLE = [
    NAME   = "front-end",
    POLICY = "ANTI_AFFINED"
]

ROLE = [
    NAME         = "apps",
    HOST_AFFINED = "2,3,4"
]

ROLE = [ NAME = "db" ]

AFFINED = "db, apps"

$ onevmgroup create ./vmg.txt
ID: 0

vmg_wizard_create

Note

This guide focuses on the CLI command onevmgroup, but you can also manage VM Groups using Sunstone, through the VM Group tab.

Placement Policies

The following placement policies cane be applied to the VMs of a VM Group.

VM to Host Affinity

Specifies a set of hosts where the VMs of a role can be allocated. This policy is set in a role basis using the HOST_AFFINED and HOST_ANTI_AFFINED attributes. The host affinity rules are compatible with any other rules applied to the role VMs.

For example, if you want to place the VMs implementing the database for your application in high performance hosts you could use:

ROLE = [
    NAME         = "database",
    HOST_AFFINED = "1,2,3,4"
]

VM to VM Affinity

Specifies whether the VMs of a role have to be placed together in the same host (AFFINED) or scattered across different hosts (ANTI_AFFINED). The VM to VM affinity is set per role with the POLICY attribute.

For example, you may want to spread cpu-bound VMs across hosts to prevent contention

ROLE = [
    NAME   = "workers",
    POLICY = "ANTI_AFFINED"
]

Role to Role Affinity

Specifies whether the VMs of a role have to be placed together or separately with the VMs of other role. This useful to combine the Host-VM and VM-VM policies. Affinity rules for roles are set with the AFFINED and ANTI_AFFINED attributes.

For example, I want the VMs of a database to run together so they access the same storage, I want all the backup VMs to run in a separate hosts; and I want database and backups to be also in different hosts. Finally, I may have some constraints about where the database and backups may run:

ROLE = [
    NAME  = "apps",
    HOST_AFFINED = "1,2,3,4,5,6,7"
    POLICY = "AFFINED"
]

ROLE = [
    NAME = "backup",
    HOST_ANTI_AFFINED = "3,4"
    POLICY = "ANTI_AFFINED"
]

ANTI_AFFINED = "workers, backup"

Warning

Note that a role policy has to be coherent with any role-role policy, i.e. a role with an ANTI_AFFINED policy cannot be included in any AFFINED role-role rule.

Scheduler Configuration and Remarks

VMGroups are placed by dynamically generating the requirement (SCHED_REQUIREMENTS) of each VM an re-evaluating these expressions. Moreover, the following is also considered:

  • The scheduler will look for a host with enough capacity for an affined set of VMs. If there is no such host all the affined VMs will remain pending.
  • If new VMs are added to an affined role, it will pick one of the hosts where the VMs are running. By default, all should be running in the same host but if you manually migrate a VM to another host it will be considered feasible for the role.
  • The scheduler does not have any synchronization point with the state of the VM group, it will start scheduling pending VMs as soon as they show up.
  • Re-scheduling of VMs works as for any other VM, it will look for a different host considering the placement constraints.

Using a VM Group

Once you have defined your VM Group you can start adding VMs to it, by either picking a role and VM group at instantiation or by setting it in the VM Template. To apply a VM Group to your Virtual Machines either use the Sunstone wizard, or set the VM_GROUP attribute:

$ onetemplate update 0
...
VMGROUP = [ VMGROUP_NAME = "muilt-tier app", ROLE = "db" ]

You can also specify the VM_GROUP by its id (VMGROUP_ID), and in case of multiple groups with the same name you can select it by owner with VMGROUP_UID; as any other resource in OpenNebula.

Note

You can also add the VMGROUP attribute when a VM is created (onevm create) or when the associated template is instantiated (onetemplate instantiate). This way the same VM template can be associated with different roles.

VM Group Management

VM Groups can be updated to edit or add new rules. Currently only role to role rules can be updated if there are no VMs in the roles. All base operations are supported for the VMGroup object: rename, chgrp, chown chmod, list, show and delete.

Note also that the same ACL/permission system is applied to VM Groups, so use access is required to place VMs in a group.