cluster:Vc-dgiref

Contents 1 Problem 2 Schedule plan 3 Solution plan 3.1 Analysis 3.2 Design 3.2.1 Infrastructure 3.2.2 Create VM algorithm 3.3 Implementation 3.4 Maintenance

Problem

Maintain the virtual machines into the D-Grid reference installation cluster with the Open Source software.

Schedule plan

phase	begin	end	duration (month)	status
analysis	01.01.10	15.01.10	0,5	ready
design	16.01.10	15.02.10	1	ready
implementation	01.02.10	31.07.10	6	ready
maintenance	01.08.10	31.10.10	3	in progress
test	01.11.10	31.12.10	2

Solution plan

Analysis

• Virtual infrastructure
  • there are different Open Source solutions available for the Linux Cluster Virtualization.
  • all machines into the current (2010.1) D-Grid reference installation used the Scientific Linux 5.4 (except gLite, but will be changed to SL 5.4)
  • the Scientific Linux 5.4 includes the Kernel-based Virtual Machine (KVM) by default
• Configuration management
  • D-Grid reference installation includes already the cfengine v.3 (cf3) configuration management software

Conclusion:

• the KVM is a choice to be the virtualization infrastructure for the D-Grid Virtual Cluster.
• the libvirt API can be used to unify the Virtual Machine (VM) management process
• cf3 will be used to maintain/configure the virtual cluster

Design

Infrastructure

• common view for the D-Grid reference installation cluster infrastructure

codebase structure	binary repository structure	configuration manager structure
HEAD DEV/ [ development branch ] PROD/ [ production branch ] cf3/ [ cf3 production ] wikibot/ [ configuration/mantainance scripts ]	HEAD os [ used os iso files ] rpms [ software in rpm format ] src [ software in tar/bin format ] sandbox [ vm & configurations ]	HEAD inputs/ [ cf3 inputs ] library/ [ library ] tasks/ [ tasks ] failsafe.cf promises.cf update.cf modules/ [ cf3 modules ] repl/ [ replications ] cf3.preconf

Create VM algorithm

Prepare host >	Prepare generic image >	Configure VM >
Configure the machine network for support bridge devices. Create cf3 promises. Create script for installing/configuring/deleting virtual machines.	Create the generic host for configuration. Install and configure cfengine. Upload the generic host image and xml config to the NFS common directory.	Run the script and will be: Change generic image for new virtual machine. Create new virtual machine with changed image. After that into the virtual host automaticaly: Apply individual settings with cf3 policies. Upgrade and apply cf3 policies from central server. Report when the job is done.

Implementation

• Create scripts for
  • maintain a "generic" qemu-kvm VM
  • maintain script for "first start" reconfigure and manage status of "generic"

• Create cf3 promises
  • cf3 promises

Maintenance

• Apply cf3 configurations
  • cf3 promises