Install and Configure IBM V3700, Brocade 300B Fabric and ESXi Host Step by Step

Step1: Hardware Installation

Follow the official IBM video tutorial to rack and stack IBM V3700.

 

image

image

image

Cabling V3700, ESX Host and Fabric.

  • Connect each canister of V3700 Storage to two Fabric. Canister1 FC Port 1—>Fabric1 and Canister 1 FC Port 2—>Fabric2. Canister2 FC Port 1—>Fabric1 and Canister 2 FC Port 2—>Fabric2.
  • Connect two HBAs of each Host to two Fabric.
  • Connect Disk Enclosure to two canister
  • Connect Both Power cable of each devices to multiple power supply

Step2: Initial Setup

Management IP Connection: Once you racked the storage, connect Canister1 Port 1 and Canister 2 Port 1 into two Gigabit Ethernet port in same VLAN. Make LACP is configured in both port in your switch.

image

Follow the official IBM video tutorial to setup management IP or download Redbook Implementation Guide and follow section 2.4.1

 

One initial setup is complete. Log on to V3700 storage using Management IP.

Click Monitoring>System>Enclosure>Canister. Record serial number, part number and machine signature.

image

Step3: Configure Event Notification

Click Settings>Event Notification>Edit. Add correct email address. You must add management IP address of v3700 into Exchange Relay Connector. Now Click test button to check you received email.

image

image

Step4: Licensing Features

Click Settings>General>Licensing>Actions>Automatic>Add>Type Activation Key>Activate. repeat the step for all licensed features.

image

IBM V3700 At a Glance

image

Simple Definition:

MDisk: Bounce of disk configured in preset RAID or User defined RAID. For example you have 4 SSD hard drive and 20 SAS hard drive. You can chose automatic configuration of storage which will be configured by Wizard. However you can chose to have 1 RAID5 single parity MDisk for SSD and 2x RAID5 MDisk with parity for 20 SAS hard drive. In this case you will have three MDisk in your controller. Simply MDisk is RAID Group.

Pool: Storage Pool act as container for MDisks and available capacity ready to be provisioned.

Volume: Volumes are logical segregation of Pools. Volume can defines as LUNs and ready to be mapped or connected to ESX host or Hyper-v Host.

Step5: Configure Storage

Click Pools>Internal Storage>Configure Storage>Select recommended or user defined. Follow the wizard to complete MDisk.

image

image

Step6: Configure Pool

image

Click Pools>Click Volumes by Pool>Click New Volume>Generic>Select Quantity, Size, Pool then Click Create.

image

image

image

Repeat the steps to create multiple volumes for Hyper-v Host or ESXI host.

Important! In IBM V3700, if you configure storage using GUI, GUI console automatically select default functionality of the storage for example number of mdisk. you will not have option to select disks and mdisk you want. Example, you may want create large mdisk containing 15 disks but GUI will create 3xmdisk which means you will loose lot of capacity by doing so. To avoid this, you can create mdisk, raid and pool using command line.

Telnet to your storage using putty.  type username: superuser and password is your password. Type the following command.
Creating RAID5 arrays and a pool

svctask mkmdiskgrp -ext 1024 -guiid 0 -name Pool01 -warning 80%

Creating a spare with drive 6

svctask chdrive -use spare 6

Creating a RAID Group (12 disk)

svctask mkarray -drive 4:11:5:9:3:7:8:10:12:13:14 -level raid5 -sparegoal 1 0

Creating SSD Raid5 with easy tier (disk0, disk1, disk2 are SSD)

svctask mkarray -drive 1:2:0 -level raid5 -sparegoal 0 Pool01

Now go back to GUI and check you have created two mdisk and a Pool with easy tier activated.

Step7: Configure Fabric

Once you rack and stack Brocade 300B switches. Connect both Brocade switches using CAT6 cable to your Ethernet Switch. This could be your core switch or an access switch. Connect your laptop to network as well.

References are here. Quick Start Guide and Setup Guide

Default Passwords

username: root password: fibranne
username: admin password: password

Connect the console cable provided within brocade box to your laptop. Insert EZSetup cd into cdrom of your laptop. Run Easy Setup Wizard.

Alternatively, you can connect the switch to the network and connect to it via http://10.77.77.77 (Give yourself an IP address of 10.77.77.1/24). Use the username root and the password fibranne

If you don’t want to do that, connect the console cable (provided) to your PC and launch the EZ Setup Software supplied with the switch. Select English > OK.

At the Welcome Screen > Click Next > Click Next > accept the EULA > Install > Done > Select Serial Cable > Click Next > Click Next (make sure HyperTerminal is NOT on or it will fail). It should find the switch > Set its IP details.

image

Next > Follow Instructions.

Install Java on your laptop. Open browser, Type IP address of Brocade, you can connect to the switch via its web console Once logged in using default username:root and password: fibranne

image

Click Switch Admin>Type DNS Server, Domain Name, Apply. Click License>Add new License, Apply.

image

image

Click Zone Admin>Click Alias>New Alias>Type the name of Alias. Click Ok. Expand Switch Port, Select WWNN>Add members. Repeat for Canister Node 1, Canister Node 2, ESX Host1, ESX Host2, ESX Host 3….

image

image

Select Zone Tab> New Zone > Type the Name of Zone, Example vSphere or Hyper_v. Select Aliases>Click Add Members> Add all Aliases.

image

Select Zone Config Tab>New Zone Config>Type the name of Zone Config>Select vSphere or Hyper_V Zone>Add Members

image

Click Save Config. Click Enable Config.

image

image

Repeat above steps for all fabric.

Step8: Configure Hosts in V3700

Click Hosts>New Host>Fibre Channel Host>Generic>Type the Name of the Host>Select Port>Create Host.

image

image

image

image

Right Click on each host>Map Volumes.

image

Step9: Configure ESXi Host

Right Click on ESX Cluster>Rescan for datastores>

image

image

Click ESX Host>Configuration>Storage>Add Storage>Click Next>Select Correct and Matching UID>Type the matching Name same as volume name within IBM V3700. Click Next>Select VMFS5>Finish.

image

Rescan for datatores for all Host again. you will see same data store popped up in all Hosts.

Finding HBA, WWNN

Select ESX Host>Configuration>Storage Adapters

image

image

Verifying Multipathing

Right Click on Storage>property>Manage Paths

image

image

Finding and Matching UID

Log on to IBM V3700 Storage>Volume>Volumes

image

Click ESX Host>Configuration>Storage>Devices

image

VMware vSphere: What’s New 5.0

HA: VMware provides several features that can be leveraged to increase the availability of a virtualized environment.With the latest release, several enhancements have been incorporated within VMware vCenter Server Heartbeat. These feature enhancements are the result of the focus of VMware in three key areas — manageability, usability,and application support.

Networking:  There are two broad types of networking capabilities that are new or enhanced in the VMware vSphere 5.0 release. The first type improves the network administrator’s ability to monitor and troubleshoot virtual infrastructure traffic by introducing features such as
• NetFlow
• Port mirror

The second type focuses on enhancements to the network I/O control (NIOC) capability first released in vSphere 4.1. The following are the key NIOC enhancements:
• User-defined resource pool
• vSphere replication traffic type
• IEEE 802.1p tagging

User-defined network resource pools in vSphere 5.0 provide an ability to add new traffic types beyond the standard system traffic types that are used for I/O scheduling.

Performance:  The following are some of the performance highlights:

VMware vCenter™ Server scalability
• Faster high-availability (HA) configuration times
• Faster failover rates – 60% more virtual machines within the same time
• Lower management operational latencies
• Higher management operations throughput (Ops/min)

Compute
• 32-way vCPU scalability
• 1TB memory support

Storage
• vSphere® Storage I/O Control (Storage I/O Control) now supports NFS – Set storage quality of service priorities per virtual machine for better access to storage resources for high-priority applications Network
• vSphere® Network I/O Control (Network I/O Control) – Gives a higher granularity of network load balancing vSphere vMotion®
• vSphere vMotion® (vMotion) – Multi–network adaptor enablement that contributes to an even faster vMotion
• vSphere Storage vMotion® (Storage vMotion) – Fast, live storage migration with I/O mirroring

Technical:

These advancements build on the core capacities in vSphere to provide improved
scalability; better performance; and easier provisioning, monitoring and troubleshooting. This paper focuses on
the following new features and enhancements:
• Virtual machine enhancements
• Improved SSD handling and optimization
• Command-line enhancements
• VMware® ESXi™ firewall
• vSphere Image Builder
• vSphere Auto Deploy server
• vSphere Host Profiles
• VMware vCenter™ Update Manager

Storage: VMware vSphere™ 5.0 brings many new capabilities to extend the benefits of vSphere 4.1. These new features and enhancements to core capabilities in vSphere provide more performance optimization and easier provisioning, monitoring and troubleshooting.

The topics to be covered in this paper are:
• vSphere® VMFS-5
• vSphere® Storage Distributed Resource Scheduler (Storage DRS)
• vSphere® Storage APIs – Storage Awareness
• Profile-Driven Storage
• Fibre Channel over Ethernet
• vSphere® Storage I/O Control (Storage I/O Control)
• vSphere® Storage APIs – Array Integration
• vSphere® Storage vMotion® (Storage vMotion)

VMware vSphere New Licensing Model:

Attributes ESX4.1 ESX5.0
Licensing Unit CPU CPU
SnS Unit CPU CPU
Core per proc

6 cores  Standard
Enterprise, ESS,
ESS+

12 core for Advanced
and Ent. Plus

unlimited

Physical RAM
Capacity per host

256GB for Standard,
Advanced Ent, ESS, ESS+

Unlimited for Ent. Plus

unlimited

vRAM Capacity
per proc

N/A

24GB Ess, Ess Plus, Standard
32GB Enterprise
48GB Ent. Plus

Pooling of
entitlements

N/A vRAM entitlement shared among ESX Host
Monitoring tool N/A Built-in

So how do you know, how much CPU license you need and how much vRAM entitlement you have? For example, you have 3 dual CPU ESX Host, each CPU has 12 core and you would like to buy standard license to start with. In this case, you need 3 Host X 2 CPU=6 CPU standard license. Your entitlement for vRAM would be 24GBx6CPU=144GB in total because standard license only allow 24GB per CPU. In this capacity, you will be able to virtualize 36 virtual machine that means 4GB per virtual machine. So if your hardware capacity is 192GB than you can not use extra 48GB vRAM.

What happen if you need more vRAM, there are two option either you upgrade your license from standard to enterprise or buy more vRAM license. Say you upgrade to Enterprise license than you are entitled to have 32GBx6CPU=192GB vRAM or you have to buy additional 48GB vRAM license on top of standard license.

Installation of vCenter: Here, for this article, I am doing an in place upgrade of my test VMware vSphere 4.1 infrastructure. In a production environment, this is not an recommended approach. you can download 60 days trial version from from VMware evaluation site. Systems requirements are fairly straight forward. you have to have Windows Server 2008 x64 Server as a domain member. In VMware vSphere 5.0 you can download Linux based VMware vCenter appliance. 

1

2

3

4567891011121314151617181920

21

Installation of New VI Client: Once you finish installing VMware vCenter, you have to have VI Client 5.0 to connect to the vCenter. Follow the screen shot to install VI client.

2223242526

Installation of vSphere Update Manager:

272829303132333435

Installation of ESXi Dump Collector:

36

37

It would be an wise idea to integrate dump collector on vCenter so that you can perform all administrative task from one single platform.

383940414243

Installation of Syslog Collector:

4445464748495051

Installation of Auto Deploy: The vSphere Auto Deploy server simplifies the deployment of VMware ESXi hosts in your environment. Using the Auto Deploy server, you can provision hundreds of physical hosts with VMware ESXi software. You can specify the image to deploy and the host to provision with the image. When a physical host setup for Auto Deploy is turned on, Auto Deploy uses a PXE boot infrastructure in conjunction with vSphere Host Profiles to provision and customize that host. No state is stored on the host itself. Instead, the Auto Deploy server manages state information for each host.
When a physical host is booted, it PXE boots over the network where a DHCP server assigns an IP address and redirects the host to a TFTP server, which directs the host to perform an HTTP boot from the Auto Deploy server. The Auto Deploy server then streams the VMware ESXi software image into memory on the target host. Once the entire image is resident in memory, VMware ESXi boots up and contacts the VMware vCenter Server, where Host Profiles can be used to automatically configure the host. Once the host has been configured, it is placed into the proper VMware vCenter cluster or folder and is available to host virtual machines.

52535455565758

Installation of Authentication Proxy:

5960616263

Once you have installed every all necessary part of vSphere, you can start all the services associated with the new installation.

64

New Features at a Glace:

image

65

66

Relevant References:

Download VMware vSphere 5.0

Technical Resource Center

The Cloud Era is Here