Академический Документы
Профессиональный Документы
Культура Документы
Abstract.............................................................................................................................................. 2 Overview of Virtual Connect technology................................................................................................. 2 Considerations when using Virtual Connect technology ............................................................................ 3 Creating server profiles..................................................................................................................... 3 MAC/WWN addressing .................................................................................................................. 4 Virtual Connect domains ................................................................................................................... 5 Virtual Connect management ................................................................................................................ 5 Virtual Connect Enterprise Manager ................................................................................................... 6 Virtual Connect Manager.................................................................................................................. 8 Virtual Connect with Ethernet networks ................................................................................................... 9 Uplink configurations...................................................................................................................... 10 Virtual LAN ................................................................................................................................... 10 Link aggregation groups ................................................................................................................. 10 Link failover................................................................................................................................... 10 Network loops ............................................................................................................................... 10 NIC teaming ................................................................................................................................. 11 Module stacking ............................................................................................................................ 11 Virtual Connect Ethernet Modules..................................................................................................... 12 Virtual Connect with Fibre Channel networks ........................................................................................ 13 N_Port ID Virtualization (NPIV) ........................................................................................................ 14 HP Virtual Connect Fibre Channel Modules for BladeSystem c-Class..................................................... 15 Conclusion........................................................................................................................................ 17 For more information.......................................................................................................................... 18 Call to action .................................................................................................................................... 18
Abstract
As data center density and complexity increase, so do demands for IT efficiency and responsiveness. As a result, simplifying system interconnections becomes significantly more important. HP has developed the HP Virtual Connect architecture to boost the efficiency and productivity of data center server, storage, and network administrators. This technology brief explains how Virtual Connect (VC) technology virtualizes the connections between the server and the network infrastructure (server-edge virtualization) so networks can communicate with pools of HP BladeSystem servers, allowing administrators to change servers in minutes instead of days or weeks. Virtual Connect provides the following: Cleanly separates server enclosure administration from local area network (LAN) and storage area network (SAN) administration maintains end-to-end connections of the preferred network fabric brands relieves LAN and SAN administrators from routine server-centric tasks Makes servers ready for rapid change at any time, so that server administrators can add, move, or replace servers without impacting production LAN and SAN availability, reducing costs and time to deploy Offers central management of one Virtual Connect domain through the Virtual Connect Manager (VCM) or hundreds of domains through the Virtual Connect Enterprise Manager (VCEM) Group-based management of Virtual Connect domains increases infrastructure consistency, limits configuration errors, and enables rapid change management across multiple enclosures VCEM repository provides efficient address administration eliminating the risk of address conflicts
The I/O connection profile, or server profile, provides the linkage between the server and the connections defined in Virtual Connect. Server profiles are created within Virtual Connect management tools and contain information about server addresses, connections, and boot parameters. HP Virtual Connect modules are required to activate the full server-edge virtualization across the system. The underlying Virtual Connect management capabilities run on a processor in the Ethernet module, so each BladeSystem enclosure must have at least one Virtual Connect Ethernet module. No special mezzanine cards are required for the server blades; HP Virtual Connect works with the standard Ethernet NICs and Fibre Channel (FC) HBAs that are available with HP BladeSystem c-Class server blades.
about server MAC and WWN addresses, connections to LANs and SANs for each Network Interface Controller (NIC) and FC Host Bus Adapter (HBA), Virtual Local Area Networks (VLAN), as well as Preboot eXecution Environment (PXE) and/or SAN Boot parameters, and profile failover resources. Once a server profile is assigned to a server blade in a specific bay and the server is powered on, the connection specifics of that profile are applied to that server blade. Virtual Connect server connection profiles are assigned to BladeSystem enclosure bays rather than to individual servers, making the system more flexible and reliable: If a physical server is replaced, the MAC and WWN assignments for the enclosure bay remain constant, and the change is invisible to the network. If a server connection profile is moved from one enclosure bay to another, the MAC, WWN, bootfrom-SAN definitions and associated workloads move with the profile, presenting a cost-effective solution for rapid system recovery or for reassigning server workloads. By applying server profiles to empty enclosure bays, administrators can pre-populate LAN and SAN network assignments for rapid server deployment.
NOTE: A server blade must be powered off to assign or remove a server profile.
MAC/WWN addressing
No virtual devices are created; the WWNs and MAC addresses are real. They are the only WWNs and MAC addresses seen by the system, the Operating System (OS), and the networks. Although the hardware ships with default MAC addresses and WWNs, Virtual Connect resets the MAC addresses and WWNs prior to boot, so PXE/SAN boot and all operating systems will see only the Virtual Connect managed values. During Virtual Connect environment setup, the administrator can select MAC/WWN from one of the following groups: Factory default MACs/WWNs A specific, user-defined range of MACs/WWNs One of several HP pre-defined ranges of MACs/WWNs Using factory default MAC addresses is not recommended because they cannot be moved to another server blade. System administrators must be careful to use each reserved range only once within their enterprise environments.
NOTE: HP is registered with the appropriate standards bodies as an Ethernet and FC vendor and WWN ranges for exclusive use with Virtual Connect. These reserved ranges will never be used as factory default MACs/WWNs on any hardware.
If a server is moved from a Virtual Connect managed enclosure to an unmanaged enclosure, the local MAC addresses and WWNs automatically return to the original factory defaults. If a server is removed from a server bay within a Virtual Connect domain and is plugged into another bay in the
same domain or into a bay in a different domain, it will be assigned the new set of addresses appropriate for that server bay location.
Virtual Connect Enterprise Manager (VCEM) provides the following core capabilities: Single intuitive console controls up to 250 Virtual Connect domains (up to 1000 BladeSystem enclosures and 16,000 servers) 1 with VCEM v6.00 or greater when used with Virtual Connect Ethernet multi-enclosure domain configurations Central repository administers over 256K MAC addresses and WWNs for server-to-network connectivity simplifies address assignments and eliminates the risk of conflicts Group-based management of Virtual Connect domains using common configuration profiles increases infrastructure consistency, limits configuration errors, simplifies enclosure deployment and enables configuration changes to be pushed to multiple Virtual Connect domains Scripted and manual movement of server connection profiles and associated workloads between BladeSystem enclosures system administrators can add, change and replace servers across the data center in minutes without impacting production LAN and SAN availability Automated failover of server connection profiles to user-defined spare servers
One Domain = up to 4 enclosures in a VC multiple enclosure configuration; 250 domains x 4 enclosures = 1000 enclosures x 16 servers per enclosure = 16,000 servers
Seamlessly integrates with existing Virtual Connect environments discovers and aggregates Virtual Connect domain resources into the VCEM console and address repository Licensed per c-Class enclosure simplifies deployment and enables timely support for current and future BladeSystem and Virtual Connect hardware
NOTE: Virtual Connect Enterprise Manager is licensed per BladeSystem c-Class enclosure, with separate options for c3000 and c7000 enclosures. A VCEM license is required for each enclosure to be managed in both single and multi-enclosure domain configurations.
Using VCEM, system administrators can upgrade and/or replace a server by simply reassigning its Virtual Connect server connection profile to an alternate server in another enclosure bay or another enclosure (Figure 4). This simple example illustrates a profile move from Server A to Server C using VCEM. Note that the LANs associated with each uplink port and the contents of the Virtual Connect server profile remain the same; only the location of the profile has changed. When a Virtual Connect server connection profile is moved, the associated MAC, WWN, boot from SAN parameters and related workload always move with the profile. Profile movement can be initiated manually from all Virtual Connect management tools. Virtual Connect Enterprise Manager can automate this entire process using its profile failover and spare server allocation features, and has the ability to move server profiles to any other domain in the same Virtual Connect Domain Group, whether it is in the same rack, across the datacenter or at another site. Profile movement and failover can be used to provide cost-effective server blade recovery, perform proactive hardware maintenance with reduced downtimes, and control rapid server repurposing to meet changing workload and application priorities. When moving Virtual Connect server profiles, the fastest completion times are achieved when the corresponding source and target servers are configured to boot-from-SAN. The automated profile failover functionality delivered in VCEM requires a boot-from-SAN environment.
Figure 4. This figure illustrates a profile move from Server A to Server C using VCEM.
VCEM is included in the Insight Software media kit delivered with every HP BladeSystem c-Class enclosure, and can also be downloaded at www.hp.com/go/vcem.
Unlike VCEM, VCM is designed only to configure and manage its own local domain and cannot administer across multiple Virtual Connect domains. Each VCM uses its own local range of MAC addresses and WWNs to assign to server connection profiles. VCM contains utilities and a profile wizard to create, assign, and move server profiles within its local domain. The profile format, content and general operations used by VCM are the same as for VCEM.
Figure 5. This illustration shows the Virtual Connect Manager homepage for single domain setup and administration.
If the VC Domain is deleted after the VC-Ethernet module has been configured with specific LAN and VLAN connections defined, the default configuration connecting all 16 server-side NICs to Uplink Port 1 will be reinstated until a new VC domain is created.
Uplink configurations
Virtual Connect supports a variety of uplink types and uplink speeds. These uplinks can be configured in a variety of ways: Simple, single cable uplink with one VLAN Multiple uplink ports aggregated in an IEEE 802.3ad Link Aggregation Control Protocol (LACP) link aggregation group (dynamic port channel or port trunk) Multiple VLANs sharing a single port or port-trunk, IEEE 802.1Q leveraging single or aggregated ports
NOTE: Virtual Connect does not participate in Spanning Tree protocol on network uplinks.
Virtual LAN
Virtual Connect is fully VLAN-aware. VLAN-tagged frames can be interpreted by the HP 1/10-Gb Virtual Connect module using a Shared Uplink Set and passed to the appropriate Virtual Connect Network. Alternatively, VLAN-tagged frames can be passed through the Virtual Connect Network for interpretation by the host.
Link failover
Virtual Connect facilitates link failover by allowing Virtual Connect networks to leverage ports on multiple Virtual Connect modules in the same VC Domain. Depending on its configuration, a Virtual Connect network will transparently shift its upstream communication to a port on the same module or on a different module in the event of a link failure.
Network loops
The Virtual Connect module prevents network loops by making sure that there is only one active uplink (or uplink link aggregation group) for any single network at any one time so traffic cannot loop through from uplink to uplink. In addition, Virtual Connect automatically discovers all the internal stacking links and uses an internal loop prevention algorithm to ensure there are no loops caused by the stacking links. None of the internal loop prevention traffic ever shows up on uplinks or moves to the external switch.
10
NIC teaming
Virtual Connect supports most features available in the HP NIC Teaming Software. With the HP NIC Teaming software a user can introduce a variety of host-based features including NIC fault-tolerance and Transmit Load Balancing.
Module stacking
Virtual Connect Ethernet modules can be stacked by cabling the Ethernet modules together within a Virtual Connect domain. Interconnecting the Ethernet modules (module stacking) allows all Ethernet network controllers on all servers in the Virtual Connect domain to have access to any Virtual ConnectEthernet uplink port. By using these module-to-module links, a single pair of uplinks can be used as the data center network connections for the entire Virtual Connect domain. Furthermore, it allows any server NIC to be connected to any Ethernet network. Network connections can be aggregated and can be from different modules. The stacking link between adjacent Virtual Connect Ethernet modules is internal (Figure 6).
Figure 6. This illustration of stacked Virtual Connect Ethernet modules uses 10 GbE ports for stacking.
HP recommends fully redundant interconnection of Virtual Connect-Ethernet modules. If a stacking cable is lost, the Ethernet packets within the Virtual Connect domain will be automatically re-routed to the uplink through the redundant path. Such a connection also preserves network connectivity if an Ethernet interconnect module fails or is removed.
11
The following modules are available as of this writing: HP Virtual Connect Flex-10 10GB Ethernet Module for BladeSystem c-Class HP 1/10Gb-F Virtual Connect Ethernet Module for BladeSystem c-Class For the most up-to-date product information, see the HP website at www.hp.com/go/virtualconnect. Virtual machine applications often require increased network connections per server. Virtual Connect Flex-10 can optimize networks by allowing administrators to fine-tune network bandwidth at the server edge by dividing each 10Gb network connection into four independent physical FlexNIC server connections. Each FlexNIC can be configured from 100 Mb up to 10 Gb, allowing just the right amount of network bandwidth based on application needs. For more detailed information about HP Virtual Connect Flex-10, review the HP Flex-10 technology brief at http://h20000.www2.hp.com/bc/docs/support/SupportManual/c01608922/c01608922.pdf. The HP 1/10Gb-F Virtual Connect Ethernet Module appears as a pass-thru device to the network, yet provides all the key benefits of integrated switching including high performance 1Gb and 10Gb Fiber Optic uplinks to the data center switch, port aggregation, failover, VLAN tagging, and stacking. The Virtual Connect Fiber Ethernet Module manages and administers server profiles that can be predefined and deployed anywhere within a Virtual Connect domain. This allows servers to come online quickly and easily without having to coordinate with network administrators. As outlined in Table 1, each Virtual Connect Ethernet Module has the following characteristics: Sixteen Ethernet downlinks (1Gb or 10Gb) to servers (connected across the signal midplane in the enclosure) Eight Ethernet uplinks (copper or fiber) to external networks One or two CX4 uplinks to connect to core switches or to stack Virtual Connect modules One or two internal cross-connects, or inter-switch links, across the signal midplane in the enclosure for a failover connection between Virtual Connect modules Support for existing 802.1 bridging specifications (802.1AB, 802.1Q, IEEE 802.2, and 802.3ad).
12
Table 1. Detailed information about Virtual Connect Ethernet modules HP Virtual Connect Flex-10 10Gb Ethernet Module Number of Uplink Ports (copper) Number of Downlink Ports Crosslink connections 1 x 10 Gb copper uplinks CX-4 HP 1/10Gb-F Virtual Connect Ethernet Module 1 x 10 Gb copper uplinks CX-4
16 x 10 Gb downlinks midplane
16 x 1 Gb downlinks midplane
2 x 10Gb SR or LR fiber uplinks XFP 2 x 1Gb SX or RJ-45 fiber uplinks SFP 4 x 1Gb 1000/100/10Gb copper uplinks RJ-45 1 management USB port 1 internal interface to Onboard Administrator module Embedded SNMPv1, v2 Line Rate, full-duplex 62 Gbps bridging fabric Less than 4us latency
Management
1 management USB port 1 internal interface to Onboard Administrator module Embedded SNMPv1, v2
Performance
Up to 4 FlexNICs per 10Gb server connection Line Rate, full-duplex 240Gbps bridging fabric Less than 1us latency 802.1AB, 802.1Q, IEEE 802.2, 802.3ad
Protocol support
13
In order to use Virtual Connect Fibre Channel modules, administrators must have the following: An HP Fibre Channel mezzanine adapter with the appropriate supported firmware and boot BIOS installed in at least one of the c-Class blades within the chassis At least one Virtual Connect Ethernet module installed in interconnect bay one An available interconnect bay for the VC-FC module(s) VC-FC modules are supported in interconnect bays 3 thru 8 in the HP BladeSystem c7000 enclosure and interconnect bays 3 and 4 in the HP BladeSystem c3000 enclosure VC-FC module uplink ports must be attached to NPIV-capable SAN switches, and NPIV must be enabled on the SAN switch ports. Most enterprise class SAN switches today support NPIV however, a firmware upgrade may be required. Please refer to the SAN switch vendor documentation for more details. If switch based zoning is in place, using NPIV will require soft zoning (zoning by WWN) to ensure that multiple connections sharing a single NPIV switch port will be zoned. Virtual Connect Fibre Channel modules do not have any mechanisms within the modules themselves to support VC-FC module failover. HP recommends deploying VC-FC modules in pairs in a side-by-side configuration (for example, interconnect bays 3 and 4, or 5 and 6). In doing so, standard Fibre Channel redundant solutions can be implemented at the OS layer in order to support multiple paths either in an active/passive or active/active solution. (Active/passive and active/active solutions are dependent upon the OS layer, HBA drivers, and failover support software.)
14
SAN zoning is supported. HP recommends that customers use soft or WWN-based zoning whenever Virtual Connect Fibre Channel is used. However, customers could use port-based zoning, but they will need to restrict movement of Virtual Connect server profiles among servers that map to the same SAN switch port. Traditionally, storage resources have been tied to a physical HBA and could not be provisioned to the virtual machines using the SAN administrators tools of choice like zoning and selective storage presentation. HP Virtual Connect Fibre Channel Modules remove this storage management limitation, facilitating multiple HBA WWNs on the physical server. Each virtual machine can have its own unique WWN and it remains associated with that virtual machine even as the virtual machine is moved. Now SAN administrators can manage and provision storage to virtual HBAs, up to 128 per server blade, with the same methods and quality of service as physical HBAs.
15
Figure 7. This illustration depicts an HP VC-FC Module with default 4:1 over-subscription.
Table2 identifies the supported configurations for side-by-side VC-FC modules co-located in the same enclosure and VC-FC modules within the same bay group across several enclosures in the MultiEnclosure domain.
Table 2. Supported VC- FC module configurations HP VC 4Gb FC Module HP VC 4Gb FC Module HP VC 8Gb 20-Port FC Module HP VC 8Gb 24-Port FC Module Supported Supported HP VC 8Gb 20Port FC Module Supported Supported HP VC 8Gb 24Port FC Module Not Supported Not Supported
Not Supported
Not Supported
Supported
Table 3 provides detailed information about the VC-FC modules currently available. For the most upto-date product information please see the HP website at www.hp.com/go/virtualconnect.
16
Table 3. VC- FC module capabilities HP VC 4Gb FC Module Uplink Port Capabilities Downlink Port Capabilities Number of Uplink Ports Number of Transceivers (included) NPIV Logins per Uplink Port NPIV Logins per Downlink Port Minimum Oversubscription Supported SAN Fabrics Minimum required version of Virtual Connect Manager 4Gb (4/2/1/Auto) 4Gb (4/2/1/Auto) 4 4 SFP 255 128 4:1 4 1.30 HP VC 8Gb 20-Port FC Module 8Gb (8/4/2/Auto) 8Gb (8/4/2/1/Auto) 4 None 255 128 4:1 4 2.30 HP VC 8Gb 24-Port FC Module 8Gb (8/4/2/Auto) 8Gb (8/4/21/Auto) 8 2 SFP+ 255 255 2:1 8 2.10
Conclusion
HP Virtual Connect technology provides a simple, easy-to-use tool for managing connections between HP BladeSystem c-Class server blades and external networks. It cleanly separates enclosure administration from LAN and SAN administration, relieving LAN and SAN administrators from server maintenance. It makes HP BladeSystem c-Class server blades change-ready, so that server administrators can add, move, or replace them without affecting the LANs or SANs. With Virtual Connect Flex-10 technology, the server administrator can choose how many NICs are on each server and set the bandwidth of each NIC port in increments of 100 Mb between 100 Mb and 10 Gb. As each server blade is installed the system administrator can quickly use VCEM to assign LAN and SAN connections. No more coordinating with LAN and SAN administrators or waiting for them to become available, which saves time, frees up LAN/SAN resources, and provides server administrators the ultimate flexibility to do what is needed when it is needed.
17
www.hp.com/go/vcem
www.hp.com/go/hpsim www.hp.com/go/insight
Call to action
Send comments about this paper to TechCom@HP.com.
2007, 2009,2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
18