Академический Документы
Профессиональный Документы
Культура Документы
EMC INFRASTRUCTURE FOR VIRTUAL DESKTOPS ENABLED BY EMC VNX SERIES (NFS), CISCO UCS, VMWARE vSPHERE 4.1, AND CITRIX XENDESKTOP 5
Copyright 2011 EMC Corporation. All Rights Reserved. EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. VMware, ESX, VMware vCenter, VMware View, and VMware vSphere are registered trademarks or trademarks of VMware, Inc. in the United States and/or other jurisdictions. All other trademarks used herein are the property of their respective owners. VMware and/or Citrix may have substituted components of the original environment in this document with hardware of a similar (or higher) specification to the original equipment used in the EMC Proven Solution. The content contained in this document originated from a validated EMC Proven Solution. The modification introduced by VMware and/or Citrix may have caused changes in performance, functionality, or scalability of the original solution. Please refer to www.emc.com/solutions for further information on validated EMC Proven Solutions. Part Number: h8278
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
Table of contents
Table of contents
1 Introduction ................................................................................................. 9
Introduction to the new EMC VNX series for unified storage .................................................. 9
Software suites available .......................................................................................................... 10 Software packages available ..................................................................................................... 10
Configuration ...................................................................................................................... 14
Test results ................................................................................................................................ 14 Hardware resources................................................................................................................... 14 Software resources .................................................................................................................... 15
Table of contents
Storage Design........................................................................................... 21
EMC VNX series storage architecture .................................................................................. 21
Introduction .............................................................................................................................. 21 Storage layout ........................................................................................................................... 22 Storage layout overview ............................................................................................................ 22 File system layout ...................................................................................................................... 23 EMC VNX FAST Cache ................................................................................................................. 23 EMC VSI for VMware vSphere ..................................................................................................... 24 vCenter Server storage layout .................................................................................................... 24 VNX shared file systems ............................................................................................................ 24 Roaming profiles and folder redirection ..................................................................................... 25 EMC VNX for File Home Directory feature .................................................................................... 25 Profile export ............................................................................................................................. 26 Capacity .................................................................................................................................... 26
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
Table of contents
Table of contents
Storage processor utilization ..................................................................................................... 64 FAST Cache IOPS ....................................................................................................................... 65 Data Mover CPU utilization ........................................................................................................ 66 Data Mover NFS load ................................................................................................................. 66 ESX CPU load............................................................................................................................. 67 ESX disk response time ............................................................................................................. 68
Conclusion................................................................................................. 89
Summary ............................................................................................................................ 89 References .......................................................................................................................... 89
White papers ............................................................................................................................. 89 Other documentation ................................................................................................................ 89
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
List of Tables
List of Tables
Table 1. Table 2. Table 3. Table 4. Table 5. Terminology ............................................................................................................... 12 Solution hardware ...................................................................................................... 14 Solution software ....................................................................................................... 15 File systems ............................................................................................................... 24 Environment profile .................................................................................................... 49
List of Figures
Figure 1. Figure 2. Figure 3. Figure 4. Figure 5. Figure 6. Figure 7. Figure 8. Figure 9. Figure 10. Figure 11. Figure 12. Figure 13. Figure 14. Figure 15. Figure 16. Figure 17. Figure 18. Figure 19. Figure 20. Figure 21. Figure 22. Figure 23. Figure 24. Figure 25. Figure 26. Figure 27. Figure 28. Figure 29. Figure 30. Figure 31. Figure 32. Figure 33. Figure 34. Figure 35. Figure 36. Reference architecture................................................................................................ 13 Storage layout ............................................................................................................ 22 File system layout ....................................................................................................... 23 UNC path for roaming profiles .................................................................................... 26 10 gigabit connectivity ............................................................................................... 27 Rear view of the two VNX5300 Data Movers ................................................................ 29 vSwitch configuration ................................................................................................. 31 Load-balancing policy ................................................................................................ 31 vSwitch virtual ports ................................................................................................... 32 UCS Manager - MTU configuration .............................................................................. 36 Select Create Catalog ................................................................................................. 39 Select the Machine type ............................................................................................. 40 Select the cluster host ................................................................................................ 40 Specify the number of virtual machines ...................................................................... 41 Select an Active Directory location.............................................................................. 41 Review the summary .................................................................................................. 42 Select Hosts ............................................................................................................... 43 Select Change details ................................................................................................. 43 Change Host Details window ...................................................................................... 43 Advanced Host Details window .................................................................................. 44 Twenty 200 GB thick LUNs .......................................................................................... 45 FAST Cache tab........................................................................................................... 46 Enable FAST Cache ..................................................................................................... 47 MMC snap-in .............................................................................................................. 47 Sample virtual desktop properties .............................................................................. 48 Boot storm - Disk IOPS for a single SAS drive .............................................................. 52 Boot storm - LUN IOPS and response time .................................................................. 53 Boot storm - Storage processor total IOPS .................................................................. 54 Boot storm - Storage processor utilization .................................................................. 55 Boot storm - FAST Cache IOPS .................................................................................... 56 Boot storm Data Mover CPU utilization .................................................................... 57 Boot storm Data Mover NFS load ............................................................................. 58 Boot storm - ESX CPU load .......................................................................................... 59 Boot storm - Average Guest Millisecond/Command counter ....................................... 60 Antivirus - Disk I/O for a single SAS drive.................................................................... 61 Antivirus - LUN IOPS and response time...................................................................... 62 EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
List of Figures
Figure 37. Figure 38. Figure 39. Figure 40. Figure 41. Figure 42. Figure 43. Figure 44. Figure 45. Figure 46. Figure 47. Figure 48. Figure 49. Figure 50. Figure 51. Figure 52. Figure 53. Figure 54. Figure 55. Figure 56. Figure 57. Figure 58. Figure 59. Figure 60. Figure 61. Figure 62. Figure 63. Figure 64. Figure 65. Figure 66.
Antivirus - Storage processor IOPS ............................................................................. 63 Antivirus - Storage processor utilization ..................................................................... 64 Antivirus - FAST Cache IOPS ........................................................................................ 65 Antivirus Data Mover CPU utilization........................................................................ 66 Antivirus Data Mover NFS load................................................................................. 66 Antivirus - ESX CPU load ............................................................................................. 67 Antivirus - Average Guest Millisecond/Command counter .......................................... 68 Patch install - Disk IOPS for a single SAS drive............................................................ 69 Patch install - LUN IOPS and response time ................................................................ 70 Patch install - Storage processor IOPS ........................................................................ 71 Patch install - Storage processor utilization ................................................................ 72 Patch install - FAST Cache IOPS .................................................................................. 73 Patch install Data Mover CPU utilization .................................................................. 74 Patch install Data Mover NFS load ........................................................................... 74 Patch install - ESX CPU load........................................................................................ 75 Patch install - Average Guest Millisecond/Command counter ..................................... 76 Login VSI response times ........................................................................................... 77 Login storm timing ..................................................................................................... 78 Login VSI - Disk IOPS for a single SAS drive ................................................................ 79 Login VSI - LUN IOPS and response time ..................................................................... 80 Login VSI - Storage processor IOPS ............................................................................. 81 Login VSI - Storage processor utilization ..................................................................... 81 Login VSI - FAST Cache IOPS ....................................................................................... 82 Login VSI Data Mover CPU utilization ....................................................................... 83 Login VSI Data Mover NFS load ................................................................................ 83 Login VSI - ESX CPU load ............................................................................................ 84 Login VSI - Average Guest Millisecond/Command counter .......................................... 85 Boot storm average latency comparison .................................................................. 86 Antivirus scan scan time comparison ...................................................................... 87 Patch storm average latency comparison................................................................. 88
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
Chapter 1: Introduction
Introduction
This chapter introduces the solution and its components, and includes the following sections: Introduction to the new EMC VNX series for unified storage Document overview Reference architecture Configuration
Expanded EMC UltraFlex I/O connectivityFibre Channel (FC), Internet Small Computer System Interface (iSCSI), Common Internet File System (CIFS), Network File System (NFS) including parallel NFS (pNFS), Multi-Path File System (MPFS), and Fibre Channel over Ethernet (FCoE) connectivity for converged networking over Ethernet The VNX series includes five new software suites and two new software packages, making it easier and simpler to attain the maximum overall benefits.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
Chapter 1: Introduction
VNX FAST SuiteAutomatically optimizes for the highest system performance and the lowest storage cost simultaneously. VNX Local Protection SuitePractices safe data protection and repurposing. VNX Remote Protection SuiteProtects data against localized failures, outages, and disasters. VNX Application Protection SuiteAutomates application copies and proves compliance. VNX Security and Compliance SuiteKeeps data safe from changes, deletions, and malicious activity.
VNX Total Protection PackIncludes local, remote, and application protection suites. VNX Total Efficiency PackageIncludes all five software suites (not available for the VNX5100). VNX Total Value PackageIncludes all three protection software suites and the Security and Compliance Suite (the VNX5100 exclusively supports this package).
Document overview
EMC's commitment to consistently maintain and improve quality is led by the Total Customer Experience (TCE) program, which is driven by Six Sigma methodologies. As a result, EMC has built Customer Integration Labs in its Global Solutions Centers to reflect realworld deployments in which TCE use cases are developed and executed. These use cases provide EMC with an insight into the challenges that are currently facing its customers. This Proven Solutions Guide summarizes a series of best practices that were discovered or validated during testing of the EMC Infrastructure for Virtual Desktops Enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5 solution by using the following products: EMC VNX series Citrix XenDesktop 5 VMware vSphere 4.1 Cisco UCS B-series servers Use case definition The following six use cases are examined in this solution: Boot storm Antivirus scan Microsoft security patch install
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
10
Chapter 1: Introduction
Login storm User workload simulated with Login VSI tool Chapter 6: Testing and Validation contains the test definitions and results for each use case. Purpose The purpose of this solution is to provide a virtualized infrastructure for virtual desktops powered by Citrix XenDesktop 5, Cisco UCS B-series servers, VMware vSphere 4.1, EMC VNX series (NFS), VNX FAST Cache, and storage pools. This solution includes all the attributes required to run this environment, such as hardware and software, including Active Directory, and the required Citrix XenDesktop configuration. Information in this document can be used as the basis for a solution build, white paper, best practices document, or training. Scope This Proven Solutions Guide contains the results observed from testing the EMC Infrastructure for Virtual Desktops Enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5 solution. The objectives of this testing are to establish: A reference architecture of validated hardware and software that permits easy and repeatable deployment of the solution. The storage best practices to configure the solution in a manner that provides optimal performance, scalability, and protection in the context of the midtier enterprise market. Not in scope Implementation instructions are beyond the scope of this document. Information on how to install and configure Citrix XenDesktop 5 components, Cisco UCS, vSphere 4.1, and the required EMC products is outside the scope of this document. Links to supporting documentation for these products are supplied where applicable. The intended audience for this Proven Solutions Guide is: EMC, Cisco, VMware, and Citrix customers EMC, Cisco, VMware, and Citrix partners Internal EMC, Cisco, VMware, and Citrix personnel Prerequisites It is assumed that the reader has a general knowledge of the following products: VMware vSphere 4.1 Citrix XenDesktop 5 EMC VNX series Cisco UCS and Nexus switches
Audience
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
11
Chapter 1: Introduction
Terminology
Terminology Definition
EMC VNX FAST Cache is a feature that enables the use of EFD as an expanded cache layer for the array. MCS is a collection of services that work together to create virtual desktops from a master desktop image on demand, optimizing storage utilization, and providing a pristine virtual desktop to each user every time they log on. Login VSI is a third-party benchmarking tool developed by Login Consultants that simulates real-world VDI workload by using an AutoIT script, and determines the maximum system capacity based on the response time of the users.
Reference architecture
Corresponding reference architecture This Proven Solutions Guide has a corresponding Reference Architecture document that is available on EMC Powerlink and EMC.com. The EMC Infrastructure for Virtual
Desktops Enabled by EMC VNX Series(NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5 Reference Architecture provides more details.
If you do not have access to these documents, contact your EMC representative.
The reference architecture and the results in this Proven Solutions Guide are valid for 1,000 Windows 7 virtual desktops conforming to the workload described in Validated environment profile on page 49.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
12
Chapter 1: Introduction
Reference Figure 1 depicts the logical architecture of the midsize solution. architecture logical diagram
Figure 1.
Reference architecture
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
13
Chapter 1: Introduction
Configuration
Test results Hardware resources Chapter 6: Testing and Validation provides more information on the performance results. Table 2 lists the hardware used for the solution. Table 2. Hardware
EMC VNX5300
Configuration
Two Data Movers (active/standby) Three DAEs configured with: Thirty 300 GB, 15k rpm 3.5 SAS disks Nine 2 TB, 7200 rpm 3.5 NL-SAS disks Three 100 GB, 3.5 Flash drives
Notes
VNX shared storage
Forty 10 Gb ports
16
Memory: 72 GB RAM CPU: Two Intel Xeon E5540 2.5 GHz quad-core processors Internal storage: Two 146 GB internal SAS disks External storage: VNX5300 (NFS) HBA/NIC: M71KR-Q Qlogic Converged Network Adapter (CNA)
Other servers
Memory: 20 GB RAM CPU: Two Intel Xeon E5450 3.0 GHz quad-core processors Internal storage: One 67 GB disk External storage: VNX5300 (NFS) NIC: Two Broadcom NetXtreme II BCM 1000 Base-T Adapters
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
14
Chapter 1: Introduction
Software resources Table 3 lists the hardware used for the solution. Table 3. Software
EMC VNX5300 VNX OE for File VNX OE for Block VSI for VMware vSphere: Unified Storage Management VSI for VMware vSphere: Storage Viewer Cisco UCS and Nexus Cisco UCS B-Series server Cisco Nexus 5020 XenDesktop Desktop Virtualization Citrix XenDesktop Controller OS for XenDesktop Controller Microsoft SQL Server VMware vSphere ESX Server vCenter Server OS for vCenter Server Virtual Desktops Note: This software is used to generate the test load Operating system Microsoft Office Internet Explorer Adobe Reader McAfee Virus Scan Adobe Flash Player Bullzip PDF Printer Login VSI (VDI workload generator) MS Windows 7 Enterprise (32-bit) Office 2007 Version 12 8.0.7600.16385 9.1.0 8.7.0i Enterprise 10 6.0.0.865 2.1.2 Pro edition ESX 4.1 (Build 208167) 4.1 (Build 208111) Windows Server 2008 R2 Enterprise Edition Version 5 Platinum Edition Windows Server 2008 R2 Enterprise Edition Version 2008 Enterprise Edition (64-bit) Version 1.3(1m) Version 4.2(1)N1(1) Release 7.0.12.101 Release 31 (05.31.000.5.006) Version 4.1 Version 4.0.1
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
15
Chapter 1: Introduction
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
16
Citrix XenDesktop 5
Introduction Citrix XenDesktop offers a powerful and flexible desktop virtualization solution that allows you to deliver on-demand virtual desktops and applications to users anywhere, using any type of device. With XenDesktops FlexCast delivery technology, you can deliver every type of virtual desktop, tailored to individual performance and personalization needs for unprecedented flexibility and mobility. Powered by Citrix HDX technologies, XenDesktop provides a superior user experience with Flash multimedia and applications, 3D graphics, webcams, audio, and branch office delivery, while using less bandwidth than alternative solutions. The highspeed delivery protocol provides unparalleled responsiveness over any network, including low bandwidth and high latency WAN connections. Deploying Citrix XenDesktop components This solution is deployed using two XenDesktop 5 controllers that are capable of scaling up to 1,000 virtual desktops. The core elements of a Citrix XenDesktop 5 implementation are: Citrix XenDesktop 5 controllers Citrix License Server VMware vSphere 4.1 Additionally, the following components are required to provide the infrastructure for a XenDesktop 5 deployment: Microsoft Active Directory Microsoft SQL Server DNS Server EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide 17
DHCP Server
The Citrix XenDesktop controller is the central management location for virtual desktops and has the following key roles: Broker connections between users and virtual desktops Control the creation and retirement of virtual desktop images Assign users to desktops Control the state of the virtual desktops Control access to the virtual desktops Two XenDesktop 5 controllers were used in this solution to provide high availability as well as load balancing of brokered desktop connections. A Citrix License Server is installed on one of the controllers.
Machine Creation Services (MCS) is a new provisioning mechanism introduced in XenDesktop 5. It is integrated with the new XenDesktop management interface, Desktop Studio, to provision, manage, and decommission desktops throughout the desktop lifecycle management from a centralized point of management. MCS allows several types of machines to be managed within a catalog in Desktop Studio, including dedicated and pooled machines. Desktop customization is persistent for dedicated machines, while a pooled machine is required if a nonpersistent desktop is appropriate. In this solution, 1,000 virtual desktops that are running Windows 7 were provisioned by using MCS. The desktops were deployed from two dedicated machine catalogs. Desktops provisioned using MCS share a common base image within a catalog. Because of this, the base image is typically accessed with sufficient frequency to naturally leverage EMC VNX FAST Cache, where frequently accessed data is promoted to Flash drives to provide optimal I/O response time with fewer physical disks.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
18
vSphere cluster
Two vSphere clusters were deployed to house 1,000 desktops in this solution. Each cluster consists of eight ESX servers to support 500 desktops, resulting in 62-63 virtual machines per ESX server. Each cluster had access to four datastores for desktop provisioning, for a total of 125 virtual machines per data store. The Infrastructure cluster consists of three ESX servers and holds the following virtual machines: Windows 2008 R2 domain controllerprovides DNS, Active Directory, and DHCP services. SQL Server 2008 SP2 on Windows 2008 R2provides databases for vCenter Server and XenDesktop 5 controllers. vCenter Server on Windows 2008 R2provides management services for the VMware clusters and XenDesktop controllers. XenDesktop 5 controllers on Windows 2008 R2provide services for managing virtual desktops.
Windows infrastructure
Introduction Microsoft Windows provides the infrastructure used to support the virtual desktops and includes the following components: Microsoft Active Directory Microsoft SQL Server DNS Server DHCP Server Microsoft Active Directory The Windows domain controller runs the Active Directory service that provides the framework to manage and support the virtual desktop environment. Active Directory performs the following functions: Manages the identities of users and their information Applies group policy objects Deploys software and updates Microsoft SQL Server Microsoft SQL Server is a relational database management system (RDBMS). A dedicated SQL Server 2008 SP2 is used to provide the required databases to vCenter Server and XenDesktop controllers. DNS is the backbone of Active Directory and provides the primary name resolution mechanism for Windows servers and clients. In this solution, the DNS role is enabled on the domain controller. EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
DNS Server
19
DHCP Server
The DHCP Server provides the IP address, DNS Server name, gateway address, and other information to the virtual desktops. In this solution, the DHCP role is enabled on the domain controller. The DHCP scope is configured to accommodate the range of IP addresses for 1,000 or more virtual desktop machines.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
20
3
Introduction
Storage Design
The storage design described in this section applies to the specific components of this solution.
File-based storage over the CIFS (Common Internet File System) protocol is used to store user data and roaming profiles. This has the following benefits: Redirection of user data and roaming profiles to a central location for easy backup and administration. Single instancing and compression of unstructured user data to provide the highest storage utilization and efficiency.
This section explains the configuration of the storage that was provided over NFS to the ESX cluster to store the VMDK images, and the storage that was provided over CIFS to redirect user data and roaming profiles.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
21
Storage layout
10
11
12
13
14
Bus 0 Enclosure 2
FAST Cache
UNBOUND
RAID 1
10
11
12
13
14
Bus 0 Enclosure 1
10
11
12
13
14
Bus 0 Enclosure 0
SAS
SSD
NL SAS
UNBOUND
Storage layout
The following storage configuration was used in the solution: Four SAS disks (0_0 to 0_3) are used for the VNX OE. Disks 0_4, 1_10, and 2_13 are hot spares. These disks are denoted as hot spare in the storage layout diagram. Twenty SAS disks (0_5 to 0_14 and 1_0 to 1_9) on the RAID 5 storage pool 1 are used to store virtual desktops. FAST Cache is enabled for the entire pool. Twenty LUNs of 200 GB each are carved out of the pool to form four striped volumes, which are used to create eight NFS file systems. The file systems are presented to the ESX servers as datastores. Two Flash drives (1_11 and 1_12) are used for EMC VNX FAST Cache. There are no user-configurable LUNs on these drives. Five SAS disks (2_0 to 2_4) on the RAID 5 storage pool 2 are used to store the infrastructure virtual machines. A 1 TB LUN is carved out of the pool to form an NFS file system. The file system is presented to the ESX servers as a datastore. Eight NL-SAS disks (2_5 to 2_12) on the RAID 6 (6+2) group are used to store user data and roaming profiles. Two VNX file systems are created on two LUNs, a 2 TB file system for profiles, and a 4 TB file system for user data. Disks 1_13, 1_14, and 2_14 are unbound. They are not used for testing this solution.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
22
The following diagram shows the layout of the NFS file systems.
Figure 3.
20 LUNs of 200GB each are carved out of the 20-SAS-drive storage pool and are used to create 4 NAS pools. Each NAS pool stripes across 5 dvols with a stripe size of 256KB. Two file systems are carved out of each NAS pool and presented to the ESX servers as datastores. 1,000 virtual desktops are evenly distributed among the eight NFS datastores. EMC VNX FAST Cache VNX FAST Cache, a part of the VNX FAST Suite, enables Flash drives to be used as an expanded cache layer for the array. The VNX5300 is configured with two 100 GB Flash drives in a RAID 1 configuration for a 93 GB read/write-capable cache. This is the minimum amount of FAST Cache. Larger configurations are supported for scaling beyond 1,000 desktops. FAST Cache is an array-wide feature available for both file and block storage. FAST Cache works by examining 64 KB chunks of data in FAST Cache-enabled objects on the array. Frequently accessed data is copied to the FAST Cache and subsequent accesses to the data chunk are serviced by FAST Cache. This enables immediate promotion of very active data to Flash drives. This dramatically improves the response times for the active data and reduces data hot spots that can occur within the LUN. FAST Cache is an extended read/write cache that enables XenDesktop to deliver consistent performance at Flash drive speeds by absorbing read-heavy activities such as boot storms and antivirus scans, and write-heavy workloads such as operating system patches and application updates.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
23
This extended read/write cache is an ideal caching mechanism for MCS in XenDesktop 5 because the base desktop image and other active user data are accessed with sufficient frequency to service the data is directly from the Flash drives without having to access slower drives at a lower storage tier. EMC VSI for VMware vSphere EMC Virtual Storage Integrator (VSI) for VMware vSphere is a plug-in to VMware vSphere Client that provides a single management interface used for managing EMC storage within the vSphere environment. Features can be added and removed from VSI independently, providing flexibility for customizing VSI user environments. Features are managed using the VSI Feature Manager. VSI provides a unified user experience, allowing new features to be introduced rapidly in response to changing customer requirements. The following features were used during the validation testing: Storage Viewer (SV) extends the vSphere client to facilitate the discovery and identification of EMC VNX storage devices that are allocated to VMware ESX hosts and virtual machines. SV presents the underlying storage details to the virtual datacenter administrator, merging the data of several different storage mapping tools into a few seamless vSphere client views. Unified Storage Management simplifies storage administration of the EMC VNX unified storage platform. It enables VMware administrators to provision new NFS and VMFS datastores, and RDM volumes seamlessly within vSphere client. Refer to the EMC VSI for VMware vSphere product guides on Powerlink for more information. vCenter Server storage layout A storage pool of 20 x 300 GB SAS drives was configured on the VNX to provide the storage required for the virtual desktops. Eight NFS file systems were carved out of the pool to present to the ESX clusters as eight datastores. Each of these 500 GB datastores accommodates 125 virtual machines, allowing each desktop to grow to a maximum average size of 4 GB. The pool of desktops created in XenDesktop is balanced across all eight datastores. Virtual desktops use two VNX shared file systems, one for user profiles and the other to redirect user storage. Each file system is exported to the environment through a CIFS share. The following table shows the file systems used for user profiles and redirected user storage. Table 4.
profiles_fs userdata1_fs
File system
Size
2 TB 4 TB
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
24
The local user profile is not recommended in a VDI environment. A performance penalty is incurred when a new local profile is created whenever a user logs in to a new desktop image. On the other hand, roaming profiles and folder redirection allow user data to be stored centrally on a network location that resides on a CIFS share hosted by VNX. This reduces the performance hit during user logon while allowing user data to roam with the profiles. Alternative profile management tools such as Citrix User Profile Manager, or a thirdparty tool such as AppSense Environment Manager, provide more advanced and granular features to manage various user profile scenarios. Refer to User Profiles for XenApp and XenDesktop on the Citrix website for further details.
The EMC VNX for File Home Directory feature uses the userdata1_fs file system to automatically map the H: drive of each virtual desktop to the users own dedicated subfolder on the share. This ensures that each user has exclusive rights to a dedicated home drive share. This export does not need to be created manually. The Home Directory feature automatically maps this share for each user. The Documents folder for each user is also redirected to this share. This allows users to recover the data in the Documents folder by using the VNX Snapshots for File. The file system is set at an initial size of 1 TB, and can extend itself automatically when more space is required.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
25
Profile export
The profiles_fs file system is used to store user roaming profiles. It is exported through CIFS. The UNC path to the export is configured in Active Directory for roaming profiles as shown in the following figure:
Figure 4. Capacity
The file systems leverage Virtual Provisioning and compression to provide flexibility and increased storage efficiency. If single instancing and compression are enabled, unstructured data such as user documents typically leads to a 50 percent reduction in consumed storage. The VNX file systems for user profiles and documents are configured as follows: profiles_fs is configured to consume 2 TB of space. With a 50 percent space savings, each profile can grow up to 4 GB in size. The file system can be extended if more space is needed. userdata1_fs is configured to consume 4 TB of space. With a 50 percent space savings, each user will be able to store 8 GB of data. The file system can be extended if more space is needed.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
26
Network Design
This chapter describes the network design used in this solution and contains the following sections: Considerations VNX for file network configuration Cisco Nexus 5020 configuration Cisco UCS network configuration
Considerations
Network layout overview The figure below shows the 10 Gb Ethernet connectivity between the Cisco UCS BSeries servers and the EMC VNX storage system. Uplink Ethernet ports from the Nexus 5020 switches can be used to connect to a 1 Gb/s or 10 Gb/s external LAN. In this solution, a 1 Gb/s LAN was used to extend Ethernet connectivity to the desktop clients, XenDesktop management components, and Windows server infrastructure.
Figure 5.
10 gigabit connectivity
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
27
This validated solution uses virtual local area networks (VLANs) to segregate network traffic of various types to improve throughput, manageability, application separation, high availability, and security. The IP scheme for the virtual desktop network must be designed with enough IP addresses in one or more subnets for the DHCP Server to assign them to each virtual desktop.
Link aggregation
VNX platforms provide network high availability or redundancy by using link aggregation. This is one of the methods used to address the problem of link or switch failure. Link aggregation enables multiple active Ethernet connections to appear as a single link with a single MAC address, and potentially multiple IP addresses. In this solution, Link Aggregation Control Protocol (LACP) is configured on VNX, combining two 10 GbE ports into a single virtual device. If a link is lost in the Ethernet port, the link fails over to another port. All network traffic is distributed across the active links.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
28
fxg-1-0
fxg-1-0
To configure the link aggregation that uses fxg-1-0 and fxg-1-1 on Data Mover 2, run the following command:
$ server_sysconfig server_2 -virtual -name <Device Name> -create trk option "device=fxg-1-0,fxg-1-1 protocol=lacp"
To verify if the ports are channeled correctly, run the following command:
$ server_sysconfig server_2 -virtual -info lacp1 server_2: *** Trunk lacp1: Link is Up *** *** Trunk lacp1: Timeout is Short *** *** Trunk lacp1: Statistical Load Balancing is IP *** Device Local Grp Remote Grp Link LACP Duplex Speed -------------------------------------------------------------fxg-1-0 10000 4480 Up Up Full 10000 Mbs fxg-1-1 10000 4480 Up Up Full 10000 Mbs
The remote group number must match for both ports, and the LACP status must be Up. Verify if the appropriate speed and duplex are established as expected. Data Mover interfaces EMC recommends creation of two Data Mover interfaces and IP addresses on the same subnet with the VMkernel port on the ESX servers. Half of the NFS datastores are accessed via one IP address and the other half are accessed via the second IP. This balances the VMkernel traffic to be among the ESX NIC teaming members.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
Data Mover 3
Data Mover 2
29
The command below shows an example of assigning two IP addresses to the same virtual interface named lacp1:
$ server_ifconfig server_2 -all server_2: lacp1-1 protocol=IP device=lacp1 inet=192.168.16.2 netmask=255.255.255.0 broadcast=192.168.16.255 UP, Ethernet, mtu=9000, vlan=276, macaddr=0:60:48:1b:76:92 lacp1-2 protocol=IP device=lacp1 inet=192.168.16.3 netmask=255.255.255.0 broadcast=192.168.16.255 UP, Ethernet, mtu=9000, vlan=276, macaddr=0:60:48:1b:76:93
To enable jumbo frames for the link aggregation interface in the previous step, run the following command to increase the MTU size:
$ server_ifconfig server_2 lacp1-1 mtu=9000
To verify if the MTU size is set correctly, run the following command:
$ server_ifconfig server_2 lacp1-1 server_2: lacp1 protocol=IP device=lacp1 inet=192.168.16.2 netmask=255.255.255.0 broadcast=192.168.16.255 UP, Ethernet, mtu=9000, vlan=276, macaddr=0:60:48:1b:76:92
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
30
Figure 7.
vSwitch configuration
The NIC teaming load balancing policy for the vSwitch needs to be set to Route based on IP hash as shown below.
Figure 8.
Load-balancing policy
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
31
A vSwitch, by default, is configured with 24 or 120 virtual ports (depending on the ESX version), which may not be sufficient in a VDI environment. On the ESX servers that host the virtual desktops, each port is consumed by a virtual desktop. Set the number of ports based on the number of virtual desktops that will run on each ESX server. Note Reboot the ESX server for the changes to take effect.
Figure 9.
If an ESX server goes down or needs to be placed in maintenance mode, other ESX servers within the cluster must accommodate the additional virtual desktops that are migrated from the ESX server that goes offline. One must take into account the worstcase scenario when determining the maximum number of virtual ports per vSwitch. If there are not enough virtual ports, the virtual desktops will not be able to obtain IP addresses from the DHCP server.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
32
In order for a VMkernel port to access the NFS datastores using jumbo frames, the MTU size for the vSwitch to which the VMkernel port belong must be set accordingly using the following ESX command:
# esxcfg-vswitch m 9000 vSwitch0
To verify if the MTU size is set correctly, run the following command:
# esxcfg-vswitch l vSwitch0
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
33
Cabling
Because the Data Mover connections for the two 10 gigabit network ports are spread across two Nexus switches and LACP is configured for the two Data mover ports, virtual PortChannel (vPC) must be configured on both switches. The following excerpt is an example of the switch configuration pertaining to the vPC setup for one of the Data Mover ports. The configuration on the peer Nexus switch is mirrored for the second Data Mover port.
n5k-1# show running-config feature vpc vpc domain 2 peer-keepalive destination <peer-nexus-ip> interface port-channel3 description channel uplink to n5k-2 switchport mode trunk vpc peer-link spanning-tree port type network interface port-channel4 switchport mode trunk vpc 4 switchport trunk allowed vlan 275-277 interface Ethernet1/4 description 1/4 vnx dm2 fxg-1-0 switchport mode trunk switchport trunk allowed vlan 275-277 channel-group 4 mode active
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
34
interface Ethernet1/5 description 1/5 uplink to n5k-2 1/5 switchport mode trunk channel-group 3 mode active interface Ethernet1/6 description 1/6 uplink to n5k-2 1/6 switchport mode trunk channel-group 3 mode active
To verify if the vPC is configured correctly, run the following command on both switches and the output should look like this:
n5k-1# show vpc Legend: (*) - local vPC is down, forwarding via vPC peer-link vPC domain id : Peer status : vPC keep-alive status : Configuration consistency status: vPC role : Number of vPCs configured : Peer Gateway : Dual-active excluded VLANs : 2 peer adjacency formed ok peer is alive success secondary 1 Disabled -
vPC Peer-link status -----------------------------------------------------------------id Port Status Active vlans ---------- ----------------------------------------------1 Po3 up 1,275-277 vPC status -----------------------------------------------------------------id Port Status Consistency Reason Active vlans ------ ----------- ------ ----------- --------------- ----------4 Po4 up success success 275-277
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
35
Figure 10.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
36
Installation overview
This section provides an overview of the configuration of the following components: Desktop pools Storage pools FAST Cache VNX Home Directory The installation and configuration steps for the following components are available on the Citrix (www.citrix.com), VMware (www.vmware.com), and Cisco (www.cisco.com) websites: Citrix XenDesktop 5 VMware ESX 4.1 VMware vSphere 4.1 Cisco UCS and Nexus switches The installation and configuration steps for the following components are not covered: Microsoft System Center Configuration Manager (SCCM) Microsoft Active Directory, DNS, and DHCP Microsoft SQL Server 2008 SP2
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
37
2. 3.
HTTP access to vCenter SDK: 1. 2. Log in to the vCenter Server and open C:\Documents and Settings\All Users\Application Data\VMware\VMware VirtualCenter\proxy.xml file. Navigate to the tag where serverNamespace=/sdk. Do not modify the /sdkTunnel properties.
<e id="5"> <_type>vim.ProxyService.LocalServiceSpec</_type> <accessMode>httpAndHttps</accessMode> <port>8085</port> <serverNamespace>/sdk</serverNamespace> </e>
3. 4.
Change accessMode to httpAndHttps. Alternatively, set accessMode to httpOnly to disable HTTPS. Repeat steps 2 and 3 for serverNamespace=/. This change is required in XenDesktop 5 in order for MCS to function correctly. It is not required in previous XenDesktop versions. Save the file and restart the vmware-hostd process using the following command. You may have to reboot the vCenter Server if SDK is inaccessible after restarting the process:
service mgmt-vmware restart
5.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
38
Figure 11.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
39
4.
On the Machine Type page, select Dedicated from the Machine type list box and click Next.
Figure 12. 5.
On the Master Image page, select the cluster host from which the virtual desktops are to be deployed. Click the button to select a virtual machine or VM snapshot as the master image. Click Next to proceed.
Figure 13.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
40
6.
On the Number of VMs page, enter the number of virtual machines to create and adjust the VM specification if needed. Click Next.
Figure 14. 7.
On the Create Accounts page, select an Active Directory container to store the computer accounts. Enter the account naming scheme of your choice. An example of xd#### will create computer account names xd0001 through xd0500. These names are also used when virtual machines are created. Click Next.
Figure 15.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
41
8. 9.
On the Administrators page, make any required changes and click Next. On the Summary page, verify the settings for the catalog, name the catalog, and click Finish to start the deployment of the machines.
Figure 16.
10. You can check the machine creation status by monitoring the green progress bar while you browse the list of catalogs. Once the machines are created, they need to be added to a desktop group before any user can access the virtual desktops.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
42
Throttle commands The number of concurrent requests sent from XenDesktop controllers to the vCenter to vCenter Server Server can be adjusted to either expedite powering on/off of virtual machines, or back off the number of concurrent operations so the VMware infrastructure is not overwhelmed. Complete the following steps to change the throttle rate: 1. 2. Open Desktop Studio on one of the XenDesktop 5 controllers in Start > All Programs > Citrix > Desktop Studio. Expand Configuration, and select Hosts in the left-hand pane.
Figure 17. 3.
Select Hosts
In the right-hand pane, right-click on the existing host connection and select Change details.
Figure 18. 4.
Figure 19.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
43
5.
In the Advanced Host Details window, make the required changes and click OK twice to save the changes.
XenDesktop controllers manage the number of idle virtual desktops based on time, and automatically optimize the idle pool settings in the desktop group based on the number of virtual desktops in the group. The default idle pool settings need to be adjusted according to customer requirements to have virtual machines powered on in advance to avoid a boot storm scenario. During the validation testing, the idle desktop count is set to match the number of desktops in the group to ensure that all desktops are powered on in a steady state, and ready for client connections immediately. Complete the following steps to change the idle pool settings for a desktop group that consists of dedicated machines: 1. 2. 3. 4. 5. Open Desktop Studio on one of the XenDesktop 5 controllers in Start > All Programs > Citrix-Desktop Studio. Select Desktop Studio in the left-hand pane. Select the Powershell tab in the right-hand pane. Select Launch PowerShell in the bottom-right-hand corner of the right-hand pane. In the PowerShell window, enter the following command where XD5DG1 is the desktop group name, and PeakBufferSizePercent and OffPeakBufferSizePercent are percentages of desktops to be powered up during peak and off-peak hours:
PS C:\> set-BrokerDesktopGroup XD5DG1 PeakBufferSizePercent 100 -OffPeakBufferSizePercent 100
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
44
Storage components
Storage pools Storage pools in the EMC VNX OE support heterogeneous drive pools. In this solution, a RAID 5 storage pool was configured from 20 SAS drives. Twenty 200 GB thick LUNs were created from this storage pool as shown in the following figure. FAST Cache was enabled for the pool.
The default number of threads dedicated to serve NFS requests is 384 per Data Mover on VNX. Since 1000 desktop connections are required in this solution, it is recommended to increase the number of active NFS threads to the maximum of 2048 on each Data Mover. The nthreads parameter can be set using the following command: #server_param server_2 facility nfs modify nthreads value 2048 Reboot the Data Mover for the change to take effect. Type the following command to confirm the value of the parameter: #server_param server_2 facility nfs info nthreads
VNX file software contains a performance fix that significantly reduces NFS write latency. The minimum software patch required for the fix is 7.0.13.0. In addition to the patch upgrade, the performance fix only takes effect when the NFS file system is mounted using the uncached option as shown below: #server_mount server_2 option uncached fs1 /fs1
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
45
The uncached option can be verified using the following command: #server_mount server_2
server_2 : root_fs_2 on / uxfs,perm,rw root_fs_common on /.etc_common uxfs,perm,ro userprofiles on /userprofiles uxfs,perm,rw homedir on /homedir uxfs,perm,rw InfraOS on /InfraOS uxfs,perm,rw,uncached pool_nfs_1_fs1 on /pool_nfs_1_fs1 uxfs,perm,rw,uncached pool_nfs_2_fs2 on /pool_nfs_2_fs2 uxfs,perm,rw,uncached pool_nfs_3_fs3 on /pool_nfs_3_fs3 uxfs,perm,rw,uncached pool_nfs_4_fs4 on /pool_nfs_4_fs4 uxfs,perm,rw,uncached pool_nfs_5_fs5 on /pool_nfs_5_fs5 uxfs,perm,rw,uncached pool_nfs_6_fs6 on /pool_nfs_6_fs6 uxfs,perm,rw,uncached pool_nfs_7_fs7 on /pool_nfs_7_fs7 uxfs,perm,rw,uncached pool_nfs_8_fs8 on /pool_nfs_8_fs8 uxfs,perm,rw,uncached
FAST Cache is enabled as an array-wide feature in the system properties of the array in Unisphere. Click the FAST Cache tab, then click Create, and select the Flash drives to create the FAST Cache. There are no user-configurable parameters for FAST Cache.
Figure 22.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
46
To enable FAST Cache for any LUN in a pool, go to the pool properties in Unisphere and click the Advanced tab. Select Enabled to enable FAST Cache, as shown in the following figure.
The VNX Home Directory installer is available on the NAS Tools and Applications CD for each VNX OE for file release, and can be downloaded from the EMC online support website. After the VNX Home Directory feature is installed, use the Microsoft Management Console (MMC) snap-in to configure the feature. A sample configuration is shown in the following two figures.
Figure 24.
MMC snap-in
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
47
For any user account that ends with a suffix between 1 and 1,000, the sample configuration shown in the following figure automatically creates a user home directory in the following location and maps the H: drive to this path: \userdata1_fs file system in the format \userdata1_fs\<domain>\<user> Each user has exclusive rights to the folder.
Figure 25.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
48
Profile characteristic
Number of virtual desktops Virtual desktop OS CPU per virtual desktop Number of virtual desktops per CPU core RAM per virtual desktop Desktop provisioning method Average storage available for each virtual desktop Average IOPS per virtual desktop at steady state Average peak IOPS per virtual desktop during boot storm Number of datastores to store virtual desktops Number of virtual desktops per data store
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
49
Profile characteristic
Disk and RAID type for datastores Disk and RAID type for CIFS shares to host roaming user profiles and home directories Number of VMware clusters Number of ESX servers per cluster Number of VMs per cluster
Value
RAID 5, 300 GB, 15k rpm, 3.5 SAS disks RAID 6, 2 TB, 7200 RPM, 3.5 NL-SAS disks 2 8 500
Use cases
Four common use cases were executed to validate whether the solution performed as expected under heavy load situations. The tested use cases are listed below: Simultaneous boot of all desktops Full antivirus scan of all desktops Installation of a security update using SCCM on all desktops Login and steady state user load simulated using the Login VSI medium workload on all desktops In each use case, a number of key metrics are presented showing the overall performance of the solution.
Login VSI
To run a user load against the desktops, the Virtual Session Index (VSI) tool was used. VSI provided the guidance to gauge the maximum number of users a desktop environment can support. The Login VSI workload can be categorized as light, medium, heavy, and custom. A medium workload was selected for testing and had the following characteristics: The workload emulated a medium knowledge worker who uses Microsoft Office, Internet Explorer, and Adobe Acrobat Reader. After a session started, the medium workload repeated every 12 minutes. The response time was measured every 2 minutes during each loop. The medium workload opened up to five applications simultaneously. The type rate was 160 ms for each character. The medium workload in VSI 2.0 was approximately 35 percent more resourceintensive than VSI 1.0. Approximately 2 minutes of idle time were included to simulate real-world users.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
50
Each loop of the medium workload opened and used the following applications: Microsoft Outlook 2007Browsed 10 messages. Microsoft Internet ExplorerOne instance was left open to BBC.co.uk, one instance browsed Wired.com, Lonelyplanet.com, and a heavy Flash application gettheglass.com (not used with MediumNoFlash workload). Microsoft Word 2007One instance to measure the response time, and one instance to edit a document. Bullzip PDF Printer and Adobe Acrobat ReaderThe Word document was printed, and the PDF was reviewed. Microsoft Excel 2007A very large sheet was opened and random operations were performed. Microsoft PowerPoint 2007A presentation was reviewed and edited. 7-zipUsing the command line version, the output of the session was zipped. Login VSI launcher A Login VSI launcher is a Windows system that launches desktop sessions on target virtual desktops. There are two types of launchersmaster and slave. There is only one master in a given test bed, but there can be as many slave launchers as required. The number of desktop sessions a launcher can run is typically limited by CPU or memory resources. Login consultants recommend using a maximum of 45 sessions per launcher with two CPU cores (or two dedicated vCPUs) and 2 GB RAM, when the GDI limit has not been tuned (default). With the GDI limit tuned, this limit extends to 60 sessions per two-core machine. In this validated testing, 1,000 desktop sessions were launched from 48 launchers, for an approximate total of 21 sessions per launcher. Each launcher is allocated two vCPUs and 4 GB of RAM. There were no bottlenecks observed on the launchers during the VSI-based tests. FAST Cache configuration For all tests, FAST Cache was enabled for the storage pool holding the eight datastores used to house the 1,000 desktops.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
51
Figure 26.
During peak load, the disk serviced a maximum of 32 IOPS. FAST Cache and Data Mover cache helped to reduce the disk load.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
52
The following graph shows the LUN IOPS, and response time from one of the datastores. Because the statistics from each LUN were similar, a single LUN is reported for clarity and readability of the graph.
Figure 27.
During peak load, the LUN response time did not exceed 4 ms and the datastore serviced over 2,500 IOPS.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
53
The following graph shows the total IOPS serviced by the storage processor during the test.
Figure 28.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
54
The following graph shows the storage processor utilization during the test. The poolbased LUNs were split across both SPs to balance the load equally.
Figure 29.
The virtual desktops generated high levels of I/O during the peak load of the boot storm test, while the SP utilization remained below 45 percent.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
55
The following graph shows the IOPS serviced from FAST Cache during the boot storm test.
Figure 30.
At peak load, FAST Cache serviced over 33,000 IOPS from the datastores. The FAST Cache hits include IOPS serviced by Flash drives and SP memory cache. If memory cache hits are excluded, the pair of Flash drives alone serviced roughly 19,000 IOPS at peak load. A sizing exercise using EMC's standard performance estimate (180 IOPS) for 15k rpm SAS drives suggests that it would take roughly 106 SAS drives to achieve the same level of performance. However, EMC does not recommend using a 106:2 (53:1) ratio for SAS to SSD replacement. EMC's recommended ratio is 20:1 because workloads may vary.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
56
The following graph shows the Data Mover CPU utilization during the boot storm test. The Data Mover briefly achieved a CPU utilization of approximately 60 percent during peak load in this test.
Figure 31.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
57
The following graph shows the NFS operations per second on the Data Mover during the boot storm test. At peak load, the Data Mover serviced nearly 65,000 IOPS for 1,000 desktops, yielding an average of 65 IOPS per desktop during boot storm.
Figure 32.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
58
The following graph shows the CPU load from the ESX servers in the VMware clusters. Each server had similar results, so only a single server is reported.
Figure 33.
The ESX server briefly achieved a CPU utilization of approximately 50 percent during peak load in this test. It should be noted that hyperthreading was enabled to double the number of logical CPUs.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
59
The following graph shows the Average Guest Millisecond/Command counter, which is shown as GAVG in esxtop. This counter represents the response time for I/O operations initiated to the storage array.
Figure 34.
The GAVG values for the virtual desktop storage on the datastores were below 11 ms. This indicates excellent performance under this load.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
60
Antivirus results
Test methodology This test was conducted by scheduling a full scan of all desktops with a custom script using McAfee 8.7. The full scans were started on all the desktops over the course of 15 minutes. The total start-to-finish time was approximately 137 minutes. The following graph shows the disk I/O for a single SAS drive in the storage pool that housed the virtual desktops. Because the statistics from all drives in the pool were similar, only a single drive is reported for clarity and readability of the graph.
Figure 35.
Although the IOPS serviced by the individual drives in the pool reached as high as 76 IOPS, the disk response time was capped at 4 ms.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
61
The following graph shows the LUN IOPS and response time from one of the datastores. Because the statistics from each LUN were similar, only a single LUN is reported for clarity and readability of the graph.
Figure 36.
During peak load, the LUN response time remained within 10 ms, and the datastore serviced over 700 IOPS. The majority of the read I/O was served by the FAST Cache and not by the pool LUN.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
62
The following graph shows the total IOPS serviced by the storage processor during the test.
Figure 37.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
63
The following graph shows the storage processor utilization during the test.
Figure 38.
The antivirus scan operations caused moderate CPU utilization during peak load. The load is shared between two SPs during the scan of each collection. The EMC VNX series has sufficient scalability headroom for this workload.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
64
The following graph shows the IOPS serviced from FAST Cache during the test.
Figure 39.
At peak load, FAST Cache serviced nearly 15,000 IOPS from the datastores. The FAST Cache hits include IOPS serviced by Flash drives and SP memory cache. If memory cache hits are excluded, the pair of Flash drives alone serviced almost all of the 15,000 IOPS at peak load. A sizing exercise using EMC's standard performance estimate (180 IOPS) for 15k rpm SAS drives suggests that it would take roughly 84 SAS drives to achieve the same level of performance. However, EMC does not recommend using a 84:2 (42:1) ratio for SAS to SSD replacement. EMC's recommended ratio is 20:1 because workloads may vary.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
65
The following graph shows the Data Mover CPU utilization during the antivirus scan test. The Data Mover briefly achieved a CPU utilization of approximately 48 percent during peak load in this test.
The following graph shows the NFS operations per second from the Data Mover during the antivirus scan test. At peak load, the Data Mover serviced nearly 38,000 IOPS for 1,000 desktops, yielding an average of 38 IOPS per desktop during antivirus scans.
Figure 41.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
66
The following graph shows the CPU load from the ESX servers in the VMware clusters. A single server is reported because each server had similar results.
Figure 42.
The CPU load on the ESX server was well within acceptable limits during this test. It should be noted that hyperthreading was enabled to double the number of logical CPUs.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
67
The following graph shows the Average Guest Millisecond/Command counter, which is shown as GAVG in esxtop. This counter represents the response time for I/O operations issued to the storage array.
Figure 43.
The peak GAVG value for the virtual desktop storage never crossed 50 ms. The FAST Cache performed an enormous amount of read operations during this test.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
68
Figure 44.
The drives did not get saturated during the patch download phase. During the patch installation phase, the disk serviced as many as 297 IOPS at peak load while a response time spike of 22 ms was recorded within the 7-minute interval.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
69
The following graph shows the LUN IOPS and response time from one of the datastores. Because the statistics each LUN in the pool were similar, the statistics of a single LUN are shown for clarity and readability of the graph.
Figure 45.
During peak load, the LUN response time was below 5 ms, and the datastore serviced nearly 700 IOPS.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
70
The following graph shows the total IOPS serviced by the storage processor during the test.
Figure 46.
During peak load, the storage processors serviced over 16,000 IOPS. The load is shared between two SPs during the patch install operation on each collection of virtual desktops.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
71
The following graph shows the storage processor utilization during the test.
Figure 47.
The patch install operations caused moderate CPU utilization during peak load. The EMC VNX series has sufficient scalability headroom for this workload.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
72
The following graph shows the IOPS serviced from FAST Cache during the test.
Figure 48.
At peak load, FAST Cache serviced over 11,000 IOPS from the datastores. The FAST Cache hits include IOPS serviced by Flash drives and SP memory cache. If memory cache hits are excluded, the pair of Flash drives alone serviced over 5,000 IOPS at peak load. A sizing exercise using EMC's standard performance estimate (180 IOPS) for 15k rpm SAS drives suggests that it would take roughly 28 SAS drives to achieve the same level of performance.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
73
The following graph shows the Data Mover CPU utilization during the patch install test. The Data Mover briefly achieved a CPU utilization of approximately 20 percent during peak load in this test.
The following graph shows the NFS operations per second from the Data Mover during the patch install test. At peak load, the Data Mover serviced over 16,000 IOPS for 1,000 desktops, yielding an average of 16 IOPS per desktop during patch install.
Figure 50.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
74
The following graph shows the CPU load from the ESX servers in the VMware clusters. Because each server had similar results, the results from a single server are shown for clarity and readability of the graph.
Figure 51.
The ESX server CPU load was well within the acceptable limits during the test. It should be noted that hyperthreading was enabled to double the number of logical CPUs.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
75
The following graph shows the Average Guest Millisecond/Command counter, which is shown as GAVG in esxtop. This counter represents the response time for the I/O operations issued to the storage array.
Figure 52.
The GAVG values for virtual desktop storage on the datastores were below 10 ms for almost all data points.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
76
Figure 53.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
77
To simulate a login storm, 1,000 desktops are powered up into a steady state by setting the idle desktop count to 1,000. The login time of each session is then measured by starting a LoginVSI test to establish the sessions with a custom interval of three seconds. The 1,000 sessions are logged in within 51 minutes, a period that models a burst of login activity that takes place in the opening hour of a production environment. The LoginVSI tool has a built-in login timer that measures from the start of the logon script defined in the Active Directory group policy to the start of the LoginVSI workload for each session. Although it does not measure the total login time from an end-to-end user perspective, the measurement gives a good indication of how sessions will be affected in a login storm scenario. The following figure shows the trend of the login time in seconds as sessions started in rapid succession. The average login time for 1,000 sessions is approximately 4.7 seconds. The maximum login time is recorded at 17.3 seconds, while the minimum login time is 2 seconds. All users should receive their desktop sessions with a reasonable delay.
Figure 54.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
78
The following graph shows the disk IOPS from one of the datastores. Because the statistics from each disk were similar, only a single disk is reported for clarity and readability of the graph.
Figure 55.
During peak load, the SAS disk serviced less than 100 IOPS and the disk response time was less than 8 ms.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
79
The following graph shows the LUN IOPS and response time from one of the datastores. Because the statistics from each LUN were similar, only a single LUN is reported for clarity and readability of the graph.
Figure 56.
During peak load, the LUN response time remained under 2 ms and the datastore serviced nearly 700 IOPS.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
80
The following graph shows the total IOPS serviced by the storage processor during the test.
The following graph shows the storage processor utilization during the test.
Figure 58.
The storage processor peak utilization was below 30 percent during the logon storm. The load is shared between two SPs during the VSI load test.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
81
The following graph shows the IOPS serviced from FAST Cache during the test.
Figure 59.
At peak load, FAST Cache serviced over 10,000 IOPS from the datastores. The FAST Cache hits include IOPS serviced by Flash drives and SP memory cache. If memory cache hits are excluded, the pair of Flash drives alone serviced nearly 8,000 IOPS at peak load. A sizing exercise using EMC's standard performance estimate (180 IOPS) for 15k rpm SAS drives suggests that it would take roughly 45 SAS drives to achieve the same level of performance.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
82
The following graph shows the Data Mover CPU utilization during the Login VSI test. The Data Mover briefly achieved a CPU utilization of approximately 22 percent during peak load in this test.
The following graph shows the NFS operations per second from the Data Mover during the Login VSI test. At peak load, the Data Mover serviced nearly 10,000 IOPS for 1,000 desktops, yielding an average of 10 IOPS per desktop during logon storm.
Figure 61.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
83
The following graph shows the CPU load from the ESX servers in the VMware clusters. A single server is reported because each server had similar results.
Figure 62.
The CPU load on the ESX server was never more than 50% utilization during steady state. It should be noted that hyperthreading was enabled to double the number of logical CPUs.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
84
The following graph shows the Average Guest Millisecond/Command counter, which is shown as GAVG in esxtop. This counter represents the response time for I/O operations issued to the storage array.
Figure 63.
The GAVG values for the virtual desktop storage on the datastores were well below 5 ms during the peak load.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
85
25
20 15 10 5 0 1 2
10 11 12 13 14 15
Figure 64.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
86
The following graph shows that the antivirus scan completed in 137 minutes with FAST Cache enabled, compared to 158 minutes without FAST Cache. With FAST Cache enabled, the overall scan time was reduced by roughly 13%, and the peak response time was reduced by 21%.
50
40 30 20 10 0 1 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106 113 120 127 134 141 148 155 Minutes to scan 1000 desktops 2 Flash + 20 SAS 50 SAS
Figure 65.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
87
The graph below shows the peak host response time during patch storm without FAST Cache is roughly 1.8 times higher than with FAST Cache.
0
1 5 9 13 17 21 25 29 33 37 41 45 49 53 57 61 65
Time (mins)
2 Flash + 20 SAS 50 SAS
Figure 66.
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
88
Chapter 7: Conclusion
7
Summary
Conclusion
This chapter summarizes our test results and includes the following sections: Summary References
As shown in the previous chapter, EMC VNX FAST Cache provides measurable benefits in a desktop virtualization environment. It not only reduces response time for both read and write workloads, it effectively supports more users on fewer drives, and greater IOPS density with a lower drive requirement.
References
White papers Refer to the following white papers, available on Powerlink, for information about solutions similar to the one described in this paper:
EMC Infrastructure for Virtual Desktops Enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5 Reference Architecture EMC Infrastructure for Virtual Desktops Enabled by EMC VNX Series(FC), VMware vSphere 4.1, and Citrix XenDesktop 5Reference Architecture EMC Infrastructure for Virtual Desktops Enabled by EMC VNX Series(FC), VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide Deploying Microsoft Windows 7 Virtual Desktops with VMware ViewApplied Best Practices Guide EMC Performance Optimization for Microsoft Windows XP for the Virtual Desktop InfrastructureApplied Best Practices Deploying Microsoft Windows 7 Virtual Desktops with VMware ViewApplied Best Practices Guide
If you do not have access to the above content, contact your EMC representative. Other documentation The following documents are available on the Citrix and Cisco websites:
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
89
Chapter 7: Conclusion
EMC Infrastructure for Virtual Desktops enabled by EMC VNX Series (NFS), Cisco UCS, VMware vSphere 4.1, and Citrix XenDesktop 5Proven Solutions Guide
90