Академический Документы
Профессиональный Документы
Культура Документы
Mayura Deshmukh
April 2013
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
This document is for informational purposes only and may contain typographical errors and
technical inaccuracies. The content is provided as is, without express or implied warranties of any
kind.
2013 Dell Inc. All rights reserved. Dell and its affiliates cannot be responsible for errors or omissions
in typography or photography. Dell, the Dell logo, and PowerEdge are trademarks of Dell Inc. Intel and
Xeon are registered trademarks of Intel Corporation in the U.S. and other countries. Microsoft,
Windows, and Windows Server are either trademarks or registered trademarks of Microsoft Corporation
in the United States and/or other countries. Other trademarks and trade names may be used in this
document to refer to either the entities claiming the marks and names or their products. Dell disclaims
proprietary interest in the marks and names of others.
ii
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
Contents
Executive Summary .................................................................................................... 4
FTDW Reference Architectures Using PowerEdge R720xd Server .............................................. 4
12TB Dell R720XD FTDW Reference Architecture ................................................................. 5
Hardware Components .............................................................................................. 5
Internal Storage Controller (PERC H710P Mini) Settings ...................................................... 7
Application Configuration .......................................................................................... 9
Capacity Details .................................................................................................... 10
Performance Benchmarking ...................................................................................... 11
Conclusion ............................................................................................................. 13
References ............................................................................................................. 14
Tables
Table 1: Dell Fast Track Reference Architectures for PowerEdge R720xd Server ............................. 4
Table 2: Tested Dell FTDW Reference Architecture Components ................................................ 5
Table 3: Mount Point Naming and Storage Enclosure Mapping .................................................... 9
Table 4: Capacity Metrics .............................................................................................. 10
Table 5: Performance Metrics ......................................................................................... 11
Figures
Figure 1: Proposed Dell Fast Track Reference Architecture ....................................................... 5
Figure 2: Memory Slot Locations ........................................................................................ 7
Figure 3: Virtual Disk Settings ........................................................................................... 7
Figure 4: Internal Storage Controller Settings ....................................................................... 8
Figure 5: RAID Configuration ............................................................................................ 8
Figure 6: Storage System Components ................................................................................. 9
Figure 7: SQLIO Line Rate Test from Cache (Small 5MB File) .................................................... 12
Figure 8: SQLIO Real Rate Test from Disk (Large 25GB File) .................................................... 12
iii
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
Executive Summary
The performance and stability of any data warehouse solution is based on the integration between
solution design and hardware platform. Choosing the correct solution architecture requires balancing
the applications intended purpose and expected use with the hardware platforms components. Poor
planning, bad design, and misconfigured or improperly sized hardware often lead to increased costs,
increased risks and, even worse, unsuccessful projects.
This white paper provides guidelines to achieve a compact, balanced, optimized 12TB Microsoft SQL
Server 2012 data warehouse configuration for Dell PowerEdge R720 and R720xd servers using
Microsoft Fast Track Data Warehouse (FTDW) principles. Benefits of implementing this reference
architecture include:
Achieve a balanced and optimized system at all levels of the stack by following hardware and
software best practices.
Avoid over-provisioning hardware resources to reduce costs.
Implement a tested and validated configuration with proven methodologies and performance
behaviors to help avoid the pitfalls of improperly designed and configured systems.
Easily migrate from a small- to medium-sized data warehouse configuration (5TB) to a large
data warehouse configuration (12TB).
Data center space comes at a premium. This configuration provides a compact, high-performance
solution for large data warehouses with 12TB of data or more.
As most data warehouse queries scan large volumes of data, FTDW system design and configuration are
optimized for sequential reads and are based on concurrent query workloads. Understanding
performance and maintaining a balanced configuration helps reduce costs by avoiding over provisioning
of components.
Dell provides various Fast Track reference architectures for SQL 2012 built using the Dell PowerEdge
12th Generation servers. These solutions are differentiated depending on the data warehouse capacity
and scan rate requirements. Table 1 summarizes FTDW configurations with Dell R720XD server.
Table 1: Dell Fast Track Reference Architectures for PowerEdge R720xd Server
The 12TB R720XD configuration described in this white paper is also available as a rapid deployment,
with hardware, software, and services included in the Dell Quickstart Data Warehouse Appliance 2000
(QSDW 2000). This configuration provides a low-cost and easier migration path for customers who want
4
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
to go from a 5TB to 12TB solution. For more information on Dell QSDW 2000, see Dell Quickstart Data
Warehouse Appliance.
Hardware Components
Redundant and robust tests have been conducted on PowerEdge servers to determine best practices
and guidelines for building a balanced FTDW system. Table 2 provides the detailed hardware
configuration of the reference architecture.
Component Details
5
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
Processors
The Fast Track Data Warehouse Reference Guide for SQL Server 2012 describes how to achieve a
balance between components such as storage, memory, and processors. To balance available internal
storage and memory for the PowerEdge R720xd, the architecture uses two Intel Xeon E5-2643 four-core
processors operating at 3.3GHz.
Memory
For SQL Server 2012 reference architectures, Microsoft recommends using 128GB to 256GB of memory
for dual-socket configuration. Selection of memory DIMMS will also play a critical role in the
performance of the entire stack.
This configuration was tested with various memory sizes running at different speedsfor example,
192GB running at 1333MHz, 192GB running at 1600MHz, 112GB running at 1600MHz, and so on. Using
DIMMs with memory rate of 1600MHz showed significant performance improvement (about 400MBs/s)
over DIMMS with memory rate of 1333MHz. In the test configuration, the database server is configured
with 128GB of RAM running at 1600 MHz to which create a well-balanced configuration.
To achieve 128GB of RAM on the PowerEdge R720xd server, place eight 16GB RDIMMS in slots A1-A4 and
B1-B4 (white connectors). See Figure 2: Memory Slot LocationsFigure 2 for memory slot locations.
6
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
Read policy
The default setting for the read policy on the PERC H710P Mini is adaptive read ahead. This
configuration was tested with adaptive read ahead, No read ahead, and Read Ahead settings.
7
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
During testing, it was observed that the default setting of adaptive read ahead gave the best
performance.
RAID configuration
When deploying a new storage solution, selecting the appropriate RAID level is a critical decision that
impacts application performance. The FTDW configuration proposed in this paper uses RAID 1 disk
groups for database data files and database log files, nine RAID 1 data disk groups, and one RAID 1 log
disk group, each created with a single virtual disk. Additionally, two drives in RAID 0 are assigned as a
staging area. Figure 5 shows the proposed RAID configuration.
OS
RAID 1 RAID 1 RAID 1 RAID 1 RAID 1 RAID 1 RAID 1 RAID 1 RAID 1 RAID 1 RAID 0 Hot
Data 1 Data 2 Data 3 Data 4 Data 5 Data 6 Data 7 Data 8 Data 9 Logs Stage Spares
H710P Mini
Monolithic
Slots 0-17: Nine RAID 1 disk groups were created, each configured with a single virtual disk
dedicated for the primary user data
Slots 18-19: One RAID 1 disk group created from two disks and a single virtual disk dedicated to
host the database log files
Slots 20-21: RAID 0 disk group created from two disks dedicated for staging
Slots 22-23: Remaining two disks assigned as global hot spares
Slots 24-25 (rear bay drives): One RAID 1 disk group for operating system
For FTDW architectures, it is recommended to use mount-point rather than drive letters for storage
access. It is also important to assign the appropriate virtual disk and mount-point names to the
8
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
Figure 6 represents the storage system configuration for the proposed FTDW reference architecture.
Data file 1 - 9 Data file 1-9 Virtual disk group 1-9 RAID 1
The production, staging, and system temp databases are deployed per the recommendations provided
in the Fast Track Data Warehouse Reference Guide for SQL Server 2012.
Application Configuration
The following sections explain the settings applied to operating system and database layers.
9
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
-E: This parameter increases the number of contiguous extends that are allocated to a
database table in each file as it grows to improve sequential access.
-T1117: This trace flag ensures the even growth of all files in a file group when auto growth is
enabled. It should be noted that the FTDW reference guidelines recommend pre-allocating the
data file space rather than allowing auto-grow.
SQL Server Maximum Memory: FTDW for SQL Server 2012 guidelines suggest allocating no more than
92% of total server RAM to SQL Server. If additional applications will share the server, then adjust the
amount of RAM left available to the operating system accordingly. For this reference architecture, the
maximum server memory was set at 119808 MB (117GB).
Resource Governor: For SQL Server 2012, Resource Governor provides a maximum of 25% of SQL Server
memory resources to each session. The Resource Governor setting can be used to reduce the maximum
memory consumed per query. While it can be beneficial for many data warehouse workloads to limit
the amount of system resources available to an individual session, this is best measured through
analysis of concurrent query workloads. This configuration was tested with both 25% and 19% memory
grant, and the 25% setting was found to be optimal for the proposed configuration. For more
information, see Using the Resource Governor.
Max Degree of Parallelism: The SQL Server configuration option Max degree of parallelism controls
the number of processors used for the parallel execution of a query. For the configuration, settings of
12 and 0 were tested. The default setting of 0 provided maximum performance benefits. For more
information, see Maximum degree of parallelism configuration option.
Capacity Details
Table 4Table 4 shows the capacity metrics reported for the recommended reference configuration.
Raw Data Space (GB) 7695 Raw mirrored/striped space allocated for data
Raw User Database Space Raw user space (without compression) available
5771.3
(GB) after allocating space for tempdb
Raw user space with compression (compression
Maximum User Database factor=3.5).
19
Capacity (TB) This is an estimate for the largest amount of user
data the system will hold.
FTDW Rated Data Warehouse This capacity rating is based on up-to capacity
12
Capacity (TB) but adjusted to account for FTDW rated I/O.
10
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
Performance Benchmarking
Microsoft FTDW guidelines help to achieve optimized database architecture with balanced CPU and
storage bandwidth. Table 5 shows the performance numbers reported for the recommended reference
configuration.
The following sections describe the detailed performance characterization activities carried out for the
validated Dell Microsoft FTDW reference architecture.
The disk characterization tool, SQLIO, was used to validate the configuration. The results in Figure 7
show the maximum baseline that the system can achieve from a cache (called Line Rate). A small file is
placed on the storage, and large sequential reads are issued against it with SQLIO. This test verifies the
maximum bandwidth available in the system to ensure no bottlenecks are within the data path.
11
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
Figure 7: SQLIO Line Rate Test from Cache (Small 5MB File)
INTERNAL STORAGE
RAID 1
SQL Server 2012 RAID 1
RAID 1
PERC H710P RAID 1
Mini RAID 1
Windows Server 2008 R2 SP1 RAID 1
Controller
SQL Server 2012 Enterprise RAID 1
RAID 1 Single RAID 1 Disk Group
Dual Socket Intel Quad core E5-2643
RAID 1 Synthetic I/O rate: 375 MB/s
Aggregate Synthetic I/O rate: 2674 MB/s Intel E5-2643 Intel E5-2643 RAID 1
4 core 4 core RAID 0
CPU CPU
The second synthetic I/O test with SQLIO was performed with a large file to ensure reads are serviced
from the storage system hard drives instead of from cache. Figure 8 shows the maximum real rate that
the system is able to provide with sequential reads.
Figure 8: SQLIO Real Rate Test from Disk (Large 25GB File)
INTERNAL STORAGE
RAID 1
SQL Server 2012 RAID 1
RAID 1
PERC H710P RAID 1
Mini RAID 1
Windows Server 2008 R2 SP1 RAID 1
Controller
SQL Server 2012 Enterprise RAID 1
RAID 1 Single RAID 1 Disk Group
Dual Socket Intel Quad core E5-2643
RAID 1 Synthetic I/O rate: 294 MB/s
Aggregate Synthetic I/O rate: 2613 MB/s Intel E5-2643 Intel E5-2643 RAID 1
4 core 4 core RAID 0
CPU CPU
MCR - MCR indicates the per-core I/O throughput in MB or GB per second. This is measured by
executing a pre-defined query against the data in the buffer cache, and then measuring the
12
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
time taken to execute the query against the amount of data processed in MB or GB. For the
validated configuration with two Intel E5-2643 four-core processors, the system aggregate MCR
was 2488 MB/s. The realized MCR value per core was 311 MB/s.
BCR - BCR is calculated in terms of total read bandwidth from the storage hard drivesnot
from the buffered cache as in the MCR calculation. This is measured by running a set of
standard queries specific to the data warehouse workload. The queries range from I/O
intensive to CPU and memory intensive, and provide a reference to compare various
configurations. For the validated FTDW configuration, the aggregate BCR was 1909 MB/s.
During the evaluation cycle, the system configuration was analyzed for multiple query variants
(simple, average, and complex) with multiple sessions and different degrees of parallelism
(MAXDOP) options to arrive at the optimal configuration. The evaluation results at each step
were validated and verified jointly by Dell and Microsoft.
After the test configuration was validated, CSI was added. Then, the same set of I/O and CPU-intensive
queries were executed to compare throughput achieved using CSI. Throughput rating of 4337.5 MB/s
was achieved for CSI-enhanced benchmarks. These numbers can be used to approximate the positive
impact to query performance expected under a concurrent query workload.
Conclusion
The Dell Microsoft FTDW architecture provides a uniquely well-balanced data warehouse solution. By
following best practices at all stack layers, a balanced data warehouse environment can be achieved
with a greater performance benefits than traditional data warehouse systems.
13
Dell Reference Configuration for 12TB Microsoft SQL Server 2012 Fast Track Data Warehouse
References
Dell Services
www.dell.com\services
Dell Support
www.dell.com\support
14