2013 IBM Corporation

Flash Express
Fernando Ferreira ATS System z - zChampion IBM Academy
March 2014
Based on zEC12 TLLB
2013 IBM Corporation
Trademarks
Notes:
Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary
depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that
an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental
costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult
your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any
other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.
This information provides only general descriptions of the types and portions of workloads that are eligible for execution on Specialty Engines (e.g, zIIPs, zAAPs, and IFLs) ("SEs"). IBM authorizes customers to use IBM
SE only to execute the processing of Eligible Workloads of specific Programs expressly authorized by IBM as specified in the Authorized Use Table for IBM Machines provided at
www.ibm.com/systems/support/machine_warranties/machine_code/aut.html (AUT). No other workload processing is authorized for execution on an SE. IBM offers SE at a lower price than General Processors/Central
Processors because customers are authorized to use SEs only to process certain types and/or amounts of workloads as specified by IBM in the AUT.
The following are trademarks or registered trademarks of other companies.
* Other product and service names might be trademarks of IBM or other companies.
The following are trademarks of the International Business Machines Corporation in the United States and/or other countries.
* Registered trademarks of IBM Corporation
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel
Corporation or its subsidiaries in the United States and other countries.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce.
ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.
Java and all Java based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
OpenStack is a trademark of OpenStack LLC. The OpenStack trademark policy is available on the OpenStack website.
TEALEAF is a registered trademark of Tealeaf, an IBM Company.
Windows Server and the Windows logo are trademarks of the Microsoft group of countries.
Worklight is a trademark or registered trademark of Worklight, an IBM Company.
UNIX is a registered trademark of The Open Group in the United States and other countries.
AIX*
BladeCenter*
CICS*
Cognos*
DataPower*
DB2*
DFSMS
EASY Tier
FICON*
GDPS*
PowerHA*
PR/SM
PureSystems
Rational*
RACF*
RMF
Smarter Planet*
Storwize*
System Storage*
System x*
System z*
System z10*
Tivoli*
WebSphere*
XIV*
zEnterprise*
z10
z10 EC
z/OS*
z/VM*
z/VSE*
HiperSockets*
HyperSwap
IMS
InfiniBand*
Lotus*
MQSeries*
NetView*
OMEGAMON*
Parallel Sysplex*
POWER7*
2013 IBM Corporation
Whats New?
Dynamic Reconfiguration of Flash
Express memory
Today, Linux

RHEL V6.4 supports

Flash Express for use with
Temporary Storage*
With z/OS V2.1 announcement, CF
use of Flash Express improves resiliency
for WebSphere

MQSeries

shared
queues
Support for DB2

11 use of Flash
Express planned for 2013, rollback of
DB2 10 support via APAR
Java

SDK7 SR3 and middleware

exploiters are available
Proof Points
37% increase
in transaction throughput
during morning transition
Standalone Dump
19% reduction
in total elapsed time
SVC dump elapsed time
~25% less than
with DASD
28% improvement
in DB2 throughput
WAS Day Trader
8% performance improvement
*SLES 11 SP3 expected late 2013
Flash Express
Notable Increases in Availability and Performance
2013 IBM Corporation
What is it?
Physically comprised of internal storage stored on Flash SSDs on PCI-e
features
Extends IBMs memory management leadership with a new tier of memory,
storage class memory
Provides a secured, resilient and immediately usable solution
Benefits
Automatically improves availability for workloads at critical processing times
Drives availability & performance for workloads that cannot tolerate paging
spikes
Slashes latency for application processing such as during diagnostics
collection
Supported use of large pageable (1MB) pages boosts performance
New operations benefit! Eliminating need for PLPA and common page
datasets
Many planned LE and Middleware exploiters
zEC12/zBC12 offers optional Flash Express memory features
Supported in PCIe I/O drawer along with other PCIe I/O features
Installed in pairs for high availability
A pair provides 1.4 TB of useable storage
A maximum of 4 pairs ( 4 x 1.4 = 5.6 TB) are supported in a system
No HCD/IOCP definitions required
During morning transition,
workloads using Flash Express
reached peak throughput in under
one-fourth (23%) of the time as
compared to when using DASD
During SVC dumps, availability
was 4 times better for address
spaces and twice as good for
systems when using Flash Express
vs. DASD
Storage
Tier
System z
instructions
to read data
Real
Memory
(256 B line)
~100
Instructions
Flash
memory (4K
page)
~100 K
instructions
External
Disk (4K
page)
~5000 K
instructions
L
a
t
e
n
c
y
Test Results
Higher availability, consistent faster performance, faster start of day processing, less disruptive diagnostics
Flash Express Smarter Availability for Smarter Systems
2013 IBM Corporation
What Is Flash Express?
Also referred to as Storage Class Memory (SCM)
Flash Express is internal storage implemented via NAND Flash SSDs (Solid State Drives)
mounted in PCIe Flash Express feature
Plugs into PCIe I/O drawers in pairs
Data security provided on the feature
A pair provides 1.4 TB of useable storage (1 TB = 2
30
bytes)
A maximum of 4 pairs ( 4 x 1.4 = 5.6 TB) are supported in a system
Internal Flash Express is accessed using the new System z architected EADM (Extended
Asynchronous Data Mover) Facility
An extension of the ADM architecture used in the past with expanded storage
Access is initiated with a Start Subchannel instruction
Subchannels used were previously reserved
Definition in IOCDS is not required
The main application of internal Flash Express in zEC12/zBC12 is paging store for z/OS
Where it provides advantages in resiliency and speed
With pageable large pages being introduced in tandem for exceptional performance
zEC12 GA2 and zBC12 New Function
CF exploitation of Flash Express memory
All statements regarding IBM's plans, directions, and intent are subject to change or withdrawal without notice. Any reliance
on these Statements of General Direction is at the relying party's sole risk and will not create liability or obligation for IBM.
2013 IBM Corporation
< 20 ns
5-20 micro sec.
< 10 ms
< 200 ns
Access time
1-3 ms
seconds
CPU
Cache
Random Access
Memory (RAM)
Flash Express
Solid State Drive (SSD) Storage
Spinning Disk Drive
WORM, Tape Library
Relative Access Times for different technologies
2013 IBM Corporation
Flash Express
Flash Express exploitation:
z/OS
z/OS V2.1
z/OS V1.13 with PTFs and the z/OS V1.13 RSM Enablement Offering Web deliverable installed
Pagable Large Pages (1 MB)
z/OS V1.13 enabling PTFs for RSM enhancements
Flash Dynamic Reconfiguration
Optional PLPA and COMMON Page data sets
z/OS V1.13 Language Environment
IMS 12 Common Queue Server exploitation with APAR# PM66866
IMS 13 Common Queue Server storage; IMS 13 DB private storage pools*
DB2 V10* planned
Java SDK7 SR3 and by extension exploiters such as
CICS Transaction Server 5.1
WAS Liberty Profile v8.5
IMS 12 available October 2013
DB2 V11
Traditional WAS 8.0.0x and Traditional WAS 8.5.5 (future) **
- Linux on System z distributions:
SLES 11 SP3.
RHEL 6.4.
**Traditional WAS support is planned for a future date
*DB2 10 support for V10 with APARs is planned.. IMS 13 support is
planned
.
Flash Express Exploitation on zEC12/zBC12
2013 IBM Corporation
Paging
z/OS paging subsystem will work with mix of internal Flash Express and
External Disk
Self Tuning based on measured performance
Improved Paging Performance, Simplified Configuration
Begin Paging 1 MB Large Pages only to Flash Express
Exploit Flashs random I/O read rate to gain CPU performance by enabling additional
use of Large Pages. Currently large pages are not pagable.
Begin Speculative Page-In of 4K Pages
Exploit Flashs random I/O read rate to get Improved Resilience over Disruptions.
Market Open, Workload Failover,
Flash Express is a faster paging device compared to a hard disk
The value is NOT in replacing memory with flash but replacing disk with Flash Express
Flash Express is suitable for workloads that can tolerate paging and will not benefit workloads that cannot
afford to page
z/OS FLASH Use Cases
2013 IBM Corporation
Pre-fetching on Page Fault
z/OS leverages Flashs fast random reads to bring in additional pages with
spatial locality
z/OS is also exploring pre-fetching of more distant pages with temporal locality
by employing algorithms such as stride pre-fetching
Compute the strides of the next couple of pages likely to be referenced by recording
the offset of the current target page address and the last two faulting addresses
z/OS Paging Pre-fetching from Flash Express
2013 IBM Corporation
LFAREA Parameter
Enhanced IEASYSxx parameter - LFAREA
Enhanced to support the use of 2 GB large pages
The LFAREA parameter can be specified as:
LFAREA = ( [1M=req] [,2 GB=req] [,prompt | noprompt] )
Note: The old form of the LFAREA keyword is still supported:
LFAREA = (xx% | mmmmmmM | ggggggG | ttttttT)
Usage Enhancements
IARV64 GETSTOR enhanced to support the request for 2 GB large pages
2013 IBM Corporation
z/OS Flash Express Use Cases
Dumping
Minimize SVC Dump duration, System impact
Flash Express performance during SDUMP
Flash Express performance after SDUMP
Reduce Stand Alone Dump duration
Read time for paged out data
2013 IBM Corporation
z/OS Flash Express Use Cases
CF
Migration
Structure Real Memory Usage
If migration to Flash keeps up, structure real memory
never fills, so write activity continues to be satisfied
at real memory speeds
If migration does not keep up, there is the potential
that structure real memory will fill up, at which point
writes would be delayed until migration catches up
enough to free up sufficient real memory objects to
permit the new writes to succeed
If prefetching is successful, the GET requests for
objects never have to wait for anything to be brought
back into real, and thus these references continue to
be satisfied at real memory speeds.
If prefetching does not keep up, there is the potential
that an object would be requested/referenced that is
still in Flash. At this point, a Flash fault occurs, and
the request would be delayed until the necessary
objects are brought back in to real memory.
Note: CF requests never wait synchronously for Flash
accesses to take place the delayed requests always
return to z/OS, who redrives them to the CF in hopes
that the CF will have resolved the Flash fault by then.
Pre Fetch
2013 IBM Corporation
+
Flash Express:
Prereqs:
zEC12/zBC12, with Flash Express feature
Flash feature pair memory size is 1.4 TB
Min: 1 feature Pair = > Max: 4 feature
Pairs
Mirroring across pairs for resiliency
Typical configuration: 1 feature pair
Configuration/Setup:
Prior to Enablement; features will be on
line, unformatted
Firmware update delivery will be handled
through zEC12/zBC12 Bundle process
Firmware update via concurrent patch
Config off/on for enablement
Array build via H/W setup (CE/SE)
z/OS (Flash, Pageable Large Pages)
Prereqs:
V1.13 + Web deliverable + SPEs. Web
deliverable also contains enabling PTF:
Dynamic reconfiguration
2GB Pages (not dependent on Flash Express)
4GB Real Storage needed for pageable large
pages (not specific to Flash Express)
Configuration/Setup:
At IPL, z/OS detects if flash is assigned to the
partition. z/OS automatically uses Flash
Express for paging unless specified otherwise
via PAGESCM=NONE
All paging data can easily reside on Flash
Express
No need for fine grained capacity planning
No definition required for placement of data on
flash
Flash Express uses sub-channels. These are
allocated from the .25K reserved in sub-
channel set 0
Flash Express Requirements
2013 IBM Corporation
Typical Customer Configurations for FLASH
Flash Express feature pair useable memory size is 1.4TB
Min: 1 feature Pair
Typical customer configuration is 6 to 8 LPARs per CPC and 40 GB -
80GB for paging configuration dataset size
Even with 10 LPARs per CPC, each LPAR has 160 GB of flash memory
available for its paging datasets, more than double the current typical
customer configuration
All paging data can easily reside on Flash Express
Data will preferably go to flash and only go to disk (if any) when flash is full
No intelligent placement of data on internal flash needed
2013 IBM Corporation
4 x SSD cards. Each 400 GBs
Flash Express PCIe Adapter feature
2013 IBM Corporation
2 ports to form
A RAID 10 Mirrored
Pair with the 2
nd
Flash Express
feature
Flash Express PCIe Adapter feature with 2 ports to form a
RAID 10 Mirrored Pair
2013 IBM Corporation
Twin-Cable interconnect between the
two Flash Express features in slots 1 and 14
Flash Express - Twin-Cable to Form a RAID 10 Mirrored Pair
Flash Express features are always
installed in pairs
Maximum 4 pairs in a System
Installed in a PCIe I/O Drawer in 2
different I/O Domains
Maximum of 2 pairs installed in a
drawer
One Flash Express feature per Domain
only
Greater than 2 pairs will require a
second PCIe I/O Drawer
eConfig will reserve a slot in each
Domain in case Flash Express is
ordered in the future
Features are first installed in the front of
the installed drawers (slots 1 and 14)
before using the rear slots (25 and 33)
Flash Express features are cabled
together to form a RAID 10 Mirror for
redundancy
Data on the Flash feature is protected
with a unique key stored on the Support
Element (SE) harddisk
Only useable on the system with the
key that encrypted it
Secure Key Store is implemented via a
Smart Card that plugs into the SE
Smart Card reader
Smart Card contains both a unique key
personalised for each system and a
small Crypto engine that can perform a
set of security functions within the card
AES encryption
2013 IBM Corporation
z/OS z/OS
System z
Main
Memory
SCM
SPACE
Data transfer between
Main Memory and
Storage Class Memory
is via EADMF (4KB or
1MB blocks)
Main
Memory
Storage Class
Memory (SCM)
Partition
Maximum
Partitio
n Initial
Value
Partition
Initial
Value
Partition
Initial
Value
Partition
Maximum
LP2 LP1
Storage Class
Memory (SCM)
SCM
SPACE
Full virtualization of physical
Flash Express features across
partitions, software sees an
Abstracted Flash Storage
Space
Allows each logical partition to
be configured with its own SCM
address space
Allocate Flash Express to
partitions by amount, not card
size
Ability to change underlying
technology while preserving API
No Hardware Specifics in
Software
Error Isolation, Transparent
mirroring, Centralized
diagnostics, etc.
Hardware Logging, FRU Call,
Recovery: Independent of
software
Flash Express Virtualization
2013 IBM Corporation
Paging Dataset
HDDs or SSDs
FLASH
Main Memory
Check Data Characteristics
(i.e must reside on flash or
must reside on disk)
If data can reside on either:
check space availability
- Flash full
If space available on both
check response time
statistics
- Flash is faster
Check Data Characteristics
(i.e must reside on flash or
must reside on disk)
If data can reside on either:
check space availability
- Flash full
If space available on both
check response time
statistics
- Flash is faster
Evict Page
Flash Express vs Disk Placement Criteria
2013 IBM Corporation
Data Type Data Page Placement
Pageable Link Pack Area (PLPA)
At IPL/NIP time PLPA pages will be placed both on flash and disk.
VIO
VIO data will always be placed on disk (First to VIO accepting datasets with any
spillover flowing to nonvio datasets)
HyperSwap Critical Address
Space data
If flash space is available, all virtual pages belonging to a HyperSwap Critical
Address Space will be placed on flash memory.
If flash space is not available, these pages will be kept in memory and only
paged to disk when the system is real storage constrained and no other
alternatives exist
Pageable Large Pages
If contiguous flash space is available, pageable large pages will be
preferentially written to flash.
All other data If available space exists on both flash and disk then make a
selection based on response time.
Flash Express vs Disk Placement Criteria
2013 IBM Corporation
Flash Express
Available
Actions
Manage Flash Allocation Task
Select
Add allocation
1
2
3
2013 IBM Corporation
Flash Express Exploitation Considerations
New IEASYSxx parameter - PAGESCM
NONE - do not use flash memory for paging
ALL all flash memory is reserved for paging (default)
0, 0M, 0G, 0T - no flash memory is reserved for paging, allocated as needed for
demand paging
Defaults to ALL
New messages issued at IPL
IAR032I USE OF STORAGE-CLASS MEMORY FOR PAGING IS NOT ENABLED
PAGESCM= NONE
IAR031I USE OF STORAGE-CLASS MEMORY FOR PAGING IS ENABLED -
PAGESCM=ALL, ONLINE=00032768M
IAR031I USE OF STORAGE-CLASS MEMORY FOR PAGING IS ENABLED
PAGESCM=00000000M, ONLINE=00032768M
Specification of PLPA and COMMON paging data set is now optional
PLPA/COMMON (*NONE*)
2013 IBM Corporation
Flash Express Exploitation Considerations
Display M command
Initial
Maximum - Initial
Maximum
2013 IBM Corporation
Flash Express Exploitation - RMF Considerations
RMF Page Data Set Activity (Monitor I and Monitor II):
New entry for SCM space in report and SMF records
RMF Paging Activity (Monitor I):
SCM Paging Block data added to report and SMF records
RMF Monitor III STORM Storage Memory Objects Data Table is enhanced
to display SCM information
2013 IBM Corporation
Integrated Flash memory provides a integrated storage. RAS is provided in layers
The storage is spread over two features which mirror to each other (RAID 10). Should either feature fail, the data
is available on the other feature. Feature replacement is concurrent with customer operations.
The data is encrypted with a volatile key such that it is secure if the feature is removed. Uses smart card on the
Support Element
The data is stored over multiple flash devices in a RAID configuration. Should a flash device fail the data is
reconstructed dynamically.
Firmware recovery for general feature failures
Firmware updates are concurrent with customer operations.
Addressing on the PCIe bus to the host is protected by a SAP firmware protocol
The PCIe bus benefits from the redundant I/O interconnect.
Integrated Flash Express
Layered RAS of integrated flash memory
P
C
Ie
P
C
Ie
PCIe IO Drawer
Flash Express Card
P
C
Ie
RAID
Controller
Flash Express Card
P
C
Ie
RAID
Controller
PCIe
Switch
PCIe
Switch
U
n
i
q
u
e

P
R
O
T
O
C
O
L
U
n
i
q
u
e

P
R
O
T
O
C
O
L
S
S
D
S
S
D
S
S
D
S
S
D
Support
Element
Support
Element
ECC Protection
& Encryption
S
S
D
S
S
D
S
S
D
S
S
D
ECC Protection
& Encryption
2013 IBM Corporation
Security of Data on Flash Express
System z internal flash can be used for paging, dumping and .....
It can contain all data, including audited personally identifiable data
Client data on flash is protected by AES Encryption
Done using hardware encryption at the device like IBMs Disk and Tape encryption
Key Management is provided based on a Smart Card
Smart Card Reader installed in the Support Element
End of life Audit is based on access to the Smart Card, not access to the Flash Memory
Secure Cryptographic Erase well understood
SE HD
SE
IOP
HSA RSA Key Pair storage
Private
Public
Flash
SE
Imbedded
Key
Controller
GET_IOP_PUBLIC
SET_IOP_DEVKEY
RSA Key Pair storage
Private
HSA RSA Key Pair storage
Private
Public
HSA RSA Key Pair storage
Private
2013 IBM Corporation
Integrated Key Controller detail
Support Element (SE)
SE
Hard Disk
Integrated
Key
Controller
Support
Element
Serial Number
Flash Encryption Key /
Authentication Key
RSA Private Key
Keys Generated in the Smart Card
AES Flash Encryption Key /
Authentication Key
AES Key-Encrypting Key
RSA Public Key
2013 IBM Corporation
Support Element (SE)
Integrated
Key
Controller
RSA Public Key
Keys Generated in the Smart Card
AES Flash Encryption Key /
Authentication Key
RSA Public Key
AES Key-Encrypting Key
Firmware RSA Key Pair
HSA
Firmware Management of the Flash
Express Adapter
Flash Encryption Key /
Authentication Key
Flash
Public Key
Private Key
SE
Hard Disk
Firmware Public Key
AES Flash
Encryption Key /
Authentication Key
Private Key
Flash Encryption Key /
Authentication Key
AES Flash
Encryption Key /
Authentication Key
Key Serving Topology detail
2013 IBM Corporation
1. Workload Transition
During morning transition, workloads using Flash Express reached peak throughput in under 1/4th the time
Paging to Flash Express during morning transition showed up to a 10 times faster response time and up to a 37% increase in
throughput in the first 45 seconds
VALUE: Ability to start up call center, start trading, resume transactions during heavy morning open period without delays
2. WAS Java Performance Benchmarks
The WAS Day Trader benchmarks showed up to an 8% performance improvement using Flash Express
VALUE: Performance improvements for workloads that leverage Javas use of pageable large pages
This test used 64-bit Java 7 SR3 with JIT code cache & Java Heap leveraging Flash and pageable large pages.
3. Diagnostics
In SVC dumps, availability was up to 4 times higher for workloads and up to twice as high for systems; steady state performance was
achieved up to 4 times faster
In Standalone dump test, a 36 GB dump with Flash Express had a 19% reduction in total dump time
Transaction steady state was reached in 14 seconds with Flash Express, vs. 60 seconds with DASD.
VALUE: During SVC and Standalone dumps, System and Address spaces availability was dramatically increased. This enabled work to
be processed that would otherwise have been stopped.
4. DB2
Up to 28% improvement in DB2 throughput due to faster CPU plus Flash Express with Pageable Large Pages*
Workloads leveraging Flash Express with PLP can see up to a 8%** price performance improvement over the z196.
VALUE: Ability to realize price performance value and faster throughput
* PLP for DB2 helps DB2 to achieve up to 3% additional performance on top of zEC12 CPU expected throughput improvements of
25%.
** Based on average 5% discount for zEC12 workloads under the AWLC pricing plus up to 3% more performance per MSU with Flash
Express.
Note All tests are comparing the use of Flash Express as compared to using DASD (DS8800)
Proof Points Summary for Flash Express
2013 IBM Corporation
z/OS Exploitation Support for zEC12 and zBC12
Release
zEC12 PSP Bucket 2827DEVICE 2827/z/OS
zBC12 PSP Bucket 2828DEVICE 2828/z/OS
Base Support Exploitation Support
B
a
s
e

z
E
C
1
2

S
u
p
p
o
r
t
B
a
s
e

z
B
C
1
2

S
u
p
p
o
r
t
O
S
A
-
E
x
p
r
e
s
s
4
S

(
G
b
e
L
X

a
n
d

S
R
,

1
0
0
0
B
A
S
E
-
T
,

1
0

G
b
e
L
R

a
n
d

S
R
)
F
I
C
O
N

E
x
p
r
e
s
s
8
S

(
C
H
P
I
D

F
C
)
I
F
B

C
o
u
p
l
i
n
g

L
i
n
k
s
C
r
y
p
t
o

E
x
p
r
e
s
s
4
S

T
o
l
e
r
a
t
i
o
n
2
H
i
g
h

P
e
r
f
o
r
m
a
n
c
e

F
I
C
O
N

(
z
H
P
F
)
C
P
U

M
e
a
s
u
r
e
m
e
n
t

F
a
c
i
l
i
t
y

(
H
I
S
)
G
R
S

F
I
C
O
N

C
T
C

T
o
l
e
r
a
t
i
o
n
N
e
w

z
/
A
r
c
h
i
t
e
c
t
u
r
e

I
n
s
t
r
u
c
t
i
o
n
s
O
S
A
-
E
x
p
r
e
s
s
5
S
C
F

L
e
v
e
l

1
8
C
r
y
p
t
o

E
x
p
r
e
s
s
4
S

E
x
p
l
o
i
t
a
t
i
o
n
3
X
L

C
/
C
+
+

A
R
C
H
(
1
0
)
/
T
U
N
E
(
1
0
)
I
B
M

z
A
w
a
r
e
(
z
/
O
S

M
o
n
i
t
o
r
i
n
g
)
T
r
a
n
s
a
c
t
i
o
n
a
l

E
x
e
c
u
t
i
o
n

F
a
c
i
l
i
t
y
F
l
a
s
h

E
x
p
r
e
s
s

(
S
t
o
r
a
g
e

C
l
a
s
s

M
e
m
o
r
y

-
S
C
M
)
P
a
g
e
a
b
l
e
L
a
r
g
e

P
a
g
e
s
D
y
n
a
m
i
c

r
e
c
o
n
f
i
g
u
r
a
t
i
o
n

s
u
p
p
o
r
t

f
o
r

F
l
a
s
h

E
x
p
r
e
s
s
2

G
B

L
a
r
g
e

P
a
g
e
O
p
t
i
o
n
a
l

P
L
P
A
/

C
O
M
M
O
N

p
a
g
e

d
a
t
a

s
e
t

s
u
p
p
o
r
t
2
4
K

s
u
b
c
h
a
n
n
e
l
s

f
o
r

F
I
C
O
N

C
o
u
p
l
i
n
g

t
h
i
n

i
n
t
e
r
r
u
p
t

s
u
p
p
o
r
t
C
F

F
l
a
s
h

E
x
p
l
o
i
t
a
t
i
o
n
C
r
y
p
t
o
g
r
a
p
h
i
c

E
n
h
a
n
c
e
m
e
n
t
s
R
D
M
A

s
u
p
p
o
r
t

f
o
r

z
/
O
S

o
v
e
r

C
o
n
v
e
r
g
e
d

E
n
h
a
n
c
e
d

E
t
h
e
r
n
e
t
J
a
v
a

e
x
p
l
o
i
t
a
t
i
o
n

o
f

R
u
n
t
i
m
e

I
n
s
t
r
u
c
t
i
o
n
s
I
B
M

z
E
n
t
e
r
p
r
i
s
e

D
a
t
a

C
o
m
p
r
e
s
s
i
o
n

(
z
E
D
C
)

u
s
i
n
g

z
E
D
C
E
x
p
r
e
s
s
z/OS V1.12 P P B B B
W
P
P P P P P P W N N N N N N N N P P N N P
6
N P
7
z/OS V1.13 P P B B B
W
P
P P P P P P W P P P
W
P
W
P
W
P
W
P
W
P
P P P W P
6
N P
7
z/OS V2.1
4,5
B B B B B B B B B B B B B B B B B B B B B B B P W B B P
1
The Lifecycle Extension for z/OS V1.10 (5656-A01) is required to acquire toleration PTFs and for support. The Lifecycle Extension for z/OS V1.11 (5657-A01) is
required for support after September 30, 2012 and to acquire PTFs that become available after that date.
2
A Crypto Web Deliverable (HCR7770 or higher) AND a PTF is required for toleration unless CyrptoExpress3 is Carried Forward. Support differs depending on the
Crypto Web Deliverable installed
3
Crypto Exploitation differs based on the Crypto Web Deliverable installed
4
- Planned. All statements regarding IBM's plans, directions, and intent are subject to change or withdrawal without notice.
5
- z/OS V2.1 announced as a preview of availability
6
PTF available for toleration ONLY
7
Software decompression only
B FMID shipped in Base product P PTF is required W FMID shipped in a Web Deliverable
2013 IBM Corporation
Additional Information
z/OS Home Page
http://www.ibm.com/servers/eserver/zseries/z/OS/
zFavorites for System z
http://www.ibm.com/servers/eserver/zseries/z/OS/zfavorites/
z/OS Internet Library
http://www.ibm.com/servers/eserver/zseries/z/OS/bkserv/
IBM System z
http://www.ibm.com/systems/z/
IBM Resource Link
https://app-06.www.ibm.com/servers/resourcelink/hom03010.nsf
IBM Redbooks How-To Books (also Redpieces)
http://www.redbooks.ibm.com/
Preventive Service Planning buckets
http://www14.software.ibm.com/webapp/set2/psp/srchBroker
Enhanced HOLDDATA
http://service.boulder.ibm.com/390holddata.html
2013 IBM Corporation
ZSP03588-USEN-02