IBM - The Conference Exchange

Session Title: IBM® zEnterprise™ BladeCenter®
Extension (zBX) Hardware Overview
Session 9025
Speaker Name: Gregory Hutchison
© 2011 IBM Corporation
Agenda 2458-002
 Hardware Overview
 Networking
 Disk/Storage Considerations
–IBM Smart Analytics Optimizer
–IBM POWER7 Blades
 Hardware Management Console
 Reference
© 2011 IBM Corporation
Putting zEnterprise System to the task
z/VM
Blade Virtualization
Blade Virtualization
Future Offering
AIX on
POWER7
Linux on
System x 1
Future Offering
Linux
Linux
on
on
System
z
System
z
Optimizers
DataPower XI50z
z/OS
z/TPF
z/VSE
Select IBM Blades
IBM Smart Analytics Optimizer
System z Host
with Unified Resource Manager
System z Hardware Management Console (HMC)
Use the smarter solution to improve your application design
System z PR/SM
z HW Resources
Blade HW Resources
Support Element
zBX
Private data network (IEDN)
Unified Resource
Manager
Customer Network
Private Management Network INMN
Private High Speed Data Network IEDN
Customer Network
© 2011 IBM Corporation
zBX Hardware Components
zBX Infrastructure
Blades
Rack
zBX
Top-of-Rack Switch
Model 002
BladeCenter Chassis
Smart Analytics Optimizer
Ethernet & FC Cables
IBM Blades
BC Switches
Power Dist. Units
Opt: Heat Exchanger,
Power cord types
DataPower
XI50z
2458-002
© 2011 IBM Corporation
RACK B
RACK D
RACK C
RACK E
B36P INMN A
B35P INMN B
B32P IEDN A
B30P IEDN B
B
2
1
Z
8
BLADE
CENTERS
FRONT
VIEW
B
2
1
N
C
2
1
Z
B10B
B
0
6
Z
2458-002
B01B
C
2
1
N
D
2
1
Z
C10B
B
0
6
N
C
0
6
Z
C01B
8
BLADE
CENTERS
FRONT
VIEW
D
2
1
N
E
2
1
Z
D10B
C
0
6
N
D
0
6
Z
D01B
E
2
1
N
E10B
D
0
6
N
E
0
6
Z
E01B
E
0
6
N
© 2011 IBM Corporation
zBX Door - options
 Option 1 – Standard door
 Option 2 – Rear Door Heat Exchanger - Feature Code #0540
– Requires customer conditioned water
– Refer to the Heat Exchanger Rear Door Planning Guide to ensure that the heat is properly
dissipated.
http://publib.boulder.ibm.com/infocenter/systems/scope/hw/index.jsp?topic=/iphad_p5/iphade
xchangeroverview.htm.
– When at that link, just search on 7014-T42
 There are two circumstances which can be considered
for the Rear Door Heat eXchanger (RDHX).
1. Order the RDHX as part of the initial order for the zBX.
2. If not sure if an RDHX is needed, contact
IBM Systems & Technology Group (STG) Lab Services.
http://www.coolcentric.com/
 Option 3 – Noise Reduction Doors Feature Code #0543
7
2458-002
© 2011 IBM Corporation
Third Party Maintained z196 - Configuration, 1 CPC/1 PAIR
of PDN Connections
z196 HMC
z196
CPC1
OWNS
2458
Call
home
2458 HMC
(FC=0090)
3rd Party
Maintained
2458-002
IBM System z
Maintained
Fibre Channel
Disk Storage
IBM Storage /
Customer
Maintained
8
2458-002
© 2011 IBM Corporation
2458-002 Ordering (who does what?)
 zBX is ordered via the zEnterprise eConfig, by specifying the number of blades
– IBM Smart Analytics Optimizer
– IBM POWER7 Blades
– DataPower XI50z
 System z e-Config drives out all required infrastructure (BladeCenters, switches, racks, etc)
– System z representative is responsible for getting the connectivity (OSA’s and optics) right
 Only one zBX per controlling CPC
– Controlling CPC must be a zEnterprise 196
• z10 can attach with OSA-Express3 (OSD) 10 GbE connections, and can access the solutions/workloads
 zBX must be adjacent to the controlling CPC
– within what a 26 meter (85 feet) cable allows
 Customer provides
– All 10 Gb Ethernet Optical Cables
• OSA to zBX
• zBX to zBX
• zBX to existing customer network
– IBM Smart Analytics Optimizer
• Private DASD (DS5020)
• All Disk Optical Cables
• IEDN optical cables
– IBM POWER7 Blades
• All blades (from supported list)
• DASD (from supported list)
• All Disk Optical Cables
• IEDN optical cables
– IBM DataPower XI50z
• IEDN optical cables
© 2011 IBM Corporation
Bits and Pieces
 Internal Recipe
– Nice to know, but not essential to know.
– Represented by various feature codes within the 2458-002
• Generated by the zEnterprise 196 eConfig tool
– Internal connections pre built and wired in IBM manufacturing  Huge Benefit
– External connections performed by IBM during installation
• Optical cables and labels provided by the customer
• Disk provided by an alternate means – not supplied with the zBX
• IBM POWER7 Blades provided by an alternate means – not supplied with the zBX
– POWER7 Blade entitlement provided via eConfig
 BladeCenters
 Blades
 Internal bits and pieces
–
–
–
–
Redundant network components and paths
Redundant power
Redundant disk connections and paths
Redundant Top of Rack (TOR) switches
• INMN
• IEDN
2458-002
© 2011 IBM Corporation
Bits and Pieces
2458-002
© 2011 IBM Corporation
2458-002 Blades
IBM
Smart Analytics Optimizer
IBM Smart Analytics Optimizer
Pre-packaged
2458-002
IBM Power7 Blade
Separately ordered
DataPower XI50z
Pre-packaged
© 2011 IBM Corporation
IBM Smart Analytics Optimizer
Delivering powerful analytics to existing System z
customers
 Creates new opportunities for existing
systems by using new technology
approaches
 High performance
– Significantly improve query-intensive
workloads on IBM data systems
Smart
Analytics
Optimizer
– Improved query performance
 Requires no change to existing
applications
 Lower administration costs
 Better decisions
 No changes to DB2 query application
13
2458-002
© 2011 IBM Corporation13
2458-002 - IBM Smart Analytics Optimizer
 Pre-packaged and pre-tested
 zBX components are a logical extension to System z as a new System z
Machine Type/Model.
– Machine Type 2458
– Model 002
 Used for specialized workload processing which can be handled more
economically than if those workloads were processed directly in the System
z server
 zBX processing components are provided using standard BladeCenter®
components.
 Impressive Performance
– Compressed DB2 data
– Parallel file system
– In memory execution
14
2458-002
© 2011 IBM Corporation
zBX - Five Smart Analytics Solutions for System z
1
7 Blades
15
2
3
4
5
14 Blades
28 Blades
42 Blades
56 Blades
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
3u
9u
7 Blades
9u
14
Blades
9u
14
Blades
9u
14
Blades
9u
14
Blades
9u
14
Blades
9u
14
Blades
3u
3u
3u
3u
3u
3u
9u
14
Blades
9u
14
Blades
2458-002
3u
9u
14
Blades
9u
14
Blades
3u
3u
© 2011 IBM Corporation
zBX ISAOPT Offering Upgrades
Number of
Blades
7
14
28
42
7
14
28
42
56
Yes
Yes
Yes
add storage
Yes
add storage
Yes
Yes
add storage
Yes
add storage
Yes
add storage
Yes
add storage
Yes
add storage
56
16
2458-002
© 2011 IBM Corporation
IBM Smart Analytics Optimizer - Sizing
 How do I size the right machine?
– Watch this space, things may change
– Initially, go here
 For requests outside of North America
– dwhz@de.ibm.com
 For requests in North America
– Forward the sizing request to the BI Swat team under Beth Hamel
– DW on System z/Silicon Valley/Contr/IBM
 https://w3.tap.ibm.com/w3ki08/display/isao/Home
https://w3.tap.ibm.com/w3ki08/display/isao/Process
– Download an off-line version of the questionnaire (ISAO_Assessment_Questionnaire.doc) from
https://w3.tap.ibm.com/w3ki08/display/isao/Process
– Complete Questionnaire
• System Environment and Data Warehouse workload (to make sure that the customer meets the requirements)
 Send the completed Questionnaire to the User ID dwhz@de.ibm.com or to BI Swat team under Beth Hamel in North
America DW on System z/Silicon Valley/Contr/IBM or use dwonz@us.ibm.com.
• It is not recommended that you approach the customer until you have had feed back on the ISAO Assessment
– a quick analysis of real workload should be performed (Quick Workload test)
 Down load the ISAO Assessment Description.zip from the https://w3.tap.ibm.com/w3ki08/display/isao/Process
17
© 2011 IBM Corporation
IBM Blade based on Power7
Power ASB
http://www.ibm.com/systems/z/hardware/zenterprise/zbx.html

MT 8406-71Y (PS701)
–
–
–
–
–
–
–
Processor
3.0GHz@150W
Power7 8 Core Processor
8 Processor Cores activated
1 Processor socket
Single wide Blade only
3.0GHz
16 dimm slots (4, 8, & 16 GB/core)
300GB HDD Internal Disk
Processor
Activations (8)
3 Configurations are supported.

IBM POWER7 supports the 10Gbe IEDN.

IBM Blade Chassis attach to the INMN TOR via 1 GbE.

Blades acquired by the customer through existing channels
or through IBM (not from System z).

A PowerVM Enterprise Edition licence and Software
Maintenance Agreement is required for all 8 Cores, and
must be maintained for the duration of use.
AIX 5.3+, 6.1+
Customer procured
With AIX and PowerVM EE Licenses!
Hardware Warranty and Maintenance
24x7 on-site support for parts and service during the
1 year System z warranty and subsequent post warranty
maintenance terms. Do not purchase a separate blade
warranty. Provided as part of the zBX warranty and terms.
IBM Confidential
8411
8412
Memory kits


Feature
Code
Config 1
Config 2
Config 3
1
1
1
4
4
4
4
4
4
32GB
64GB
128GB
8 GB (2 x 4 GB)
16 GB (2 x 8 GB)
8208
8209
4
0
8
0
0
8
HDD 300GB
8274
1
1
1
8406-8275 QLogic 2-port
10Gb Converged Network
Adapter (CFFh)
8275
1
1
1
8406-8242 QLogic 8Gb
Fibre Channel Expansion
Card (CIOv)
8242
1
1
1
PowerVM EE
5228
8
8
8
Required SW
PID
SW License PID
5765-PVE
0001
8
8
8
1 YR SWMA PID
5771-PVE
1191
3 YR SWMA PID
5773-PVE
0999
Choose Qty 8 of 1 YR or 3 YR
All statements regarding IBM’s future direction and intent are subject to
change or withdrawal without notice, and represent goals and objectives only.
IBM Systems
Adding new IBM POWER7 blades –
“enablement”
Blades really are
part of the z196
© 2011 IBM Corporation
Cross Platform sizing including POWER7™ blades

Size the z196 portion
–
Engage a Techline specialist to help you collect the data and do the sizing via Deal Hub Connect
–
Use zPCR or zCP3000
•
Use CP2KEXTR and CP3KVMXT to create an EDF file for z/OS and z/VM
•
Complete data collection guides located here:
http://w3.ibm.com/techdocs/PRS2664 - for z/OS http://w3.ibm.com/techdocs/PRS2875 - for z/VM
http://partners.boulder.ibm.com/src/atsmastr.nsf/WebIndex/PRS2664 http://partners.boulder.ibm.com/src/atsmastr.nsf/WebIndex/PRS2875

Size the POWER7™ portion – allow at least one week.
1.
Sizing when migrating from competitive machines to POWER7™ blades
–
Engage a Techline specialist via Deal Hub Connect to help you collect the data and do the sizing
–
Identify which machines and which time periods the customer would like to consider
–
Collect data from the competitive machines covering the time frames
•
•
•
2.
Server consolidation data collection guidance located here:
http://w3-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS1423
http://partners.boulder.ibm.com/src/atsmastr.nsf/WebIndex/PRS1423
Sizing new applications running on POWER7™ blades
–
Engage Global Techline Solutions Sizing Support via Deal Hub Connect
•
•
•
Software sizing questionnaires located here:
http://w3-03.ibm.com/support/techline/sizing/tg_im_sizing.html
https://www-304.ibm.com/partnerworld/mem/support/trs_techline_sizing_info.html
•
Sizing when the customer has an existing set of IBM servers they would like to migrate to POWER7™ blades
–
Identify which machines and which time periods the customer would like to consider in the proposal
–
Collect data from AIX covering the time frames
•
OR
Work hand in hand with a POWER7 Specialist to collect the data and do the sizing
–
•
•
•
Engage a Techline specialist via Deal Hub Connect to help you collect the data and do the sizing
Sizing questionnaires located here: (will be published soon)
http://w3-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4034
© 2011 IBM Corporation
IBM WebSphere DataPower Integration Appliance XI50 for
zEnterprise helps extend the value of zEnterprise
Purpose-built hardware for simplified deployment and hardened security helps
businesses quickly react to change and reduce time to market
What is it?
The IBM WebSphere DataPower
Integration Appliance XI50 for
zEnterprise can help simplify, govern,
secure and integrate XML and IT
services by providing connectivity,
gateway functions, data transformation,
protocol bridging, and intelligent load
distribution.
How is it different?
 Security: VLAN support provides enforced
isolation of network traffic with secure private
networks.
 Improved support: Monitoring of hardware
with “call home” for current/expected
problems and support by System z Service
Support Representative.
 System z packaging: Increased quality with
pre-testing of blade and zBX. Upgrade history
available to ease growth.
 Operational controls: Monitoring rolled into
System z environment from single console.
Consistent change management with Unified
Resource Manager.
© 2011 IBM Corporation
IBM WebSphere DataPower Integration Appliance XI50 for
zEnterprise (DataPower XI50z)
 DataPower XI50z (2462-4BX)
– Same hardware as DataPower XI50B (4195-4BX)
• “Double-wide” Blade: 2 BladeCenter slots
• IBM HS22 Blade + DataPower expansion unit
– Same DataPower firmware (v3.8.1)
– Same ESB, Security, and Integration capabilities
 Can coexist with POWER7 blades in the same zBX BladeCenter
(Also planned to coexist with future general purpose x86 blades – Statement of Direction)
 Leverages advanced zBX BladeCenter networking infrastructure
– 2 x 1 GbE interfaces to zBX 1 GbE top of rack switches (zManager - INMN)
– 2 x 10 GbE interfaces to zBX 10 GbE top of rack switches (IEDN)
 Ordering, configuration and installation
– Hardware and firmware are configured and ordered by eConfig as zBX features
– Ships installed in a new-build zBX or field installed by IBM service as an MES
 Tightly integrated with zEnterprise
– Unified hardware and firmware management by zManager
– Inherits zEnterprise Ensemble serviceability, monitoring and reporting capabilities
22
© 2011 IBM Corporation
Networking
1
2
3
23
2458-002
intra-node management network
intra-ensemble data network
existing customer network
© 2011 IBM Corporation
Ensemble networking
1

IntraNode Management Network (OSM)
– 2 ports from 2 different OSA Express-3 1000BaseT Ethernet adapters, for
redundancy.
– To allow the HMC, to talk to the System z hypervisors, within the ensemble.
2

IntraEnsemble Data Network (OSX)
– A pair of OSA-Express3 10 GbE adapters, for redundancy.
– To allow the zEnterprise applications to communicate between OS images to
share data.
– To allow the zEnterprise applications to communicate to the zBX
– Ensemble zBX to zBX communications.
3

Existing customer network
– 10 GbE connections in the zBX TOR Switch
– For CPC’s or switches not in the ensemble
1
2
3
2458-002
intranode management network
intraensemble data network
existing customer network
© 2011 IBM Corporation
OSA-Express3 CHPID Types
 Two new OSA CHPID types are created to support the new zBX networks.
 There are now up to 6 types of NETWORK OSA CHPID’s.
3
 Existing data networks - defined as OSC, OSD, OSE, and OSN CHPID’s
– Existing customer provided and managed OSA ports used for access to the current customer
external networks. (no changes)
1
 Intra-Node Management Network – defined as OSM CHPID’s
– OSA-Express3 1000base-T
• Configured as an OSM CHPID port for Node Management Network to be connect to zEnterprise
Ensemble CPC via a new ethernet switch A/B J07.
2
 Intra-Ensemble Data Networks – defined as OSX CHPID’s
– OSA-Express3 10 GbE (LR or SR) configured as an OSX CHPID, fiber port for IEDN.
1
2
3
2458-002
intra-node management network
intra-ensemble data network
existing customer network
© 2011 IBM Corporation
CHPID Types OSX and OSM
1
OSM (INMN)
2
OSX (IEDN)
IEDN Distances
•SM (Long Reach Optics) 10 km (6.2 miles)
CHPID PORT 0
CHPID PORT 1
OSA Express3
1GbE
2 CHPIDS
2 PORTS/CHPID
OSA Express3
10 GbE
2 CHPIDS
1 PORT/CHPID
FC3367
FC3370 (LR)
Single Mode 9 micron LC duplex
CAT 6 ETH CABLE
FC3371 (SR)
Multi Mode 50/62.5 micron LC duplex
CHPID PORT 0
MUST USE
CHPID PORT 0
Supports IOCP CHPID types:
OSC, OSD, OSE, OSN, and OSM (ONLY 1000BASE-T).
OSM IOCDS EXAMPLE:
• CHPID PCHID=191,PATH=(CSS(0,1,2,3),23),TYPE=OSM,CHPARM=01,SHARED, …
• CNTLUNIT CUNUMBR=0910,PATH=((CSS(0),23)),UNIT=OSM
• IODEVICE ADDRESS=(0910,15),CUNUMBR=(0910),UNIT=OSA,UNITADD=00,
*
MODEL=M,DYNAMIC=YES,LOCANY=YES
2458-002
•MM (Short Reach Optics)
50 micron at 2000 MHz-km: 300 meters (984’)
50 micron at 500 MHz-km: 82 meters (269’)
62.5 micron at 200 MHz-km: 33 meters (108’)
Supports IOCP CHPID types:
OSD and OSX (ONLY 10 GbE).
OSX IOCDS EXAMPLE:
•CHPID PCHID=5E1,PATH=(CSS(0,1,2,3),2F),TYPE=OSX,SHARED, ….
•CNTLUNIT CUNUMBR=09F0,PATH=((CSS(0),2F)),UNIT=OSX
• IODEVICE ADDRESS=(09F0,15),CUNUMBR=(09F0),UNIT=OSA,UNITADD=00,
MODEL=X,DYNAMIC=YES,LOCANY=YES
CHPARM=01 indicates that the channel path is managed by Dynamic Channel Path Mgmt (DCM)
*
© 2011 IBM Corporation
2458-002 Intra-Node Management Network
1
zEnterprise
zBX
Ethernet switch
TOR
Ethernet switch
26 meter
IBM Supplied
TOR
26m Chrome Gray
Plenum rated cable
IBM
ly
pp
l su
wil
10 GbE
OSA Express3 10 GbE
m
3.2
OSA Express3 10 GbE
les
cab
OSA Express3 1000Base-T
OSA Express3 1000Base-T
TOR
TOR
Loopback
required
if no zBX.
Required if IBM Unified Resource Manager (FC0025), even if no zBX
2458-002
© 2011 IBM Corporation
2458-002 Top of Rack (TOR) Switches
1
J00
J02 J04
J06
J08 J10
J12
J14 J16 J18
J20 J22
J24
J26 J28 J30
J32
J34 J36
J38 J40
J42 J44
J46
J01
J03 J05
J07
J09 J11
J13
J15 J17 J19
J21 J23
J25
J27 J29 J31
J33
J35 J37
J39 J41
J43 J45
J47
J00
J02 J04
J06
J08 J10
J12
J14 J16 J18
J20 J22
J24
J26 J28 J30
J32
J34 J36
J38 J40
J42 J44
J46
J01
J03 J05
J07
J09 J11
J13
J15 J17 J19
J21 J23
J25
J27 J29 J31
J33
J35 J37
J39 J41
J43 J45
J47
B36P
B35P
1
INMN TOR SWITCH
UPLINK SLOT
1. Intra-Node Management Network
2. Intra-Ensemble Data Network
3. Existing Customer Network
UPLINK SLOT
2
3
UPLINK SLOT
UPLINK SLOT
3
2
IEDN TOR SWITCH
2458-002
© 2011 IBM Corporation
2458-002 IEDN Redundant Top of Rack (TOR) Switch
Connections
UPLINK SLOT
UPLINK SLOT
UPLINK SLOT
Up to eight CPCs
LR or SR? 2
UPLINK SLOT
EX4500
• SFP+ = 10GbE Optical SR or LR
• DAC = 10GbE Direct Attach Cables.
FC0632/0633
DAC
1 meter (3.3 ft) FC0626
5 meter (9.9 ft) FC0627
7 meter (23 ft) FC0628
Up to eight
zBX to zBX
Connections.
LR or SR?
2
Customer Network
LR or SR? 3
• SWITCH JACK PLUGGING RULES:
• J00 - J07 are SFP+ reserved for Host OSX IEDN connections.
• J08 - J23 are DAC reserved for BC IEDN, SM07/SM09 connections.
• J22 / J23 are 1 Meter DAC for Switch to Switch
• J24 - J30 are SFP+ reserved for zBX to zBX IEDN connections.
• J31 - J39 are SFP+ reserved for customer (PINK) IEDN connections.
• J40 Console Port
• J41 IEDN Switch Management Port
2458-002
Optic p/n 45W4743 - 10GE sfp+ SR - has a black handle
Optic p/n 45W4744 - 10GE sfp+ LR - has a blue handle
© 2011 IBM Corporation
Optics Ordering - FC0632 (LR) or FC0633 (SR)
FC0632/0633
1. Intra-Node Management Network
2. Intra-Ensemble Data Network
3. Existing Customer Network
Up to 8x2=16
2
z196 to zBX
Up to 7x2=14
2
zBX to zBX
Up to 9x2=18
3
zBX to existing
2458-002
© 2011 IBM Corporation
OSA Ordering
OSA to TOR
OSX
OSA to BPH
OSM
2458-002
2
3
1
© 2011 IBM Corporation
The Big Picture - connections
1
2458-002
BC MM01/02 & SM01/02
O
S
X
1000Base-T to BPH
INMN SWITCH A
IEDN SWITCH A
OSX LR/SR OPTICAL ZONE
SWITCH TO BLADE CENTER DAC ZONE
P
C
H
I
D
1000BaseT
OSM
CHPIDS
ENSEMBLE
zBX to zBX
IEDN TOR
SWITCH
OPTICAL
SR/LR ZONE
2
O
S
X
ENSEMBLE
IEDN SWITCH
CUSTOMER
MANAGED
EXTERNAL
OPTICAL
SR/LR ZONE
3
IEDN SWITCH B
OSX LR/SR OPTICAL ZONE
P
C
H
I
D
SWITCH TO BLADE CENTER DAC ZONE
BC MM01/02 & SM01/02
2
Up to 8 CPCs
INMN SWITCH B
0 if only one zBX
0 if not on existing
BPH A
BPH B
© 2011 IBM Corporation
Z196 & zBX Model 002 – Communications
HMC2
(Alternate)
Virtual Server to Virtual Server
Communications
Ac
tiv
e
N
Ac ot
t iv
e
Customer
Management
Network
IBM Service Updates
HMC1
(Primary)
Mirroring
z196, zBX Info
Smart Analytic Optimizer Database Updates
Eth Switch
Power Monitoring / Management
HMC/SE LAN (switch)
Ethernet
Switch
Blade Updates (MCL)
Database
Update
DataOSX
Exchange
10GBE OSA’s
SE
TOR
OSX (IEDN)
TOR
App Servering Blades
IBM Confidential
App Servering Blades
OSD
Customer
Network 0101
Customer managed
1
100 Data Network
System Analytics Optimizer
z/OS
DB2
ISAO
System Analytics Optimizer
System z Virtual Servers
System z Virtual Servers
System z Virtual Servers
System z Virtual Servers
OSM
1000BT OSA’s
z196
33
OSM (INMN)
zBX
© 2011 IBM Corporation
zEnterprise/2458-002 MAX CPC/NODE ENSEMBLE
ENSEMBLE
HMC
Node1-B32PJ24 to Node2-B32PJ24
Node1-B32PJ25 to Node3-B32PJ25
Node1-B32PJ26 to Node4-B32PJ26
Node1-B32PJ27 to Node5-B32PJ27
Node1-B32PJ28 to Node6-B32PJ28
Node1-B32PJ29 to Node7-B32PJ29
Node1-B32PJ30 to Node8-B32PJ30
HMC
zBX to zBX IEDN Connections
1. Intra-Node Management Network
2. Intra-Ensemble Data Network
3. Existing Customer Network
2
Node8-B30PJ24 to Node1-B30PJ24
Node8-B30PJ25 to Node2-B30PJ25
Node8-B30PJ26 to Node3-B30PJ26
Node8-B30PJ27 to Node4-B30PJ27
Node8-B30PJ28 to Node5-B30PJ28
Node8-B30PJ29 to Node6-B30PJ29
Node8-B30PJ30 to Node7-B30PJ30
© 2011 IBM Corporation
1 CEC, 1 Ensemble, 1 zBX
Additional Content

HMC (2 per Ensemble)
–
1

INMN (2 per Controlling CEC)
–

Ethernet Cables
26 meter 1000BaseT cables (BPH to Switch)
OSM (2 per each CEC in Ensemble)
–
OSA Express-3 1000BaseT Ethernet to BPH
–
3.2 meter Ethernet Cables
Connections
1 to 8 redundant connections of each type, per Ensemble
2

TOR
Switches
OSX (2 per CEC Connection)
–
OSA Express-3 10GbE, SR or LR
–
Optic modules, SR or LR
–
Customer provided 10GbE cables, SR or LR
Optional connections, depending on access to Customers network
3
Customer
Data Network

External data network (2 per connection)
–
Optic modules, SR or LR
–
Customer provided 10 GbE cables, SR or LR
intra-node management network
intra-ensemble data network
existing customer network
2458-002
© 2011 IBM Corporation
8 CEC, 1 Ensemble, 1 zBX
Additional Content

HMC (2 per Ensemble)
–
1

INMN (2 per Controlling CEC)
–

Ethernet Cables
26 meter 1000BaseT cables (BPH to Switch)
OSM (2 per each CEC in Ensemble)
–
OSA Express-3 1000BaseT Ethernet to BPH
–
3.2 meter Ethernet Cables
Connections
1 to 8 redundant connections of each type, per Ensemble
2

OSX (2 per CEC Connection)
–
OSA Express-3 10GbE, SR or LR
–
Optic modules, SR or LR
–
Customer provided 10GbE cables, SR or LR
Optional connections, depending on access to Customers network
3
TOR

External data network (2 per connection)
–
Optic modules, SR or LR
–
Customer provided 10 GbE cables, SR or LR
Switches
Customer
Data network
2458-002
Note: TOR switches could be required for OSX to OSX communications
© 2011 IBM Corporation
8+ CEC, 1 Ensemble, 1 zBX
Additional Content

HMC (2 per Ensemble)
–
1

INMN (2 per Controlling CEC)
–

Ethernet Cables
26 meter 1000BaseT cables (BPH to Switch)
OSM (2 per each CEC in Ensemble)
–
OSA Express-3 1000BaseT Ethernet to BPH
–
3.2 meter Ethernet Cables
Connections
1 to 8 redundant connections of each type, per Ensemble
2

OSX (2 per CEC Connection)
–
OSA Express-3 10GbE, SR or LR
–
Optic modules, SR or LR
–
Customer provided 10GbE cables, SR or LR
Optional connections, depending on access to Customers network or
from CECs not in the Ensemble
3
TOR
Switches
Z10 or
z196
2458-002

External data network (2 per connection)
–
Optic modules, SR or LR
–
Customer provided 10 GbE cables, SR or LR
Customer
Data network
© 2011 IBM Corporation
8 CEC, 1 Ensemble, 8 zBX
Additional Content

HMC (2 per Ensemble)
–
1

INMN (2 per Controlling CEC)
–

Ethernet Cables
26 meter 1000BaseT cables (BPH to Switch)
OSM (2 per each CEC in Ensemble)
–
OSA Express-3 1000BaseT Ethernet to BPH
–
3.2 meter Ethernet Cables
Connections
1 to 8 redundant connections of each type, per Ensemble
2

OSX (2 per CEC Connection)
–
OSA Express-3 10GbE, SR or LR
–
Optic modules, SR or LR
–
Customer provided 10GbE cables, SR or LR
–
((4 x zBX) - 2 per Ensemble) (zBX to zBX)
–
Customer provided 10 GbE cables, SR or LR
–
Optic modules, SR or LR
Optional connections, depending on access to Customers network
3

External data network (2 per connection)
–
Optic modules, SR or LR
–
Customer provided 10 GbE cables, SR or LR
Customer
Data network
2458-002
© 2011 IBM Corporation
Big Picture 2458-002 Configuration 8 CPC’s / 8 PAIR OF SR/LR MIX IEDN CONNECTIONS.
z10 EC
HMC
HMC
CPC2
HMC
z196
1 Primary, 1 Alternate HMC
CPC6
OSD
z196
O
S
M
z10 EC
CPC3
ENSEMBLE
OSX
O
S
M
CPC1
OWNS
2458
OSX
OSD
OSD
z196
Data Network Redundancy
Can be SR or LR to TOR.
CPC7
2458-002
CPC4
OSD
IBM Smart Analytics Optimizer
Fibre Channel
Disk Storage
CUSTOMER
blade SAN
Fibre Channel
Disk Storage
LEGEND
z10 EC
CPC5
O
S
M
OSX
z196
O
S
M
OSX
Customer HMC to SE/BPH A/B Network
OSD
2458 INMN
z196
OSX
CPC8
O
S
M
2458 10GbE OSX IEDN (SR) NOTE: z10 ARE OSD
SWITCH FOR LR TO SR
CONVERSION ONLY.
2458 10GbE OSX IEDN (LR) NOTE: z10 ARE OSD
2458 8Gb FC Disk Storage
PSM / INMN 1000BaseT OSA (OSM) PCHIDS to Z29BPS11/PS31-J07
2458-002
© 2011 IBM Corporation
1
1
2
2
2
3
© 2011 IBM Corporation
Storage for IBM Smart Analytics Optimizer and
IBM POWER7
41
© 2011 IBM Corporation
IBM Smart Analytics Optimizer & IBM POWER7 Disk Storage
Smart Analytics
Optimizer Disk
IEDN
10 GbE
DS5020
ISAOPT
CUSTOMER
Direct Connect
Fibre Channel
Disk Storage
POWER7
POWER7
Disk
CUSTOMER
SAN
Fibre Channel
Disk Storage
SUPPORTED
DISK LIST
© 2011 IBM Corporation
IBM Smart Analytics Optimizer Disk Attachment
Details
 Includes two 20 port – 8 Gb FC switches in each BladeCenter
to allow connectivity to disk
– Must be directly attached
7
14
– Supports 8 Gbps, 4 Gbps, 2 Gbps
• 1 Gbps is NOT supported
– Allows for connectivity to:
• DS5020 with 1 TB HDD
28
42
56
Intended to handle up to x TBs of DB2 data
0.5 TB
1 TB
16 Drives
16 Drives
8 ports
8 ports
2 TB
16 Drives
3 TB
4 TB
32 Drives
8 ports
8 ports
32 Drives
8 ports
 Disk is not part of the integrated Smart Analytics Optimizer offering
– Customer is responsible for:
• supplying disk (separate order)
• disk cabling
• disk configuring
zBX
Cables and
Storage provided
by customer
DS 5020
43
2458-002
© 2011 IBM Corporation
IBM Smart Analytics Optimizer Disk e-Config
output
7, 14, 28
Blades
42, 56
1
1814-20A
DS5020 Midrange Disk (Dual Controllers)
1
FC2080
2-Dual 8Gbps Host Pt Cards
16
FC4001
DS5020 1 TB/7.2 SATA DDM
4
FC5605
5m Fiber Optic Cable LC-LC
1
FC7802
DS5020 Linux/Intel Host Kit
1
FC8700
DS5020 2 Stg Partiti. IPO
1
FC9202
Field Integrated
1
FC9800
Power Cord 125V/10A, Group 1
1814-52A
EXP520
FC4001
DS5020 1 TB/7.2K SATA DDM
4
FC5605
5m Fiber Optic Cable FC-FC
1
FC9021
Attach to DS5020
1
FC9202
Field Integrate
1
FC9800
Power Cord 125V/10A 2.8m, (Group 1)
us 1
l
p 16
Blades
Notes:
1. Four attachment ports are standard and no charge. FC2080 adds an additional four ports (charged).
Order FC2080 in every order because it can not be MES'ed later.
2. 5m Fiber Optic Cable LC-LC (can order 1m or 25m also for attachment to a patch panel).
44
2458-002
© 2011 IBM Corporation
zBX 4 BLADECENTER FC CONNECTIONS
4 BLADECENTER, Smart Analytics Optimizer ONLY FC DISK STORAGE CASCADE CONNECTIONS
SM03/04
JACK LOCATIONS
B10B
C10B
RESERVED
for Disk Storage
B01B
C01B
IN FROM
LOWER # BC
HBA-0
HBA-1
Disk Storage
CUSTOMER SUPPLIED
*CBL HBA0J00 to B10BSM03J00
*CBL HBA1J00 to B10BSM04J00
*CBL HBA0J01 to B01BSM03J00
*CBL HBA1J01 to B01BSM04J00
2458-002
4 BC
B10BSM03J18 to C10BSM03J16
B10BSM04J18 to C10BSM04J16
B01BSM03J18 to C10BSM03J17
B01BSM04J18 to C10BSM04J17
B10BSM03J19 to C01BSM03J16
B10BSM04J19 to C01BSM04J16
B01BSM03J19 to C01BSM03J17
B01BSM04J19 to C01BSM04J17
FC INTERCONNECT CABLES
5M LC DUPLEX SR ONLY (FC 0621)
OUT TO
HIGHER # BC
PORTS 1 - 14
INTERNAL PORTS
RESERVED FOR
BLADE SERVERS
USING TOP/DOWN - LEFT/RIGHT RULES
1ST AVAILABLE J18/J19 TO NEXT BC AVAILABLE J16/J17.
© 2011 IBM Corporation
Storage for zBX and IBM POWER7
46
© 2011 IBM Corporation
IBM POWER7 Disk Storage Connections
 Physically each BladeCenter chassis (up to 14 blades)
has two 8 Gb SX ONLY (multimode) fibre channel
ports in two different internal FC switches to connect
outbound to storage.
 Cabled 2, 4 or 8 Gbps SX ports to the SAN
infrastructure
 Two paths to each storage LUN – managed
by the blade hypervisor
J00
J00
J15
J15
J16
J16
J17
J17
J18
J18
J19
J19
8Gb FC Switch Modules (FC0606)
2458-002
© 2011 IBM Corporation
FC DISK STORAGE CONNECTIONS FOR Power7 blades
blade
blade
B10B
C10B
blade
blade
C01B
CUSTOMER
blade SAN
Fibre Channel
Disk Storage
blade
D10B
blade
B01B
CUSTOMER
blade SAN
Fibre Channel
Disk Storage
blade
E10B
blade
D01B
CUSTOMER
blade SAN
Fibre Channel
Disk Storage
E01B
CUSTOMER
blade SAN
Fibre Channel
Disk Storage
Separately provided disk and cables. No BladeCenter interconnect.
Blade chassis DOES NOT cable to the same Disk Storage as Smart Analytics Optimizer chassis
2458-002
© 2011 IBM Corporation
List of Storage Devices Supported by PS701 IBM
BladeCenter® Express in IBM zEnterprise™ System*
 IBM
– DS3400, DS3500, DS3950
– DS4100, DS4200, DS4700, DS4800
– DS5020, DS5100, DS5300
– DS6000™
– DS8100, DS8300, DS8700
– SVC 2145
– XIV®
– 2105, 2107
– Storwize v7000
 Hitachi
– Lightning 9910, 9960, 9970, 9980
– USP 100, 600, 1100
– NSC55
– USP V
 HP
– EVA 3, 4X, 5, 6X, 8X
– XP 10K, 12K, 48, 128, 512,1024
 EMC
–
–
–
–
–
Symmetrix 3300, 5000 , 8000
http://www.ibm.com/systems/z/hardware/zenterprise/zbx.html
Select Support Storage Devices
Symmetrix V-MAX
DMX 800, 1000, 1000P, 2000, 2000P, 3000
DMX -3, DMXClariion CX3 all models, CX4 all models, CX300, CX400, CX500, CX600, CX700, AX4-5
* - default MPIO Path Control Module support only
ZSP03437-USEN-xx
© 2011 IBM Corporation
Hardware Management Consoles
50
© 2011 IBM Corporation
How is the Role of the HMC Changing?
 Prior to the ensemble management functions in z196, HMC availability
was not a critical concern
– HMC was not the authoritative holder of any configuration or state
information other than configuration info for the HMC itself
– HMC was not involved in any flows supporting ongoing operation other
than call-home, for which redundancy was provided
– You could turn the HMC off and there would be no effect on operations
of the managed systems
 Addition of ensemble-related function in z196 changes this:
– The HMC will now be authoritative holder of some ensemble-scoped
configuration not held by any of the Nodes in the ensemble
– Some configuration actions will be available ONLY from the HMC
managing the ensemble, not the SE
– HMC will have a role in monitoring of Workload performance
 This change in role drives a need to provide some additional
redundancy in the HMC configuration to improve availability
© 2011 IBM Corporation
HMC (Primary & Alternate Requirements)
 Both Hardware Management Consoles must be….
– Feature Code 0090 or 0091
– Same PC machine type/model.
– Same LIC level
– Same Ethernet configuration
• identical attachment adapters & same subnet
– Same modem settings
© 2011 IBM Corporation
Primary and Alternate Hardware Management Consoles
 Any V2.11.0 HMC can become the Primary HMC that controls the ensemble.
– The Primary HMC can perform all non-ensemble HMC functions on CPCs that aren't members of the
ensemble.
 The HMC that creates an ensemble (the HMC that performed the "Create Ensemble" wizard) becomes
the Primary HMC.
– Available in November 2010 when the zBX becomes available.
 The Alternate HMC is specified when executing the "Create Ensemble" wizard.
– Any V2.11.0 HMC is eligible to be an Alternate HMC after running the “Manage Alternate Hardware
Management Console task”.
 The title of Primary Hardware Management Console and Alternate Hardware Management Console will
appear on the
Login HMC panel and the title line once you are logged in.
– The default HMC titles will change to these titles when the ensemble is created.
– The titles will revert back to the default if the ensemble is deleted.
 A Primary HMC is the only HMC that can perform ensemble related management tasks (create virtual
server, manage virtual networks, create workload ....)
2458-002
© 2011 IBM Corporation
Reference
 zBX Publications
–
–
–
–
–
–
–
–
zBX Service Guide GC28-6884-01
zBX Installation Manual (2458-002) GC27-2610-00
zBX IMPP (2458-002) GC27-2611-00
zBX Service Education SE245800
zBX Safety Inspection (for mod 1 and 2) GC28-6889-00
IBM License Agreement for Machine Code SC28-6872-00
Systems Environmental Notices and User Guide Z125-5823-02
Systems Safety Notices G229-9054-02
 Redbooks
–
–
–
–
–
IBM zEnterprise Technical Introduction, SG24-7832
IBM zEnterprise Technical Guide, SG24-7833
IBM zEnterprise Configuration Setup, SG24-7834
IBM zEnterprise Platform Management, SG24-7835
IBM zEnterprise Unified Resource Manager, SG24-7921
 zBX 2458-002 SAPR Guide
– SA10-006
• 2458 TDA Confirmation Form
2458-002
© 2011 IBM Corporation
End of Presentation
55
© 2011 IBM Corporation
Dank u
Спаcиб
о
Merci
Dutch
French
‫ﺷﻜﺮًا‬
Gracias
Spanish
så mycket
감사합니다Russian TackSwedish
Korean
धन्यवाद
Arabic
‫תודה רבה‬
Hindi
Hebrew
Obrigado
Brazilian
Portuguese
Esperanto
ありがとうございます
Trugarez
Japanese
Danke
Breton
நன்றி
Italian
Tamil
go raibh maith agat
Chinese
Thank You
Dankon
Grazie
谢谢
Tak
Danish
German
děkuji
ขอบคุณ
Czech
Thai
Gaelic
© 2011 IBM Corporation
Trademarks
The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.
Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not
actively marketed or is not significant within its relevant market.
Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.
For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:
*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA,
WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®
The following are trademarks or registered trademarks of other companies.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel
Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.
* All other products may be trademarks or registered trademarks of their respective companies.
Notes:
Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will
experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual
environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without
notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance,
compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.
57
© 2011 IBM Corporation
Download PDF
Similar pages