IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter

IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
I BM
®
IBM Virtual Fabric 10Gb Switch Module for IBM
BladeCenter
IBM Redbooks Product Guide
The IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter offers the most bandwidth of any blade
switch and represents the perfect migration platform for clients who are still at 1 Gb outside the chassis
by seamlessly integrating in the existing 1 Gb infrastructure. This is the first 10 Gb switch for IBM
BladeCenter that is convergence ready (that is, able to transmit Converged Enhanced Ethernet (CEE) to
a Fibre Channel over Ethernet (FCoE) capable top-of-rack switch). This new feature is available with
firmware release 6.1 and newer.
In addition, this switch is a key part of the IBM Virtual Fabric offering, which allows clients to form up to
eight virtual network interface controllers (vNICs) from one physical adapter (14 vNICs with an adapter
plus the onboard 10 GbE controller with the BladeCenter HS23) and to manage them in virtual groups.
This switch can be managed via a command-line interface (CLI) or a graphical interface of the switch,
providing all the benefits of I/O Virtualization at 10 Gb speeds. Figure 1 shows the switch module.
Figure 1. IBM Virtual Fabric 10Gb Switch Module
Did you know
As virtualization has become a prevalent standard in the data center, more people have been looking for
ways to virtualize I/O to reduce cost and complexity while also maximizing I/O resources. Virtual Fabric
for IBM BladeCenter provides fast, flexible, easy, and reliable I/O using the IBM Virtual Fabric 10Gb
Switch Module and the Emulex Virtual Fabric Adapter, which provides the abilities to carve up an adapter
into eight virtual NICs, dynamically allocate bandwidth, manage virtual groups, and so on. With the
BladeCenter HS23, a total of 14 vNICs can be configured using the Emulex VFA II for HS23 plus the
onboard Emulex controller.
The switch is designed to support a number of different types of configurations from the blade: 1 Gb, 10
Gb, virtual NIC, Converged Enhanced Ethernet (CEE/FCoE), and iSCSI. If you have a chassis with
multiple servers, some operating at 1 Gb, some at 10 Gb, and some transmitting converged packets, this
single switch can handle all these workloads and can connect to a 1 Gb infrastructure or a 10 Gb
infrastructure, or both.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
1
Part number information
Table 1 shows the part numbers for ordering these modules and additional options for them.
Table 1. IBM part numbers and feature codes for ordering
Description
IBM part number
IBM feature code
46C7191
1639
IBM 10GBase-SR 10GbE 850 nm Fiber SFP+ Transceiver
44W4408
4942
IBM SFP+ SR Transceiver
46C3447
5053
IBM SFP+ LR Transceiver
90Y9412
A1PM
IBM SFP+ ER Transceiver
90Y9415
A1PP
IBM SFP RJ45 Transceiver
81Y1618
3268
IBM SFP 1000Base-T (RJ-45) Transceiver
00FE333
A5DL
IBM SFP SX Transceiver
81Y1622
3269
IBM SFP LX Transceiver
90Y9424
A1PN
0.5m IBM Passive DAC SFP+ Cable
00D6288
A3RG
1m IBM Passive DAC SFP+ Cable
90Y9427
A1PH
3m IBM Passive DAC SFP+ Cable
90Y9430
A1PJ
5m IBM Passive DAC SFP+ Cable
90Y9433
A1PK
7m IBM Passive DAC SFP+ Cable
00D6151
A3RH
Switch module
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
SFP+ transceivers - 10 GbE
SFP transceivers - 1 GbE
SFP+ direct-attach cables - 10 GbE
The module part number, 46C7191, include the following items:

One IBM Virtual Fabric 10Gb Switch Module

3-meter mini-USB-to-DB9 serial console cable

One filler module

IBM Virtual Fabric 10Gb Switch Module Installation Guide

IBM BladeCenter user license agreement

Important Notices document

Documentation CD-ROM
Note: Transceivers and cables are not included with the switch module. (See Table 1 for options.)
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
2
With the flexibility of the switch, clients can take advantage of the technologies they require for multiple
environments. For 1 Gb uplinks, they can take advantage of SFP transceivers. For 10 GbE uplinks, they
have a choice of either SFP+ transceivers for longer distances or more cost effective and lower power
consuming options such as SFP+ direct-attached copper (DAC) cables, which can be between 0.5 and 7
meters in length and are ideal for connecting chassis together, connecting to a top-of-rack switch, or even
connecting to an adjacent rack.
Benefits
The IBM Virtual Fabric 10Gb Switch Module offers the following benefits:

Integration and consolidation: This switch offers integration within the BladeCenter chassis,
consolidating full Layer 2-3 LAN switching and routing capabilities into a single chassis. This helps
flatten the data center infrastructure and reduces the number of discrete devices, management
consoles, and equipment that administrators must deal with, helping lower costs and simplifying
deployment.

Cost: The switch is priced extremely competitively compared with external switches, especially when
you factor in that no cables are required between the blade and the switch. In addition, the ability to
use direct-attach cables with the switch can help clients save even more compared with the more
expensive CX4, XFP, or X2 transceivers.

Performance: With support for ten 10 Gb uplinks, clients can exploit not only up to 200 Gbps of
bi-directional uplink bandwidth, but also an extremely low oversubscription (14 to 10), which can
support even the most performance-intensive environments (up to 7.2 Gbps per blade server port).
Clients wanting extreme performance can use up to four switches and the quad port 10 Gb adapter
and get up to 1.92 Tbps of data per BladeCenter H chassis.

Lower power consumption: Using only 75 W per switch delivers extreme performance per watt,
which is second to none with its support for up to 6.4 Gbps per watt of power.

Layer 3 functionality: The switch module includes Layer 3 functionality, which provides security and
performance benefits as inter-VLAN traffic stays within the chassis. This switch also provides the full
range of Layer 3 protocols from static routes for technologies such as Open Shortest Path First
(OSPF) and Border Gateway Protocol (BGP) for enterprise customers.

Interoperability: IBM switches interoperate seamlessly with other vendors' upstream switches.

Management: IBM provides a choice of interfaces that IT staff can use for management which
includes IBM System Networking graphical user interface or an industry-based CLI (Cisco-like) for
those familiar with IOS, and a full-function Web-based GUI for the latest in simplicity.

Fault tolerance: These switches learn alternate routes automatically and perform faster convergence
in the unlikely case of a link, switch, or power failure. The switch uses proven technologies like L2
trunk failover, advanced VLAN-based failover, VRRP, IGMP V3 snooping, and OSPF.

Converged fabric: The switch is designed to support CEE and connectivity to FCoE modules, making
the IBM solution fully FCoE capable. CEE will help enable clients to combine storage, messaging
traffic, VoIP, video, and other data on a common data center Ethernet infrastructure. FCoE will help
enable highly efficient block storage over Ethernet for consolidating server network connectivity. As a
result, clients can deploy a single server interface for multiple data types, which can simplify both
deployment and management of server network connectivity, while maintaining the high availability
and robustness required for storage transactions.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
3
With the combination of the switch and the QLogic Virtual Fabric Extension Module for IBM
BladeCenter, IBM is able to deliver a full integrated FCoE blade solution that appeals to those clients
who require separate LAN and SAN traffic outside the chassis due to internal politics or for those
wanting to implement FCoE but are extremely cost-sensitive. For information about the QLogic
Virtual Fabric Extension Module, see:
http://www.redbooks.ibm.com/abstracts/tips0717.html
In addition IBM will also support CEE/DCB which allows clients to forward the FCoE traffic upstream
to a Top-of-Rack Gateway device that will split out the LAN traffic (Ethernet) and the SAN (Fiber
Channel) traffic. For the latest official FCoE gateway devices that are supported visit:
http://www.ibm.com/support/entry/portal/docdisplay?lndocid=MIGR-5073016.
The IBM switch comes with a one year warranty or picks up the warranty of the chassis whichever is
longer. The software license will match the warranty and allows for the download of new features, such
as:

Virtual Fabric for IBM BladeCenter: This feature enables clients to implement and manage the
Virtual Fabric solution via a graphical interface or CLI. It is through this that administrators can
perform tasks such as activating a Virtual Fabric, selecting the number of virtual NICs (vNICs),
dynamically allocating bandwidth, creating virtual groups to simplify management, and setting up the
failover and isolation capabilities to the vNICs for better availability and security. This switch also
offers the benefit of IBM’s next-generation vNIC - Unified Fabric Port (UFP). UFP is an advanced,
cost-effective solution that provides a flexible way for clients to allocate, reallocate, and adjust
bandwidth to meet their ever-changing data center requirements.

VMready: VMready is a unique solution that enables the network to be virtual machine-aware. The
network can be configured and managed for virtual ports (v-ports) rather than just for physical ports.
With VMready, as VMs migrate across physical hosts, so do their network attributes. Virtual machines
can be added, moved, and removed while retaining the same ACLs, QoS, and VLAN attributes.
VMready allows for a define-once-use-many configuration that evolves as the server and network
topologies evolve. VMready works with all virtualization products, including VMware, Hyper-V, Xen,
and KVM, without modification of virtual machine hypervisors or guest operating systems. Available
as part of the V6.1 or later software code.
UFP support: UFP is supported using Emulex 1212 code on VFA II with HS22 blade servers. UFP
support for HS23 blade servers is planned for 2Q 2014.
Features and specifications
The IBM Virtual Fabric 10Gb Switch Module includes the following features and functions:

Form-factor


Single-wide high-speed switch module
Internal ports


14 internal auto-negotiating ports: 1 Gb or 10 Gb to the server blades
Two internal full-duplex 100 Mbps ports connected to the management module
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
4




External ports

Up to ten 10 Gb SFP+ ports (also designed to support 1 Gb SFP if required, flexibility of mixing 1
Gb/10 Gb)

One 10/100/1000 Mb copper RJ-45 used for management or data

An RS-232 mini-USB connector for serial port that provides an additional means to install
software and configure the switch module
Scalability and performance

Stacking support up to 8 switches

Autosensing 1 Gb/10 Gb internal and external Ethernet ports for bandwidth optimization

Non-blocking architecture with wire-speed forwarding of traffic and full line rate performance of
480 Gbps full duplex

Media access control (MAC) address learning: automatic update, supports up to 32 Kb MAC
addresses

Up to 128 IP interfaces per switch

Static, EtherChannel, and LACP (IEEE 802.3ad) link aggregation, up to 100 Gb of total bandwidth
per switch, up to 18 trunk groups, and up to eight ports per group

Support for jumbo frames (up to 12288 bytes)

Broadcast/multicast storm control

IGMP snooping for limit flooding of IP multicast traffic (IGMP V1, V2, and V3)

Configurable traffic distribution schemes over trunk links based on source/destination IP
addresses, MAC addresses, or both

Fast port forwarding and fast uplink convergence for rapid STP convergence
Availability and redundancy

VRRP for Layer 3 router redundancy

IEEE 802.1D STP for providing Layer 2 redundancy with PVRST+

IEEE 802.1s Multiple STP (MSTP) for topology optimization, up to 128 STP instances supported
by single switch

IEEE 802.1w Rapid STP (RSTP), providing rapid STP convergence for critical delay-sensitive,
traffic-like voice or video

Layer 2 Trunk Failover to support active/standby configurations of network adapter teaming on
blades

Interchassis redundancy (Layer 2 and Layer 3)
Converged Enhanced Ethernet

CEE support and connectivity to FCoE

Connects to a top-of-rack switch for connectivity to a Fibre Channel SAN

Supports the QLogic Virtual Fabric Extension Module for IBM BladeCenter, which provides FCoE
gateway functionality inside the BladeCenter Chassis.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
5


VLAN support

Up to 1024 VLANs supported per switch; VLAN numbers ranging from 1 to 4095 (4095 is used for
the management module’s connection only.)

802.1Q VLAN tagging support on all ports

Protocol-based VLANs
Security








VLAN-based, MAC-based, and IP-based access control lists (ACLs)
802.1X port-based authentication
Multiple user IDs and passwords
User access control
Radius, TACACS+, LDAP
Quality of service (QoS)

Up to eight queues per port

Support for IEEE 802.1p, IP ToS/DSCP, and ACL-based (MAC/IP source and destination
addresses, VLANs) traffic classification and processing

Traffic shaping and re-marking based on defined policies

Eight weighted round robin (WRR) priority queues per port for processing qualified traffic
Layer 3 functions

IP forwarding

IP filtering with ACLs (up to 4096 ACLs supported)

VRRP for router redundancy

Support for up to 128 static routes

Routing protocol support (Router Information Protocol (RIP) V1; RIP V2; OSPF V1, V2, and V3;
BGP-4), up to 1024 entries in routing table

Support for DHCP Relay

IPv6 management
Virtualization

Virtual NIC (vNIC) support





vNIC Virtual Fabric mode
vNIC Switch Independent mode
Unified fabric port (UFP) support
VMready
Manageability










Simple Network Management Protocol (SNMP, V1, V2, and V3)
HTTP/HTTPS browser GUI
Industry-standard CLI or menu-driven CLI
Telnet interface for CLI
SSH V1/V2
Serial interface for CLI
Scriptable CLI
Firmware image update (TFTP and FTP)
Network Time Protocol (NTP) for switch clock synchronization
IBM System Networking Switch Center (SNSC) support
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
6

Monitoring





Switch LEDs for external port status and switch module status indication
Port mirroring for analyzing network traffic passing through switch
Change tracking and remote logging with syslog feature
POST diagnostics
Special functions

Serial over LAN (SOL)
The switch module supports the following IEEE standards:













IEEE 802.1D STP with PVRST+
IEEE 802.1s MSTP
IEEE 802.1w RSTP
IEEE 802.1p Tagged Packets
IEEE 802.1Q Tagged VLAN (frame tagging on all ports when VLANs are enabled)
IEEE 802.1x port-based authentication
IEEE 802.2 Logical Link Control
IEEE 802.3ad Link Aggregation Control Protocol
IEEE 802.3x Full-duplex Flow Control
IEEE 802.3ab 1000BASE-T Gigabit Ethernet
IEEE 802.3ae 10GBASE-SR 10Gb Ethernet fiber optics short range
IEEE 802.3ae 10GBASE-LR 10Gb Ethernet fiber optics long range
IEEE 802.3z 1000BASE-SX Gigabit Ethernet
Supported BladeCenter chassis and expansion cards
The IBM Virtual Fabric 10Gb Switch Module is supported in the IBM BladeCenter H and HT chassis listed
in the following table.
Table 2. IBM BladeCenter chassis that supports the IBM Virtual Fabric 10Gb Switch Module
I/O module
Part number
IBM Virtual Fabric 10Gb Switch Module
46C7191
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
N
N
Y
N
Y
N
N
7
The following table lists the compatibility information for the IBM Virtual Fabric 10Gb Switch Module and
the expansion cards.
Table 3. Expansion card compatibility
Description
Part number
Feature
code
Supported by the
Virtual Fabric
10Gb Switch Module
Gigabit Ethernet integrated on the server system board
None
None
No
Ethernet Expansion Card (CFFv)
39Y9310
2969
No
Ethernet Expansion Card (CIOv)
44W4475
1039
No
2/4 Port Ethernet Expansion Card (CFFh)
44W4479
5476
Supported
QLogic Ethernet and 8 Gb Fibre Channel Expansion Card
00Y3270*
A3JC
No
10Gb Interposer Card for HS23 (uses HS23 Integrated Virtual
Fabric LOM)
94Y8550
A244
Supported
Broadcom 10 Gb Gen 2 4-port Ethernet Expansion Card
46M6164
0098
Supported
Broadcom 10 Gb Gen 2 2-port Ethernet Expansion Card
46M6168
0099
Supported
Broadcom 2-port 10Gb Virtual Fabric Adapter
81Y3133
A1QR
Supported
Brocade 2-port 10GbE Converged Network Adapter
81Y1650
5437
Supported
Emulex 10GbE Virtual Fabric Adapter
49Y4235
5755
Supported
Emulex 10GbE Virtual Fabric Adapter Advanced
49Y4275
2435
Supported
Emulex Virtual Fabric Adapter II (CFFh)
90Y3550
A1XG
Supported
Emulex Virtual Fabric Adapter Advanced II (CFFh)
90Y3566
AIXH
Supported
Emulex 10GbE VFA II for IBM BladeCenter HS23
81Y3120
A287
Supported
Emulex 10GbE VFA Advanced II for IBM BladeCenter HS23
90Y9332
A2ZN
Supported
Intel 2-port 10 Gb Ethernet Expansion Card (CFFh)
42C1810
3593
No
Mellanox 10 Gb Ethernet Expansion Card (CFFh)
90Y3570
A1NW
Supported
QLogic 2-port 10Gb Converged Network Adapter (CFFh)
00Y3280**
A3JB
Supported
QLogic 10Gb Virtual Fabric Adapter
00Y3332
A4AC
Supported
QLogic 10Gb Virtual Fabric CNA
00Y5618
A4AD
Supported
Gigabit Ethernet
10 Gigabit Ethernet
* Replaces 44X1940.
** Replaces 42C1830.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
8
The five BladeCenter chassis have the following bays:

BladeCenter S, E, and T have four standard I/O bays (1, 2, 3, and 4)

BladeCenter H has six standard I/O bays (1, 2, 3, 4), two bridge bays (5 and 6) and four high-speed
bays (7, 8, 9, and 10)

BladeCenter HT has four standard I/O bays (1, 2, 3, 4) and four high-speed bays (7, 8, 9, and 10).
The IBM Virtual Fabric 10Gb Switch Module fits in one of the high-speed I/O bay (bays 7-10). For each
supported adapter, the following table lists which specific chassis I/O bays are supported.
Table 4. IBM Virtual Fabric 10Gb Switch Module and BladeCenter chassis I/O bays support
Description
Part
number
10Gb Interposer Card for HS23
94Y8550
N
N
N
N
N
N
Y
N
Y
N
2/4 Port Ethernet Expansion Card (CFFh)
44W4479
N
N
N
N
N
N
Y
Y
Y
Y
Broadcom 10 Gb Gen 2 2-port Ethernet Exp. Card
46M6168
N
N
N
N
N
N
Y
N
Y
N
Broadcom 10 Gb Gen 2 4-port Ethernet Exp. Card
46M6164
N
N
N
N
N
N
Y
Y
Y
Y
Broadcom 2-port 10Gb Virtual Fabric Adapter
81Y3133
N
N
N
N
N
N
Y
N
Y
N
Brocade 2-port 10GbE Converged Network Adapter
81Y1650
N
N
N
N
N
N
Y
N
Y
N
Emulex 10GbE Virtual Fabric Adapter
49Y4235
N
N
N
N
N
N
Y
N
Y
N
Emulex 10GbE Virtual Fabric Adapter Advanced
49Y4275
N
N
N
N
N
N
Y
N
Y
N
Emulex 10GbE Virtual Fabric Adapter II
90Y3550
N
N
N
N
N
N
Y
N
Y
N
Emulex 10GbE Virtual Fabric Adapter II Advanced
90Y3566
N
N
N
N
N
N
Y
N
Y
N
Emulex 10GbE VFA II for IBM BladeCenter HS23
81Y3120
N
N
N
N
N
N
Y*
Y
Y*
Y
Emulex 10GbE VFA Advanced II for IBM
BladeCenter HS23
90Y9332
N
N
N
N
N
N
Y*
Y
Y*
Y
Mellanox 2-port 10Gb Ethernet Expansion Card
90Y3570
N
N
N
N
N
N
Y
N
Y
N
QLogic 2-port 10Gb Converged Network Adapter
42C1830
N
N
N
N
N
N
Y
N
Y
N
QLogic 10Gb Virtual Fabric Adapter
00Y3332
N
N
N
N
N
N
Y
N
Y
N
QLogic 10Gb Virtual Fabric CNA
00Y5618
N
N
N
N
N
N
Y
N
Y
N
* These ports are available by routing the onboard Emulex BE3 controller of the HS23 blade server through the VFA
card.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
9
Connectors and LEDs
Figure 2 shows the front panel of the IBM Virtual Fabric 10Gb Switch Module.
Figure 2. Front panel of the IBM Virtual Fabric 10Gb Switch Module
The front panel contains the following components:

LEDs display the status of the switch module and the network:

OK: indicates that the switch module has passed the power-on self-test (POST) with no critical
faults and is operational

Switch-module error: indicates that the switch module has failed the POST or detected an
operational fault

One USB RS-232 console port provides an additional means to install software and configure the
switch module. This USB-style connector enables the connection of a special serial cable that is
supplied with the switch module.

Ten SFP+ port connectors to attach SFP+ modules.

One RJ-45 Ethernet port connector.

Each external SFP+ port on the switch module contains a link/activity LED, and an RJ-45 port
contains Ethernet link OK and Ethernet Tx/Rx activity LEDs.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
10
Popular configurations
The IBM Virtual Fabric 10Gb Switch Module can be used in various configurations.
Basic two-port configuration
Figure 3 shows the use of IBM Virtual Fabric 10Gb Switch Modules to route two Ethernet ports from
Emulex 10GbE Virtual Fabric Adapter II cards installed on each server. Two IBM Virtual Fabric 10Gb
Switch Modules are installed in bay 7 and bay 9 of the BladeCenter H chassis. All connections between
the controller, card, and switch modules are internal to the chassis. No cabling is needed.
Figure 3. A dual 10Gb solution using two IBM Virtual Fabric 10Gb Switch Modules
The following table lists the components used in this configuration.
Table 5. Components used when connecting Emulex 10GbE Virtual Fabric Adapter II cards to two IBM
Virtual Fabric 10Gb Switch Modules
Diagram
reference
Part number/
machine type
Description
Quantity
Varies
IBM BladeCenter HS22 or other supported server
1 to 14
90Y3550
Emulex 10GbE Virtual Fabric Adapter II
1 per
server
8852 or 8740/8750
BladeCenter H or BladeCenter HT
1
46C7191
IBM Virtual Fabric 10Gb Switch Module
2
90Y9430
IBM Passive DAC SFP+ cable, 3M
Up to 20*
*The IBM Virtual Fabric 10Gb Switch Module has 10 external 10 Gb ports. To communicate outside of the
chassis, you must have either one SFP or SFP+ transceiver or SFP+ direct-attached copper (DAC) cable
connected. You have the flexibility to expand your bandwidth as you see fit using from one to 10
connections per switch.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
11
4-port configuration
Figure 4 shows the use of IBM Virtual Fabric 10Gb Switch Modules to route four Ethernet ports from a
Broadcom 4-port 10Gb Ethernet Expansion Card (CFFh) installed on each server. Four IBM Virtual Fabric
10Gb Switch Modules are installed in bay 7, bay 8, bay 9, and bay 10 of the BladeCenter H chassis. All
connections between the controller, card, and switch modules are internal to the chassis. No cabling is
needed.
Figure 4. A four 10Gb port solution using four IBM Virtual Fabric 10Gb Switch Modules
The following table lists the components used in this configuration.
Table 6. Components used when connecting Broadcom 4-port 10Gb Ethernet Expansion Card (CFFh) to
four IBM Virtual Fabric 10Gb Switch Modules
Diagram
reference
Part number/
machine type
Description
Quantity
Varies
IBM BladeCenter HS22 or other supported server
1 to 14
44W4465
Broadcom 4-port 10Gb Ethernet Expansion Card (CFFh)
1 per
server
8852 or 8740/8750
BladeCenter H or BladeCenter HT
1
46C7191
IBM Virtual Fabric 10Gb Switch Module
4
90Y9430
IBM Passive DAC SFP+ cable, 3M
Up to 40*
*The IBM Virtual Fabric 10Gb Switch Module has 10 external 10 Gb ports. In order to communicate
outside of the chassis you must have either one SFP or SFP+ transceiver or SFP+ DAC cable connected.
You have the flexibility to expand your bandwidth as you see fit using from one to 10 connections per
switch.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
12
4-port configuration on a BladeCenter HS23
This configuration uses a combination of the onboard Emulex-based 10Gb Ethernet controller of the
BladeCenter HS23 plus an Emulex CFFh adapter. Two 10 GbE ports are from the onboard Emulex BE3
controller and two more from the Emulex 10GbE Virtual Fabric Adapter II for HS23, 81Y3120. These four
physical ports can be configured as up to 14 vNICs. A further two Gigibit Ethernet ports are also available.
Figure 5 shows the use of four IBM Virtual Fabric 10Gb Switch Modules to route the four 10 GbE ports on
the HS23:


Two ports from the onboard Emulex BE3 controller HS23 are routed to bays 7 and 9
Two ports from the Emulex BE3 controller on the Emulex 10GbE Virtual Fabric Adapter II for HS23
are routed to bays 8 and 10
All connections between the LOM, card and switch modules are internal to the chassis. No cabling is
needed.
Figure 5. A four 10Gb port solution with the BladeCenter HS23
The following table lists the components used in this configuration.
Table 7. Components used when enabling 10 GbE ports on an HS23 to four IBM Virtual Fabric 10Gb
Switch Modules
Diagram
reference
Part number/
machine type
Description
Quantity
7875
IBM BladeCenter HS23, either configure-to-order model (CTO)
or a model without the 10 Gb LOM Interposer card
1 to 14
81Y3120
Emulex 10GbE Virtual Fabric Adapter II for HS23
1 per
server
8852 or 8740/8750
BladeCenter H or BladeCenter HT
1
46C7191
IBM Virtual Fabric 10Gb Switch Module
4
90Y9430
IBM Passive DAC SFP+ cable, 3M
Up to 40*
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
13
Network cabling requirements
The network cables that can be used with the switch are shown in the following table.
Table 8. IBM Virtual Fabric 10 GbE switch network cabling requirements
Standard
Cable
Connector
IBM SFP+ SR Transceiver
(46C3447)
10GBASE-SR
850 nm multimode fiber cable (50 µ or 62.5 µ) up to
300 m
LC
IBM SFP+ LR Transceiver
(90Y9412)
10GBASE-LR
1310 nm single-mode fiber cable up to 10 km
LC
IBM SFP+ ER Transceiver
(90Y9415)
10GBASE-ER
1310 nm single-mode fiber cable up to 40 km
LC
10GBase-SR SFP+
(MMFiber) transceiver
(44W4408)
10GBASE-SR
850 nm multimode fiber cable (50 µ or 62.5 µ) up to
300 m
LC
Direct attach cable
10GSFP+Cu
SFP+ DAC cables up to 7 m (see Table 1)
SFP+
IBM SFP RJ-45 Transceiver 1000BASE-T
(81Y1618)
UTP Category 5, 5E, and 6 up to 100 meters
RJ-45
IBM SFP SX Transceiver
(81Y1622)
1000BASE-SX
850 nm multimode fiber cable (50 µ or 62.5 µ) up to
550 m
LC
IBM SFP LX Transceiver
(90Y9424)
1000BASE-LX
1310 nm single-mode fiber cable up to 10 km
LC
Fixed RJ-45 1 GbE port
1000BASE-T
UTP Category 5, 5E, and 6 up to 100 meters
RJ-45
Transceiver
10 Gb Ethernet
1 Gb Ethernet
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
14
Related publications
For more information see the following IBM Virtual Fabric 10Gb Switch Module product publications,
available from:
http://ibm.com/support/entry/portal/docdisplay?lndocid=MIGR-5091835







Installation Guide
Application Guide
Command Reference
isCLI Reference
BBI (Browser-based Interface) Quick Guide
Release Notes
End User License Agreement
Other documents:

IBM BladeCenter Virtual Fabric home page:
http://www.ibm.com/systems/bladecenter/hardware/openfabric/virtualfabric.html

IBM BladeCenter InfoCenter, IBM Virtual Fabric 10Gb Switch Module
http://publib.boulder.ibm.com/infocenter/bladectr/documentation/topic/com.ibm.bladecenter.io_39Y92
67.doc/io_c_esm_snet_vf10g_product_page.html

IBM Redbooks Product Guide, Emulex 10GbE VFA II and Emulex 10GbE VFA Advanced II for IBM
BladeCenter HS23
http://www.redbooks.ibm.com/abstracts/tips0875.html?Open

IBM Redbooks Product Guide, Emulex Virtual Fabric Adapter (CFFh) for IBM BladeCenter
http://www.redbooks.ibm.com/abstracts/tips0748.html?Open

IBM Redbooks Product Guide, QLogic Virtual Fabric Extension Module for IBM BladeCenter
http://www.redbooks.ibm.com/abstracts/tips0717.html?Open

IBM US Announcement Letter:
http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENUS109-288

IBM BladeCenter Interoperability Guide:
http://www.redbooks.ibm.com/big

IBM Redbooks publication IBM BladeCenter Products and Technology, SG24-7523:
http://www.redbooks.ibm.com/abstracts/sg247523.html
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
15
Notices
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult your
local IBM representative for information on the products and services currently available in your area. Any reference
to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or
service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM
intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the
operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications
covering subject matter described in this document. The furnishing of this document does not give you any license
to these patents. You can send license inquiries, in writing, to:
IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions
are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS
FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain
transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies
or typographical errors. Changes are periodically made to the information herein; these changes will be
incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s)
and/or the program(s) described in this publication at any time without notice.
Any references in this information to non-IBM Web sites are provided for convenience only and do not in any
manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials
for this IBM product and use of those Web sites is at your own risk.IBM may use or distribute any of the information
you supply in any way it believes appropriate without incurring any obligation to you. Information concerning
non-IBM products was obtained from the suppliers of those products, their published announcements or other
publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance,
compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products
should be addressed to the suppliers of those products. This information contains examples of data and reports
used in daily business operations. To illustrate them as completely as possible, the examples include the names of
individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and
addresses used by an actual business enterprise is entirely coincidental.
Any performance data contained herein was determined in a controlled environment. Therefore, the results
obtained in other operating environments may vary significantly. Some measurements may have been made on
development-level systems and there is no guarantee that these measurements will be the same on generally
available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual
results may vary. Users of this document should verify the applicable data for their specific environment.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrate programming
techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any
form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs
conforming to the application programming interface for the operating platform for which the sample programs are
written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or
imply reliability, serviceability, or function of these programs.
© Copyright International Business Machines Corporation 2009. All rights reserved.
Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by
GSA ADP Schedule Contract with IBM Corp.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
16
This document was created or updated on April 28, 2014.
Send us your comments in one of the following ways:
Use the online Contact us review form found at:
ibm.com/redbooks

Send your comments in an e-mail to:
redbook@us.ibm.com

Mail your comments to:
IBM Corporation, International Technical Support Organization
Dept. HYTD Mail Station P099
2455 South Road
Poughkeepsie, NY 12601-5400 U.S.A.

This document is available online at http://www.ibm.com/redbooks/abstracts/tips0708.html .
Trademarks
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business
Machines Corporation in the United States, other countries, or both. These and other IBM trademarked
terms may also be registered or common law trademarks in other countries. A current list of IBM
trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml
The following terms are trademarks of the International Business Machines Corporation in the United
States, other countries, or both:
BladeCenter®
IBM®
Redbooks®
Redbooks (logo)®
System x®
Other company, product, or service names may be trademarks or service marks of others.
IBM Virtual Fabric 10Gb Switch Module for IBM BladeCenter
17
Was this manual useful for you? yes no
Thank you for your participation!

* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project

Download PDF

advertising