®
Ethernet Expansion Card (CIOv) for IBM BladeCenter
IBM BladeCenter at-a-glance guide
The Ethernet Expansion Card (CIOv) is an Ethernet expansion card with two 1 Gb Ethernet ports
designed for BladeCenter servers with CIOv expansion slots. It is based on proven Broadcom 5709S
ASIC technology and offers value added features like TCP Offload (TOE) and software-based iSCSI
support for high performance.
This card is installed into the CIOv slot of the supported blade server. It provides connections to
Ethernet-compatible modules located in bays 3 and 4 of supported BladeCenter chassis. The CIOv slot is
a second generation PCI Express x8 slot. A maximum of one Ethernet Expansion Card (CIOv) is
supported per single-wide blade server.
The Ethernet Expansion Card (CIOv) is shown in Figure 1.
Figure 1. Ethernet Expansion Card (CIOv)
Did you know?
Today's virtualized servers require a larger number of network adapters. This adapter is a perfect fit for
these environments because it can enable up to eight Ethernet ports per blade server.
The adapter is based on the PCI Express bus, which can be thought of as a high-speed serial
replacement of the older technology. Its use offers many benefits including higher speeds and the ability
to send and receive data at the same time.
When using the CIOv adapter, you can simultaneously use a CFFh adapter to enable more types of I/O to
supported blade servers such as the HS22 when installed in the IBM BladeCenter H chassis. The
innovative design of the CIOv adapter is designed to work with the CFFh adapter to support this
combination workload.
Ethernet Expansion Card (CIOv) for IBM BladeCenter
1
Part number information
Table 1. Ordering part number and feature code
Description
Part number
Feature code
Ethernet Expansion Card (CIOv) for IBM BladeCenter
44W4475
1039
This part number includes the following items:
z
One Ethernet Expansion Card (CIOv) for IBM BladeCenter
z
The Documentation CD that contains Ethernet Expansion Card (CIOv) for IBM BladeCenter
z
The IBM Important Notices document
Installation and User’s Guide
Features
The expansion card has the following features:
z
PCI Express host interface
z
Broadcom BCM5709S communication module
z
BladeCenter Open Fabric Manager (BOFM) support
z
Connection to 1000BASE-X environments using BladeCenter Ethernet switches
z
Full-duplex (FDX) capability, enabling simultaneous transmission and reception of data on the
Ethernet local area network (LAN)
z
Failover support
z
Preboot Execution Environment (PXE) support
z
Support for direct memory access (DMA)
z
Wake on LAN support for both ports
Operating environment
The expansion card is supported in this environment:
z
Temperature:
z
z
10 to 35°C (50 to 95°F) at 0 to 914 m (0 to 3,000 ft)
10 to 32°C (50 to 90°F) at 914 to 2,133 m (3,000 to 7,000 ft)
z
Relative humidity: 8% to 80%
z
Maximum altitude: 2,133 m (7,000 ft)
Ethernet Expansion Card (CIOv) for IBM BladeCenter
2
Supported servers and I /O modules
The Ethernet Expansion Card (CIOv) is supported in the IBM BladeCenter servers listed in Table 2.
Table 2. Supported servers
Expansion card
Part number
Ethernet Expansion Card 44W4475
(CIOv)
N
N
N
Y
N
N
N
N
N
N
N
N
N
N
N
See IBM ServerProven for the latest information on the expansion cards supported by each blade server
type: http://ibm.com/servers/eserver/serverproven/compat/us/.
CIOv expansion cards are installed in the CIOv slot in supported servers such as the HS22, as shown in
green in Figure 2.
Figure 2. Location of the CIOv slot in the IBM BladeCenter HS22
Ethernet Expansion Card (CIOv) for IBM BladeCenter
3
The Ethernet Expansion Card (CIOv) requires that a supported I/O module is installed in bay 3 and bay 4
of the chassis that the cards and servers are installed in. The supported I/O modules are:
z
z
z
z
Any IBM, BNT or Cisco Ethernet Switch Module (standard form-factor switch module)
Optical Pass-thru Module
Copper Pass-thru Module
Intelligent Copper Pass-thru Module
Popular configurations
This section shows two popular configurations using the Ethernet Expansion Card (CIOv).
Adding two extra Ethernet ports per blade server
Most often, the Ethernet Expansion Card (CIOv) is used to expand the number of Ethernet ports per blade
to increase network bandwidth. This is shown in Figure 3.
Figure 3. The Ethernet Expansion Card (CIOv) provides two extra Ethernet ports per blade server
The components used in this configuration are listed in Table 3.
Table 3. Components used when connecting the Ethernet Expansion Card (CIOv) to external Ethernet
network
Diagram
reference
Part number /
Machine type
Description
Quantity
Varies
IBM BladeCenter HS22 or other supported server
1 to 14
44W4475
Ethernet Expansion Card (CIOv)
1 per
server
Varies
IBM BladeCenter E, BladeCenter H, or BladeCenter S*
1
Varies
Any Ethernet-compatible switch module
1 or 2
*Note: The expansion card can be installed in servers in the BladeCenter S (8886). However, by doing so
you will lose the ability to connect to the BladeCenter S Disk Storage Modules (DSMs). The Ethernet
expansion card will go in the place of the SAS expansion card needed to connected to the DSMs. Instead,
use the 2/4 Port Ethernet Expansion Card (CFFh), part number 44W4479.
Ethernet Expansion Card (CIOv) for IBM BladeCenter
4
iSCSI SAN storage solution
In addition, this card can be used to connect to external iSCSI-based entry-level SAN, as shown in Figure
4.
Figure 4. IBM BladeCenter connected to an external IBM System Storage DS3300 storage solution
The components used in this configuration are listed in Table 4.
Table 4. Components used when connecting the Ethernet Expansion Card (CIOv) to external iSCSI disk
storage
Diagram
reference
Part number /
Machine type
Description
Quantity
Varies
IBM BladeCenter HS22 or other supported server
1 to 14
44W4475
Ethernet Expansion Card (CIOv)
1 per
server
Varies
IBM BladeCenter E, BladeCenter H, or BladeCenter S*
1
Varies
Any Ethernet-compatible switch module
1 or 2
1726-31X or
1726-32X
IBM System Storage DS3300 (Single or Dual Controller)
1
1727
Optional IBM System Storage EXP3000 (Single or Dual ESM)
1 to 3
39R6536
DS3000 Partition Expansion License
1
*Note: The expansion card can be installed in servers in the BladeCenter S (8886). However, by doing so
you will lose the ability to connect to the BladeCenter S Disk Storage Modules (DSMs). The Ethernet
expansion card will go in the place of the SAS expansion card needed to connected to the DSMs. Instead,
use the 2/4 Port Ethernet Expansion Card (CFFh), part number 44W4479.
This configuration will also require cabling between the chassis and the storage server and between the
storage server and expansion units. (The cable part numbers are not listed in Table 4.)
Ethernet Expansion Card (CIOv) for IBM BladeCenter
5
Supported operating systems
The following operating systems support the expansion card:
z
z
z
z
z
z
z
z
z
z
z
z
z
z
z
z
z
z
z
z
Microsoft Windows Server 2003, Web Edition
Microsoft Windows Server 2003/2003 R2, Enterprise Edition
Microsoft Windows Server 2003/2003 R2, Enterprise x64 Edition
Microsoft Windows Server 2003/2003 R2, Standard Edition
Microsoft Windows Server 2003/2003 R2, Standard x64 Edition
Microsoft Windows Server 2008, Enterprise x64 Edition
Microsoft Windows Server 2008, Enterprise x86 Edition
Microsoft Windows Server 2008, Standard x64 Edition
Microsoft Windows Server 2008, Standard x86 Edition
Microsoft Windows Server 2008, Web x64 Edition
Microsoft Windows Server 2008, Web x86 Edition
Microsoft Windows Small Business Server 2003/2003 R2 Premium Edition
Microsoft Windows Small Business Server 2003/2003 R2 Standard Edition
Red Hat Enterprise Linux 5 Server Edition
Red Hat Enterprise Linux 5 Server with Xen x64 Edition
Red Hat Enterprise Linux 5 Server x64 Edition
SUSE Linux Enterprise Server 10 for AMD64/EM64T
SUSE Linux Enterprise Server 10 for x86
SUSE Linux Enterprise Server 10 with Xen for AMD64/EM64T
SUSE Linux Enterprise Server 10 with Xen for x86
See IBM ServerProven for the latest information on the specific versions and service packs supported:
http://ibm.com/servers/eserver/serverproven/compat/us/. Select the blade server and then select the
expansion card to see the supported operating systems.
Related publications
For more information refer to these documents:
z
Ethernet Expansion Card (CIOv) Installation and User's Guide:
http://www.ibm.com/support/docview.wss?uid=psg1MIGR-080268
z
IBM US Announcement Letter for the Ethernet Expansion Card (CIOv)
http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENUS109-101
z
IBM BladeCenter Interoperability Guide
http://www.ibm.com/support/docview.wss?uid=psg1MIGR-5073016
z
IBM Redbooks publication IBM BladeCenter Products and Technology:
http://www.redbooks.ibm.com/abstracts/sg247523.html
Ethernet Expansion Card (CIOv) for IBM BladeCenter
6
Notices
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local
IBM representative for information on the products and services currently available in your area. Any reference to an
IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may
be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property
right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM
product, program, or service. IBM may have patents or pending patent applications covering subject matter described
in this document. The furnishing of this document does not give you any license to these patents. You can send
license inquiries, in writing, to:
IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions
are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS
FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain
transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or
typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in
new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s)
described in this publication at any time without notice.
Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner
serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this
IBM product and use of those Web sites is at your own risk.IBM may use or distribute any of the information you
supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-IBM
products was obtained from the suppliers of those products, their published announcements or other publicly
available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility
or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be
addressed to the suppliers of those products. This information contains examples of data and reports used in daily
business operations. To illustrate them as completely as possible, the examples include the names of individuals,
companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses
used by an actual business enterprise is entirely coincidental.
Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained
in other operating environments may vary significantly. Some measurements may have been made on
development-level systems and there is no guarantee that these measurements will be the same on generally
available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual results
may vary. Users of this document should verify the applicable data for their specific environment.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrate programming techniques
on various operating platforms. You may copy, modify, and distribute these sample programs in any form without
payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to
the application programming interface for the operating platform for which the sample programs are written. These
examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability,
serviceability, or function of these programs.
© Copyright International Business Machines Corporation 2009. All rights reserved.
Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by
GSA ADP Schedule Contract with IBM Corp.
Ethernet Expansion Card (CIOv) for IBM BladeCenter
7
This document was created or updated on March 30, 2009.
Send us your comments in one of the following ways:
Use the online Contact us review form found at:
ibm.com/redbooks
Send your comments in an e-mail to:
z
redbook@us.ibm.com
Mail your comments to:
z
IBM Corporation, International Technical Support Organization
Dept. HYTD Mail Station P099
2455 South Road
Poughkeepsie, NY 12601-5400 U.S.A.
z
This document is available online at http://www.ibm.com/redbooks/abstracts/tips0697.html .
Trademarks
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business
Machines Corporation in the United States, other countries, or both. These and other IBM trademarked
terms may also be registered or common law trademarks in other countries. A current list of IBM
trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml
The following terms are trademarks of the International Business Machines Corporation in the United
States, other countries, or both:
BladeCenter®
FlashCopy®
IBM®
Redbooks®
Redbooks (logo)®
ServerProven®
System Storage™
The following terms are trademarks of other companies:
SUSE, the Novell logo, and the N logo are registered trademarks of Novell, Inc. in the United States and
other countries.
Enterprise Linux, Red Hat, and the Shadowman logo are trademarks or registered trademarks of Red
Hat, Inc. in the U.S. and other countries.
Microsoft, Windows Server, Windows, and the Windows logo are trademarks of Microsoft Corporation in
the United States, other countries, or both.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both.
Other company, product, or service names may be trademarks or service marks of others.
Ethernet Expansion Card (CIOv) for IBM BladeCenter
8