Cisco UCS C240 M5 Server Installation and Service Guide

Cisco UCS C240 M5 Server Installation and Service Guide
First Published: 2017-07-14
Last Modified: 2017-09-12
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883
Text Part Number:
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS,
INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH
THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY,
CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15
of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment
generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.
The following information is for FCC compliance of Class B devices: This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15
of the FCC rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses and can radiate radio
frequency energy and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. However, there is no guarantee that interference
will not occur in a particular installation. If the equipment causes interference to radio or television reception, which can be determined by turning the equipment off and on, users are
encouraged to try to correct the interference by using one or more of the following measures:
• Reorient or relocate the receiving antenna.
• Increase the separation between the equipment and receiver.
• Connect the equipment into an outlet on a circuit different from that to which the receiver is connected.
• Consult the dealer or an experienced radio/TV technician for help.
Modifications to this product not authorized by Cisco could void the FCC approval and negate your authority to operate the product
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version
of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED "AS IS" WITH ALL FAULTS.
CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT
LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS
HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network
topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional
and coincidental.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: http://
www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership
relationship between Cisco and any other company. (1110R)
© 2017
Cisco Systems, Inc. All rights reserved.
CHAPTER
1
Overview
• Overview, page 1
• External Features, page 2
• Serviceable Component Locations, page 7
• Summary of Server Features, page 8
Overview
The server is orderable in different versions, each with a different front panel/drive-backplane configuration.
• Cisco UCS C240 M5 (UCSC-C240-M5SX)—Small form-factor (SFF) drives, with 24-drive backplane.
◦Front-loading drive bays 1—24 support 2.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 2.5-inch NVMe SSDs.
◦Optionally, the two rear-loading drive bays support up to two 2.5-inch SAS/SATA drives; or up
to two 2.5-inch NVMe SSDs.
•
◦
◦
◦
• Cisco UCS C240 M5 (UCSC-C240-M5S)—SFF drives, with 8-drive backplane and DVD drive option.
◦Front-loading drive bays 1—8 support 2.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 2.5-inch NVMe SSDs.
◦Optionally, the two rear-loading drive bays support up to two 2.5-inch SAS/SATA drives; or up
to two 2.5-inch NVMe SSDs.
• Cisco UCS C240 M5 (UCSC-C240-M5L)—Large form-factor (LFF) drives, with 12-drive backplane.
◦Front-loading drive bays 1—12 support 3.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 3.5-inch NVMe SSDs.
Cisco UCS C240 M5 Server Installation and Service Guide
1
Overview
External Features
◦Optionally, the two rear-loading drive bays support up to two 2.5-inch SAS/SATA drives; or up
to two 2.5-inch NVMe SSDs.
External Features
This topic shows the external features of the server versions.
For definitions of LED states, see Front-Panel LEDs, on page 32.
Cisco UCS C240 M5 Server (SFF Drives, 24-Drive) Front Panel Features
Figure 1: Cisco UCS C240 M5 Server (SFF Drives, 24-Drive) Front Panel
1
• UCSC-C240-M5SX: Drive bays 1—24 support
SAS/SATA drives.
7
Temperature status LED
8
Power supply status LED
•
2
• UCSC-C240-M5SX: Drive bays 1 and 2 support
NVMe PCIe SSDs.
•
Cisco UCS C240 M5 Server Installation and Service Guide
2
Overview
External Features
3
Power button/power status LED
9
Network link activity LED
4
Unit identification button/LED
10
Pull-out asset tag
5
System status LED
11
KVM connector (used with KVM cable that provides one
DB-15 VGA, one DB-9 serial, and two USB connectors)
6
Fan status LED
-
Cisco UCS C240 M5 Server (SFF Drives, 8-Drive) Front Panel Features
The following figure shows the front panel features of the small form-factor (SFF) drive, 8-drive version of
the server (UCSC-C240-M5S).
For definitions of LED states, see Front-Panel LEDs, on page 32.
Figure 2: Cisco UCS C240 M5 Server (SFF Drives, 8-Drive) Front Panel
1
UCSC-C240-M5S: Drive bays 1—8 support SAS/SATA 7
drives.
Temperature status LED
2
UCSC-C240-M5S: Drive bays 1 and 2 support NVMe
PCIe SSDs.
8
Power supply status LED
3
Power button/power status LED
9
Network link activity LED
Cisco UCS C240 M5 Server Installation and Service Guide
3
Overview
External Features
4
Unit identification button/LED
10
DVD player
5
System status LED
11
Pull-out asset tag
6
Fan status LED
-
KVM connector (used with KVM cable that provides one
DB-15 VGA, one DB-9 serial, and two USB connectors)
Cisco UCS C240 M5 Server (LFF Drives, 12-Drive) Front Panel Features
The following figure shows the front panel features of the large form-factor (LFF) drive version of the server
(UCSC-C240-M5L).
For definitions of LED states, see Front-Panel LEDs, on page 32.
Figure 3: Cisco UCS C240 M5 Server (LFF Drives) Front Panel
1
UCSC-C240-M5L: Drive bays 1—12 support 3.5-inch 7
SAS/SATA drives.
Temperature status LED
2
Drive bays 1 and 2 support 3.5-inch NVMe SSDs.
8
Power supply status LED
9
Network link activity LED
A size-converter drive sled is required to hold 2.5-inch
SSDs.
Power button/power status LED
3
Cisco UCS C240 M5 Server Installation and Service Guide
4
Overview
External Features
4
Unit identification button/LED
10
KVM connector (used with KVM cable that provides one
DB-15 VGA, one DB-9 serial, and two USB connectors)
5
System health LED
11
Pull-out asset tag
6
Fan status LED
-
Cisco UCS C240 M5 Server Rear Panel Features
The rear panel features are the same for all versions of the server.
For definitions of LED states, see Rear-Panel LEDs, on page 35.
Figure 4: Cisco UCS C240 M5 Server Rear Panel
1
PCIe riser 1 (PCIe slot 1, 2, 3), with the following
options:
7
USB 3.0 ports (two)
8
Dual 1-Gb/10-Gb Ethernet ports (LAN1 and LAN2)
• 1—Slots 1 (x8), 2 (x16), 3 (x8); slot 3 requires
CPU2.
• 1B—Slots 1 (x8), 2 (x8), 3 (x8); all slots supported
by CPU1
See PCIe Slot Specifications, on page 95 for slot
specifications.
2
PCIe riser 2 (PCIe slots 4, 5, 6), with the following
options:
• 2A—Slots 4 (x16), 5 (x16), and 6 (x8).
The dual LAN ports can support 1 Gbps and 10 Gbps,
depending on the link partner capability.
• 2B—Slots 4 (x8), 5 (x16), and 6 (x8); includes
cable connector for rear-loading NVMe SSDs.
• 2C—With slots 4 (x8), 5 (x8), and 6 (x8); includes
two cable connectors for rear-loading and
front-loading NVMe SSDs.
•
Cisco UCS C240 M5 Server Installation and Service Guide
5
Overview
External Features
Rear 2.5-inch drive bays:
3
9
VGA video port (DB-15 connector)
10
1-Gb Ethernet dedicated management port
11
Serial port (RJ-45 connector)
•
• All other C240 M5 PIDs support up to two drives:
◦When using a hardware-RAID controller card
in the server, SAS/SATA drives or NVMe
SSDs are supported in the rear bays.
◦When using software RAID in the server,
only NVMe SSDs are supported in the rear
bays.
Power supplies (two, redundant as 1+1)
4
See Power Specifications, on page 122 for specifications
and supported options.
5
Threaded holes for dual-hole grounding lug.
6
Modular LAN-on-motherboard (mLOM) card slot (x16) 12
Cisco UCS C240 M5 Server Installation and Service Guide
6
Rear unit identification button/LED
Overview
Serviceable Component Locations
Serviceable Component Locations
This topic shows the locations of the field-replaceable components and service-related items. The view in the
following figure shows the server with the top cover removed.
Figure 5: Cisco UCS C240 M5 Server, Serviceable Component Locations
1
Front-loading drive bays.
11
Rear-drive backplane assembly
2
Cooling fan modules (six, hot-swappable)
12
Power supplies (hot-swappable when redundant as 1+1)
3
DIMM sockets on motherboard (up to 12 per CPU)
13
Rear 2.5-inch drive bays:
Not visible under air baffle in this view.
•
• All other C240 M5 PIDs support up to two drives:
See DIMM Population Rules and Memory Performance
Guidelines , on page 70 for DIMM slot numbering.
◦When using a hardware-RAID controller card
in the server, SAS/SATA drives or NVMe
SSDs are supported in the rear bays.
◦When using software RAID in the server, only
NVMe SSDs are supported in the rear bays.
4
CPUs and heatsinks (up to two)
Not visible under air baffle in this view.
14
Trusted platform module (TPM) socket on motherboard
(not visible in this view)
Cisco UCS C240 M5 Server Installation and Service Guide
7
Overview
Summary of Server Features
Supercap unit (RAID backup) mounting bracket
5
15
PCIe riser 2 (PCIe slots 4, 5, 6), with the following options:
• 2A—Slots 4 (x16), 5 (x16), and 6 (x8).
• 2B—Slots 4 (x8), 5 (x16), and 6 (x8); includes cable
connector for rear-loading NVMe SSDs.
• 2C—With slots 4 (x8), 5 (x8), and 6 (x8); includes
two cable connectors for rear-loading and
front-loading NVMe SSDs.
•
6
Internal, vertical USB 3.0 port on motherboard
16
Micro-SD card socket on PCIe riser 1
7
Mini storage module socket
17
PCIe riser 1 (PCIe slot 1, 2, 3), with the following options:
Supports either an SD card carrier with two SD card
slots; or an M.2 SSD carrier with two slots for either two
M.2 SATA or two M.2 NVMe SSDs.
• 1A—Slots 1 (x8), 2 (x16), 3 (x8); slot 2 requires
CPU2.
• 1B—Slots 1 (x8), 2 (x8), 3 (x8); all slots supported
by CPU1
8
Chassis intrusion switch (optional)
18
Modular LOM (mLOM) card bay on chassis floor (x16
PCIe lane), not visible in this view
9
PCIe cable connectors for NVMe SSDs, only on these
PCIe riser 2 options:
19
Cisco modular RAID controller PCIe slot (dedicated slot)
20
RTC battery, vertical socket
21
Securing clips for GPU cards on air baffle
• 2B: One connector for rear NVMe SSDs.
• 2C: One connector for rear NVMe SSDs plus one
connector for front-loading NVMe SSDs
•
Rear-drive fan module
10
The Technical Specifications Sheets for all versions of this server, which include supported component part
numbers, are at Cisco UCS Servers Technical Specifications Sheets (scroll down to Technical Specifications).
Summary of Server Features
The following table lists a summary of server features.
Feature
Description
Chassis
Two rack-unit (2RU) chassis
Cisco UCS C240 M5 Server Installation and Service Guide
8
Overview
Summary of Server Features
Feature
Description
Central Processor
Up to two CPUs from the Intel Xeon Processor Scalable Family. This includes CPUs from
the following series:
• Intel Xeon Bronze 3XXX Processors
• Intel Xeon Silver 4XXX Processors
• Intel Xeon Gold 5XXX Processors
• Intel Xeon Gold 6XXX Processors
• Intel Xeon Platinum 8XXX Processors
Memory
24 DDR4 DIMM sockets on the motherboard (12 each CPU)
Multi-bit error protection
Multi-bit error protection is supported
Baseboard management
BMC, running Cisco Integrated Management Controller (Cisco IMC) firmware.
Depending on your Cisco IMC settings, Cisco IMC can be accessed through the 1-Gb dedicated
management port, the 1-Gb/10-Gb Ethernet LAN ports, or a Cisco virtual interface card.
Network and management I/O
Rear panel:
• One 1-Gb Ethernet dedicated management port (RJ-45 connector)
• Two 1-Gb/10-Gb BASE-T Ethernet LAN ports (RJ-45 connectors)
The dual LAN ports can support 1 Gbps and 10 Gbps, depending on the link partner
capability.
• One RS-232 serial port (RJ-45 connector)
• One VGA video connector port (DB-15 connector)
• Two USB 3.0 ports
Front panel:
• One front-panel keyboard/video/mouse (KVM) connector that is used with the KVM
cable, which provides two USB 2.0, one VGA, and one DB-9 serial connector.
Modular LOM
One dedicated socket (x16 PCIe lane) that can be used to add an mLOM card for additional
rear-panel connectivity.
WoL
The two 1-Gb/10-Gb BASE-T Ethernet LAN ports support the wake-on-LAN (WoL) standard.
Cisco UCS C240 M5 Server Installation and Service Guide
9
Overview
Summary of Server Features
Feature
Description
Power
Two power supplies, redundant as 1+1:
•
• AC power supplies 1050 W AC each
• AC power supplies 1600 W AC each
• DC power supplies 1050 W DC each
Do not mix power supply types or wattages in the server.
ACPI
The advanced configuration and power interface (ACPI) 4.0 standard is supported.
Cooling
Six hot-swappable fan modules for front-to-rear cooling.
PCIe I/O
Six horizontal PCIe expansion slots on two PCIe riser assemblies.
See PCIe Slot Specifications, on page 95 for specifications of the slots.
InfiniBand
The PCIe bus slots in this server support the InfiniBand architecture.
Cisco UCS C240 M5 Server Installation and Service Guide
10
Overview
Summary of Server Features
Feature
Description
Storage, front-panel
The server is orderable in different versions, each with a different front panel/drive-backplane
configuration.
• Cisco UCS C240 M5 (UCSC-C240-M5SX)—Small form-factor (SFF) drives, with
24-drive backplane.
◦Front-loading drive bays 1—24 support 2.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 2.5-inch NVMe SSDs.
◦Optionally, the two rear-loading drive bays support up to two 2.5-inch SAS/SATA
drives; or up to two 2.5-inch NVMe SSDs.
•
◦
◦
◦
• Cisco UCS C240 M5 (UCSC-C240-M5S)—SFF drives, with 8-drive backplane and
DVD drive option.
◦Front-loading drive bays 1—8 support 2.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 2.5-inch NVMe SSDs.
◦Optionally, the two rear-loading drive bays support up to two 2.5-inch SAS/SATA
drives; or up to two 2.5-inch NVMe SSDs.
• Cisco UCS C240 M5 (UCSC-C240-M5L)—Large form-factor (LFF) drives, with
12-drive backplane.
◦Front-loading drive bays 1—12 support 3.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 3.5-inch NVMe SSDs.
◦Optionally, the two rear-loading drive bays support up to two 2.5-inch SAS/SATA
drives; or up to two 2.5-inch NVMe SSDs.
SAS/SATA drives are hot-swappable. NVMe SSDs are hot-pluggable, meaning that they
must be shut down in the operating system before hot-removal.
Storage, rear-panel
The server can be ordered with a rear-drive backplane assembly that provides bays for two
rear-loading, 2.5-inch drives:
•
• All other C240 M5 PIDs support up to two drives:
◦When using a hardware-RAID controller card in the server, SAS/SATA drives or
NVMe SSDs are supported in the rear bays.
◦When using software RAID in the server, only NVMe SSDs are supported in the
rear bays.
Cisco UCS C240 M5 Server Installation and Service Guide
11
Overview
Summary of Server Features
Feature
Description
Storage, internal
The server has these internal storage options:
• One USB 3.0 port on the motherboard.
• Mini-storage module socket, optionally with either:
◦SD card carrier. Supports up to two SD cards.
◦M.2 SSD carrier. Supports either two SATA M.2 SSDs or two NVMe M.2 SSDs.
• One micro-SD card socket on PCIe riser 1.
Other removable media
The SFF drives, 8-drive version of the server supports a front-loading DVD drive option.
Storage management
The server has a dedicated internal socket that supports one of the following storage-controller
options:
• A PCIe-style Cisco modular RAID controller card (SAS/SATA).
• A PCIe-style interposer card for the server’s embedded SATA RAID controller.
For a detailed list of storage controller options, see Supported Storage Controllers and Cables,
on page 129.
RAID backup
The server has a mounting bracket on the removable air baffle for one supercap unit that is
used with the Cisco modular RAID controller card.
Integrated video
Integrated VGA video.
Cisco UCS C240 M5 Server Installation and Service Guide
12
CHAPTER
2
Installing the Server
• Preparing for Installation, page 13
• Installing the Server in a Rack, page 16
• Initial Server Setup, page 21
• NIC Mode and NIC Redundancy Settings, page 25
• Updating the BIOS and Cisco IMC Firmware, page 27
• Accessing the System BIOS, page 27
• Smart Access Serial, page 27
• Smart Access USB, page 28
Preparing for Installation
This section contains the following topics:
Installation Warnings and Guidelines
Note
Before you install, operate, or service a server, review the Regulatory Compliance and Safety Information
for Cisco UCS C-Series Servers for important safety information.
Cisco UCS C240 M5 Server Installation and Service Guide
13
Installing the Server
Installation Warnings and Guidelines
Warning
IMPORTANT SAFETY INSTRUCTIONS
This warning symbol means danger. You are in a situation that could cause bodily injury. Before
you work on any equipment, be aware of the hazards involved with electrical circuitry and be
familiar with standard practices for preventing accidents. Use the statement number provided at
the end of each warning to locate its translation in the translated safety warnings that accompanied
this device.
Statement 1071
Warning
To prevent the system from overheating, do not operate it in an area that exceeds the maximum
recommended ambient temperature of: 35° C (95° F).
Statement 1047
Warning
The plug-socket combination must be accessible at all times, because it serves as the main
disconnecting device.
Statement 1019
Warning
This product relies on the building’s installation for short-circuit (overcurrent) protection. Ensure
that the protective device is rated not greater than: 250 V, 15 A.
Statement 1005
Warning
Installation of the equipment must comply with local and national electrical codes.
Statement 1074
Warning
This unit is intended for installation in restricted access areas. A restricted access area can be
accessed only through the use of a special tool, lock, and key, or other means of security.
Statement 1017
Caution
To ensure proper airflow it is necessary to rack the servers using rail kits. Physically placing the units on
top of one another or “stacking” without the use of the rail kits blocks the air vents on top of the servers,
which could result in overheating, higher fan speeds, and higher power consumption. We recommend that
you mount your servers on rail kits when you are installing them into the rack because these rails provide
the minimal spacing required between the servers. No additional spacing between the servers is required
when you mount the units using rail kits.
Cisco UCS C240 M5 Server Installation and Service Guide
14
Installing the Server
Rack Requirements
Caution
Avoid uninterruptible power supply (UPS) types that use ferroresonant technology. These UPS types can
become unstable with systems such as the Cisco UCS, which can have substantial current draw fluctuations
from fluctuating data traffic patterns.
When you are installing a server, use the following guidelines:
• Plan your site configuration and prepare the site before installing the server. See the Cisco UCS Site
Preparation Guide for the recommended site planning tasks.
• Ensure that there is adequate space around the server to allow for accessing the server and for adequate
airflow. The airflow in this server is from front to back.
• Ensure that the air-conditioning meets the thermal requirements listed in the Environmental Specifications,
on page 122.
• Ensure that the cabinet or rack meets the requirements listed in the Rack Requirements, on page 15.
• Ensure that the site power meets the power requirements listed in the Power Specifications, on page
122. If available, you can use an uninterruptible power supply (UPS) to protect against power failures.
Rack Requirements
The rack must be of the following type:
• A standard 19-in. (48.3-cm) wide, four-post EIA rack, with mounting posts that conform to English
universal hole spacing, per section 1 of ANSI/EIA-310-D-1992.
• The rack-post holes can be square 0.38-inch (9.6 mm), round 0.28-inch (7.1 mm), #12-24 UNC, or
#10-32 UNC when you use the Cisco-supplied slide rails.
• The minimum vertical rack space per server must be two rack units (RUs), equal to 3.5 in. (88.9 mm).
Supported Cisco Slide Rail Kits
The server supports the following rail kit options:
• Cisco part UCSC-RAILB-M4= (ball-bearing slide rail kit)
• Cisco part UCSC-CMAF-M4= (cable management arm)
Rack Installation Tools Required
The slide rails sold by Cisco Systems for this server do not require tools for installation.
Slide Rail and Cable Management Arm Dimensions
The slide rails for this server have an adjustment range of 24 to 36 inches (610 to 914 mm).
The optional cable management arm (CMA) adds additional length requirements:
• The additional distance from the rear of the server to the rear of the CMA is 5.4 inches (137.4 mm).
• The total length of the server including the CMA is 35.2 inches (894 mm).
Cisco UCS C240 M5 Server Installation and Service Guide
15
Installing the Server
Installing the Server in a Rack
Installing the Server in a Rack
Warning
To prevent bodily injury when mounting or servicing this unit in a rack, you must take special
precautions to ensure that the system remains stable. The following guidelines are provided to ensure
your safety:
This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
When mounting this unit in a partially filled rack, load the rack from the bottom to the top with
the heaviest component at the bottom of the rack.
If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing
the unit in the rack.
Statement 1006
Step 1
Attach the inner rails to the sides of the server:
a) Align an inner rail with one side of the server so that the three keyed slots in the rail align with the three pegs on the
side of the server.
b) Set the keyed slots over the pegs, and then slide the rail toward the front to lock it in place on the pegs. The front slot
has a metal clip that locks over the front peg.
c) Install the second inner rail to the opposite side of the server.
Figure 6: Attaching the Inner Rail to the Side of the Server
1
Step 2
Front of server
Inner rail
Open the front securing plate on both slide-rail assemblies. The front end of the slide-rail assembly has a spring-loaded
securing plate that must be open before you can insert the mounting pegs into the rack-post holes.
Cisco UCS C240 M5 Server Installation and Service Guide
16
2
Installing the Server
Installing the Server in a Rack
On the outside of the assembly, push the green-arrow button toward the rear to open the securing plate.
Figure 7: Front Securing Mechanism, Inside of Front End
Step 3
1
Front mounting pegs
3
2
Rack post between mounting pegs and opened
securing plate
-
Securing plate shown pulled back to the open
position
Install the outer slide rails into the rack:
a) Align one slide-rail assembly front end with the front rack-post holes that you want to use.
The slide rail front-end wraps around the outside of the rack post and the mounting pegs enter the rack-post holes
from the outside-front. See Figure 7: Front Securing Mechanism, Inside of Front End, on page 17.
The rack post must be between the mounting pegs and the open securing
plate.
b) Push the mounting pegs into the rack-post holes from the outside-front.
c) Press the securing plate release button, marked PUSH. The spring-loaded securing plate closes to lock the pegs in
place.
d) Adjust the slide-rail length, and then push the rear mounting pegs into the corresponding rear rack-post holes. The
slide rail must be level front-to-rear.
The rear mounting pegs enter the rear rack-post holes from the inside of the rack post.
Note
e) Attach the second slide-rail assembly to the opposite side of the rack. Ensure that the two slide-rail assemblies are
at the same height and are level front-to-back.
f) Pull the inner slide rails on each assembly out toward the rack front until they hit the internal stops and lock in place.
Step 4
Insert the server into the slide rails:
Caution
This server can weigh up to 64 pounds (29 kilograms) when fully loaded with components. We recommend
that you use a minimum of two people or a mechanical lift when lifting the server. Attempting this procedure
alone could result in personal injury or equipment damage.
a) Align the rear ends of the inner rails that are attached to the server sides with the front ends of the empty slide rails
on the rack.
Cisco UCS C240 M5 Server Installation and Service Guide
17
Installing the Server
Installing the Server in a Rack
b) Push the inner rails into the slide rails on the rack until they stop at the internal stops.
c) Slide the inner-rail release clip toward the rear on both inner rails, and then continue pushing the server into the rack
until its front slam-latches engage with the rack posts.
Figure 8: Inner-Rail Release Clip
Step 5
1
Inner-rail release clip
2
Inner rail attached to server and inserted into outer slide rail
Outer slide rail attached to rack post
(Optional) Secure the server in the rack more permanently by using the two screws that are provided with the slide rails.
Perform this step if you plan to move the rack with servers installed.
With the server fully pushed into the slide rails, open a hinged slam latch lever on the front of the server and insert a
screw through the hole that is under the lever. The screw threads into the static part of the rail on the rack post and
prevents the server from being pulled out. Repeat for the opposite slam latch.
Cisco UCS C240 M5 Server Installation and Service Guide
18
3
Installing the Server
Installing the Cable Management Arm (Optional)
Installing the Cable Management Arm (Optional)
Note
Step 1
The cable management arm (CMA) is reversible left-to-right. To reverse the CMA, see Reversing the
Cable Management Arm (Optional), on page 20 before installation.
With the server pushed fully into the rack, slide the CMA tab of the CMA arm that is farthest from the server onto the
end of the stationary slide rail that is attached to the rack post. Slide the tab over the end of the rail until it clicks and
locks.
Figure 9: Attaching the CMA to the Rear Ends of the Slide Rails
1
CMA tab on arm farthest from server attaches to
end of stationary outer slide rail.
3
CMA tab on width-adjustment slider attaches to end
of stationary outer slide rail.
2
CMA tab on arm closest to the server attaches to
end of inner slide rail attached to server.
4
Rear of server
Cisco UCS C240 M5 Server Installation and Service Guide
19
Installing the Server
Reversing the Cable Management Arm (Optional)
Step 2
Step 3
Step 4
Step 5
Slide the CMA tab that is closest to the server over the end of the inner rail that is attached to the server. Slide the tab
over the end of the rail until it clicks and locks
Pull out the width-adjustment slider that is at the opposite end of the CMA assembly until it matches the width of your
rack.
Slide the CMA tab that is at the end of the width-adjustment slider onto the end of the stationary slide rail that is attached
to the rack post. Slide the tab over the end of the rail until it clicks and locks.
Open the hinged flap at the top of each plastic cable guide and route your cables through the cable guides as desired.
Reversing the Cable Management Arm (Optional)
Step 1
Step 2
Step 3
Rotate the entire CMA assembly 180 degrees, left-to-right. The plastic cable guides must remain pointing upward.
Flip the tabs at the ends of the CMA arms so that they point toward the rear of the server.
Pivot the tab that is at the end of the width-adjustment slider. Depress and hold the metal button on the outside of the
tab and pivot the tab 180 degrees so that it points toward the rear of the server.
Figure 10: Reversing the CMA
1
CMA tab on end of width-adjustment slider
Cisco UCS C240 M5 Server Installation and Service Guide
20
2
Metal button on outside of tab
Installing the Server
Initial Server Setup
Initial Server Setup
Note
This section describes how to power on the server, assign an IP address, and connect to server management
when using the server in standalone mode. To use the server in Cisco UCS Manager integration, specific
cabling and settings are required. See Installation For Cisco UCS Manager Integration, on page 165.
Server Default Settings
The server is shipped with these default settings:
• The NIC mode is Shared LOM EXT.
Shared LOM EXT mode enables the 1-Gb/10-Gb Ethernet ports and the ports on any installed Cisco
virtual interface card (VIC) to access the Cisco Integrated Management Interface (Cisco IMC). If you
want to use the 10/100/1000 dedicated management ports to access Cisco IMC, you can connect to the
server and change the NIC mode as described in Setting Up the System With the Cisco IMC Configuration
Utility, on page 23.
• The NIC redundancy is Active-Active. All Ethernet ports are utilized simultaneously.
• DHCP is enabled.
• IPv4 is enabled.
Connection Methods
There are two methods for connecting to the system for initial setup:
• Local setup—Use this procedure if you want to connect a keyboard and monitor directly to the system
for setup. This procedure can use a KVM cable (Cisco PID N20-BKVM) or the ports on the rear of the
server.
• Remote setup—Use this procedure if you want to perform setup through your dedicated management
LAN.
Note
To configure the system remotely, you must have a DHCP server on the same network
as the system. Your DHCP server must be preconfigured with the range of MAC
addresses for this server node. The MAC address is printed on a label that is on the
pull-out asset tag on the front panel. This server node has a range of six MAC addresses
assigned to the Cisco IMC. The MAC address printed on the label is the beginning of
the range of six contiguous MAC addresses.
This section contains the following topics:
Cisco UCS C240 M5 Server Installation and Service Guide
21
Installing the Server
Connecting to the Server Locally For Setup
Connecting to the Server Locally For Setup
This procedure requires the following equipment:
• VGA monitor
• USB keyboard
• Either the supported Cisco KVM cable (Cisco PID N20-BKVM); or a USB cable and VGA DB-15 cable
Step 1
Attach a power cord to each power supply in your server, and then attach each power cord to a grounded AC power
outlet.
If you are using DC power supplies, see Installing DC Power Supplies (First Time Installation), on page 91.
Wait for approximately two minutes to let the server boot to standby power during the first bootup. You can verify system
power status by looking at the system Power Status LED on the front panel. The system is in standby power mode when
the LED is amber.
Step 2
Connect a USB keyboard and VGA monitor to the server using one of the following methods:
• Connect an optional KVM cable (Cisco PID N20-BKVM) to the KVM connector on the front panel. Connect your
USB keyboard and VGA monitor to the KVM cable.
• Connect a USB keyboard and VGA monitor to the corresponding connectors on the rear panel.
Step 3
Open the Cisco IMC Configuration Utility:
a) Press and hold the front panel power button for four seconds to boot the server.
b) During bootup, press F8 when prompted to open the Cisco IMC Configuration Utility.
Step 4
Continue with Setting Up the System With the Cisco IMC Configuration Utility, on page 23.
Connecting to the Server Remotely For Setup
This procedure requires the following equipment:
• One RJ-45 Ethernet cable that is connected to your management LAN.
Cisco UCS C240 M5 Server Installation and Service Guide
22
Installing the Server
Setting Up the System With the Cisco IMC Configuration Utility
Before You Begin
Note
Step 1
To configure the system remotely, you must have a DHCP server on the same network as the system.
Your DHCP server must be preconfigured with the range of MAC addresses for this server node. The
MAC address is printed on a label that is on the pull-out asset tag on the front panel. This server node has
a range of six MAC addresses assigned to the Cisco IMC. The MAC address printed on the label is the
beginning of the range of six contiguous MAC addresses.
Attach a power cord to each power supply in your server, and then attach each power cord to a grounded AC power
outlet.
If you are using DC power supplies, see Installing DC Power Supplies (First Time Installation), on page 91.
Wait for approximately two minutes to let the server boot to standby power during the first bootup. You can verify system
power status by looking at the system Power Status LED on the front panel. The system is in standby power mode when
the LED is amber.
Step 2
Step 3
Step 4
Plug your management Ethernet cable into the dedicated management port on the rear panel.
Allow your preconfigured DHCP server to assign an IP address to the server node.
Use the assigned IP address to access and log in to the Cisco IMC for the server node. Consult with your DHCP server
administrator to determine the IP address.
Note
The default user name for the server is admin. The default password is password.
Step 5
From the Cisco IMC Server Summary page, click Launch KVM Console. A separate KVM console window opens.
Step 6
From the Cisco IMC Summary page, click Power Cycle Server. The system reboots.
Step 7
Select the KVM console window.
Step 8
The KVM console window must be the active window for the following keyboard actions to
work.
When prompted, press F8 to enter the Cisco IMC Configuration Utility. This utility opens in the KVM console window.
Step 9
Continue with Setting Up the System With the Cisco IMC Configuration Utility, on page 23.
Note
Setting Up the System With the Cisco IMC Configuration Utility
Before You Begin
The following procedure is performed after you connect to the system and open the Cisco IMC Configuration
Utility.
Step 1
Set the NIC mode to choose which ports to use to access Cisco IMC for server management:
• Shared LOM EXT (default)—This is the shared LOM extended mode, the factory-default setting. With this mode,
the Shared LOM and Cisco Card interfaces are both enabled. You must select the default Active-Active NIC
redundancy setting in the following step.
Cisco UCS C240 M5 Server Installation and Service Guide
23
Installing the Server
Setting Up the System With the Cisco IMC Configuration Utility
In this NIC mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports. If the system
determines that the Cisco card connection is not getting its IP address from a Cisco UCS Manager system because
the server is in standalone mode, further DHCP requests from the Cisco card are disabled. Use the Cisco Card NIC
mode if you want to connect to Cisco IMC through a Cisco card in standalone mode.
• Shared LOM—The 1-Gb/10-Gb Ethernet ports are used to access Cisco IMC. You must select either the Active-Active
or Active-standby NIC redundancy setting in the following step.
• Dedicated—The dedicated management port is used to access Cisco IMC. You must select the None NIC redundancy
setting in the following step.
• Cisco Card—The ports on an installed Cisco UCS Virtual Interface Card (VIC) are used to access the Cisco IMC.
You must select either the Active-Active or Active-standby NIC redundancy setting in the following step.
See also the required VIC Slot setting below.
• VIC Slot—Only if you use the Cisco Card NIC mode, you must select this setting to match where your VIC is
installed. The choices are Riser1, Riser2, or Flex-LOM (the mLOM slot).
◦If you select Riser1, you must install the VIC in slot 1.
◦If you select Riser2, you must install the VIC in slot 2.
◦If you select Flex-LOM, you must install an mLOM-style VIC in the mLOM slot.
Step 2
Set the NIC redundancy to your preference. This server has three possible NIC redundancy settings:
• None—The Ethernet ports operate independently and do not fail over if there is a problem. This setting can be used
only with the Dedicated NIC mode.
• Active-standby—If an active Ethernet port fails, traffic fails over to a standby port. Shared LOM and Cisco Card
modes can each use either Active-standby or Active-active settings.
• Active-active (default)—All Ethernet ports are utilized simultaneously. The Shared LOM EXT mode must use only
this NIC redundancy setting. Shared LOM and Cisco Card modes can each use either Active-standby or Active-active
settings.
Step 3
Choose whether to enable DHCP for dynamic network settings, or to enter static network settings.
Note
Before you enable DHCP, you must preconfigure your DHCP server with the range of MAC addresses for this
server. The MAC address is printed on a label on the rear of the server. This server has a range of six MAC
addresses assigned to Cisco IMC. The MAC address printed on the label is the beginning of the range of six
contiguous MAC addresses.
The static IPv4 and IPv6 settings include the following:
• The Cisco IMC IP address.
For IPv6, valid values are 1 - 127.
• The gateway.
For IPv6, if you do not know the gateway, you can set it as none by entering :: (two colons).
• The preferred DNS server address.
For IPv6, you can set this as none by entering :: (two colons).
Cisco UCS C240 M5 Server Installation and Service Guide
24
Installing the Server
NIC Mode and NIC Redundancy Settings
Step 4
Step 5
(Optional) Make VLAN settings.
Press F1 to go to the second settings window, then continue with the next step.
From the second window, you can press F2 to switch back to the first window.
Step 6
Step 7
Step 8
Step 9
(Optional) Set a hostname for the server.
(Optional) Enable dynamic DNS and set a dynamic DNS (DDNS) domain.
(Optional) If you check the Factory Default check box, the server reverts to the factory defaults.
(Optional) Set a default user password.
Note
The factory default username for the server is admin. The default password is password.
Step 10
(Optional) Enable auto-negotiation of port settings or set the port speed and duplex mode manually.
Note
Auto-negotiation is applicable only when you use the Dedicated NIC mode. Auto-negotiation sets the port speed
and duplex mode automatically based on the switch port to which the server is connected. If you disable
auto-negotiation, you must set the port speed and duplex mode manually.
Step 11
Step 12
(Optional) Reset port profiles and the port name.
Press F5 to refresh the settings that you made. You might have to wait about 45 seconds until the new settings appear
and the message, “Network settings configured” is displayed before you reboot the server in the next step.
Press F10 to save your settings and reboot the server.
Note
If you chose to enable DHCP, the dynamically assigned IP and MAC addresses are displayed on the console
screen during bootup.
Step 13
What to Do Next
Use a browser and the IP address of the Cisco IMC to connect to the Cisco IMC management interface. The
IP address is based upon the settings that you made (either a static address or the address assigned by your
DHCP server).
Note
The factory default username for the server is admin. The default password is password.
To manage the server, see the Cisco UCS C-Series Rack-Mount Server Configuration Guide or the Cisco UCS
C-Series Rack-Mount Server CLI Configuration Guide for instructions on using those interfaces for your
Cisco IMC release. The links to the configuration guides are in the Cisco UCS C-Series Documentation
Roadmap.
NIC Mode and NIC Redundancy Settings
Table 1: Valid NIC Redundancy Settings For Each NIC Mode
NIC Mode
Valid NIC Redundancy Settings
Shared LOM EXT
Active-active
Dedicated
None
Cisco UCS C240 M5 Server Installation and Service Guide
25
Installing the Server
NIC Mode and NIC Redundancy Settings
Shared LOM
Active-active
Active-standby
Cisco Card
Active-active
Active-standby
This server has the following NIC mode settings that you can choose from:
• Shared LOM EXT (default)—This is the shared LOM extended mode, the factory-default setting. With
this mode, the Shared LOM and Cisco Card interfaces are both enabled. You must select the default
Active-Active NIC redundancy setting in the following step.
In this NIC mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports. If
the system determines that the Cisco card connection is not getting its IP address from a Cisco UCS
Manager system because the server is in standalone mode, further DHCP requests from the Cisco card
are disabled. Use the Cisco Card NIC mode if you want to connect to Cisco IMC through a Cisco card
in standalone mode.
• Shared LOM—The 1-Gb/10-Gb Ethernet ports are used to access Cisco IMC. You must select either
the Active-Active or Active-standby NIC redundancy setting in the following step.
• Dedicated—The dedicated management port is used to access Cisco IMC. You must select the None
NIC redundancy setting in the following step.
• Cisco Card—The ports on an installed Cisco UCS Virtual Interface Card (VIC) are used to access the
Cisco IMC. You must select either the Active-Active or Active-standby NIC redundancy setting in the
following step.
See also the required VIC Slot setting below.
• VIC Slot—Only if you use the Cisco Card NIC mode, you must select this setting to match where your
VIC is installed. The choices are Riser1, Riser2, or Flex-LOM (the mLOM slot).
◦If you select Riser1, you must install the VIC in slot 1.
◦If you select Riser2, you must install the VIC in slot 2.
◦If you select Flex-LOM, you must install an mLOM-style VIC in the mLOM slot.
This server has the following NIC redundancy settings that you can choose from:
• None—The Ethernet ports operate independently and do not fail over if there is a problem. This setting
can be used only with the Dedicated NIC mode.
• Active-standby—If an active Ethernet port fails, traffic fails over to a standby port. Shared LOM and
Cisco Card modes can each use either Active-standby or Active-active settings.
• Active-active (default)—All Ethernet ports are utilized simultaneously. The Shared LOM EXT mode
must use only this NIC redundancy setting. Shared LOM and Cisco Card modes can each use either
Active-standby or Active-active settings.
Cisco UCS C240 M5 Server Installation and Service Guide
26
Installing the Server
Updating the BIOS and Cisco IMC Firmware
Updating the BIOS and Cisco IMC Firmware
Caution
When you upgrade the BIOS firmware, you must also upgrade the Cisco IMC firmware to the same version
or the server does not boot. Do not power off the server until the BIOS and Cisco IMC firmware are
matching or the server does not boot.
Cisco provides the Cisco Host Upgrade Utility to assist with simultaneously upgrading the BIOS, Cisco
IMC, and other firmware to compatible levels.
The server uses firmware obtained from and certified by Cisco. Cisco provides release notes with each firmware
image. There are several possible methods for updating the firmware:
• Recommended method for firmware update: Use the Cisco Host Upgrade Utility to simultaneously
upgrade the Cisco IMC, BIOS, and component firmware to compatible levels.
See the Cisco Host Upgrade Utility Quick Reference Guide for your firmware release at the documentation
roadmap link below.
• You can upgrade the Cisco IMC and BIOS firmware by using the Cisco IMC GUI interface.
See the Cisco UCS C-Series Rack-Mount Server Configuration Guide.
• You can upgrade the Cisco IMC and BIOS firmware by using the Cisco IMC CLI interface.
See the Cisco UCS C-Series Rack-Mount Server CLI Configuration Guide.
For links to the documents listed above, see the Cisco UCS C-Series Documentation Roadmap.
Accessing the System BIOS
Step 1
Step 2
Step 3
Step 4
Step 5
Step 6
Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup.
Note
The version and build of the current BIOS are displayed on the Main page of the
utility.
Use the arrow keys to select the BIOS menu page.
Highlight the field to be modified by using the arrow keys.
Press Enter to select the field that you want to change, and then modify the value in the field.
Press the right arrow key until the Exit menu screen is displayed.
Follow the instructions on the Exit menu screen to save your changes and exit the setup utility (or press F10). You can
exit without saving changes by pressing Esc.
Smart Access Serial
This server supports the Smart Access Serial feature. This feature allows you to switch between host serial
and Cisco IMC CLI.
Cisco UCS C240 M5 Server Installation and Service Guide
27
Installing the Server
Smart Access USB
• This feature has the following requirements:
◦A serial cable connection, which can use either the RJ-45 serial connector on the server rear panel,
or a DB-9 connection when using the KVM cable (Cisco PID N20-BKVM) on the front-panel
KVM console connector.
◦Console redirection must be enabled in the server BIOS.
◦Terminal type must be set to VT100+ or VTUFT8.
◦Serial-over-LAN (SOL) must be disabled (SOL is disabled by default).
• To switch from host serial to Cisco IMC CLI, press Esc+9.
You must enter your Cisco IMC credentials to authenticate the connection.
• To switch from Cisco IMC CLI to host serial, press Esc+8.
Note
You cannot switch to Cisco IMC CLI if the serial-over-LAN (SOL) feature is enabled.
• After a session is created, it is shown in the CLI or web GUI by the name serial.
Smart Access USB
This server supports the Smart Access USB feature. The board management controller (BMC) in this server
can accept a USB mass storage device and access the data on it. This feature allows you to use the front-panel
USB device as a medium to transfer data between the BMC and the user without need for network connectivity.
This can be useful, for example, when remote BMC interfaces are not yet available, or are not accessible due
to network misconfiguration.
• This feature has the following requirements:
◦The KVM cable (Cisco PID N20-BKVM) connected to the front panel KVM console connector.
◦A USB storage device connected to one of the USB 2.0 connectors on the KVM cable. The USB
device must draw less than 500 mA to avoid disconnect by the current-protection circuit.
Note
Any mouse or keyboard that is connected to the KVM cable is disconnected when you
enable Smart Access USB.
◦You can use USB 3.0-based devices, but they will operate at USB 2.0 speed.
◦We recommend that the USB device have only one partition.
◦The file system formats supported are: FAT16, FAT32, MSDOS, EXT2, EXT3, and EXT4. NTFS
is not supported.
• The front-panel KVM connector has been designed to switch the USB port between Host OS and BMC.
Cisco UCS C240 M5 Server Installation and Service Guide
28
Installing the Server
Smart Access USB
• Smart Access USB can be enabled or disabled using any of the BMC user interfaces. For example, you
can use the Cisco IMC Configuration Utility that is accessed by pressing F8 when prompted during
bootup.
◦Enabled: the front-panel USB device is connected to the BMC.
◦Disabled: the front-panel USB device is connected to the host.
• In a case where no management network is available to connect remotely to Cisco IMC, a Device
Firmware Update (DFU) shell over serial cable can be used to generate and download technical support
files to the USB device that is attached to front panel USB port.
Cisco UCS C240 M5 Server Installation and Service Guide
29
Installing the Server
Smart Access USB
Cisco UCS C240 M5 Server Installation and Service Guide
30
CHAPTER
3
Maintaining the Server
This chapter contains the following sections:
• Status LEDs and Buttons, page 31
• Preparing For Component Installation, page 39
• Removing and Replacing Components, page 43
• Service Headers and Jumpers, page 112
Status LEDs and Buttons
This section contains information for interpreting LED states.
Cisco UCS C240 M5 Server Installation and Service Guide
31
Maintaining the Server
Front-Panel LEDs
Front-Panel LEDs
Figure 11: Front Panel LEDs
Table 2: Front Panel LEDs, Definition of States
LED Name
1
SAS/SATA drive fault
SAS
Note
NVMe solid state drive (SSD) drive tray LEDs have
different behavior than SAS/SATA drive trays.
States
• Off—The hard drive is operating properly.
• Amber—Drive fault detected.
• Amber, blinking—The device is rebuilding.
• Amber, blinking with one-second interval—Drive locate
function activated in the software.
SAS/SATA drive activity LED
2
SAS
• Off—There is no hard drive in the hard drive tray (no
access, no fault).
• Green—The hard drive is ready.
• Green, blinking—The hard drive is reading or writing
data.
Cisco UCS C240 M5 Server Installation and Service Guide
32
Maintaining the Server
Front-Panel LEDs
1
NVMe SSD drive fault
NVMe Note
NVMe solid state drive (SSD) drive tray LEDs have
different behavior than SAS/SATA drive trays.
• Off—The drive is not in use and can be safely removed.
• Green—The drive is in use and functioning properly.
• Green, blinking—the driver is initializing following
insertion or the driver is unloading following an eject
command.
• Amber—The drive has failed.
• Amber, blinking—A drive Locate command has been
issued in the software.
2
NVMe SSD activity
NVMe
3
• Off—No drive activity.
• Green, blinking—There is drive activity.
Power button/LED
• Off—There is no AC power to the server.
• Amber—The server is in standby power mode. Power
is supplied only to the Cisco IMC and some motherboard
functions.
• Green—The server is in main power mode. Power is
supplied to all server components.
4
Unit identification
• Off—The unit identification function is not in use.
• Blue, blinking—The unit identification function is
activated.
Cisco UCS C240 M5 Server Installation and Service Guide
33
Maintaining the Server
Front-Panel LEDs
System health
5
• Green—The server is running in normal operating
condition.
• Green, blinking—The server is performing system
initialization and memory check.
• Amber, steady—The server is in a degraded operational
state (minor fault). For example:
◦Power supply redundancy is lost.
◦CPUs are mismatched.
◦At least one CPU is faulty.
◦At least one DIMM is faulty.
◦At least one drive in a RAID configuration failed.
• Amber, 2 blinks—There is a major fault with the system
board.
• Amber, 3 blinks—There is a major fault with the memory
DIMMs.
• Amber, 4 blinks—There is a major fault with the CPUs.
Power supply status
6
• Green—All power supplies are operating normally.
• Amber, steady—One or more power supplies are in a
degraded operational state.
• Amber, blinking—One or more power supplies are in a
critical fault state.
Fan status
7
• Green—All fan modules are operating properly.
• Amber, blinking—One or more fan modules breached
the non-recoverable threshold.
Network link activity
8
• Off—The Ethernet LOM port link is idle.
• Green—One or more Ethernet LOM ports are link-active,
but there is no activity.
• Green, blinking—One or more Ethernet LOM ports are
link-active, with activity.
Cisco UCS C240 M5 Server Installation and Service Guide
34
Maintaining the Server
Rear-Panel LEDs
9
Temperature status
• Green—The server is operating at normal temperature.
• Amber, steady—One or more temperature sensors
breached the critical threshold.
• Amber, blinking—One or more temperature sensors
breached the non-recoverable threshold.
10
DVD drive activity
• Off—The drive is idle.
• Green, steady—The drive is spinning up a disk.
• Green, blinking—The drive is accessing data.
Rear-Panel LEDs
Figure 12: Rear Panel LEDs
Table 3: Rear Panel LEDs, Definition of States
LED Name
1
1-Gb/10-Gb Ethernet link speed (on both LAN1 and LAN2)
States
• Off—Link speed is 100 Mbps.
• Amber—Link speed is 1 Gbps.
• Green—Link speed is 10 Gbps.
2
1-Gb/10-Gb Ethernet link status (on both LAN1 and LAN2)
• Off—No link is present.
• Green—Link is active.
• Green, blinking—Traffic is present on the active link.
Cisco UCS C240 M5 Server Installation and Service Guide
35
Maintaining the Server
Rear-Panel LEDs
1-Gb Ethernet dedicated management link speed
3
• Off—Link speed is 10 Mbps.
• Amber—Link speed is 100 Mbps.
• Green—Link speed is 1 Gbps.
1-Gb Ethernet dedicated management link status
4
• Off—No link is present.
• Green—Link is active.
• Green, blinking—Traffic is present on the active link.
Rear unit identification
5
• Off—The unit identification function is not in use.
• Blue, blinking—The unit identification function is
activated.
Power supply status (one LED each power supply unit)
6
AC power supplies:
• Off—No AC input (12 V main power off, 12 V standby
power off).
• Green, blinking—12 V main power off; 12 V standby
power on.
• Green, solid—12 V main power on; 12 V standby power
on.
• Amber, blinking—Warning threshold detected but 12 V
main power on.
• Amber, solid—Critical error detected; 12 V main power
off (for example, over-current, over-voltage, or
over-temperature failure).
DC power supply (UCSC-PSUV2-1050DC):
• Off—No DC input (12 V main power off, 12 V standby
power off).
• Green, blinking—12 V main power off; 12 V standby
power on.
• Green, solid—12 V main power on; 12 V standby power
on.
• Amber, blinking—Warning threshold detected but 12 V
main power on.
• Amber, solid—Critical error detected; 12 V main power
off (for example, over-current, over-voltage, or
over-temperature failure).
Cisco UCS C240 M5 Server Installation and Service Guide
36
Maintaining the Server
Rear-Panel LEDs
7
SAS/SATA drive fault
SAS
Note
NVMe solid state drive (SSD) drive tray LEDs have
different behavior than SAS/SATA drive trays.
• Off—The hard drive is operating properly.
• Amber—Drive fault detected.
• Amber, blinking—The device is rebuilding.
• Amber, blinking with one-second interval—Drive locate
function activated in the software.
8
SAS/SATA drive activity LED
SAS
• Off—There is no hard drive in the hard drive tray (no
access, no fault).
• Green—The hard drive is ready.
• Green, blinking—The hard drive is reading or writing
data.
7
NVMe SSD drive fault
NVMe Note
NVMe solid state drive (SSD) drive tray LEDs have
different behavior than SAS/SATA drive trays.
• Off—The drive is not in use and can be safely removed.
• Green—The drive is in use and functioning properly.
• Green, blinking—the driver is initializing following
insertion or the driver is unloading following an eject
command.
• Amber—The drive has failed.
• Amber, blinking—A drive Locate command has been
issued in the software.
8
NVMe
NVMe SSD activity
• Off—No drive activity.
• Green, blinking—There is drive activity.
Cisco UCS C240 M5 Server Installation and Service Guide
37
Maintaining the Server
Internal Diagnostic LEDs
Internal Diagnostic LEDs
The server has internal fault LEDs for CPUs, DIMMs, and fan modules.
Figure 13: Internal Diagnostic LED Locations
Fan module fault LEDs (one on the top of each fan
module)
1
3
DIMM fault LEDs (one behind each DIMM socket on the
motherboard)
These LEDs operate only when the server is in standby
power mode.
• Amber—Fan has a fault or is not fully seated.
• Green—Fan is OK.
• Amber—DIMM has a fault.
• Off—DIMM is OK.
CPU fault LEDs (one behind each CPU socket on the
motherboard).
2
These LEDs operate only when the server is in standby
power mode.
• Amber—CPU has a fault.
• Off—CPU is OK.
Cisco UCS C240 M5 Server Installation and Service Guide
38
-
Maintaining the Server
Preparing For Component Installation
Preparing For Component Installation
This section includes information and tasks that help prepare the server for component installation.
Required Equipment For Service Procedures
The following tools and equipment are used to perform the procedures in this chapter:
• T-30 Torx driver (supplied with replacement CPUs for heatsink removal)
• #1 flat-head screwdriver (used during CPU or heatsink replacement)
• #1 Phillips-head screwdriver (for M.2 SSD and intrusion switch replacement)
• Electrostatic discharge (ESD) strap or other grounding equipment such as a grounded mat
Shutting Down and Removing Power From the Server
The server can run in either of two power modes:
• Main power mode—Power is supplied to all server components and any operating system on your drives
can run.
• Standby power mode—Power is supplied only to the service processor and certain components. It is
safe for the operating system and data to remove power cords from the server in this mode.
Caution
After a server is shut down to standby power, electric current is still present in the server. To completely
remove power, you must disconnect all power cords from the power supplies in the server, as directed in
the service procedures.
You can shut down the server by using the front-panel power button or the software management interfaces.
Shutting Down Using the Power Button
Step 1
Check the color of the Power button/LED:
• Amber—The server is already in standby mode and you can safely remove power.
• Green—The server is in main power mode and must be shut down before you can safely remove power.
Step 2
Invoke either a graceful shutdown or a hard shutdown:
Caution
To avoid data loss or damage to your operating system, you should always invoke a graceful shutdown of
the operating system.
• Graceful shutdown—Press and release the Power button. The operating system performs a graceful shutdown and
the server goes to standby mode, which is indicated by an amber Power button/LED.
Cisco UCS C240 M5 Server Installation and Service Guide
39
Maintaining the Server
Shutting Down and Removing Power From the Server
• Emergency shutdown—Press and hold the Power button for 4 seconds to force the main power off and immediately
enter standby mode.
Step 3
If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Shutting Down Using The Cisco IMC GUI
You must log in with user or admin privileges to perform this task.
Step 1
In the Navigation pane, click the Server tab.
Step 2
On the Server tab, click Summary.
Step 3
In the Actions area, click Power Off Server.
Step 4
Click OK.
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber
Power button/LED.
Step 5
If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Shutting Down Using The Cisco IMC CLI
You must log in with user or admin privileges to perform this task.
Step 1
At the server prompt, enter:
Example:
server# scope chassis
Step 2
At the chassis prompt, enter:
Example:
server/chassis# power shutdown
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber
Power button/LED.
Step 3
If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Cisco UCS C240 M5 Server Installation and Service Guide
40
Maintaining the Server
Removing the Server Top Cover
Shutting Down Using The Cisco UCS Manager Equipment Tab
You must log in with user or admin privileges to perform this task.
Step 1
In the Navigation pane, click Equipment.
Step 2
Expand Equipment > Rack Mounts > Servers.
Step 3
Step 4
Choose the server that you want to shut down.
In the Work pane, click the General tab.
Step 5
In the Actions area, click Shutdown Server.
Step 6
If a confirmation dialog displays, click Yes.
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber
Power button/LED.
Step 7
If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Shutting Down Using The Cisco UCS Manager Service Profile
You must log in with user or admin privileges to perform this task.
Step 1
In the Navigation pane, click Servers.
Step 2
Expand Servers > Service Profiles.
Step 3
Step 4
Step 5
Expand the node for the organization that contains the service profile of the server that you are shutting down.
Choose the service profile of the server that you are shutting down.
In the Work pane, click the General tab.
Step 6
In the Actions area, click Shutdown Server.
Step 7
If a confirmation dialog displays, click Yes.
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber
Power button/LED.
Step 8
If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Removing the Server Top Cover
Step 1
Remove the top cover:
Cisco UCS C240 M5 Server Installation and Service Guide
41
Maintaining the Server
Removing the Server Top Cover
a) If the cover latch is locked, use a screwdriver to turn the lock 90-degrees counterclockwise to unlock it.
b) Lift on the end of the latch that has the green finger grip. The cover is pushed back to the open position as you lift
the latch.
c) Lift the top cover straight up from the server and set it aside.
Step 2
Replace the top cover:
a) With the latch in the fully open position, place the cover on top of the server about one-half inch (1.27 cm) behind
the lip of the front cover panel. The opening in the latch should fit over the peg that sticks up from the fan tray.
b) Press the cover latch down to the closed position. The cover is pushed forward to the closed position as you push
down the latch.
c) If desired, lock the latch by using a screwdriver to turn the lock 90-degrees clockwise.
Figure 14: Removing the Top Cover
1
Cover latch
2
Cover lock
3
Cisco UCS C240 M5 Server Installation and Service Guide
42
Serial number label location
Maintaining the Server
Serial Number Location
Serial Number Location
The serial number for the server is printed on a label on the top of the server, near the front. See Removing
the Server Top Cover, on page 41.
Hot Swap vs Hot Plug
Some components can be removed and replaced without shutting down and removing power from the server.
This type of replacement has two varieties: hot-swap and hot-plug.
• Hot-swap replacement—You do not have to shut down the component in the software or operating
system. This applies to the following components:
◦SAS/SATA hard drives
◦SAS/SATA solid state drives
◦Cooling fan modules
◦Power supplies (when redundant as 1+1)
• Hot-plug replacement—You must take the component offline before removing it for the following
component:
◦NVMe PCIe solid state drives
Removing and Replacing Components
Warning
Blank faceplates and cover panels serve three important functions: they prevent exposure to
hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI)
that might disrupt other equipment; and they direct the flow of cooling air through the chassis. Do
not operate the system unless all cards, faceplates, front covers, and rear covers are in place.
Statement 1029
Caution
When handling server components, handle them only by carrier edges and use an electrostatic discharge
(ESD) wrist-strap or other grounding device to avoid damage.
Cisco UCS C240 M5 Server Installation and Service Guide
43
Maintaining the Server
Serviceable Component Locations
Tip
You can press the unit identification button on the front panel or rear panel to turn on a flashing, blue unit
identification LED on both the front and rear panels of the server. This button allows you to locate the
specific server that you are servicing when you go to the opposite side of the rack. You can also activate
these LEDs remotely by using the Cisco IMC interface.
This section describes how to install and replace server components.
Serviceable Component Locations
This topic shows the locations of the field-replaceable components and service-related items. The view in the
following figure shows the server with the top cover removed.
Figure 15: Cisco UCS C240 M5 Server, Serviceable Component Locations
1
Front-loading drive bays.
11
Rear-drive backplane assembly
2
Cooling fan modules (six, hot-swappable)
12
Power supplies (hot-swappable when redundant as 1+1)
Cisco UCS C240 M5 Server Installation and Service Guide
44
Maintaining the Server
Serviceable Component Locations
3
DIMM sockets on motherboard (up to 12 per CPU)
13
Not visible under air baffle in this view.
Rear 2.5-inch drive bays:
•
• All other C240 M5 PIDs support up to two drives:
See DIMM Population Rules and Memory Performance
Guidelines , on page 70 for DIMM slot numbering.
◦When using a hardware-RAID controller card
in the server, SAS/SATA drives or NVMe
SSDs are supported in the rear bays.
◦When using software RAID in the server, only
NVMe SSDs are supported in the rear bays.
4
CPUs and heatsinks (up to two)
14
Trusted platform module (TPM) socket on motherboard
(not visible in this view)
15
PCIe riser 2 (PCIe slots 4, 5, 6), with the following options:
Not visible under air baffle in this view.
5
Supercap unit (RAID backup) mounting bracket
• 2A—Slots 4 (x16), 5 (x16), and 6 (x8).
• 2B—Slots 4 (x8), 5 (x16), and 6 (x8); includes cable
connector for rear-loading NVMe SSDs.
• 2C—With slots 4 (x8), 5 (x8), and 6 (x8); includes
two cable connectors for rear-loading and
front-loading NVMe SSDs.
•
6
Internal, vertical USB 3.0 port on motherboard
16
Micro-SD card socket on PCIe riser 1
7
Mini storage module socket
17
PCIe riser 1 (PCIe slot 1, 2, 3), with the following options:
Supports either an SD card carrier with two SD card
slots; or an M.2 SSD carrier with two slots for either two
M.2 SATA or two M.2 NVMe SSDs.
• 1A—Slots 1 (x8), 2 (x16), 3 (x8); slot 2 requires
CPU2.
• 1B—Slots 1 (x8), 2 (x8), 3 (x8); all slots supported
by CPU1
8
Chassis intrusion switch (optional)
18
Modular LOM (mLOM) card bay on chassis floor (x16
PCIe lane), not visible in this view
9
PCIe cable connectors for NVMe SSDs, only on these
PCIe riser 2 options:
19
Cisco modular RAID controller PCIe slot (dedicated slot)
20
RTC battery, vertical socket
• 2B: One connector for rear NVMe SSDs.
• 2C: One connector for rear NVMe SSDs plus one
connector for front-loading NVMe SSDs
•
10
Rear-drive fan module
Cisco UCS C240 M5 Server Installation and Service Guide
45
Maintaining the Server
Replacing Front-Loading SAS/SATA Drives
21
Securing clips for GPU cards on air baffle
The Technical Specifications Sheets for all versions of this server, which include supported component part
numbers, are at Cisco UCS Servers Technical Specifications Sheets (scroll down to Technical Specifications).
Replacing Front-Loading SAS/SATA Drives
Note
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they
are hot-swappable.
To replace rear-loading SAS/SATA drives, see #unique_71.
Front-Loading SAS/SATA Drive Population Guidelines
The server is orderable in four different versions, each with a different front panel/drive-backplane configuration.
• Cisco UCS C240 M5 (UCSC-C240-M5SX)—Small form-factor (SFF) drives, with 24-drive backplane.
◦Front-loading drive bays 1—24 support 2.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 2.5-inch NVMe SSDs.
•
◦
◦
• Cisco UCS C240 M5 (UCSC-C240-M5S)—SFF drives, with 8-drive backplane and DVD drive option.
◦Front-loading drive bays 1—8 support 2.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 2.5-inch NVMe SSDs.
• Cisco UCS C240 M5 (UCSC-C240-M5L)—Large form-factor (LFF) drives, with 12-drive backplane.
◦Front-loading drive bays 1—12 support 3.5-inch SAS/SATA drives.
◦Optionally, front-loading drive bays 1 and 2 support 3.5-inch NVMe SSDs.
Cisco UCS C240 M5 Server Installation and Service Guide
46
Maintaining the Server
Replacing Front-Loading SAS/SATA Drives
Drive bay numbering is shown in the following figures.
Figure 16: Small Form-Factor Drive (24-Drive) Versions, Drive Bay Numbering
Figure 17: Small Form-Factor Drive (8-Drive) Version, Drive Bay Numbering
Figure 18: Large Form-Factor Drive (12-Drive) Version, Drive Bay Numbering
Observe these drive population guidelines for optimum performance:
• When populating drives, add drives to the lowest-numbered bays first.
Note
For diagrams of which drive bays are controlled by particular controller cables on the
backplane, see Storage Controller Cable Connectors and Backplanes, on page 133.
• Keep an empty drive blanking tray in any unused bays to ensure proper airflow.
• You can mix SAS/SATA hard drives and SAS/SATA SSDs in the same server. However, you cannot
configure a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when
you create a logical volume, it must contain all SAS/SATA hard drives or all SAS/SATA SSDs.
4K Sector Format SAS/SATA Drives Considerations
• You must boot 4K sector format drives in UEFI mode, not legacy mode. See the procedures in this
section.
• Do not configure 4K sector format and 512-byte sector format drives as part of the same RAID volume.
Cisco UCS C240 M5 Server Installation and Service Guide
47
Maintaining the Server
Replacing Front-Loading SAS/SATA Drives
• Operating system support on 4K sector drives is as follows: Windows: Win2012 and Win2012R2; Linux:
RHEL 6.5, 6.6, 6.7, 7.0, 7.2; SLES 11 SP3, and SLES 12. ESXi/Vmware is not supported.
Setting Up UEFI Mode Booting in the BIOS Setup Utility
Step 1
Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.
Step 2
Go to the Boot Options tab.
Step 3
Set UEFI Boot Options to Enabled.
Step 4
Under Boot Option Priorities, set your OS installation media (such as a virtual DVD) as your Boot Option #1.
Step 5
Go to the Advanced tab.
Step 6
Select LOM and PCIe Slot Configuration.
Step 7
Set the PCIe Slot ID: HBA Option ROM to UEFI Only.
Step 8
Press F10 to save changes and exit the BIOS setup utility. Allow the server to reboot.
Step 9
After the OS installs, verify the installation:
a) Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.
b) Go to the Boot Options tab.
c) Under Boot Option Priorities, verify that the OS you installed is listed as your Boot Option #1.
Setting Up UEFI Mode Booting in the Cisco IMC GUI
Step 1
Step 2
Use a web browser and the IP address of the server to log into the Cisco IMC GUI management interface.
Navigate to Server > BIOS.
Step 3
Under Actions, click Configure BIOS.
Step 4
In the Configure BIOS Parameters dialog, select the Advanced tab.
Step 5
Go to the LOM and PCIe Slot Configuration section.
Step 6
Set the PCIe Slot: HBA Option ROM to UEFI Only.
Step 7
Click Save Changes. The dialog closes.
Step 8
Under BIOS Properties, set Configured Boot Order to UEFI.
Step 9
Under Actions, click Configure Boot Order.
Step 10
In the Configure Boot Order dialog, click Add Local HDD.
Step 11
Step 12
In the Add Local HDD dialog, enter the information for the 4K sector format drive and make it first in the boot order.
Save changes and reboot the server. The changes you made will be visible after the system reboots.
Cisco UCS C240 M5 Server Installation and Service Guide
48
Maintaining the Server
Replacing Front-Loading SAS/SATA Drives
Replacing a Front-Loading SAS/SATA Drive
Note
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they
are hot-swappable.
Step 1
Remove the drive that you are replacing or remove a blank drive tray from the bay:
a) Press the release button on the face of the drive tray.
b) Grasp and open the ejector lever and then pull the drive tray out of the slot.
c) If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the tray and then lift
the drive out of the tray.
Step 2
Install a new drive:
a) Place a new drive in the empty drive tray and install the four drive-tray screws.
b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay.
Cisco UCS C240 M5 Server Installation and Service Guide
49
Maintaining the Server
Replacing Front-Loading SAS/SATA Drives
c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Figure 19: Replacing a Drive in a Drive Tray
1
Ejector lever
3
Drive tray screws (two on each side)
2
Release button
4
Drive removed from drive tray
Cisco UCS C240 M5 Server Installation and Service Guide
50
Maintaining the Server
Replacing Rear-Loading SAS/SATA Drives
Replacing Rear-Loading SAS/SATA Drives
Note
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they
are hot-swappable.
Rear-Loading SAS/SATA Drive Population Guidelines
The rear drive bay support differs by server PID and which type of RAID controller is used in the server:
• UCSC-C240-M5SX—Small form-factor (SFF) drives, with 24-drive backplane.
◦Hardware RAID—Rear drive bays support SAS or NVMe drives
◦Embedded software RAID—Rear drive bays support NVMe drives only.
•
◦
• UCSC-C240-M5S—SFF drives, with 8-drive backplane and DVD drive option.
◦Hardware RAID—Rear drive bays support SAS or NVMe drives
◦Embedded software RAID—Rear drive bays support NVMe drives only.
• UCSC-C240-M5L—Large form-factor (LFF) drives, with 12-drive backplane.
◦Hardware RAID—Rear drive bays support SAS or NVMe drives
◦Embedded software RAID—Rear drive bays support NVMe drives only.
• The rear drive bay numbering follows the front-drive bay numbering in each server version:
◦8-drive server—rear bays are numbered bays 9 and 10.
◦12-drive server—rear bays are numbered bays 13 and 14.
◦24-drive server—rear bays are numbered bays 25 and 26.
• When populating drives, add drives to the lowest-numbered bays first.
• Keep an empty drive blanking tray in any unused bays to ensure proper airflow.
• You can mix SAS/SATA hard drives and SAS/SATA SSDs in the same server. However, you cannot
configure a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when
you create a logical volume, it must contain all SAS/SATA hard drives or all SAS/SATA SSDs.
Cisco UCS C240 M5 Server Installation and Service Guide
51
Maintaining the Server
Replacing Rear-Loading SAS/SATA Drives
Replacing a Rear-Loading SAS/SATA Drive
Note
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they
are hot-swappable.
Step 1
Remove the drive that you are replacing or remove a blank drive tray from the bay:
a) Press the release button on the face of the drive tray.
b) Grasp and open the ejector lever and then pull the drive tray out of the slot.
c) If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the tray and then lift
the drive out of the tray.
Step 2
Install a new drive:
a) Place a new drive in the empty drive tray and install the four drive-tray screws.
b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay.
Cisco UCS C240 M5 Server Installation and Service Guide
52
Maintaining the Server
Replacing Front-Loading NVMe SSDs
c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Figure 20: Replacing a Drive in a Drive Tray
1
Ejector lever
3
Drive tray screws (two on each side)
2
Release button
4
Drive removed from drive tray
Replacing Front-Loading NVMe SSDs
This section is for replacing 2.5-inch or 3.5-inch form-factor NVMe solid-state drives (SSDs) in front-panel
drive bays.
Cisco UCS C240 M5 Server Installation and Service Guide
53
Maintaining the Server
Replacing Front-Loading NVMe SSDs
To replace HHHL form-factor NVMe SSDs in the PCIe slots, see Replacing HHHL Form-Factor NVMe Solid
State Drives, on page 66.
Front-Loading NVMe SSD Population Guidelines
The front drive bay support for 2.5- or 3.5-inch NVMe SSDs differs by server PID:
• UCSC-C240-M5SX—Small form-factor (SFF) drives, with 24-drive backplane. Drive bays 1 and 2
support 2.5-inch NVMe SSDs.
•
• UCSC-C240-M5S—SFF drives, with 8-drive backplane and DVD drive option. Drive bays 1 and 2
support 2.5-inch NVMe SSDs.
• UCSC-C240-M5L—Large form-factor (LFF) drives, with 12-drive backplane. Drive bays 1 and 2 support
2.5-inch and 3.5-inch NVMe SSDs. If you use 2.5-inch NVMe SSDs, a size-converter drive tray
(UCS-LFF-SFF-SLED2) is required for this version of the server.
Front-Loading NVME SSD Requirements and Restrictions
Observe these requirements:
• The server must have two CPUs. PCIe riser 2C is not available in a single-CPU system. PCIe riser 2C
has connectors for the cable that connects to the front-panel drive backplane.
• PCIe cable and PCIe riser 2C. This is the cable that carries the PCIe signal from the front-panel drive
backplane to PCIe riser 2C. These two items are kitted as follows:
◦For small form factor (SFF) versions of the server: CBL-NVME-C240SFF
◦For large form factor (LFF) versions of the server: CBL-NVME-C240LFF
• Hot-plug support must be enabled in the system BIOS. If you ordered the system with NVMe drives,
hot-plug support is enabled at the factory.
Observe these restrictions:
• NVMe 2.5- and 3.5-inch SSDs support booting only in UEFI mode. Legacy boot is not supported. For
instructions on setting up UEFI boot, see Setting Up UEFI Mode Booting in the BIOS Setup Utility,
on page 48 or Setting Up UEFI Mode Booting in the Cisco IMC GUI, on page 48.
• You cannot control NVMe PCIe SSDs with a SAS RAID controller because NVMe SSDs interface with
the server via the PCIe bus.
• You can combine NVMe 2.5- or 3.5-inch SSDs and HHHL form-factor SSDs in the same system, but
the same partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two HGST
HHHL form-factor SSDs is an invalid configuration. A valid configuration is two HGST NVMe SFF
2.5-inch SSDs and two HGST HHHL form-factor SSDs.
• UEFI boot is supported in all supported operating systems. Hot-insertion and hot-removal are supported
in all supported operating systems except VMWare ESXi.
Cisco UCS C240 M5 Server Installation and Service Guide
54
Maintaining the Server
Replacing Front-Loading NVMe SSDs
Enabling Hot-Plug Support in the System BIOS
Hot-plug (OS-informed hot-insertion and hot-removal) is disabled in the system BIOS by default.
• If the system was ordered with NVMe PCIe SSDs, the setting was enabled at the factory. No action is
required.
• If you are adding NVMe PCIe SSDs after-factory, you must enable hot-plug support in the BIOS. See
the following procedures.
Enabling Hot-Plug Support Using the BIOS Setup Utility
Step 1
Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.
Step 2
Navigate to Advanced > PCI Subsystem Settings > NVMe SSD Hot-Plug Support.
Step 3
Set the value to Enabled.
Step 4
Save your changes and exit the utility.
Enabling Hot-Plug Support Using the Cisco IMC GUI
Step 1
Step 2
Use a browser to log in to the Cisco IMC GUI for the server.
Navigate to Compute > BIOS > Advanced > PCI Configuration.
Step 3
Set NVME SSD Hot-Plug Support to Enabled.
Step 4
Save your changes.
Replacing a Front-Loading NVMe SSD
This topic describes how to replace 2.5- or 3.5-inch form-factor NVMe SSDs in the front-panel drive bays.
Step 1
Note
OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported on all
supported operating systems except VMware ESXi.
Note
OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug
Support in the System BIOS, on page 55.
Remove an existing front-loading NVMe SSD:
Cisco UCS C240 M5 Server Installation and Service Guide
55
Maintaining the Server
Replacing Front-Loading NVMe SSDs
a) Shut down the NVMe SSD to initiate an OS-informed removal. Use your operating system interface to shut down
the drive, and then observe the drive-tray LED:
• Green—The drive is in use and functioning properly. Do not remove.
• Green, blinking—the driver is unloading following a shutdown command. Do not remove.
• Off—The drive is not in use and can be safely removed.
Step 2
Step 3
b) Press the release button on the face of the drive tray.
c) Grasp and open the ejector lever and then pull the drive tray out of the slot.
d) Remove the four drive tray screws that secure the SSD to the tray and then lift the SSD out of the tray.
Note
If this is the first time that front-loading NVMe SSDs are being installed in the server, you must install a PCIe
cable with PCIe riser 2C. See Installing Riser 2C Kit For Front-Loading NVMe SSDs, on page 57.
Install a new front-loading NVMe SSD:
a) Place a new SSD in the empty drive tray and install the four drive-tray screws.
b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay.
c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Observe the drive-tray LED and wait until it returns to solid green before accessing the drive:
• Off—The drive is not in use.
• Green, blinking—the driver is initializing following hot-plug insertion.
• Green—The drive is in use and functioning properly.
Cisco UCS C240 M5 Server Installation and Service Guide
56
Maintaining the Server
Replacing Front-Loading NVMe SSDs
Figure 21: Replacing a Drive in a Drive Tray
1
Ejector lever
3
Drive tray screws (two on each side)
2
Release button
4
Drive removed from drive tray
Installing Riser 2C Kit For Front-Loading NVMe SSDs
The front-loading NVMe SSDs interface with the server via the PCIe bus. A PCIe cable connects the front-panel
drive backplane to PCIe riser 2C.
Cisco UCS C240 M5 Server Installation and Service Guide
57
Maintaining the Server
Replacing Front-Loading NVMe SSDs
Note
Only PCIe riser version 2C has a connector that supports front-loading NVMe SSDs. This riser 2C is
kitted with the required PCIe cable. For SFF versions of the server, use kit CBL-NVME-C240SFF; For
the LFF version of the server, use kit CBL-NVME-C24LFF.
• If the server was ordered with front-loading NVMe SSDs, this kit was preinstalled at the factory. No
action is required.
• If you are adding front-loading NVMe SSDs for the first time, you must order and install the kit as
described in the following procedure.
Step 1
Step 2
Step 3
Step 4
Remove the existing PCIe riser 2 version and replace it with PCIe riser 2C. See Replacing a PCIe Riser, on page 93.
Connect the two connectors on one end of the cable to the PCIe connectors on the drive backplane.
Route the cables through the chassis cable guides to the rear of the server as shown below.
Connect the other end of the cable to the "Front NVMe" connector on PCIe riser 2C.
In the following figure, the colored lines represent cabling paths:
• The red line represents the cable path from riser 2C to the front-drive backplane.
• The blue line represents the cable path from riser 2C to the optional rear-drive backplane.
Figure 22: PCIe Cabling From PCIe Riser 2 to Drive Backplanes
Cisco UCS C240 M5 Server Installation and Service Guide
58
Maintaining the Server
Replacing Rear-Loading NVMe SSDs
1
Front NVMe cable connector
2
(on riser version 2C only)
Rear NVMe cable connector
(on riser version 2B, 2C, or 2D only)
Replacing Rear-Loading NVMe SSDs
This section is for replacing 2.5-inch form-factor NVMe solid-state drives (SSDs) in rear-panel drive bays.
This section contains the following topics:
Rear-Loading NVMe SSD Population Guidelines
The rear drive bay support differs by server PID and which type of RAID controller is used in the server for
non-NVMe drives:
• UCSC-C240-M5SX—Small form-factor (SFF) drives, with 24-drive backplane.
◦Hardware RAID—Rear drive bays support SAS or NVMe drives
◦Embedded software RAID—Rear drive bays support NVMe drives only.
•
◦
• UCSC-C240-M5S—SFF drives, with 8-drive backplane and DVD drive option.
◦Hardware RAID—Rear drive bays support SAS or NVMe drives
◦Embedded software RAID—Rear drive bays support NVMe drives only.
• UCSC-C240-M5L—Large form-factor (LFF) drives, with 12-drive backplane.
◦Hardware RAID—Rear drive bays support SAS or NVMe drives
◦Embedded software RAID—Rear drive bays support NVMe drives only.
• The rear drive bay numbering follows the front-drive bay numbering in each server version:
◦8-drive server—rear bays are numbered bays 9 and 10.
◦12-drive server—rear bays are numbered bays 13 and 14.
◦24-drive server—rear bays are numbered bays 25 and 26.
• When populating drives, add drives to the lowest-numbered bays first.
• Keep an empty drive blanking tray in any unused bays to ensure proper airflow.
Cisco UCS C240 M5 Server Installation and Service Guide
59
Maintaining the Server
Replacing Rear-Loading NVMe SSDs
Rear-Loading NVME SSD Requirements and Restrictions
Observe these requirements:
• The server must have two CPUs. PCIe riser 2 is not available in a single-CPU system. PCIe riser 2B or
2C has the connector for the cable that connects to the rear drive backplane.
• PCIe cable and PCIe riser 2B or 2C. This is the cable that carries the PCIe signal from the rear drive
backplane to PCIe riser 2B or 2C. These items are kitted as follows:
◦Kit for all server versions; includes rear backplane, fan, and cable: UCSC-RNVME-240M5
◦PCIe cable only: CBL-NVME-C240RF
• Hot-plug support must be enabled in the system BIOS. If you ordered the system with NVMe drives,
hot-plug support is enabled at the factory.
Observe these restrictions:
• NVMe SSDs support booting only in UEFI mode. Legacy boot is not supported. For instructions on
setting up UEFI boot, see Setting Up UEFI Mode Booting in the BIOS Setup Utility, on page 48 or
Setting Up UEFI Mode Booting in the Cisco IMC GUI, on page 48.
• You cannot control NVMe PCIe SSDs with a SAS RAID controller because NVMe SSDs interface with
the server via the PCIe bus.
• You can combine NVMe 2.5-inch SSDs and HHHL form-factor SSDs in the same system, but the same
partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two HGST HHHL
form-factor SSDs is an invalid configuration. A valid configuration is two HGST NVMe SFF 2.5-inch
SSDs and two HGST HHHL form-factor SSDs.
• UEFI boot is supported in all supported operating systems. Hot-insertion and hot-removal are supported
in all supported operating systems except VMWare ESXi.
Replacing a Rear-Loading NVMe SSD
This topic describes how to replace 2.5-inch form-factor NVMe SSDs in the rear-panel drive bays.
Step 1
Note
OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported on all
supported operating systems except VMware ESXi.
Note
OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug
Support in the System BIOS, on page 55.
Remove an existing rear-loading NVMe SSD:
a) Shut down the NVMe SSD to initiate an OS-informed removal. Use your operating system interface to shut down
the drive, and then observe the drive-tray LED:
Cisco UCS C240 M5 Server Installation and Service Guide
60
Maintaining the Server
Replacing Rear-Loading NVMe SSDs
• Green—The drive is in use and functioning properly. Do not remove.
• Green, blinking—the driver is unloading following a shutdown command. Do not remove.
• Off—The drive is not in use and can be safely removed.
b) Press the release button on the face of the drive tray.
c) Grasp and open the ejector lever and then pull the drive tray out of the slot.
d) Remove the four drive tray screws that secure the SSD to the tray and then lift the SSD out of the tray.
Note
If this is the first time that rear-loading NVMe SSDs are being installed in the server, you must install a PCIe
cable with PCIe riser 2B or 2C.
Step 2
Step 3
The server must also have an optional rear drive backplane (see Replacing a Rear-Loading Drive Backplane
Assembly, on page 64).
Install a new front-loading NVMe SSD:
a) Place a new SSD in the empty drive tray and install the four drive-tray screws.
b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay.
c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Observe the drive-tray LED and wait until it returns to solid green before accessing the drive:
• Off—The drive is not in use.
• Green, blinking—the driver is initializing following hot-plug insertion.
• Green—The drive is in use and functioning properly.
Cisco UCS C240 M5 Server Installation and Service Guide
61
Maintaining the Server
Replacing Rear-Loading NVMe SSDs
Figure 23: Replacing a Drive in a Drive Tray
1
Ejector lever
3
Drive tray screws (two on each side)
2
Release button
4
Drive removed from drive tray
Installing Riser 2B or 2C Kit For Rear-Loading NVMe SSDs
The rear-loading NVMe SSDs interface with the server via the PCIe bus. A PCIe cable connects the rear drive
backplane to PCIe riser 2B or 2C.
Cisco UCS C240 M5 Server Installation and Service Guide
62
Maintaining the Server
Replacing Rear-Loading NVMe SSDs
Note
PCIe riser versions 2B and 2C have a connector that supports rear-loading NVMe SSDs. Riser 2C is kitted
with the required PCIe cable. For all versions of the server, use kit UCSC-RNVME-C240M5; You can
also order the cable only: CBL-NVME-C24LRF. (Riser 2D is not orderable separately.)
• If the server was ordered with rear-loading NVMe SSDs, this kit was preinstalled at the factory. No
action is required.
• If you are adding rear-loading NVMe SSDs for the first time, you must order and install the kit as
described in the following procedure.
Step 1
Step 2
Step 3
Step 4
If necessary, remove the existing PCIe riser 2 version and replace it with PCIe riser 2B or 2C. (Riser 2D is not orderable
separately.) See Replacing a PCIe Riser, on page 93.
Connect the two connectors on one end of the cable to the PCIe connectors on the rear drive backplane.
Route the cables to PCIe riser 2B or 2C.
Connect the two connectors on the other end of the cable to the "Rear NVMe" connector on PCIe riser 2Bor 2C.
In the following figure, the colored lines represent cabling paths:
• The blue line represents the cable path from riser 2B or 2C to the optional rear drive backplane.
• The red line represents the cable path from riser 2C (only) to the front drive backplane.
Figure 24: PCIe Cabling From PCIe Riser 2 to Drive Backplanes
Cisco UCS C240 M5 Server Installation and Service Guide
63
Maintaining the Server
Replacing a Rear-Loading Drive Backplane Assembly
1
Front NVMe cable connector
(on riser version 2C only)
2
Rear NVMe cable connector
(on riser version 2B or 2C)
Replacing a Rear-Loading Drive Backplane Assembly
Although all server versions have the rear-drive cage installed as part of the chassis at the factory, you can
use it only if you have ordered or installed a rear backplane.
Step 1
Step 2
Step 3
Step 4
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Remove any existing rear drive backplane assembly:
a) Remove any drives from the existing rear drive backplane and set them aside.
b) Remove the fan from the rear backplane assembly. Pinch the green finger-grips on the top of the fan and then lift
straight up.
c) Disconnect the CONN REAR cable from the backplane.
d) Lift the hinged rear backplane retainer on the top of the rear backplane cage. This metal retainer is marked blue.
e) Grasp the black plastic fingergrip on the rear backplane and lift the backplane straight up to remove it from the
motherboard socket and cage.
Step 5
Install a new rear backplane or kit:
a) Grasp the new rear backplane by the black plastic fingergrip on its frame.
b) Lower the new backplane into the guide channels on the cage until its edge connector touches the socket on the
motherboard.
c) Push down on the top of the backplane until its securing clips click and the edge connector is firmly seated in the
motherboard socket.
d) Close the hinged rear backplane retainer on the top of the cage.
e) Connect the CONN REAR cable from your SAS controller or PCIe riser to the socket on the backplane.
f) Install the rear backplane fan. With the arrows on top of the fan pointing toward the rear, lower the fan's connector
over the socket and align the guides on the fan into the channels that are on the power supply cage.
g) Push down on the top of the fan until it clicks.
h) Install drives to the rear bays.
Step 6
Step 7
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Cisco UCS C240 M5 Server Installation and Service Guide
64
Maintaining the Server
Replacing a Rear-Drive Backplane Fan
Replacing a Rear-Drive Backplane Fan
The fan on the rear-loading drive backplane can be replaced separately from the backplane assembly.
Step 1
Step 2
Step 3
Step 4
Step 5
Step 6
Step 7
Step 8
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Caution
If there are drives installed in the rear drive backplane, do not operate the server with the rear drive fan
removed.
Grasp the finger-grips on the top of the fan and pull straight up to disconnect it from its socket on the assembly.
Align the new fan over the socket on the assembly. The arrow on the fan must point toward the rear of the server.
Slide the fan down and press on its top until it is firmly connected to the socket on the assembly.
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 25: Rear Drive Backplane Fan
Cisco UCS C240 M5 Server Installation and Service Guide
65
Maintaining the Server
Replacing HHHL Form-Factor NVMe Solid State Drives
Rear fan location on rear drive cage
1
-
Replacing HHHL Form-Factor NVMe Solid State Drives
This section is for replacing half-height, half-length (HHHL) form-factor NVMe SSDs in the PCIe risers.
HHHL SSD Population Guidelines
Observe the following population guidelines when installing HHHL form-factor NVMe SSDs:
• Two-CPU systems—You can populate up to 6 HHHL form-factor SSDs, using PCIe slots 1 – 6.
• One-CPU systems—In a single-CPU system, PCIe riser 2 is not available. Therefore, the maximum
number of HHHL form-factor SSDs you can populate is 3, using PCIe slots 1 - 3.
HHHL Form-Factor NVME SSD Requirements and Restrictions
Observe these requirements:
• All versions of the server support HHHL form-factor NVMe SSDs.
Observe these restrictions:
• You cannot boot from an HHHL form-factor NVMe SSD.
• You cannot control HHHL NVMe SSDs with a SAS RAID controller because NVMe SSDs interface
with the server via the PCIe bus.
• You can combine NVMe SFF 2.5- or 3.5-inch SSDs and HHHL form-factor SSDs in the same system,
but the same partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two
HGST HHHL form-factor SSDs is an invalid configuration. A valid configuration is two HGST NVMe
SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs.
Replacing an HHHL Form-Factor NVMe SSD
Note
Step 1
In a single-CPU server, PCIe riser 2 (PCIe slot 2) is not available.
Remove an existing HHHL form-factor NVME SSD (or a blank filler panel) from the PCIe riser:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Cisco UCS C240 M5 Server Installation and Service Guide
66
Maintaining the Server
Replacing HHHL Form-Factor NVMe Solid State Drives
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
d) Use two hands to flip up and grasp the blue riser handle and the blue fingergrip area on the front edge of the riser,
and then lift straight up.
e) On the bottom of the riser, push the release latch that holds the securing plate, and then swing the hinged securing
plate open.
f) Open the hinged card-tab retainer that secures the rear-panel tab of the card.
g) Pull evenly on both ends of the HHHL form-factor NVME SSD to remove it from the socket on the PCIe riser.
If the riser has no SSD, remove the blanking panel from the rear opening of the riser.
Step 2
Install a new HHHL form-factor NVME SSD:
a)
b)
c)
d)
e)
f)
g)
h)
Open the hinged, plastic card-tab retainer.
Align the new SSD with the empty socket on the PCIe riser.
Push down evenly on both ends of the card until it is fully seated in the socket.
Ensure that the SSD’s rear panel tab sits flat against the riser rear-panel opening and then close the hinged card-tab
retainer over the rear-panel tab.
Close the hinged securing plate.
Position the PCIe riser over its socket on the motherboard and over the chassis alignment channels.
Carefully push down on both ends of the PCIe riser to fully engage its connector with the sockets on the motherboard.
Replace the top cover to the server.
Cisco UCS C240 M5 Server Installation and Service Guide
67
Maintaining the Server
Replacing Fan Modules
i) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 26: PCIe Riser Card Securing Mechanisms
1
Release latch on hinged securing plate
3
2
Hinged securing plate
-
Hinged card-tab retainer
Replacing Fan Modules
The six fan modules in the server are numbered as shown in Serviceable Component Locations, on page 7.
Tip
There is a fault LED on the top of each fan module. This LED lights green when the fan is correctly seated
and is operating OK. The LED lights amber when the fan has a fault or is not correctly seated.
Cisco UCS C240 M5 Server Installation and Service Guide
68
Maintaining the Server
Replacing Fan Modules
Caution
You do not have to shut down or remove power from the server to replace fan modules because they are
hot- swappable. However, to maintain proper cooling, do not operate the server for more than one minute
with any fan module removed.
Step 1
Remove an existing fan module:
a) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
b) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
c) Grasp and squeeze the fan module release latches on its top. Lift straight up to disengage its connector from the
motherboard.
Step 2
Install a new fan module:
a) Set the new fan module in place. The arrow printed on the top of the fan module should point toward the rear of the
server.
b) Press down gently on the fan module to fully engage it with the connector on the motherboard.
c) Replace the top cover to the server.
d) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 27: Top View of Fan Module
1
Fan module release latches
2
Fan module fault LED
Cisco UCS C240 M5 Server Installation and Service Guide
69
Maintaining the Server
Replacing Memory DIMMs
Replacing Memory DIMMs
Caution
DIMMs and their sockets are fragile and must be handled with care to avoid damage during installation.
Caution
Cisco does not support third-party DIMMs. Using non-Cisco DIMMs in the server might result in system
problems or damage to the motherboard.
Note
To ensure the best server performance, it is important that you are familiar with memory performance
guidelines and population rules before you install or replace DIMMs.
DIMM Population Rules and Memory Performance Guidelines
This topic describes the rules and guidelines for maximum memory performance.
DIMM Slot Numbering
The following figure shows the numbering of the DIMM slots on the motherboard.
Figure 28: DIMM Slot Numbering
DIMM Population Rules
Observe the following guidelines when installing or replacing DIMMs for maximum performance:
• Each CPU supports six memory channels.
◦CPU 1 supports channels A, B, C, D, E, F.
◦CPU 2 supports channels G, H, J, K, L, M.
Cisco UCS C240 M5 Server Installation and Service Guide
70
Maintaining the Server
Replacing Memory DIMMs
• Each channel has two DIMM sockets (for example, channel A = slots A1, A2).
◦A channel can operate with one or two DIMMs installed.
◦If a channel has only one DIMM, populate slot 1 first (the blue slot).
• When both CPUs are installed, populate the DIMM sockets of each CPU identically.
◦Fill blue #1 slots in the channels first: A1, G1, B1, H1, C1, J1, D1, K1, E1, L1, F1, M1
◦Fill black #2 slots in the channels second: A2, G2, B2, H2, C2, J2, D2, K2, E2, L2, F2, M2
• Any DIMM installed in a DIMM socket for which the CPU is absent is not recognized. In a single-CPU
configuration, populate the channels for CPU1 only (A, B, C, D, E, F).
• The maximum combined memory allowed in the 12 DIMM slots controlled by any one CPU is 768 GB.
To populate the 12 DIMM slots with more than 768 GB of combined memory, you must use a
high-memory CPU that has a PID that ends with an "M", for example, UCS-CPU-6134M.
• Memory mirroring reduces the amount of memory available by 50 percent because only one of the two
populated channels provides data. When memory mirroring is enabled, you must install DIMMs in even
numbers of channels.
• The NVIDIA Tesla P-Series GPU can support more than 1 TB of memory in the server. All other
NVIDIA GPUs can support only 1 TB or less of memory in the server. Therefore, do not install DIMMs
totalling more than 1 TB capacity when using an NVIDIA GPU card other than P-Series in this server.
• Observe the DIMM mixing rules shown in the following table.
Table 4: DIMM Mixing Rules
DIMM Parameter
DIMMs in the Same Channel
DIMMs in the Same Bank
DIMM Capacity
You can mix different capacity You cannot mix DIMM
For example, 8GB, 16GB, 32GB, DIMMs in the same channel (for capacities in a bank (for example
example, A1, A2).
A1, B1). Pairs of DIMMs must
64GB, 128GB
be identical (same PID and
revision).
DIMM speed
For example, 2666 GHz
DIMM type
RDIMMs or LRDIMMs
You can mix speeds, but DIMMs
will run at the speed of the
slowest DIMMs/CPUs installed
in the channel.
You cannot mix DIMM speeds
in a bank (for example A1, B1).
Pairs of DIMMs must be
identical (same PID and
revision).
You cannot mix DIMM types in You cannot mix DIMM types in
a channel.
a bank.
Memory Mirroring
The CPUs in the server support memory mirroring only when an even number of channels are populated with
DIMMs. If one or three channels are populated with DIMMs, memory mirroring is automatically disabled.
Cisco UCS C240 M5 Server Installation and Service Guide
71
Maintaining the Server
Replacing CPUs and Heatsinks
Memory mirroring reduces the amount of memory available by 50 percent because only one of the two
populated channels provides data. The second, duplicate channel provides redundancy.
Replacing DIMMs
Identifying a Faulty DIMM
Each DIMM socket has a corresponding DIMM fault LED, directly in front of the DIMM socket. See Internal
Diagnostic LEDs, on page 38 for the locations of these LEDs. When the server is in standby power mode,
these LEDs light amber to indicate a faulty DIMM.
Step 1
Remove an existing DIMM:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
d) Remove the air baffle that covers the front ends of the DIMM slots to provide clearance.
e) Locate the DIMM that you are removing, and then open the ejector levers at each end of its DIMM slot.
Step 2
Install a new DIMM:
Note
Before installing DIMMs, see the memory population rules for this server: DIMM Population Rules and Memory
Performance Guidelines , on page 70.
a) Align the new DIMM with the empty slot on the motherboard. Use the alignment feature in the DIMM slot to correctly
orient the DIMM.
b) Push down evenly on the top corners of the DIMM until it is fully seated and the ejector levers on both ends lock
into place.
c) Replace the top cover to the server.
d) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Replacing CPUs and Heatsinks
This section contains the following topics:
• CPU Configuration Rules, on page 73
• Tools Required For CPU Replacement, on page 73
• Replacing a CPU and Heatsink, on page 73
• Additional CPU-Related Parts to Order with RMA Replacement Motherboards, on page 80
Cisco UCS C240 M5 Server Installation and Service Guide
72
Maintaining the Server
Replacing CPUs and Heatsinks
CPU Configuration Rules
This server has two CPU sockets on the motherboard. Each CPU supports six DIMM channels (12 DIMM
slots). See DIMM Population Rules and Memory Performance Guidelines , on page 70.
• The server can operate with one CPU or two identical CPUs installed.
• The minimum configuration is that the server must have at least CPU 1 installed. Install CPU 1 first,
and then CPU 2.
• The maximum combined memory allowed in the 12 DIMM slots controlled by any one CPU is 768 GB.
To populate the 12 DIMM slots with more than 768 GB of combined memory, you must use a
high-memory CPU that has a PID that ends with an "M", for example, UCS-CPU-6134M.
• The following restrictions apply when using a single-CPU configuration:
◦The maximum number of DIMMs is 12 (only CPU 1 channels A, B, C, D, E, F).
◦PCIe riser 2 (slots 4, 5, 6) is unavailable.
◦You must use PCIe riser 1B (UCSC-PCI-1B-C240M5) to have support for all three slots (PCIe 1,
2, 3). In PCIe riser 1 (UCSC-PCI-1-C240M5), slot 3 is unavailable because it is controlled by CPU
2.
◦Front- and rear-loading NVMe drives are unavailable (they require PCIe riser 2B or 2C).
Tools Required For CPU Replacement
You need the following tools and equipment for this procedure:
• T-30 Torx driver—Supplied with replacement CPU.
• #1 flat-head screwdriver—Supplied with replacement CPU.
• CPU assembly tool—Supplied with replacement CPU. Orderable separately as Cisco PID UCS-CPUAT=.
• Heatsink cleaning kit—Supplied with replacement CPU. Orderable separately as Cisco PID
UCSX-HSCK=.
• Thermal interface material (TIM)—Syringe supplied with replacement CPU. Use only if you are reusing
your existing heatsink (new heatsinks have a pre-applied pad of TIM). Orderable separately as Cisco
PID UCS-CPU-TIM=.
See also Additional CPU-Related Parts to Order with RMA Replacement Motherboards, on page 80.
Replacing a CPU and Heatsink
Caution
CPUs and their sockets are fragile and must be handled with extreme care to avoid damaging pins. The
CPUs must be installed with heatsinks and thermal interface material to ensure cooling. Failure to install
a CPU correctly might result in damage to the server.
Cisco UCS C240 M5 Server Installation and Service Guide
73
Maintaining the Server
Replacing CPUs and Heatsinks
An instructive video is available for this procedure: CPU and Heatsink Replacement in Cisco UCS M5 Servers
Step 1
Remove the existing CPU/heatsink assembly from the server:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
d) Use the T-30 Torx driver that is supplied with the replacement CPU to loosen the four captive nuts that secure the
assembly to the motherboard standoffs.
Note
Alternate loosening the heatsink nuts evenly so that the heatsink remains level as it is raised. Loosen the
heatsink nuts in the order shown on the heatsink label: 4, 3, 2, 1.
e) Lift straight up on the CPU/heatsink assembly and set it heatsink-down on an antistatic surface.
Figure 29: Removing the CPU/Heatsink Assembly
Cisco UCS C240 M5 Server Installation and Service Guide
74
Maintaining the Server
Replacing CPUs and Heatsinks
Step 2
1
Heatsink
4
CPU socket on motherboard
2
Heatsink captive nuts (two on each side)
5
T-30 Torx driver
3
CPU carrier (below heatsink in this view)
-
Separate the heatsink from the CPU assembly (the CPU assembly includes the CPU and the plastic CPU carrier):
a) Place the heatsink with CPU assembly so that it is oriented upside-down.
Note the thermal-interface material (TIM) breaker location. TIM BREAKER is stamped on the CPU carrier next to
a small slot.
Figure 30: Separating the CPU Assembly From the Heatsink
1
CPU carrier
4
CPU-carrier inner-latch nearest to the TIM breaker
slot
2
CPU
5
#1 flat-head screwdriver inserted into TIM breaker
slot
Cisco UCS C240 M5 Server Installation and Service Guide
75
Maintaining the Server
Replacing CPUs and Heatsinks
3
TIM BREAKER slot in CPU carrier
-
b) Pinch inward on the CPU-carrier clip that is nearest the TIM breaker slot and then push up to disengage the clip from
its slot in the heatsink corner.
c) Insert the blade of a #1 flat-head screwdriver into the slot marked TIM BREAKER.
Note
In the following step, do not pry on the CPU surface. Use gentle rotation to lift on the plastic surface of the
CPU carrier at the TIM breaker slot. Use caution to avoid damaging the heatsink surface.
d) Gently rotate the screwdriver to lift up on the CPU until the TIM on the heatsink separates from the CPU.
Note
Do not allow the screwdriver tip to touch or damage the green CPU
substrate.
e) Pinch the CPU-carrier clip at the corner opposite the TIM breaker and push up to disengage the clip from its slot in
the heatsink corner.
f) On the remaining two corners of the CPU carrier, gently pry outward on the outer-latches and then lift the
CPU-assembly from the heatsink.
Note
Handle the CPU-assembly by the plastic carrier only. Do not touch the CPU surface. Do not separate the
CPU from the plastic carrier.
Step 3
The new CPU assembly is shipped on a CPU assembly tool. Take the new CPU assembly and CPU assembly tool out
of the carton.
If the CPU assembly and CPU assembly tool become separated, note the alignment features for correct orientation. The
pin 1 triangle on the CPU carrier must be aligned with the angled corner on the CPU assembly tool.
Cisco UCS C240 M5 Server Installation and Service Guide
76
Maintaining the Server
Replacing CPUs and Heatsinks
Caution
CPUs and their sockets are fragile and must be handled with extreme care to avoid damaging
pins.
Figure 31: CPU Assembly Tool, CPU Assembly, and Heatsink Alignment Features
Step 4
1
CPU assembly tool
4
Angled corner on heatsink (pin 1 alignment feature)
2
CPU assembly (CPU in plastic carrier frame)
5
Triangle cut into plastic carrier (pin 1 alignment
feature)
3
Heatsink
6
Angled corner on CPU assembly tool (pin 1
alignment feature)
Apply new TIM to the heatsink:
Cisco UCS C240 M5 Server Installation and Service Guide
77
Maintaining the Server
Replacing CPUs and Heatsinks
Note
The heatsink must have new TIM on the heatsink-to-CPU surface to ensure proper cooling and performance.
• If you are installing a new heatsink, it is shipped with a pre-applied pad of TIM. Go to step 5.
• If you are reusing a heatsink, you must remove the old TIM from the heatsink and then apply new TIM to the CPU
surface from the supplied syringe. Continue with step a below.
a) Apply the cleaning solution that is included with the heatsink cleaning kit (UCSX-HSCK=) to the old TIM on the
heatsink and let it soak for a least 15 seconds.
b) Wipe all of the TIM off the heatsink using the soft cloth that is included with the heatsink cleaning kit. Be careful to
avoid scratching the heatsink surface.
c) Using the syringe of TIM provided with the new CPU (UCS-CPU-TIM=), apply 4 cubic centimeters of thermal
interface material to the top of the CPU. Use the pattern shown below to ensure even coverage.
Figure 32: Thermal Interface Material Application Pattern
Step 5
Step 6
Use only the correct heatsink for your CPUs to ensure proper cooling. There are two different heatsinks:
UCSC-HS-C240M5 for standard-performance CPUs 150 W and less; UCSC-HS2-C240M5 for high-performance
CPUs above 150 W. Note the wattage described on the heatsink label.
With the CPU assembly on the CPU assembly tool, set the heatsink onto the CPU assembly. Note the Pin 1 alignment
features for correct orientation. Push down gently until you hear the corner clips of the CPU carrier click onto the heatsink
corners.
Caution
In the following step, use extreme care to avoid touching or damaging the CPU contacts or the CPU socket
pins.
Install the CPU/heatsink assembly to the server:
a) Lift the heatsink with attached CPU assembly from the CPU assembly tool.
b) Align the assembly over the CPU socket on the motherboard.
Note
Cisco UCS C240 M5 Server Installation and Service Guide
78
Maintaining the Server
Replacing CPUs and Heatsinks
Note the alignment features. The pin 1 angled corner on the heatsink must align with the pin 1 angled corner on the
CPU socket. The CPU-socket posts must align with the guide-holes in the assembly.
Figure 33: Installing the Heatsink/CPU Assembly to the CPU Socket
1
Guide hole in assembly (two)
4
Angled corner on heatsink (pin 1 alignment feature)
2
CPU socket alignment post (two)
5
Angled corner on socket (pin 1 alignment feature)
3
CPU socket leaf spring
-
c) Set the heatsink with CPU assembly down onto the CPU socket.
d) Use the T-30 Torx driver that is supplied with the replacement CPU to tighten the four captive nuts that secure the
heatsink to the motherboard standoffs.
Cisco UCS C240 M5 Server Installation and Service Guide
79
Maintaining the Server
Replacing a Mini-Storage Module
Alternate tightening the heatsink nuts evenly so that the heatsink remains level while it is lowered. Tighten
the heatsink nuts in the order shown on the heatsink label: 1, 2, 3, 4. The captive nuts must be fully tightened
so that the leaf springs on the CPU socket lie flat.
e) Replace the top cover to the server.
f) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Note
Additional CPU-Related Parts to Order with RMA Replacement Motherboards
When a return material authorization (RMA) of the motherboard or CPU is done on a Cisco UCS C-Series
server, additional parts might not be included with the CPU or motherboard spare bill of materials (BOM).
The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.
• Scenario 1—You are reusing the existing heatsinks:
◦Heat sink cleaning kit (UCSX-HSCK=)
◦Thermal interface material (TIM) kit for M5 servers (UCS-CPU-TIM=)
• Scenario 2—You are replacing the existing heatsinks:
Caution
Use only the correct heatsink for your CPUs to ensure proper cooling. There are two
different heatsinks: UCSC-HS-C240M5= for CPUs 150 W and less;
UCSC-HS2-C240M5= for CPUs above 150 W.
◦Heat sink: UCSC-HS-C240M5= for CPUs 150 W and less; UCSC-HS2-C240M5= for CPUs above
150 W
◦Heat sink cleaning kit (UCSX-HSCK=)
• Scenario 3—You have a damaged CPU carrier
◦CPU carrier (UCS-M5-CPU-CAR=)
A CPU heat sink cleaning kit is good for up to four CPU and heat sink cleanings. The cleaning kit contains
two bottles of solution, one to clean the CPU and heat sink of old TIM and the other to prepare the surface of
the heat sink.
New heat sink spares come with a pre-applied pad of TIM. It is important to clean any old TIM off of the
CPU surface prior to installing the heat sinks. Therefore, even when you are ordering new heat sinks, you
must order the heat sink cleaning kit.
Replacing a Mini-Storage Module
The mini-storage module plugs into a motherboard socket to provide additional internal storage. The module
is available in two different versions:
• SD card carrier—provides two SD card sockets.
Cisco UCS C240 M5 Server Installation and Service Guide
80
Maintaining the Server
Replacing a Mini-Storage Module
• M.2 SSD Carrier—provides two M.2 form-factor SSD sockets. These M.2 SSDs can be either two SATA
SSDs or two NVMe SSDs (no mixing).
Replacing a Mini-Storage Module Carrier
This topic describes how to remove and replace a mini-storage module carrier. The carrier has one media
socket on its top and one socket on its underside. Use the following procedure for any type of mini-storage
module carrier (SD card or M.2 SSD).
Step 1
Step 2
Step 3
Step 4
Step 5
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Remove a carrier from its socket:
a) Locate the mini-storage module carrier in its socket just in front of power supply 1.
b) Push outward on the securing clips that holds each end of the carrier.
c) Lift both ends of the carrier to disengage it from the socket on the motherboard.
d) Set the carrier on an anti-static surface.
Install a carrier to its socket:
a) Position carrier over socket, with the carrier's connector facing down. Two alignment pegs must match with two
holes on the carrier.
b) Gently push down the socket end of the carrier so that the two pegs go through the two holes on the carrier.
Cisco UCS C240 M5 Server Installation and Service Guide
81
Maintaining the Server
Replacing a Mini-Storage Module
c) Push down on the carrier so that the securing clips click over it at both ends.
Step 6
Step 7
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 34: Mini-Storage Module Carrier Socket
1
Location of socket on motherboard
3
2
Alignment pegs
-
Securing clips
Replacing an SD Card in a Mini-Storage Carrier For SD
This topic describes how to remove and replace an SD card in a mini-storage carrier for SD (PID
UCS-MSTOR-SD). The carrier has one SD card socket on its top and one socket on its underside.
Population Rules For Mini-Storage SD Cards
• You can use one or two SD cards in the carrier.
• Dual SD cards can be configured in a RAID 1 array through the Cisco IMC interface.
Cisco UCS C240 M5 Server Installation and Service Guide
82
Maintaining the Server
Replacing a Mini-Storage Module
• SD socket 1 is on the top side of the carrier; SD socket 2 is on the underside of the carrier (the same side
as the carrier's motherboard connector).
Step 1
Step 2
Power off the server and then remove the mini-storage module carrier from the server as described in Replacing a
Mini-Storage Module Carrier, on page 81.
Remove an SD card:
a) Push on the top of the SD card, and then release it to allow it to spring out from the socket.
b) Grasp and remove the SD card from the socket.
Step 3
Install a new SD card:
a) Insert the new SD card into the socket with its label side facing up (away from the carrier).
b) Press on the top of the SD card until it clicks in the socket and stays in place.
Step 4
Install the mini-storage module carrier back into the server and then power it on as described in Replacing a Mini-Storage
Module Carrier, on page 81.
Replacing an M.2 SSD in a Mini-Storage Carrier For M.2
This topic describes how to remove and replace an M.2 SATA or NVMe SSD in a mini-storage carrier for
M.2 (PID UCS-MSTOR-M2). The carrier has one M.2 SSD socket on its top and one socket on its underside.
Population Rules For Mini-Storage M.2 SSDs
• Both M.2 SSDs must be either SATA or NVMe; do not mix types in the carrier.
• You can use one or two M.2 SSDs in the carrier.
• M.2 socket 1 is on the top side of the carrier; M.2 socket 2 is on the underside of the carrier (the same
side as the carrier's motherboard connector).
• Dual SATA M.2 SSDs can be configured in a RAID 1 array through the BIOS Setup Utility's embedded
SATA RAID interface. See Embedded SATA RAID Controller, on page 137.
Step 1
Step 2
Step 3
Power off the server and then remove the mini-storage module carrier from the server as described in Replacing a
Mini-Storage Module Carrier, on page 81.
Remove an M.2 SSD:
a) Use a #1 Phillips-head screwdriver to remove the single screw that secures the M.2 SSD to the carrier.
b) Remove the M.2 SSD from its socket on the carrier.
Install a new M.2 SSD:
a) Insert the new M.2 SSD connector-end into the socket on the carrier with its label side facing up.
b) Press the M.2 SSD flat against the carrier.
Cisco UCS C240 M5 Server Installation and Service Guide
83
Maintaining the Server
Replacing a Micro SD Card
c) Install the single screw that secures the end of the M.2 SSD to the carrier.
Step 4
Install the mini-storage module carrier back into the server and then power it on as described in Replacing a Mini-Storage
Module Carrier, on page 81.
Replacing a Micro SD Card
There is one socket for a Micro SD card on the top of PCIe riser 1.
Caution
To avoid data loss, we do not recommend that you hot-swap the Micro SD card while it is operating, as
indicated by its activity LED turning amber. The activity LED turns amber when the Micro SD card is
updating or deleting.
Step 1
Remove an existing Micro SD card:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
d) Locate the Micro SD card. The socket is on the top of PCIe riser 1, under a plastic cover.
e) Use your fingertip to push the retainer on the plastic socket cover open far enough to provide access to the Micro SD
card, then push down and release the Micro SD card to make it spring up.
f) Grasp the Micro SD card and lift it from the socket.
Step 2
Install a new Micro SD card:
a) While holding the retainer on the plastic cover open with your fingertip, align the new Micro SD card with the socket.
b) Gently push down on the card until it clicks and locks in place in the socket.
c) Replace the top cover to the server.
Cisco UCS C240 M5 Server Installation and Service Guide
84
Maintaining the Server
Replacing an Internal USB Drive
d) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 35: Location of Internal Micro SD Card Socket
1
Location of Micro SD card socket on the top of
PCIe riser 1
3
Plastic retainer (push aside to access socket)
2
Micro SD card socket under plastic retainer
4
Micro SD activity LED
Replacing an Internal USB Drive
This section includes procedures for installing a USB drive and for enabling or disabling the internal USB
port.
Replacing a USB Drive
Caution
Step 1
We do not recommend that you hot-swap the internal USB drive while the server is powered on because
of the potential for data loss.
Remove an existing internal USB drive:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Cisco UCS C240 M5 Server Installation and Service Guide
85
1
Maintaining the Server
Replacing an Internal USB Drive
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
d) Locate the USB socket on the motherboard, in front of the power supplies.
e) Grasp the USB drive and pull it vertically to free it from the socket.
Step 2
Install a new internal USB drive:
a) Align the USB drive with the socket.
b) Push the USB drive vertically to fully engage it with the socket.
c) Replace the top cover to the server.
d) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 36: Location of Internal USB Port <ILLO PENDING>
Location of vertical USB socket on motherboard
Cisco UCS C240 M5 Server Installation and Service Guide
86
-
Maintaining the Server
Replacing the RTC Battery
Enabling or Disabling the Internal USB Port
The factory default is that all USB ports on the server are enabled. However, the internal USB port can be
enabled or disabled in the server BIOS.
Step 1
Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup.
Step 2
Navigate to the Advanced tab.
Step 3
On the Advanced tab, select USB Configuration.
Step 4
On the USB Configuration page, select USB Ports Configuration.
Step 5
Scroll to USB Port: Internal, press Enter, and then choose either Enabled or Disabled from the dialog box.
Step 6
Press F10 to save and exit the utility.
Replacing the RTC Battery
Warning
There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same
or equivalent type recommended by the manufacturer. Dispose of used batteries according to the
manufacturer’s instructions.
[Statement 1015]
The real-time clock (RTC) battery retains system settings when the server is disconnected from power. The
battery type is CR2032. Cisco supports the industry-standard CR2032 battery, which can be ordered from
Cisco (PID N20-MBLIBATT) or purchased from most electronic stores.
Step 1
Remove the RTC battery:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
d) Remove PCIe riser 1 from the server to provide clearance to the RTC battery socket that is on the motherboard. See
Replacing a PCIe Riser, on page 93.
e) Locate the horizontal RTC battery socket.
f) Remove the battery from the socket on the motherboard. Gently pry the securing clip to the side to provide clearance,
then lift up on the battery.
Step 2
Install a new RTC battery:
a) Insert the battery into its socket and press down until it clicks in place under the clip.
Cisco UCS C240 M5 Server Installation and Service Guide
87
Maintaining the Server
Replacing Power Supplies
The positive side of the battery marked “3V+” should face
up.
b) Replace PCIe riser 1 to the server. See Replacing a PCIe Riser, on page 93.
c) Replace the top cover to the server.
d) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Note
Figure 37: RTC Battery Location on Motherboard
1
RTC battery in horizontal socket on motherboard -
Replacing Power Supplies
The server can have one or two power supplies. When two power supplies are installed they are redundant as
1+1.
• See also Power Specifications, on page 122 for more information about the supported power supplies.
• See also Rear-Panel LEDs, on page 35 for information about the power supply LEDs.
This section includes procedures for replacing AC and DC power supply units.
Cisco UCS C240 M5 Server Installation and Service Guide
88
Maintaining the Server
Replacing Power Supplies
Replacing AC Power Supplies
Step 1
Note
If you have ordered a server with power supply redundancy (two power supplies), you do not have to
power off the server to replace a power supply because they are redundant as 1+1.
Note
Do not mix power supply types or wattages in the server. Both power supplies must be identical.
Remove the power supply that you are replacing or a blank panel from an empty bay:
a) Perform one of the following actions:
• If your server has only one power supply, shut down and remove power from the server as described in Shutting
Down and Removing Power From the Server, on page 39.
• If your server has two power supplies, you do not have to shut down the server.
b) Remove the power cord from the power supply that you are replacing.
c) Grasp the power supply handle while pinching the release lever toward the handle.
d) Pull the power supply out of the bay.
Step 2
Install a new power supply:
a) Grasp the power supply handle and insert the new power supply into the empty bay.
b) Push the power supply into the bay until the release lever locks.
c) Connect the power cord to the new power supply.
d) Only if you shut down the server, press the Power button to boot the server to main power mode.
Figure 38: Replacing AC Power Supplies
1
Power supply release lever
2
Power supply handle
Cisco UCS C240 M5 Server Installation and Service Guide
89
Maintaining the Server
Replacing Power Supplies
Replacing DC Power Supplies
Note
Warning
This procedure is for replacing DC power supplies in a server that already has DC power supplies installed.
If you are installing DC power supplies to the server for the first time, see Installing DC Power Supplies
(First Time Installation), on page 91.
A readily accessible two-poled disconnect device must be incorporated in the fixed wiring.
Statement 1022
Warning
This product requires short-circuit (overcurrent) protection, to be provided as part of the building
installation. Install only in accordance with national and local wiring regulations.
Statement 1045
Warning
Installation of the equipment must comply with local and national electrical codes.
Statement 1074
Step 1
Note
If you are replacing DC power supplies in a server with power supply redundancy (two power supplies),
you do not have to power off the server to replace a power supply because they are redundant as 1+1.
Note
Do not mix power supply types or wattages in the server. Both power supplies must be identical.
Remove the DC power supply that you are replacing or a blank panel from an empty bay:
a) Perform one of the following actions:
• If you are replacing a power supply in a server that has only one DC power supply, shut down and remove
power from the server as described in Shutting Down and Removing Power From the Server, on page 39.
• If you are replacing a power supply in a server that has two DC power supplies, you do not have to shut down
the server.
b) Remove the power cord from the power supply that you are replacing. Lift the connector securing clip slightly and
then pull the connector from the socket on the power supply.
c) Grasp the power supply handle while pinching the release lever toward the handle.
d) Pull the power supply out of the bay.
Step 2
Install a new DC power supply:
a) Grasp the power supply handle and insert the new power supply into the empty bay.
Cisco UCS C240 M5 Server Installation and Service Guide
90
Maintaining the Server
Replacing Power Supplies
b) Push the power supply into the bay until the release lever locks.
c) Connect the power cord to the new power supply. Press the connector into the socket until the securing clip clicks
into place.
d) Only if you shut down the server, press the Power button to boot the server to main power mode.
Figure 39: Replacing DC Power Supplies
1
Keyed cable connector (CAB-48DC-40A-8AWG) 3
2
Keyed DC input socket
PSU status LED
-
Installing DC Power Supplies (First Time Installation)
Note
Warning
This procedure is for installing DC power supplies to the server for the first time. If you are replacing DC
power supplies in a server that already has DC power supplies installed, see Replacing DC Power Supplies,
on page 90.
A readily accessible two-poled disconnect device must be incorporated in the fixed wiring.
Statement 1022
Warning
This product requires short-circuit (overcurrent) protection, to be provided as part of the building
installation. Install only in accordance with national and local wiring regulations.
Statement 1045
Cisco UCS C240 M5 Server Installation and Service Guide
91
Maintaining the Server
Replacing Power Supplies
Warning
Installation of the equipment must comply with local and national electrical codes.
Statement 1074
Note
Caution
Do not mix power supply types or wattages in the server. Both power supplies must be identical.
As instructed in the first step of this wiring procedure, turn off the DC power source from your facility’s
circuit breaker to avoid electric shock hazard.
Step 1
Turn off the DC power source from your facility’s circuit breaker to avoid electric shock hazard.
Note
The required DC input cable is Cisco part CAB-48DC-40A-8AWG. This 3-meter cable has a 3-pin connector
on one end that is keyed to the DC input socket on the power supply. The other end of the cable has no connector
so that you can wire it to your facility’s DC power.
Step 2
Wire the non-terminated end of the cable to your facility’s DC power input source.
Connect the terminated end of the cable to the socket on the power supply. The connector is keyed so that the wires align
for correct polarity and ground.
Step 3
Step 4
Step 5
Return DC power from your facility’s circuit breaker.
Press the Power button to boot the server to main power mode.
Figure 40: Replacing DC Power Supplies
Step 6
1
Keyed cable connector (CAB-48DC-40A-8AWG) 3
2
Keyed DC input socket
-
See Grounding for DC Power Supplies, on page 93 for information about additional chassis grounding.
Cisco UCS C240 M5 Server Installation and Service Guide
92
PSU status LED
Maintaining the Server
Replacing a PCIe Riser
Grounding for DC Power Supplies
AC power supplies have internal grounding and so no additional grounding is required when the supported
AC power cords are used.
When using a DC power supply, additional grounding of the server chassis to the earth ground of the rack is
available. Two screw holes for use with your dual-hole grounding lug and grounding wire are supplied on the
chassis rear panel.
Note
The grounding points on the chassis are sized for M5 screws. You must provide your own screws, grounding
lug, and grounding wire. The grounding lug must be dual-hole lug that fits M5 screws. The grounding
cable that you provide must be 14 AWG (2 mm), minimum 60° C wire, or as permitted by the local code.
Replacing a PCIe Riser
This server has two toolless PCIe risers for horizontal installation of PCIe cards. Each riser is available in
multiple versions. See PCIe Slot Specifications, on page 95 for detailed descriptions of the slots and features
in each riser version.
Step 1
Step 2
Step 3
Step 4
Step 5
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Remove the PCIe riser that you are replacing:
a) Grasp the flip-up handle on the riser and the blue forward edge, and then lift up evenly to disengage its circuit board
from the socket on the motherboard. Set the riser on an antistatic surface.
b) If the riser has a card installed, remove the card from the riser. See Replacing a PCIe Card, on page 97.
Install a new PCIe riser:
Note
The PCIe risers are not interchangeable. If you plug a PCIe riser into the wrong socket, the server will not boot.
Riser 1 must plug into the motherboard socket labeled “RISER1.” Riser 2 must plug into the motherboard socket
labeled “RISER2.”
a) If you removed a card from the old PCIe riser, install the card to the new riser. See Replacing a PCIe Card, on page
97.
b) Position the PCIe riser over its socket on the motherboard and over its alignment slots in the chassis.
Cisco UCS C240 M5 Server Installation and Service Guide
93
Maintaining the Server
Replacing a PCIe Card
c) Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with the socket on the
motherboard.
Step 6
Step 7
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 41: PCIe Riser Alignment Features
1
Riser handling points (flip-up handle and blue
forward edge)
2
Riser 2 alignment features in chassis
3
Riser 1 alignment features in chassis
Replacing a PCIe Card
Note
Cisco supports all PCIe cards qualified and sold by Cisco. PCIe cards not qualified or sold by Cisco are
the responsibility of the customer. Although Cisco will always stand behind and support the C-Series
rack-mount servers, customers using standard, off-the-shelf, third-party cards must go to the third-party
card vendor for support if any issue with that particular card occurs.
Cisco UCS C240 M5 Server Installation and Service Guide
94
Maintaining the Server
Replacing a PCIe Card
PCIe Slot Specifications
The server contains two toolless PCIe risers for horizontal installation of PCIe cards. Each riser is orderable
in multiple versions.
• Riser 1 contains PCIe slots 1, 2, and 3 and is available in two different options:
◦Option 1—Slots 1 (x8), 2 (x16), and 3 (x8). Slots 1 and 2 are controlled by CPU 1; slot 3 is
controlled by CPU 2 and is unavailable in a single-CPU configuration.
◦Option 1B—Slots 1 (x8), 2 (x8), and 3 (x8). All slots are controlled by CPU 1.
• Riser 2 contains PCIe slots 4, 5 and 6 and is available in four different options:
◦Option 2A—Slots 4 (x16), 5 (x16), and 6 (x8).
◦Option 2B—With slots 4 (x8), 5 (x16), and 6 (x8); includes one PCIe cable connector for
rear-loading NVMe SSDs.
◦Option 2C—With slots 4 (x8), 5 (x8), and 6 (x8); includes one PCIe cable connector for rear-loading
NVMe SSDs, plus one PCIe cable connector for front-loading NVMe SSDs.
◦
Note
Figure 42: Rear Panel, Showing PCIe Slot Numbering
The following tables describe the specifications for the slots.
Table 5: PCIe Riser 1 (UCSC-PCI-1-C240M5) PCIe Expansion Slots
Slot Number
Electrical Lane Connector
Width
Length
Maximum Card Card Height
Length
(Rear Panel
Opening)
NCSI Support
GPU Card
Support
1
Gen-3 x8
x24 connector
¾ length
Full height
Yes 1
No
2
Gen-3 x16
x24 connector
Full length
Full height
Yes
Yes
32
Gen-3 x8
x16 connector
Full length
Full hight
No
No
Micro SD card
slot
One socket for Micro SD card on the top of the riser.
Cisco UCS C240 M5 Server Installation and Service Guide
95
Maintaining the Server
Replacing a PCIe Card
1 NCSI is supported in only one slot at a time. If a GPU card is present in slot 2, NCSI support automatically moves to slot 1.
2 Slot 3 is not available in a single-CPU system.
Table 6: PCIe Riser 1B (UCSC-PCI-1B-C240M5) PCIe Expansion Slots
Slot Number
Electrical Lane Connector
Width
Length
Maximum Card Card Height
Length
(Rear Panel
Opening)
NCSI Support
GPU Card
Support
1
Gen-3 x8
x24 connector
¾ length
Full height
Yes 3
No
2
Gen-3 x8
x24 connector
Full length
Full height
Yes
Yes
3
Gen-3 x8
x16 connector
Full length
Full hight
No
No
Micro SD card
slot
One socket for Micro SD card on top of the riser.
3 NCSI is supported in only one slot at a time. If a GPU card is present in slot 2, NCSI support automatically moves to slot 1.
Note
Riser 2 is not available in a single-CPU system.
Table 7: PCIe Riser 2A (UCSC-PCI-2A-C240M5) PCIe Expansion Slots
Slot Number
Electrical Lane Connector
Width
Length
Maximum Card Card Height
Length
(Rear Panel
Opening)
NCSI Support
GPU Card
Support
4
Gen-3 x16
x24 connector
¾ length
Full height
Yes 4
No
5
Gen-3 x16
x24 connector
Full length
Full height
Yes
Yes
6
Gen-3 x8
x16 connector
Full length
Full hight
No
No
4 NCSI is supported in only one slot at a time. If a GPU card is present in slot 5, NCSI support automatically moves to slot 4.
Table 8: PCIe Riser 2B (UCSC-PCI-2B-C240M5) PCIe Expansion Slots
Slot Number
Electrical Lane Connector
Width
Length
Maximum Card Card Height
Length
(Rear Panel
Opening)
NCSI Support
GPU Card
Support
4
Gen-3 x8
¾ length
Yes 5
No
x24 connector
Cisco UCS C240 M5 Server Installation and Service Guide
96
Full height
Maintaining the Server
Replacing a PCIe Card
5
Gen-3 x16
x24 connector
Full length
Full height
Yes
Yes
6
Gen-3 x8
x16 connector
Full length
Full hight
No
No
Cable connector Gen-3 x8
for rear NVMe
SSDs
To rear drive backplane; supports rear-loading NVMe SSDs.
5 NCSI is supported in only one slot at a time. If a GPU card is present in slot 5, NCSI support automatically moves to slot 4.
Table 9: PCIe Riser 2C (UCSC-PCI-2C-C240M5) PCIe Expansion Slots
Slot Number
Electrical Lane Connector
Width
Length
Maximum Card Card Height
Length
(Rear Panel
Opening)
NCSI Support
GPU Card
Support
4
Gen-3 x8
x24 connector
¾ length
Full height
Yes
No
5
Gen-3 x8
x24 connector
Full length
Full height
Yes6
No
6
Gen-3 x8
x16 connector
Full length
Full hight
No
No
Cable connector Gen-3 x8
for rear NVMe
SSDs
To rear drive backplane; supports rear-loading NVMe SSDs.
Cable connector Gen-3 x8
for front NVMe
SSDs
To front drive backplane; supports front-loading NVMe SSDs.
6 NCSI is supported in only one slot at a time.
Note
Replacing a PCIe Card
Note
If you are installing a Cisco UCS Virtual Interface Card, there are prerequisite considerations. See Cisco
Virtual Interface Card (VIC) Considerations, on page 99.
Note
RAID controller cards install into a dedicated motherboard socket. See Replacing a SAS Storage Controller
Card (RAID or HBA), on page 101.
Cisco UCS C240 M5 Server Installation and Service Guide
97
Maintaining the Server
Replacing a PCIe Card
Note
Step 1
Step 2
Step 3
Step 4
Step 5
For instructions on installing or replacing double-wide GPU cards, see GPU Card Installation, on page
149.
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Remove the PCIe card that you are replacing:
a) Remove any cables from the ports of the PCIe card that you are replacing.
b) Use two hands to flip up and grasp the blue riser handle and the blue fingergrip area on the front edge of the riser,
and then lift straight up.
c) On the bottom of the riser, push the release latch that holds the securing plate, and then swing the hinged securing
plate open.
d) Open the hinged card-tab retainer that secures the rear-panel tab of the card.
e) Pull evenly on both ends of the PCIe card to remove it from the socket on the PCIe riser.
If the riser has no card, remove the blanking panel from the rear opening of the riser.
Install a new PCIe card:
a) With the hinged card-tab retainer open, align the new PCIe card with the empty socket on the PCIe riser.
b) Push down evenly on both ends of the card until it is fully seated in the socket.
c) Ensure that the card’s rear panel tab sits flat against the riser rear-panel opening and then close the hinged card-tab
retainer over the card’s rear-panel tab.
d) Swing the hinged securing plate closed on the bottom of the riser. Ensure that the clip on the plate clicks into the
locked position.
e) Position the PCIe riser over its socket on the motherboard and over the chassis alignment channels.
Cisco UCS C240 M5 Server Installation and Service Guide
98
Maintaining the Server
Replacing a PCIe Card
f) Carefully push down on both ends of the PCIe riser to fully engage its connector with the sockets on the motherboard.
Step 6
Step 7
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 43: PCIe Riser Card Securing Mechanisms
1
Release latch on hinged securing plate
3
2
Hinged securing plate
-
Hinged card-tab retainer
Cisco Virtual Interface Card (VIC) Considerations
This section describes VIC card support and special considerations for this server.
Cisco UCS C240 M5 Server Installation and Service Guide
99
Maintaining the Server
Replacing an mLOM Card
Note
If you use the Cisco Card NIC mode, you must also make a VIC Slot setting that matches where your VIC
is installed. The options are Riser1, Riser2, and Flex-LOM. See NIC Mode and NIC Redundancy Settings,
on page 25 for more information about NIC modes.
If you want to use the Cisco UCS VIC card for Cisco UCS Manager integration, see also the Cisco UCS
C-Series Server Integration with Cisco UCS Manager Guides for details about supported configurations,
cabling, and other requirements.
Table 10: VIC Support and Considerations in This Server
VIC
How Many
Supported in
Server
Slots That
Primary Slot For
Primary Slot For Minimum Cisco
Support VICs Cisco UCS Manager Cisco Card NIC IMC Firmware
Integration
Mode
Cisco UCS VIC 1385
2 PCIe
PCIe 2
UCSC-PCIE-C40Q-03
Cisco UCS VIC 1387
PCIe 2
PCIe 2
3.1(1)
mLOM
mLOM
3.1(1)
PCIe 5
1 mLOM
mLOM
UCSC-MLOM-C40Q-03
Replacing an mLOM Card
The server supports a modular LOM (mLOM) card to provide additional rear-panel connectivity. The mLOM
socket is on the motherboard, under the storage controller card.
The mLOM socket provides a Gen-3 x16 PCIe lane. The socket remains powered when the server is in 12 V
standby power mode and it supports the network communications services interface (NCSI) protocol.
Note
Step 1
If your mLOM card is a Cisco UCS Virtual Interface Card (VIC), see Cisco Virtual Interface Card (VIC)
Considerations, on page 99 for more information and support details.
Remove any existing mLOM card (or a blanking panel):
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
d) Remove any storage controller (RAID or HBA card) to provide clearance to the mLOM socket on the motherboard.
See Replacing a SAS Storage Controller Card (RAID or HBA), on page 101.
e) Loosen the single captive thumbscrew that secures the mLOM card to the threaded standoff on the chassis floor.
Cisco UCS C240 M5 Server Installation and Service Guide
100
Maintaining the Server
Replacing a SAS Storage Controller Card (RAID or HBA)
f) Slide the mLOM card horizontally to free it from the socket, then lift it out of the server.
Step 2
Install a new mLOM card:
a) Set the mLOM card on the chassis floor so that its connector is aligned with the motherboard socket.
b) Push the card horizontally to fully engage the card's edge connector with the socket.
c) Tighten the captive thumbscrew to secure the card to the chassis floor.
d) Return the storage controller card to the server. See Replacing a SAS Storage Controller Card (RAID or HBA), on
page 101.
e) Replace the top cover to the server.
f) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 44: Location of the mLOM Card Socket Below the Storage Controller Card
1
Position of horizontal mLOM card socket
2
Position of mLOM card thumbscrew
Replacing a SAS Storage Controller Card (RAID or HBA)
For hardware-based storage control, the server can use a Cisco modular SAS RAID controller or SAS HBA
that plugs into a dedicated, vertical socket on the motherboard.
Cisco UCS C240 M5 Server Installation and Service Guide
101
Maintaining the Server
Replacing a SAS Storage Controller Card (RAID or HBA)
Storage Controller Card Firmware Compatibility
Firmware on the storage controller (RAID or HBA) must be verified for compatibility with the current Cisco
IMC and BIOS versions that are installed on the server. If not compatible, upgrade or downgrade the storage
controller firmware using the Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible
level.
See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring
server components to compatible levels: HUU Guides.
Replacing a SAS Storage Controller Card (RAID or HBA)
For detailed information about storage controllers in this server, see Supported Storage Controllers and Cables,
on page 129.
A storage controller card is shipped in a plastic mounting frame. You do not have to remove this frame from
an existing card because the frame is preinstalled on a replacement card.
Step 1
Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Step 2
Remove any existing storage controller card from the server:
Note
A controller card for this server is mounted inside a plastic carrier-frame that helps to secure the card to the
inner chassis wall. You do not have to remove this plastic carrier frame from the existing card.
a) Disconnect SAS/SATA cables and any supercap cable from the existing card.
b) Lift up on the card's blue ejector lever to unseat it from the motherboard socket.
c) Lift straight up on the card's carrier frame to disengage the card from the motherboard socket and to disengage the
frame from pegs on the chassis wall.
Step 3
Install a new storage controller card:
a) Carefully align the card edge with the motherboard socket. At the same time, align the two slots on the back of the
carrier frame with the pegs on the chassis inner wall.
b) Push on both corners of the card to seat its connector in the riser socket. At the same time, ensure that the slots on
the carrier frame engage with the pegs on the inner chassis wall.
c) Fully close the blue ejector lever on the card to lock the card into the socket.
d) Connect SAS/SATA cables and any supercap cable to the new card.
If this is a first-time installation, see Storage Controller Cable Connectors and Backplanes, on page 133 for cabling
instructions.
Cisco UCS C240 M5 Server Installation and Service Guide
102
Maintaining the Server
Replacing the Supercap (RAID Backup)
Step 4
Step 5
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 45: Replacing a Storage Controller Card
1
Blue ejector lever on card top edge
2
Pegs on inner chassis wall (four)
Replacing the Supercap (RAID Backup)
This server supports installation of one supercap unit. The unit mounts to a bracket on the removable air baffle.
The supercap provides approximately three years of backup for the disk write-back cache DRAM in the case
of a sudden power loss by offloading the cache to the NAND flash.
Cisco UCS C240 M5 Server Installation and Service Guide
103
Maintaining the Server
Replacing the Supercap (RAID Backup)
Warning
There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the
same or equivalent type recommended by the manufacturer. Dispose of used batteries according to
the manufacturer’s instructions.
Statement 1015
Step 1
Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Step 2
Remove an existing supercap:
a) Disconnect the supercap cable from the existing supercap.
b) Push aside the securing tab that holds the supercap to its bracket on the air baffle.
c) Lift the supercap free of the bracket and set it aside.
Step 3
Install a new supercap:
a) Set the new supercap into the mounting bracket.
b) Push aside the black plastic tab on the air baffle and set the supercap into the bracket. Relax the tab so that it closes
over the top edge of the supercap.
Cisco UCS C240 M5 Server Installation and Service Guide
104
Maintaining the Server
Replacing a SATA Interposer Card (8-Drive Server Only)
c) Connect the supercap cable from the RAID controller card to the connector on the supercap cable.
Step 4
Step 5
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 46: Supercap Bracket on Air Baffle
Supercap bracket on removeable air baffle
1
2
Securing tab
Replacing a SATA Interposer Card (8-Drive Server Only)
Note
The only version of this server that supports controlling front-loading drives with embedded SATA RAID
is the SFF, 8-drives version (UCSC-C240-M5S).
For software-based storage control that uses the server's embedded SATA controller to control front-loading
drives, the server requires a SATA interposer card that plugs into a dedicated socket on the motherboard (the
same socket used for SAS storage controllers).
Cisco UCS C240 M5 Server Installation and Service Guide
105
Maintaining the Server
Replacing a SATA Interposer Card (8-Drive Server Only)
Note
You cannot use a hardware RAID controller card and the embedded software RAID controller to control
front drives at the same time. See Storage Controller Considerations, on page 129 for details about RAID
support.
Step 1
Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Step 2
Remove any existing SATA interposer card from the server:
Note
A SATA interposer card for this server is preinstalled inside a plastic carrier-frame that helps to secure the card
to the inner chassis wall. You do not have to remove this plastic carrier frame from the existing card.
a) Disconnect PCIe cables from the existing card.
b) Lift up on the card's blue ejector lever to unseat it from the motherboard socket.
c) Lift straight up on the card's carrier frame to disengage the card from the motherboard socket and to disengage the
frame from pegs on the chassis wall.
Step 3
Install a new SATA interposer card:
a) Carefully align the card edge with the motherboard socket. At the same time, align the two slots on the back of the
carrier frame with the pegs on the chassis inner wall.
b) Push on both corners of the card to seat its connector in the riser socket. At the same time, ensure that the slots on
the carrier frame engage with the pegs on the inner chassis wall.
c) Fully close the blue ejector lever on the card to lock the card into the socket.
d) Connect PCIe cables to the new card.
If this is a first-time installation, see Storage Controller Cable Connectors and Backplanes, on page 133 for cabling
instructions.
Cisco UCS C240 M5 Server Installation and Service Guide
106
Maintaining the Server
Replacing a Chassis Intrusion Switch
Step 4
Step 5
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 47: Replacing SATA Interposer Card
1
Blue ejector lever on card top edge
2
Pegs on inner chassis wall (four)
Replacing a Chassis Intrusion Switch
The chassis intrusion switch in an optional security feature that logs an event in the system event log (SEL)
whenever the cover is removed from the chassis.
Step 1
Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Cisco UCS C240 M5 Server Installation and Service Guide
107
Maintaining the Server
Replacing a Chassis Intrusion Switch
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Step 2
Remove an existing intrusion switch:
a) Disconnect the intrusion switch cable from the socket on the motherboard.
b) Use a #1 Phillips-head screwdriver to loosen and remove the single screw that holds the switch mechanism to the
chassis wall.
c) Slide the switch mechanism straight up to disengage it from the clips on the chassis.
Step 3
Install a new intrusion switch:
a) Slide the switch mechanism down into the clips on the chassis wall so that the screwholes line up.
b) Use a #1 Phillips-head screwdriver to install the single screw that secures the switch mechanism to the chassis wall.
c) Connect the switch cable to the socket on the motherboard.
Step 4
Step 5
Replace the cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Figure 48: Replacing a Chassis Intrusion Switch
1
Intrusion switch location
Cisco UCS C240 M5 Server Installation and Service Guide
108
-
Maintaining the Server
Installing a Trusted Platform Module (TPM)
Installing a Trusted Platform Module (TPM)
The trusted platform module (TPM) is a small circuit board that plugs into a motherboard socket and is then
permanently secured with a one-way screw. The socket location is on the motherboard below PCIe riser 2.
TPM Considerations
• This server supports either TPM version 1.2 or TPM version 2.0.
• Field replacement of a TPM is not supported; you can install a TPM after-factory only if the server does
not already have a TPM installed.
• If there is an existing TPM 1.2 installed in the server, you cannot upgrade to TPM 2.0. If there is no
existing TPM in the server, you can install TPM 2.0.
• If the TPM 2.0 becomes unresponsive, reboot the server.
Installing and Enabling a TPM
Note
Field replacement of a TPM is not supported; you can install a TPM after-factory only if the server does
not already have a TPM installed.
This topic contains the following procedures, which must be followed in this order when installing and enabling
a TPM:
1 Installing the TPM Hardware
2 Enabling the TPM in the BIOS
3 Enabling the Intel TXT Feature in the BIOS
Installing TPM Hardware
Note
Step 1
For security purposes, the TPM is installed with a one-way screw. It cannot be removed with a standard
screwdriver.
Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Cisco UCS C240 M5 Server Installation and Service Guide
109
Maintaining the Server
Installing a Trusted Platform Module (TPM)
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Step 2
Step 3
Remove PCIe riser 2 from the server to provide clearance to the TPM socket on the motherboard.
Install a TPM:
a) Locate the TPM socket on the motherboard.
b) Align the connector that is on the bottom of the TPM circuit board with the motherboard TPM socket. Align the
screw hole on the TPM board with the screw hole that is adjacent to the TPM socket.
c) Push down evenly on the TPM to seat it in the motherboard socket.
d) Install the single one-way screw that secures the TPM to the motherboard.
Step 4
Step 5
Step 6
Step 7
Replace PCIe riser 2 to the server. See Replacing a PCIe Riser, on page 93.
Replace the cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Continue with Enabling the TPM in the BIOS, on page 111.
Figure 49: Location of the TPM Socket
1
TPM socket location on motherboard, below PCIe riser 2
Cisco UCS C240 M5 Server Installation and Service Guide
110
Maintaining the Server
Installing a Trusted Platform Module (TPM)
Enabling the TPM in the BIOS
After hardware installation, you must enable TPM support in the BIOS.
Step 1
Enable TPM Support:
a) Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.
b) Log in to the BIOS Setup Utility with your BIOS Administrator password.
c) On the BIOS Setup Utility window, choose the Advanced tab.
d) Choose Trusted Computing to open the TPM Security Device Configuration window.
e) Change TPM SUPPORT to Enabled.
f) Press F10 to save your settings and reboot the server.
Step 2
Verify that TPM support is now enabled:
a) Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.
b) Log into the BIOS Setup utility with your BIOS Administrator password.
c) Choose the Advanced tab.
d) Choose Trusted Computing to open the TPM Security Device Configuration window.
e) Verify that TPM SUPPORT and TPM State are Enabled.
Step 3
Continue with Enabling the Intel TXT Feature in the BIOS, on page 111.
Enabling the Intel TXT Feature in the BIOS
Intel Trusted Execution Technology (TXT) provides greater protection for information that is used and stored
on the business server. A key aspect of that protection is the provision of an isolated execution environment
and associated sections of memory where operations can be conducted on sensitive data, invisibly to the rest
of the system. Intel TXT provides for a sealed portion of storage where sensitive data such as encryption keys
can be kept, helping to shield them from being compromised during an attack by malicious code.
Step 1
Step 2
Reboot the server and watch for the prompt to press F2.
When prompted, press F2 to enter the BIOS Setup utility.
Step 3
Verify that the prerequisite BIOS values are enabled:
a) Choose the Advanced tab.
b) Choose Intel TXT(LT-SX) Configuration to open the Intel TXT(LT-SX) Hardware Support window.
c) Verify that the following items are listed as Enabled:
• VT-d Support (default is Enabled)
• VT Support (default is Enabled)
• TPM Support
• TPM State
d) Do one of the following:
Cisco UCS C240 M5 Server Installation and Service Guide
111
Maintaining the Server
Service Headers and Jumpers
• If VT-d Support and VT Support are already enabled, skip to step 4.
• If VT-d Support and VT Support are not enabled, continue with the next steps to enable them.
e) Press Escape to return to the BIOS Setup utility Advanced tab.
f) On the Advanced tab, choose Processor Configuration to open the Processor Configuration window.
g) Set Intel (R) VT and Intel (R) VT-d to Enabled.
Step 4
Enable the Intel Trusted Execution Technology (TXT) feature:
a) Return to the Intel TXT(LT-SX) Hardware Support window if you are not already there.
b) Set TXT Support to Enabled.
Step 5
Press F10 to save your changes and exit the BIOS Setup utility.
Service Headers and Jumpers
This server includes two blocks of headers (J38, J39) that you can jumper for certain service and debug
functions.
This section contains the following topics:
• Using the Clear CMOS Header (J38, Pins 9 - 10), on page 113
• Using the BIOS Recovery Header (J38, Pins 11 - 12), on page 114
• Using the Clear Password Header (J38, Pins 13 - 14), on page 116
• Using the Boot Alternate Cisco IMC Image Header (J39, Pins 1 - 2), on page 117
• Using the Reset Cisco IMC Password to Default Header (J39, Pins 3 - 4), on page 118
Cisco UCS C240 M5 Server Installation and Service Guide
112
Maintaining the Server
Using the Clear CMOS Header (J38, Pins 9 - 10)
• Using the Reset Cisco IMC to Defaults Header (J39, Pins 5 - 6), on page 118
Figure 50: Location of Service Header Blocks J38 and J39
1
Location of header block J38
6
Location of header block J39
2
J38 pin 1 arrow printed on motherboard
7
J39 pin 1 arrow printed on motherboard
3
Clear CMOS: J38 pins 9 - 10
8
Boot Cisco IMC from alternate image: J39 pins 1 - 2
4
Recover BIOS: J38 pins 11 - 12
9
Reset Cisco IMC password to default: J39 pins 3 - 4
5
Clear password: J38 pins 13 - 14
10
Reset Cisco IMC to defaults: J39 pins 5 - 6
Using the Clear CMOS Header (J38, Pins 9 - 10)
You can use this switch to clear the server’s CMOS settings in the case of a system hang. For example, if the
server hangs because of incorrect settings and does not boot, use this jumper to invalidate the settings and
reboot with defaults.
Cisco UCS C240 M5 Server Installation and Service Guide
113
Maintaining the Server
Using the BIOS Recovery Header (J38, Pins 11 - 12)
Caution
Step 1
Step 2
Step 3
Step 4
Step 5
Step 6
Step 7
Step 8
Step 9
Step 10
Clearing the CMOS removes any customized settings and might result in data loss. Make a note of any
necessary customized settings in the BIOS before you use this clear CMOS procedure.
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Install a two-pin jumper across J38 pins 9 and 10.
Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby power mode,
indicated when the Power LED on the front panel is amber.
Return the server to main power mode by pressing the Power button on the front panel. The server is in main power
mode when the Power LED is green.
Note
You must allow the entire server to reboot to main power mode to complete the reset. The state of the jumper
cannot be determined without the host CPU running.
Press the Power button to shut down the server to standby power mode, and then remove AC power cords from the server
to remove all power.
Remove the top cover from the server.
Remove the jumper that you installed.
Note
If you do not remove the jumper, the CMOS settings are reset to the defaults every time you power-cycle the
server.
Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the
server by pressing the Power button.
Using the BIOS Recovery Header (J38, Pins 11 - 12)
Depending on which stage the BIOS becomes corrupted, you might see different behavior.
• If the BIOS BootBlock is corrupted, you might see the system get stuck on the following message:
Initializing and configuring memory/hardware
• If it is a non-BootBlock corruption, a message similar to the following is displayed:
****BIOS FLASH IMAGE CORRUPTED****
Flash a valid BIOS capsule file using Cisco IMC WebGUI or CLI interface.
IF Cisco IMC INTERFACE IS NOT AVAILABLE, FOLLOW THE STEPS MENTIONED BELOW.
1. Connect the USB stick with recovery.cap file in root folder.
2. Reset the host.
IF THESE STEPS DO NOT RECOVER THE BIOS
1. Power off the system.
2. Mount recovery jumper.
3. Connect the USB stick with recovery.cap file in root folder.
4. Power on the system.
Wait for a few seconds if already plugged in the USB stick.
REFER TO SYSTEM MANUAL FOR ANY ISSUES.
Cisco UCS C240 M5 Server Installation and Service Guide
114
Maintaining the Server
Using the BIOS Recovery Header (J38, Pins 11 - 12)
Note
As indicated by the message shown above, there are two procedures for recovering the BIOS. Try procedure
1 first. If that procedure does not recover the BIOS, use procedure 2.
Procedure 1: Reboot With recovery.cap File
Step 1
Step 2
Step 3
Step 4
Step 5
Download the BIOS update package and extract it to a temporary location.
Copy the contents of the extracted recovery folder to the root directory of a USB drive. The recovery folder contains the
recovery.cap file that is required in this procedure.
Note
The recovery.cap file must be in the root directory of the USB drive. Do not rename this file. The USB drive
must be formatted with either the FAT16 or FAT32 file system.
Insert the USB drive into a USB port on the server.
Reboot the server.
Return the server to main power mode by pressing the Power button on the front panel.
The server boots with the updated BIOS boot block. When the BIOS detects a valid recovery.cap file on the USB drive,
it displays this message:
Found a valid recovery file...Transferring to Cisco IMC
System would flash the BIOS image now...
System would restart with recovered image after a few seconds...
Step 6
Wait for server to complete the BIOS update, and then remove the USB drive from the server.
Note
During the BIOS update, Cisco IMC shuts down the server and the screen goes blank for about 10 minutes. Do
not unplug the power cords during this update. Cisco IMC powers on the server after the update is complete.
Procedure 2: Use BIOS Recovery Header and recovery.cap File
Step 1
Step 2
Step 3
Step 4
Download the BIOS update package and extract it to a temporary location.
Copy the contents of the extracted recovery folder to the root directory of a USB drive. The recovery folder contains the
recovery.cap file that is required in this procedure.
Note
The recovery.cap file must be in the root directory of the USB drive. Do not rename this file. The USB drive
must be formatted with either the FAT16 or FAT32 file system.
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39. Disconnect power dords from all power supplies.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Cisco UCS C240 M5 Server Installation and Service Guide
115
Maintaining the Server
Using the Clear Password Header (J38, Pins 13 - 14)
Step 5
Step 6
Step 7
Step 8
Step 9
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Install a two-pin jumper across J38 pins 11 and 12.
Reconnect AC power cords to the server. The server powers up to standby power mode.
Insert the USB thumb drive that you prepared in Step 2 into a USB port on the server.
Return the server to main power mode by pressing the Power button on the front panel.
The server boots with the updated BIOS boot block. When the BIOS detects a valid recovery.cap file on the USB drive,
it displays this message:
Found a valid recovery file...Transferring to Cisco IMC
System would flash the BIOS image now...
System would restart with recovered image after a few seconds...
Step 10
Step 11
Step 12
Step 13
Wait for server to complete the BIOS update, and then remove the USB drive from the server.
Note
During the BIOS update, Cisco IMC shuts down the server and the screen goes blank for about 10 minutes. Do
not unplug the power cords during this update. Cisco IMC powers on the server after the update is complete.
After the server has fully booted, power off the server again and disconnect all power cords.
Remove the jumper that you installed.
Note
If you do not remove the jumper, after recovery completion you see the prompt, “Please remove the recovery
jumper.”
Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the
server by pressing the Power button.
Using the Clear Password Header (J38, Pins 13 - 14)
You can use this switch to clear the administrator password.
Step 1
Step 2
Step 3
Step 4
Step 5
Step 6
Step 7
Step 8
Step 9
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39. Disconnect power dords from all power supplies.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Install a two-pin jumper across J38 pins 13 and 14.
Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby power mode,
indicated when the Power LED on the front panel is amber.
Return the server to main power mode by pressing the Power button on the front panel. The server is in main power
mode when the Power LED is green.
Note
You must allow the entire server to reboot to main power mode to complete the reset. The state of the jumper
cannot be determined without the host CPU running.
Press the Power button to shut down the server to standby power mode, and then remove AC power cords from the server
to remove all power.
Remove the top cover from the server.
Remove the jumper that you installed.
Cisco UCS C240 M5 Server Installation and Service Guide
116
Maintaining the Server
Using the Boot Alternate Cisco IMC Image Header (J39, Pins 1 - 2)
If you do not remove the jumper, the password is cleared every time you power-cycle the
server.
Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the
server by pressing the Power button.
Note
Step 10
Using the Boot Alternate Cisco IMC Image Header (J39, Pins 1 - 2)
You can use this Cisco IMC debug header to force the system to boot from an alternate Cisco IMC image.
Step 1
Step 2
Step 3
Step 4
Step 5
Step 6
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39. Disconnect power cords from all power supplies.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Install a two-pin jumper across J39 pins 1 and 2.
Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby power mode,
indicated when the Power LED on the front panel is amber.
Return the server to main power mode by pressing the Power button on the front panel. The server is in main power
mode when the Power LED is green.
Note
When you next log in to Cisco IMC, you see a message similar to the following:
'Boot from alternate image' debug functionality is enabled.
CIMC will boot from alternate image on next reboot or input power
cycle.
If you do not remove the jumper, the server will boot from an alternate Cisco IMC image every time that you
power cycle the server or reboot Cisco IMC.
To remove the jumper, press the Power button to shut down the server to standby power mode, and then remove AC
power cords from the server to remove all power.
Remove the top cover from the server.
Remove the jumper that you installed.
Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the
server by pressing the Power button.
Note
Step 7
Step 8
Step 9
Step 10
Cisco UCS C240 M5 Server Installation and Service Guide
117
Maintaining the Server
Using the Reset Cisco IMC Password to Default Header (J39, Pins 3 - 4)
Using the Reset Cisco IMC Password to Default Header (J39, Pins 3 - 4)
You can use this Cisco IMC debug header to force the Cisco IMC password back to the default.
Step 1
Step 2
Step 3
Step 4
Step 5
Step 6
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39. Disconnect power cords from all power supplies.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Install a two-pin jumper across J39 pins 3 and 4.
Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby power mode,
indicated when the Power LED on the front panel is amber.
Return the server to main power mode by pressing the Power button on the front panel. The server is in main power
mode when the Power LED is green.
Note
When you next log in to Cisco IMC, you see a message similar to the following:
'Reset to default CIMC password' debug functionality is enabled.
On input power cycle, CIMC password will be reset to defaults.
If you do not remove the jumper, the server will reset the Cisco IMC password to the default every time that
you power cycle the server. The jumper has no effect if you reboot Cisco IMC.
To remove the jumper, press the Power button to shut down the server to standby power mode, and then remove AC
power cords from the server to remove all power.
Remove the top cover from the server.
Remove the jumper that you installed.
Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the
server by pressing the Power button.
Note
Step 7
Step 8
Step 9
Step 10
Using the Reset Cisco IMC to Defaults Header (J39, Pins 5 - 6)
You can use this Cisco IMC debug header to force the Cisco IMC settings back to the defaults.
Step 1
Step 2
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39. Disconnect power cords from all power supplies.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Cisco UCS C240 M5 Server Installation and Service Guide
118
Maintaining the Server
Using the Reset Cisco IMC to Defaults Header (J39, Pins 5 - 6)
Step 3
Step 4
Step 5
Step 6
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Install a two-pin jumper across J39 pins 5 and 6.
Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby power mode,
indicated when the Power LED on the front panel is amber.
Return the server to main power mode by pressing the Power button on the front panel. The server is in main power
mode when the Power LED is green.
Note
When you next log in to Cisco IMC, you see a message similar to the following:
'CIMC reset to factory defaults' debug functionality is enabled.
On input power cycle, CIMC will be reset to factory defaults.
If you do not remove the jumper, the server will reset the Cisco IMC to the default settings every time that you
power cycle the server. The jumper has no effect if you reboot Cisco IMC.
To remove the jumper, press the Power button to shut down the server to standby power mode, and then remove AC
power cords from the server to remove all power.
Remove the top cover from the server.
Remove the jumper that you installed.
Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the
server by pressing the Power button.
Note
Step 7
Step 8
Step 9
Step 10
Cisco UCS C240 M5 Server Installation and Service Guide
119
Maintaining the Server
Using the Reset Cisco IMC to Defaults Header (J39, Pins 5 - 6)
Cisco UCS C240 M5 Server Installation and Service Guide
120
APPENDIX
A
Server Specifications
• Server Specifications, page 121
• Power Cord Specifications, page 125
Server Specifications
This appendix lists the physical, environmental, and power specifications for the server.
• Physical Specifications, on page 121
• Environmental Specifications, on page 122
• Power Specifications, on page 122
Physical Specifications
The following table lists the physical specifications for the server versions.
Table 11: Physical Specifications
Description
Specification
Height
3.4 in. (86.4 mm)
Width
16.9 in. (429.0 mm)
Depth (length)
Server only: 29.5 in. (740.3 mm)
Server with slide rail: 31.0 in (787.4 mm)
Maximum weight (fully loaded chassis)
SFF 8-drive: 45.5 lb. (20.6 Kg)
SFF 24-drive: 57.5 lb. (26.1 Kg)
LFF 12-drive: 64.0 lb. (29.0 Kg)
Cisco UCS C240 M5 Server Installation and Service Guide
121
Server Specifications
Environmental Specifications
Environmental Specifications
The following table lists the environmental requirements and specifications for the server.
Table 12: Physical Specifications
Description
Specification
Temperature, Operating
41 to 95°F (5 to 35°C)
Derate the maximum temperature by 1°C per every 305 meters
of altitude above sea level.
Temperature, non-operating
–40 to 149°F (–40 to 65°C)
(when the server is stored or transported)
Humidity (RH), operating
10 to 90%
Humidity (RH), non-operating
5 to 93%
(when the server is stored or transported)
Altitude, operating
0 to 10,000 feet
Altitude, non-operating
0 to 40,000 feet
(when the server is stored or transported)
Sound power level
5.5
Measure A-weighted per ISO7779 LwAd (Bels)
Operation at 73°F (23°C)
Sound pressure level
40
Measure A-weighted per ISO7779 LpAm (dBA)
Operation at 73°F (23°C)
Power Specifications
Note
Do not mix power supply types or wattages in the server. Both power supplies must be identical.
You can get more specific power information for your exact server configuration by using the Cisco UCS
Power Calculator:
http://ucspowercalc.cisco.com
The power specifications for the supported power supply options are listed in the following sections.
Cisco UCS C240 M5 Server Installation and Service Guide
122
Server Specifications
Power Specifications
1050 W AC Power Supply
This section lists the specifications for each 1050 W AC power supply (Cisco part number
UCSC-PSU1-1050W).
Table 13: 1050 W AC Specifications
Description
Specification
AC Input Voltage
Nominal range: 100–120 VAC, 200–240 VAC
(Range: 90–132 VAC, 180–264 VAC)
AC Input Frequency
Nominal range: 50 to 60Hz
(Range: 47–63 Hz)
Maximum AC Input current
12.5 A at 100 VAC
6.0 A at 208 VAC
Maximum input volt-amperes
1250 VA at 100 VAC
Maximum inrush current
15 A (sub-cycle duration)
Maximum hold-up time
12 ms at 1050 W
Maximum output power per PSU
800 W at 100–120 VAC
1050 W at 200–240 VAC
Power supply output voltage
12 VDC
Power supply standby voltage
12 VDC
Efficiency rating
Climate Savers Platinum Efficiency (80Plus Platinum certified)
Form factor
RSP2
Input connector
IEC320 C14
1600 W AC Power Supply
This section lists the specifications for each 1600 W AC power supply (Cisco part number
UCSC-PSU1-1600W).
Table 14: 1600 W AC Specifications
Description
Specification
Cisco UCS C240 M5 Server Installation and Service Guide
123
Server Specifications
Power Specifications
AC Input Voltage
Nominal range: 200–240 VAC
(Range: 180–264 VAC)
AC Input Frequency
Nominal range: 50 to 60Hz
(Range: 47–63 Hz)
Maximum AC Input current
9.5 A at 200 VAC
Maximum input volt-amperes
1250 VA at 200 VAC
Maximum inrush current
30 A at 35° C
Maximum hold-up time
80 ms at 1600 W
Maximum output power per PSU
1600 W at 200–240 VAC
Power supply output voltage
12 VDC
Power supply standby voltage
12 VDC
Efficiency rating
Climate Savers Platinum Efficiency (80Plus Platinum certified)
Form factor
RSP2
Input connector
IEC320 C14
1050 W DC Power Supply
This section lists the specifications for each 1050 W DC power supply (Cisco part number
UCSC-PSUV2-1050DC).
Table 15: 1050 W DC Specifications
Description
Specification
DC Input Voltage
Nominal range: -48 to -60 VDC
(Range: -40 to -72 VDC)
Maximum DC input current
N32 A at -40 VDC
Maximum input wattage
1234 W
Maximum inrush current
35 A (sub-cycle duration)
Maximum hold-up time
5 ms at 100% load (1050 W main and 36 W standby)
Cisco UCS C240 M5 Server Installation and Service Guide
124
Server Specifications
Power Cord Specifications
Maximum output power per PSU
1050 W on 12 VDC main power
36 W on 12 VDC standby power
Power supply output voltage
12 VDC
Power supply standby voltage
12 VDC
Efficiency rating
≥ 92% at 50% load
Form factor
RSP2
Input connector
Fixed 3-wire block
Power Cord Specifications
Each power supply in the server has a power cord. Standard power cords or jumper power cords are available
for connection to the server. The shorter jumper power cords, for use in racks, are available as an optional
alternative to the standard power cords.
Note
Only the approved power cords or jumper power cords listed below are supported.
Table 16: Supported Power Cords
Description
Length (Feet)
Length (Meters)
CAB-48DC-40A-8AWG
11.7
3.5
9.8
3.0
8.2
2.5
6.6
2.0
DC power cord, -48 VDC, 40 A, 8 AWG
Three-socket Mini-Fit connector to
three-wire
CAB-C13-C14-AC
AC power cord, 10 A; C13 to C14,
recessed receptacle
CAB-250V-10A-AR
AC power cord, 250 V, 10 A
Argentina
CAB-C13-C14-2M-JP
AC Power Cord, C13 to C14
Japan PSE Mark
Cisco UCS C240 M5 Server Installation and Service Guide
125
Server Specifications
Power Cord Specifications
CAB-9K10A-EU
8.2
2.5
8.2
2.5
8.2
2.5
2.2
0.68
6.6
2.0
8.2
2.5
8.2
2.5
8.2
2.5
8.2
2.5
8.2
2.5
AC Power Cord, 250 V, 10 A; CEE 7/7
Plug
Europe
CAB-250V-10A-IS
AC Power Cord, 250 V, 10 A
Israel
CAB-250V-10A-CN
AC power cord, 250 V, 10 A
PR China
CAB-C13-CBN
AC cabinet jumper power cord, 250, 10 A,
C13 to C14
CAB-C13-C14-2M
AC cabinet jumper power cord, 250 V, 10
A,
C13 to C14
CAB-9K10A-AU
AC power cord, 250 V, 10 A, 3112 plug,
Australia
CAB-N5K6A-NA
AC power cord, 200/240 V, 6 A,
North America
CAB-250V-10A-ID
AC power Cord, 250 V, 10 A,
India
CAB-9K10A-SW
AC power cord, 250 V, 10 A, MP232 plug
Switzerland
CAB-250V-10A-BR
AC power Cord, 250 V, 10 A
Brazil
Cisco UCS C240 M5 Server Installation and Service Guide
126
Server Specifications
Power Cord Specifications
CAB-9K10A-UK
8.2
2.5
8.2
2.5
6.6
2.0
8.2
2.5
NA
NA
AC power cord, 250 V, 10 A (13 A fuse),
BS1363 plug
United Kingdom
CAB-9K12A-NA
AC power cord, 125 V, 13 A, NEMA 5-15
plug
North America
CAB-AC-L620-C13
AC power cord, NEMA L6-20 to C13
connectors
CAB-9K10A-IT
AC power cord, 250 V, 10 A, CEI
23-16/VII plug
Italy
R2XX-DMYMPWRCORD
No power cord; PID option for ordering
server with no power cord
Cisco UCS C240 M5 Server Installation and Service Guide
127
Server Specifications
Power Cord Specifications
Cisco UCS C240 M5 Server Installation and Service Guide
128
APPENDIX
B
Storage Controller Considerations
This appendix provides storage controller (RAID and HBA) information.
• Supported Storage Controllers and Cables, page 129
• Storage Controller Card Firmware Compatibility, page 131
• RAID Backup (Supercap), page 131
• Write-Cache Policy for Cisco 12G SAS Modular RAID Controllers, page 132
• Mixing Drive Types in RAID Groups, page 132
• RAID Controller Migration, page 133
• Storage Controller Cable Connectors and Backplanes, page 133
• Embedded SATA RAID Controller, page 137
• For More RAID Utility Information, page 147
Supported Storage Controllers and Cables
This server supports a single, PCIe-style, SAS RAID or HBA controller that plugs into a dedicated internal
socket.
Note
For SFF, 8-drives version only (UCSC-C240-M5S): Do not mix controller types in the server. Do not use
the embedded SATA controller and a hardware-based RAID controller card to control front-loading drives
at the same time. This combination is not supported and could result in data loss.
Note
NVMe PCIe SSDs cannot be controlled by a SAS/SATA RAID controller.
This server supports the RAID and HBA controller options and cable requirements shown in the following
table.
Cisco UCS C240 M5 Server Installation and Service Guide
129
Storage Controller Considerations
Supported Storage Controllers and Cables
Controller
Server
Version/Maximum
Drives Controlled
Embedded RAID (PCH
SATA)
• All server versions
can use the
embedded SATA
controller to
control two internal
SATA M.2 drives.
RAID Levels
Optional Supercap
Backup?
Required Cables
0, 1, 10
No
UCSC-C240-M5S only:
Use the SAS/SATA
cable included with the
chassis to connect the
interposer to the front
drive backplane.
No cables are required
for control of internal
SATA M.2 drives.
• SFF 8-drives only
(UCSC-C240-M5S):
8 front-loading,
SATA-only drives
Cisco 12G Modular
RAID Controller
UCSC-RAID-M5
Includes 2-GB cache;
controls up to 16 drives.
This controller is
supported only in the
following server
versions:
0, 1, 5, 6, 10, 50, 60
Yes
Use SAS/SATA cable
included with chassis to
connect controller to
drive backplanes.
This controller is
0, 1, 5, 6, 10, 50, 60
supported only in the
following server version:
Yes
Use SAS/SATA cable
included with chassis to
connect controller to
drive backplanes.
•
• SFF 8-drives
(UCSC-C240-M5S):
8 front-loading,
plus 2 rear-loading
SAS/SATA drives
• LFF 12-drives
(UCSC-C240-M5L):
12 front-loading,
plus 2 rear-loading
SAS/SATA drives
Cisco 12G Modular
RAID Controller
UCSC-RAID-M5HD
Includes 4-GB cache;
controls up to 26 drives
• SFF 24-drives
(UCSC-C240-M5SX):
24 front-loading,
plus 2 rear-loading
SAS/SATA drives
Cisco UCS C240 M5 Server Installation and Service Guide
130
Storage Controller Considerations
Storage Controller Card Firmware Compatibility
Cisco 12G Modular SAS This controller is
Non-RAID
HBA
supported only in the
following server
UCSC-SAS-M5
versions:
Controls up to 16 drives.
•
• SFF 8-drives
(UCSC-C240-M5S):
No
Use SAS/SATA cable
included with chassis to
connect controller to
drive backplanes.
No
Use SAS/SATA cable
included with chassis to
connect controller to
drive backplanes.
8 front-loading,
plus 2 rear-loading
SAS/SATA drives
• LFF 12-drives
(UCSC-C240-M5L):
12 front-loading,
plus 2 rear-loading
SAS/SATA drives
Cisco 12G Modular SAS This controller is
Non-RAID
HBA (For Up To 24
supported only in the
Drives)
following server version:
UCSC-SAS-M5HD
Controls up to 24 drives.
• SFF 24-drives
(UCSC-C240-M5SX):
24 front-loading,
plus 2 rear-loading
SAS/SATA drives
Storage Controller Card Firmware Compatibility
Firmware on the storage controller (RAID or HBA) must be verified for compatibility with the current Cisco
IMC and BIOS versions that are installed on the server. If not compatible, upgrade or downgrade the storage
controller firmware using the Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible
level.
See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring
server components to compatible levels: HUU Guides.
RAID Backup (Supercap)
This server supports installation of one supercap unit. The unit mounts to a bracket in-line with the fan modules.
The optional SCPM provides approximately three years of backup for the disk write-back cache DRAM in
the case of a sudden power loss by offloading the cache to the NAND flash.
For supercap unit replacement instructions, see Replacing the Supercap (RAID Backup), on page 103.
Cisco UCS C240 M5 Server Installation and Service Guide
131
Storage Controller Considerations
Write-Cache Policy for Cisco 12G SAS Modular RAID Controllers
Write-Cache Policy for Cisco 12G SAS Modular RAID Controllers
For this server and other Cisco Generation M5 servers, the default write-cache policy for the Cisco Modular
RAID controllers is Write Through (irrespective of the presence of a charged supercap or “good BBU”). This
utilizes the optimal performance characteristics of the controller.
The write policy can be set to Write Back, if preferred. You can set the write policy using the following
methods:
• For standalone servers, use the Cisco IMC interface to set Virtual Drive Properties > Write Policy. See
the “Managing Storage Adapters” section in your Cisco IMC Configuration Guide.
Cisco IMC GUI and CLI Configuration Guides
• For Cisco UCS-integrated servers, use the Cisco UCS Manager interface to set the write-cache policy
as part of virtual drive configuration in your storage profile.
Cisco UCS Manager Configuration Guides
• Use the LSI Option ROM Configuration Utility.
Mixing Drive Types in RAID Groups
The following table lists the technical capabilities for mixing hard disk drive (HDD) and solid state drive
(SSD) types in a RAID group. However, see the recommendations that follow for the best performance.
Table 17: Mixing Drive Types
Mix of Drive Types in RAID Group
Allowed?
SAS HDD + SATA HDD
Yes
SAS SSD + SATA SSD
Yes
HDD + SSD
No
Drive Type Mixing Best Practices
For the best performance follow these guidelines:
• Use either all SAS or all SATA drives in a RAID group.
• Use the same capacity for each drive in the RAID group.
• Never mix HDDs and SSDs in the same RAID group.
Cisco UCS C240 M5 Server Installation and Service Guide
132
Storage Controller Considerations
RAID Controller Migration
RAID Controller Migration
The SFF, 8-drives version of the server (UCSC-C240-M5S) can use the software-based, embedded SATA
RAID controller to control front-loading SATA drives.
Note
For SFF, 8-drives version only (UCSC-C240-M5S): Do not mix controller types in the server. Do not use
the embedded SATA controller and a hardware-based RAID controller card to control front-loading drives
at the same time. This combination is not supported and could result in data loss.
See the table below for which data migrations are allowed and a summary of migration steps.
Starting RAID Controller
Migrate to Hardware RAID
Allowed?
Migrate to Software RAID
Allowed?
None (no drives).
Allowed
Allowed
Embedded RAID is disabled in the 1 Install RAID card.
BIOS.
2 Connect SAS cables.
1 Install SATA interposer card.
2 Connect SATA cables.
3 Enable embedded RAID in
BIOS.
Embedded software RAID.
Data migration from
software
RAID
to
Embedded RAID is enabled in the
hardware RAID is not
BIOS.
supported and could
result in data loss.
Allowed only before there is data
on the drives; data migration is not
supported.
Caution
1 Disable embedded RAID in the
BIOS.
2 Install RAID card.
3 Install SAS cables.
Hardware RAID.
-
Not allowed.
Embedded RAID is disabled in the
BIOS.
Storage Controller Cable Connectors and Backplanes
This section describes cabling for the storage controllers and backplanes. The SAS/SATA cables are
factory-installed and are used for all supported internal controllers.
Cisco UCS C240 M5 Server Installation and Service Guide
133
Storage Controller Considerations
Storage Controller Cable Connectors and Backplanes
This section also contains diagrams that show the cable-to-drive mapping.
Embedded SATA RAID
This SW RAID option is supported for controlling front-loading SATA drives in the SFF, 8-drive version
only (UCSC-C240-M5S).
This embedded RAID option requires that you have a SATA interposer card installed in the dedicated controller
socket. Use the SAS/SATA cables that came with the server.
1 Connect SAS/SATA cable A1 from the A1 interposer connector to the A1 front backplane connector.
2 Connect SAS/SATA cable A2 from the A2 interposer connector to the A2 front backplane connector.
Figure 51: SATA Interposer Cabling (SFF, 8-Drive Version Only)
Cisco 12G Modular SAS RAID Controller or HBA For Up To 16 Drives (UCSC-RAID-M5 or UCSC-SAS-M5)
The drive support differs by server version, as described in the following sections. These controllers are
supported only in these server versions:
• SFF 8-Drives UCSC-C240-M5S
•
• LFF 12-Drives UCSC-C240-M5L
SFF 8-Drives UCSC-C240-M5S
This HW RAID or HBA option can control up to 8 front-loading SAS/SATA drives in this server version,
plus two rear-loading SAS/SATA drives.
1 Connect SAS/SATA cable A1 from the A1 card connector to the A1 front backplane connector.
2 Connect SAS/SATA cable A2 from the A2 card connector to the A2 front backplane connector.
Cisco UCS C240 M5 Server Installation and Service Guide
134
Storage Controller Considerations
Storage Controller Cable Connectors and Backplanes
3 Optional for rear drives: Connect SAS/SATA cable B1 from the B1 card connector to the rear backplane
connector.
Figure 52: SFF, 8-Drive UCSC-C240-M5S Cabling With UCSC-RAID-M5
LFF 12-Drives UCSC-C240-M5L
This HW RAID or HBA option can control up to 12 front-loading SAS/SATA drives in this server version,
plus 2 rear-loading SAS/SATA drives.
1 Connect SAS/SATA cable A1 from the A1 card connector to the A1 front backplane connector.
2 Connect SAS/SATA cable A2 from the A2 card connector to the A2 front backplane connector.
3 Connect SAS/SATA cable B2 from the B2 card connector to the B2 front backplane connector.
Cisco UCS C240 M5 Server Installation and Service Guide
135
Storage Controller Considerations
Storage Controller Cable Connectors and Backplanes
4 Optional for rear drives: Connect SAS/SATA cable B1 from the B1 card connector to the rear backplane
connector.
Figure 53: LFF, 12-Drive UCSC-C240-M5L Cabling With UCSC-RAID-M5
Cisco 12G Modular SAS RAID Controller or HBA For Up To 26 Drives (UCSC-RAID-M5HD or UCSC-SAS-M5HD)
This controller is supported only in this server version:
• SFF 24-Drives UCSC-C240-M5SX
This HW RAID or HBA option can control up to 24 front-loading SAS/SATA drives in this server version,
plus 2 rear-loading SAS/SATA drives.
1 Connect SAS/SATA cable A double-connectors A1 and A2 to the A1 and A2 connectors on the controller
card.
2 Connect SAS/SATA cable A, single connector CONN-A to the CONN-A backplane connector.
3 Connect SAS/SATA cable B double-connectors B1 and B2 to the B1 and B2 connectors on the controller
card.
4 Connect SAS/SATA cable B, single connector CONN-B to the CONN-B backplane connector.
5 Connect SAS/SATA cable C double-connectors C1 and C2 to the C1 and C2 connectors on the controller
card.
6 Connect SAS/SATA cable C, single connector CONN-C to the CONN-C backplane connector.
Cisco UCS C240 M5 Server Installation and Service Guide
136
Storage Controller Considerations
Embedded SATA RAID Controller
7 Optional for rear drives: Connect SAS/SATA cable D from the D1 card connector (on the reverse side of
the card) to the rear backplane connector.
Figure 54: SFF, 24-Drive UCSC-C240-M5SX Cabling With UCSC-RAID-M5HD
Embedded SATA RAID Controller
All versions of the server include an embedded SATA MegaRAID controller that can be used to control two
internal SATA M.2 drives. This controller supports RAID levels 0, 1, and 10.
The SFF, 8-drives version of the server (UCSC-C240-M5S) can also use the embedded SATA controller to
control up to eight front-loading, SATA-only drives. Control of front-loading drives with this embedded
controller is not supported in other versions of the server.
Note
VMware ESX/ESXi or any other virtualized environments are not supported for use with the embedded
MegaRAID controller. Hypervisors such as Hyper-V, Xen, or KVM are also not supported for use with
the embedded MegaRAID controller.
Cisco UCS C240 M5 Server Installation and Service Guide
137
Storage Controller Considerations
Embbeded SATA RAID Requirements
Embbeded SATA RAID Requirements
The embedded SATA RAID controller requires the following items:
• For control of front-loading SATA drives: SFF, 8-drives server version UCSC-C240-M5S (only). Other
versions of the server do not support control of front-loading drives with this embedded controller.
• For control of front-loading SATA drives: Interposer card UCSC-SATAIN-240M5 installed in the
dedicated storage controller socket.
• For control of front-loading SATA drives: The SAS/SATA cables that are preinstalled in the chassis.
• Primary controller: SATA drives only (up to eight, in front drive bays 1–8).
• Secondary controller: M.2 mini-storage module with two SATA M.2 SSDs.
• The embedded SATA RAID controllers must be enabled in the server BIOS. If you ordered the server
with embedded SATA RAID, it is enabled at the factory.
• (Optional) LSI MegaSR drivers for Windows or Linux.
• The software RAID controller requires UEFI boot mode; Legacy boot mode is not supported.
• If you use an embedded RAID controller with Linux and a DVD drive is present on the pSATA controller,
both the pSATA and the sSATA controller must be set to LSI SW RAID mode.
Embedded SATA RAID Controller Considerations
Note the following considerations:
• The SFF, 8-drives version of the server (UCSC-C240-M5S) can use the embedded SATA controller to
control up to eight front-loading, SATA-only drives, and up to two internal M.2 SATA drives. Control
of the two internal M.2 SATA drives is supported in all versions of the server; control of front-loading
drives is not supported in other versions of the server.
• The default setting for this embedded controller hub is SATA RAID 0, 1, and 10 support for up to eight
SATA drives. The hub is divided into two SATA controllers that have different functions. See Embedded
SATA RAID: Two SATA Controllers, on page 139.
• When you order the server with this embedded controller, the controller is enabled in the BIOS.
Instructions for enabling the controller are included for the case in which a server is reset to defaults.
See Enabling SATA Mode For the Embedded Controllers , on page 139.
• You cannot downgrade from using a hardware RAID controller card for front-loading drive control to
using the software RAID embedded controller for front-loading drive control (see RAID Controller
Migration, on page 133).
Caution
Data migration from software RAID (embedded RAID) to hardware RAID (a controller
card) for front-loading drives is not supported and could result in data loss. Migrations
from software RAID to hardware RAID are supported only before there is data on the
front-loading drives, or when there are no drives in the server.
Cisco UCS C240 M5 Server Installation and Service Guide
138
Storage Controller Considerations
Embedded SATA RAID: Two SATA Controllers
• The required drivers for this controller are already installed and ready to use. However, if you will use
this controller with Windows or Linux, you must download and install additional drivers for those
operating systems. See Installing LSI MegaSR Drivers For Windows and Linux, on page 140.
Embedded SATA RAID: Two SATA Controllers
The embedded RAID platform controller hub (PCH) is split into two controllers: primary SATA (pSATA)
and secondary SATA (sSATA). These two controllers are seen as separate RAID controllers in the Cisco
IMC interface and are configurable separately.
• SFF 8-drives server UCSC-C240-M5S (only):
◦The pSATA controller controls up to eight front-loading SATA drives.
◦The sSATA controller controls two internal SATA M.2 drives, when they are present in the M.2
mini-storage module option.
If the M.2 mini-storage module is not present, or if M.2 NVMe drives are installed in the
mini-storage module, the sSATA controller is automatically disabled.
• All other versions of the server:
◦The pSATA controller is disabled.
◦The sSATA controller controls two internal SATA M.2 drives, when they are present in the SATA
mini-storage module option.
If the M.2 mini-storage module is not present, or if M.2 NVMe drives are installed in the
mini-storage module, the sSATA controller is automatically disabled.
• Each controller is listed separately in the BIOS. You can enable or disable the controllers in the BIOS.
See Enabling SATA Mode For the Embedded Controllers , on page 139.
Enabling SATA Mode For the Embedded Controllers
This procedure uses the server's BIOS Setup Utility
Step 1
Set the SATA mode:
a) Boot the server and press F2 when prompted to enter the BIOS Setup utility.
b) Choose the Advanced tab, and then choose LOM and PCIe Slots Configuration.
c) Server version UCSC-C240-M5S only: For the primary pSATA controller, select pSATA, and then choose one of
the options from the dialog:
• LSI SW RAID—Enable the embedded pSATA RAID controller.
Note
This menu option does not appear when the server is set to boot in Legacy mode (UEFI mode is
required). To change the boot mode, use the BIOS setting for Boot Options > Boot Mode.
• Disabled—Disable the embedded pSATA RAID controller.
Cisco UCS C240 M5 Server Installation and Service Guide
139
Storage Controller Considerations
Accessing the Software RAID Configuration Utility
d) For the secondary sSATA controller, select M.2 and then choose one of the options from the dialog:
• LSI SW RAID—Enable the embedded sSATA RAID controller for control of internal SATA M.2 drives.
Note
Note
This menu option does not appear when the server is set to boot in Legacy mode (UEFI mode is
required). To change the boot mode, use the BIOS setting for Boot Options > Boot Mode.
This menu option does not appear when the server has no M.2 mini storage module, or when no SATA
M.2 drive is installed in the mini-storage module.
• AHCI—Enable control of the internal SATA M.2 drives by AHCI through your OS rather than the embedded
RAID controller.
• Disabled—Disable the embedded sSATA RAID controller.
Step 2
Press F10 to save your changes and exit the utility.
Accessing the Software RAID Configuration Utility
To configure RAID settings for the embedded SATA RAID controllers, use the utility that is built into the
BIOS. Each controller is controlled by its own instance of the utility.
Step 1
Boot the server and press F2 when prompted to enter the BIOS Setup utility.
Step 2
Choose the Advanced tab.
Step 3
Select the instance of the utility that is for the controller that you want to manage (primary or secondary):
• For the pSATA controller, select LSI Software RAID Configuration Utility (SATA).
• For the sSATA controller, select LSI Software RAID Configuration Utility (sSATA).
Installing LSI MegaSR Drivers For Windows and Linux
Note
The required drivers for this controller are already installed and ready to use. However, if you will use
this controller with Windows or Linux, you must download and install additional drivers for those operating
systems.
This section explains how to install the LSI MegaSR drivers for the following supported operating systems:
• Microsoft Windows Server
• Red Hat Enterprise Linux (RHEL)
• SUSE Linux Enterprise Server (SLES)
Cisco UCS C240 M5 Server Installation and Service Guide
140
Storage Controller Considerations
Installing LSI MegaSR Drivers For Windows and Linux
For the specific supported OS versions, see the Hardware and Software Compatibility Matrix for your server
release.
Downloading the MegaSR Drivers
The MegaSR drivers are included in the C-Series driver ISO for your server and OS.
Step 1
Find the drivers ISO file download for your server online and download it to a temporary location on your workstation:
a) See the following URL: http://www.cisco.com/cisco/software/navigator.html.
b) Click Servers - Unified Computing in the middle column.
c) Click UCS C-Series Rack-Mount Standalone Server Software in the right-hand column.
d) Click your model of server in the right-hand column.
e) Click Unified Computing System (UCS) Drivers.
f) Click the release number that you are downloading.
g) Click Download to download the drivers’ ISO file.
h) Verify the information on the next page, and then click Proceed With Download.
Step 2
Continue through the subsequent screens to accept the license agreement and then browse to a location where you want
to save the driver ISO file.
Microsoft Windows Server Drivers
Installing Microsoft Windows Server Drivers
The Windows Server operating system automatically adds the driver to the registry and copies the driver to
the appropriate directory.
Before You Begin
Before you install this driver on an embedded controller, you must configure a RAID drive group on the
embedded controller for the drives where you will install the OS (pSATA and/or sSATA).
To access the configuration utility, open the BIOS Setup Utility, go to the Advanced tab, and then choose
the utility instance for the embedded controller:
• For pSATA, select LSI Software RAID Configuration Utility (SATA)
• For sSATA, select LSI Software RAID Configuration Utility (sSATA)
Step 1
Step 2
Download the Cisco UCS C-Series drivers’ ISO, as described in Downloading the MegaSR Drivers, on page 141.
Prepare the drivers on a USB thumb drive:
a) Burn the ISO image to a disk.
b) Browse the contents of the drivers folders to the location of the embedded MegaRAID drivers:
/<OS>/Storage/Intel/C600/
Cisco UCS C240 M5 Server Installation and Service Guide
141
Storage Controller Considerations
Installing LSI MegaSR Drivers For Windows and Linux
c) Expand the Zip file, which contains the folder with the MegaSR driver files.
d) Copy the expanded folder to a USB thumb drive.
Step 3
Start the Windows driver installation using one of the following methods:
• To install from local media, connect an external USB DVD drive to the server (if the server does not have a DVD
drive installed) and then insert the first Windows installation disk into the DVD drive. Skip to Step 6.
• To install from remote ISO, log in to the server’s Cisco IMC interface and continue with the next step.
Step 4
Launch a Virtual KVM console window and click the Virtual Media tab.
a) Click Add Image and browse to select your remote Windows installation ISO file.
b) Check the check box in the Mapped column for the media that you just added, and then wait for mapping to complete.
Step 5
Step 6
Power cycle the server.
Press F6 when you see the F6 prompt during bootup. The Boot Menu window opens.
Step 7
On the Boot Manager window, choose the physical disk or virtual DVD and press Enter. The Windows installation
begins when the image is booted.
Step 8
Press Enter when you see the prompt, “Press any key to boot from CD.”
Step 9
Observe the Windows installation process and respond to prompts in the wizard as required for your preferences and
company standards.
Step 10
When Windows prompts you with “Where do you want to install Windows,” install the drivers for embedded MegaRAID:
a) Click Load Driver. You are prompted by a Load Driver dialog box to select the driver to be installed.
b) Connect the USB thumb drive that you prepared in Step 3 to the target server.
c) On the Windows Load Driver dialog, click Browse.
d) Use the dialog box to browse to the location of the drivers folder on the USB thumb drive, and then click OK.
Windows loads the drivers from the folder and when finished, the driver is listed under the prompt, “Select the driver
to be installed.”
e) Click Next to install the drivers.
Updating Microsoft Windows Server Drivers
Step 1
Click Start, point to Settings, and then click Control Panel.
Step 2
Double-click System, click the Hardware tab, and then click Device Manager. Device Manager starts.
Step 3
In Device Manager, double-click SCSI and RAID Controllers, right-click the device for which you are installing the
driver, and then click Properties.
Step 4
On the Driver tab, click Update Driver to open the Update Device Driver wizard, and then follow the wizard instructions
to update the driver.
Cisco UCS C240 M5 Server Installation and Service Guide
142
Storage Controller Considerations
Installing LSI MegaSR Drivers For Windows and Linux
Linux Drivers
Dowloading the Driver Image File
See Downloading the MegaSR Drivers, on page 141 for instructions on downloading the drivers. The Linux
driver is included in the form of dud-[driver version].img, which is the boot image for the embedded
MegaRAID stack.
Note
The LSI MegaSR drivers that Cisco provides for RHEL and SLES are for the original GA versions of
those distributions. The drivers do not support updates to those OS kernels.
Preparing Physical Thumb Drive for Linux
This topic describes how to prepare physical Linux thumb drive from the driver image files.
This procedure requires a CD or DVD drive that you can use to burn the ISO image to disk; and a USB thumb
drive.
Alternatively, you can mount the dud.img file as a virtual floppy disk, as described in the installation procedures.
For RHEL and SLES, you can use a driver disk utility to create disk images from image files.
Step 1
Step 2
Download the Cisco UCS C-Series drivers ISO, as described in Downloading the MegaSR Drivers, on page 141 and
save it to your Linux system.
Extract the dud.img file:
a) Burn the ISO image to a disc.
b) Browse the contents of the drivers folders to the location of the embedded MegaRAID drivers:
/<OS>/Storage/Intel/C600/
c) Expand the Zip file, which contains the folder with the driver files.
Step 3
Step 4
Step 5
Copy the driver update disk image dud-[driver version].img to your Linux system.
Insert a blank USB thumb drive into a port on your Linux system.
Create a directory and mount the DUD image to that directory:
Example:
mkdir <destination_folder>
mount -oloop <driver_image> <destination_folder>
Step 6
Copy the contents in the directory to your USB thumb drive.
Installing the Red Hat Enterprise Linux Driver
For the specific supported OS versions, see the Hardware and Software Compatibility Matrix for your server
release.
Cisco UCS C240 M5 Server Installation and Service Guide
143
Storage Controller Considerations
Installing LSI MegaSR Drivers For Windows and Linux
This topic describes the fresh installation of the RHEL device driver on systems that have the embedded
MegaRAID stack.
Note
If you use an embedded RAID controller with Linux, both the pSATA and the sSATA controller must be
set to LSI SW RAID mode.
Before You Begin
Before you install this driver on an embedded controller, you must configure a RAID drive group on the
embedded controller that controls the drives where you will install the OS (pSATA and/or sSATA).
To access the configuration utility, open the BIOS Setup Utility, go to the Advanced tab, and then choose
the utility instance for the embedded controller:
• For pSATA, select LSI Software RAID Configuration Utility (SATA)
• For sSATA, select LSI Software RAID Configuration Utility (sSATA)
Step 1
Prepare the dud.img (or .iso) file using one of the following methods:
• To install from physical drive, use the procedure in Preparing Physical Thumb Drive for Linux, on page 143, then
continue with step 4.
• To install from virtual disk, download the Cisco UCS C-Series drivers’ ISO, as described in Downloading the
MegaSR Drivers, on page 141, then continue with the next step.
Step 2
Extract the dud.img (or .iso) file:
a) Burn the ISO image to a disk.
b) Browse the contents of the drivers folders to the location of the embedded MegaRAID drivers:
/<OS>/Storage/Intel/C600/
c) Copy the dud-<driver version>.img (or .iso) file to a temporary location on your workstation.
Step 3
Start the Linux driver installation using one of the following methods:
• To install from local media, connect an external USB DVD drive to the server and then insert the first RHEL
installation disk into the drive. Then continue with Step 6.
• To install from remote ISO, log in to the server’s Cisco IMC interface. Then continue with the next step.
Step 4
Launch a Virtual KVM console window and click the Virtual Media tab.
a) Click Add Image and browse to select your remote RHEL installation ISO file.
b) Click Add Image again and browse to select your dud.img file.
c) Check the check boxes in the Mapped column for the media that you just added, then wait for mapping to complete.
Step 5
Step 6
Power-cycle the target server.
Press F6 when you see the F6 prompt during bootup. The Boot Menu window opens.
Step 7
On the Boot Manager window, select the physical disk or virtual disk and press Enter.
The RHEL installation begins when the image is booted.
Step 8
Enter one of the following blacklist commands at the boot prompt:
Cisco UCS C240 M5 Server Installation and Service Guide
144
Storage Controller Considerations
Installing LSI MegaSR Drivers For Windows and Linux
• For RHEL 6.x (32- and 64-bit), enter:
linux dd blacklist=isci blacklist=ahci nodmraid noprobe=<atadrive number>
Note
The noprobe values depend on the number of drives. For example, to install RHEL 6.5 on a RAID 5
configuration with three drives, enter:
Linux dd blacklist=isci blacklist=ahci nodmraid noprobe=ata1 noprobe=ata2
• For RHEL 7.x (32- and 64-bit), enter:
linux dd modprobe.blacklist=ahci nodmraid
Step 9
Press Enter.
The prompt asks whether you have a driver disk.
Step 10
Use the arrow key to choose Yes, and then press Enter.
Step 11
Choose fd0 to indicate that you have a disk with the driver on it.
Step 12
Do one of the following actions:
• If you prepared the dud.img (or .iso) file on a physical thumb drive, insert the thumb drive to the target server and
then press Enter.
• If you mapped the dud.img (or .iso) file as a virtual disk, choose the location of the virtual disk.
The installer locates and loads the driver for your device. The following message appears:
Loading megasr driver...
Step 13
Step 14
Follow the RHEL installation procedure to complete the installation.
Reboot the target server.
Installing the SUSE Linux Enterprise Server Driver
For the specific supported OS versions, see the Hardware and Software Compatibility Matrix for your server
release.
This topic describes the fresh installation of the SLES driver on systems that have the embedded MegaRAID
stack.
Note
If you use an embedded RAID controller with Linux, both the pSATA and the sSATA controller must be
set to LSI SW RAID mode.
Before You Begin
Before you install this driver on an embedded controller, you must configure a RAID drive group on the
embedded controller that controls the drives where you will install the OS (pSATA and/or sSATA).
To access the configuration utility, open the BIOS Setup Utility, go to the Advanced tab, and then choose
the utility instance for the embedded controller:
• For pSATA, select LSI Software RAID Configuration Utility (SATA)
Cisco UCS C240 M5 Server Installation and Service Guide
145
Storage Controller Considerations
Installing LSI MegaSR Drivers For Windows and Linux
• For sSATA, select LSI Software RAID Configuration Utility (sSATA)
Step 1
Prepare the dud.img file using one of the following methods:
• To install from physical disk, use the procedure in Preparing Physical Thumb Drive for Linux, on page 143, then
continue with step 4.
• To install from virtual disk, download the Cisco UCS C-Series drivers’ ISO, as described in Downloading the
MegaSR Drivers, on page 141, then continue with the next step.
Step 2
Extract the dud.img file:
a) Burn the ISO image to a disk.
b) Browse the contents of the drivers folders to the location of the embedded MegaRAID drivers:
/<OS>/Storage/Intel/C600/
c) Copy the dud-<driver version>.img file to a temporary location on your workstation.
Step 3
Start the Linux driver installation using one of the following methods:
• To install from local media, connect an external USB DVD drive to the server and then insert the first SLES
installation disk into the drive. Then continue with Step 6.
• To install from remote ISO, log in to the server’s Cisco IMC interface. Then continue with the next step.
Step 4
Launch a Virtual KVM console window and click the Virtual Media tab.
a) Click Add Image and browse to select your remote RHEL installation ISO file.
b) Click Add Image again and browse to select your dud.img file.
c) Check the check boxes in the Mapped column for the media that you just added, then wait for mapping to complete.
Step 5
Step 6
Power-cycle the target server.
Press F6 when you see the F6 prompt during bootup. The Boot Menu window opens.
Step 7
On the Boot Manager window, select the physical disk or virtual disk and press Enter.
The SLES installation begins when the image is booted.
Step 8
When the first SLES screen appears, choose Installation.
Step 9
Enter the following command in the Boot Options field:
• For SLES 12.x, enter:
brokenmodules=ahci
Step 10
Press F6 for the driver and choose Yes.
Step 11
Do one of the following actions:
• If you prepared the dud.img file on a physical thumb drive, insert the thumb drive to the target server and then
press Enter.
• If you mapped the dud.img file as a virtual disk, choose the location of the virtual disk.
Yes
appears under the F6 Driver heading.
Cisco UCS C240 M5 Server Installation and Service Guide
146
Storage Controller Considerations
For More RAID Utility Information
Step 12
Press Enter to choose Installation.
Step 13
Press OK.
The following message is displayed:
LSI Soft RAID Driver Updates added.
Step 14
At the menu, choose the driver update medium and press the Back button.
Step 15
Step 16
Follow the SLES installation wizard to complete the installation.
Reboot the target server.
For More RAID Utility Information
The Broadcom utilities have help documentation for more information about using the utilities.
• For basic information about RAID and for using the utilities for the RAID controller cards that are
supported in Cisco servers, see the Cisco UCS Servers RAID Guide.
• For hardware SAS MegaRAID configuration—Broadcom 12Gb/s MegaRAID SAS Software User
Guide, Version 2.8
• For embedded software MegaRAID and the utility that is accessed via the server BIOS (refer to Chapter
4)—Avago Technologies Embedded MegaRAID Software User Guide, Revison 2.1.
Cisco UCS C240 M5 Server Installation and Service Guide
147
Storage Controller Considerations
For More RAID Utility Information
Cisco UCS C240 M5 Server Installation and Service Guide
148
APPENDIX
C
GPU Card Installation
This appendix contains configuration rules and installation procedures for the supported GPU cards.
• Server Firmware Requirements, page 149
• GPU Card Configuration Rules, page 149
• Requirement For All GPUs: Memory-Mapped I/O Greater Than 4 GB, page 150
• Installing a Double-Wide GPU Card, page 151
• Using NVIDIA GRID License Server For M-Series and P-Series GPUs, page 154
• Installing Drivers to Support the GPU Cards, page 162
Server Firmware Requirements
The following table lists the minimum server firmware versions for the supported GPU cards.
GPU Card
Cisco IMC/BIOS Minimum Version Required
NVIDIA Tesla M10
3.1(1)
NVIDIA Tesla P40
3.1(1)
NVIDIA Tesla P100 12GB
3.1(1)
NVIDIA Tesla P100 16GB
3.1(1)
AMD FirePro S7150 X2
3.1(1)
GPU Card Configuration Rules
Note the following rules when populating a server with GPU cards.
Cisco UCS C240 M5 Server Installation and Service Guide
149
GPU Card Installation
Requirement For All GPUs: Memory-Mapped I/O Greater Than 4 GB
Caution
When using NVIDIA Tesla P100 12GB or 16GB GPU cards in this server, the maximum operating
temperature (air inlet temperature) for the server is 28° C (82.4° F).
Caution
When using NVIDIA Tesla P40 GPU cards in this server, the maximum operating temperature (air inlet
temperature) for the server is 32° C (89.6° F).
• Use the UCS power calculator at the following link to determine the power needed based on your server
configuration: http://ucspowercalc.cisco.com
• Double-wide GPU cards are supported in PCIe riser 1, slot 2 and in PCIe riser 2, slot 5.
Note
GPU cards are not supported in all PCIe riser options. GPU cards are supported only in
the following riser options:
• PCIe riser 1 (UCSC-PCI-1-C240M5)
• PCIe riser 2A (UCSC-PCI-2A-C240M5)
• PCIe riser 2B (UCSC-PCI-2B-C240M5)
• A double-wide GPU card installed in slot 2 also covers slot 4; a double wide GPU card installed in slot
5 also covers slot 6.
• Do not mix different brands or models of GPU cards in the server.
• You can install a GPU card and a Cisco UCS VIC in the same riser. When you install a GPU card in
slot 2, NCSI support in riser 1 automatically moves to slot 1. When you install a GPU card in slot 5,
NCSI support in riser 2 automatically moves to slot 4.
• The NVIDIA Tesla P-series GPUs can support more than 1 TB of memory in the server. All other
NVIDIA GPUs (M-series) can support only 1 TB or less of memory in the server. Therefore, do not
install DIMMs totaling more than 1 TB capacity when using an M-Series NVIDIA GPU card in this
server.
Requirement For All GPUs: Memory-Mapped I/O Greater Than
4 GB
All supported GPU cards require enablement of the BIOS setting that allows greater than 4 GB of
memory-mapped I/O (MMIO).
• Standalone Server: If the server is used in standalone mode, this BIOS setting is enabled by default:
Advanced > PCI Configuration > Memory Mapped I/O Above 4 GB [Enabled]
If you need to change this setting, enter the BIOS Setup Utility by pressing F2 when prompted during
bootup.
Cisco UCS C240 M5 Server Installation and Service Guide
150
GPU Card Installation
Installing a Double-Wide GPU Card
• If the server is integrated with Cisco UCS Manager and is controlled by a service profile, this setting is
enabled by default in the service profile when a GPU is present.
To change this setting manually, use the following procedure.
Step 1
Refer to the Cisco UCS Manager configuration guide (GUI or CLI) for your release for instructions on configuring
service profiles:
Cisco UCS Manager Configuration Guides
Step 2
Step 3
Refer to the chapter on Configuring Server-Related Policies > Configuring BIOS Settings.
In the section of your profile for PCI Configuration BIOS Settings, set Memory Mapped IO
of the following:
Above 4GB Config
to one
• Disabled—Does not map 64-bit PCI devices to 64 GB or greater address space.
• Enabled—Maps I/O of 64-bit PCI devices to 64 GB or greater address space.
• Platform Default—The policy uses the value for this attribute contained in the BIOS defaults for the server. Use
this only if you know that the server BIOS is set to use the default enabled setting for this item.
Step 4
Reboot the server.
Note
Cisco UCS Manager pushes BIOS configuration changes through a BIOS policy or default BIOS settings to
the Cisco Integrated Management Controller (CIMC) buffer. These changes remain in the buffer and do not
take effect until the server is rebooted.
Installing a Double-Wide GPU Card
Use the following procedure to install or replace the following supported GPU cards:
• NVIDIA Tesla M10
• NVIDIA Tesla P40
• NVIDIA Tesla P100 12GB
• NVIDIA Tesla P100 16GB
• AMD FirePro S7150 X2
Note
Caution
When using NVIDIA Tesla P100 12GB or 16GB GPU cards in this server, the maximum operating
temperature (air inlet temperature) for the server is 28° C (82.4° F).
When using NVIDIA Tesla P40 GPU cards in this server, the maximum operating temperature (air inlet
temperature) for the server is 32° C (89.6° F).
Cisco UCS C240 M5 Server Installation and Service Guide
151
GPU Card Installation
Installing a Double-Wide GPU Card
Table 18: C240 M5 Operating Temperature Requirements For GPU Cards
Note
Step 1
Step 2
Step 3
Step 4
Step 5
GPU Card
Maximum Server Operating Temperature (Air
Inlet Temperature)
NVIDIA Tesla M10
35° C (95.0° F)
NVIDIA Tesla P40
32° C (89.6° F)
NVIDIA Tesla P100 12GB
28° C (82.4° F)
NVIDIA Tesla P100 16GB
28° C (82.4° F)
AMD FirePro S7150 X2
35° C (95.0° F)
The GPU card might be shipped with two power cables: a straight cable and a Y-cable. The straight cable
is used for connecting power to the GPU card in this server; do not use the Y-cable, which is used for
connecting the GPU card in external devices only (such as the Magma chassis).
Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 39.
Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the
rack.
Remove the top cover from the server as described in Removing the Server Top Cover, on page 41.
Remove an existing GPU card:
a) Use two hands to grasp the metal bracket of the PCIe riser and lift straight up to disengage its connector from the
socket on the motherboard. Set the riser on an antistatic surface.
b) On the bottom of the riser, press down on the clip that holds the securing plate.
c) Swing open the hinged securing plate to provide access.
d) Open the hinged plastic retainer that secures the rear-panel tab of the card.
e) Disconnect the GPU card's power cable from the power connector on the PCIe riser.
f) Pull evenly on both ends of the GPU card to remove it from the socket on the PCIe riser.
Install a new GPU card:
Note
Observe the configuration rules for this server, as described in GPU Card Configuration Rules, on page
149.
a) Align the GPU card with the socket on the riser, and then gently push the card’s edge connector into the socket. Press
evenly on both corners of the card to avoid damaging the connector.
b) Connect the GPU power cable. The straight power cable connectors are color-coded. Connect the cable's black
connector into the black connector on the GPU card and the cable's white connector into the white GPU POWER
connector on the PCIe riser.
Cisco UCS C240 M5 Server Installation and Service Guide
152
GPU Card Installation
Installing a Double-Wide GPU Card
Do not reverse the straight power cable. Connect the black connector on the cable to the black connector
on the GPU card. Connect the white connector on the cable to the white connector on the PCIe riser.
Close the card-tab retainer over the end of the card.
Swing the hinged securing plate closed on the bottom of the riser. Ensure that the clip on the plate clicks into the
locked position.
Position the PCIe riser over its socket on the motherboard and over the chassis alignment channels.
Carefully push down on both ends of the PCIe riser to fully engage its connector with the sockets on the motherboard.
At the same time, align the GPU front support bracket (on the front end of the GPU card) with the securing latch that
is on the server's air baffle.
Caution
c)
d)
e)
f)
Step 6
Insert the GPU front support bracket into the latch that is on the air baffle:
a) Pinch the latch release tab and hinge the latch toward the front of the server.
b) Hinge the latch back down so that its lip closes over the edge of the GPU front support bracket.
c) Ensure that the latch release tab clicks and locks the latch in place.
Figure 55: GPU Front Support Bracket Inserted to Securing latch on Air Baffle
1
Front end of GPU card
3
Lip on securing latch
2
GPU front support bracket
4
Securing latch release tab
Cisco UCS C240 M5 Server Installation and Service Guide
153
GPU Card Installation
Using NVIDIA GRID License Server For M-Series and P-Series GPUs
Step 7
Step 8
Step 9
Replace the top cover to the server.
Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button.
Optional: Continue with Installing Drivers to Support the GPU Cards, on page 162.
Note
If you installed an NVIDIA Tesla M-series or P-Series GPU, you must install GRID licenses to use the GRID
features. See Using NVIDIA GRID License Server For M-Series and P-Series GPUs, on page 154.
Using NVIDIA GRID License Server For M-Series and P-Series
GPUs
This section applies to NVIDIA Tesla M-Series and P-Series GPUs.
Use the topics in this section in the following order when obtaining and using NVIDIA GRID licenses.
1 Familiarize yourself with the NVIDIA GRID License Server.
NVIDIA GRID License Server Overview, on page 154
2 Register your product activation keys with NVIDIA.
Registering Your Product Activation Keys With NVIDIA, on page 156
3 Download the GRID software suite.
Downloading the GRID Software Suite, on page 156
4 Install the GRID License Server software to a host.
Installing NVIDIA GRID License Server Software, on page 156
5 Generate licenses on the NVIDIA Licensing Portal and download them.
Installing GRID Licenses From the NVIDIA Licensing Portal to the License Server, on page 158
6 Manage your GRID licenses.
Managing GRID Licenses , on page 160
NVIDIA GRID License Server Overview
The NVIDIA M-Series GPUs combine Tesla and GRID functionality when the licensed GRID features such
as GRID vGPU and GRID Virtual Workstation are enabled. These features are enabled during OS boot by
borrowing a software license that is served over the network from the NVIDIA GRID License Server virtual
appliance. The license is returned to the license server when the OS shuts down.
Cisco UCS C240 M5 Server Installation and Service Guide
154
GPU Card Installation
NVIDIA GRID License Server Overview
You obtain the licenses that are served by the GRID License Server from NVIDIA’s Licensing Portal as
downloadable license files, which you install into the GRID License Server via its management interface.
Figure 56: NVIDIA GRID Licensing Architecture
There are three editions of GRID licenses, which enable three different classes of GRID features. The GRID
software automatically selects the license edition based on the features that you are using.
GRID License Edition
GRID Feature
GRID Virtual GPU (vGPU)
Virtual GPUs for business desktop computing
GRID Virtual Workstation
Virtual GPUs for midrange workstation computing
GRID Virtual Workstation – Extended
Virtual GPUs for high-end workstation computing
Workstation graphics on GPU pass-through
Cisco UCS C240 M5 Server Installation and Service Guide
155
GPU Card Installation
Registering Your Product Activation Keys With NVIDIA
Registering Your Product Activation Keys With NVIDIA
After your order is processed, NVIDIA sends you a Welcome email that contains your product activation
keys (PAKs) and a list of the types and quantities of licenses that you purchased.
Step 1
Select the Log In link, or the Register link if you do not already have an account.
The NVIDIA Software Licensing Center > License Key Registration dialog opens.
Step 2
Complete the License Key Registration form and then click Submit My Registration Information.
The NVIDIA Software Licensing Center > Product Information Software dialog opens.
Step 3
If you have additional PAKs, click Register Additional Keys. For each additional key, complete the form on the License
Key Registration dialog and then click Submit My Registration Information.
Step 4
Agree to the terms and conditions and set a password when prompted.
Downloading the GRID Software Suite
Step 1
Step 2
Return to the NVIDIA Software Licensing Center > Product Information Software dialog.
Click the Current Releases tab.
Step 3
Click the NVIDIA GRID link to access the Product Download dialog. This dialog includes download links for:
• NVIDIA License Manager software
• The gpumodeswitch utility
• The host driver software
Step 4
Use the links to download the software.
Installing NVIDIA GRID License Server Software
For full installation instructions and troubleshooting, refer to the NVIDIA GRID License Server User Guide.
Also refer to the NVIDIA GRID License Server Release Notes for the latest information about your release.
http://www.nvidia.com
Platform Requirements for NVIDIA GRID License Server
• The hosting platform can be a physical or a virtual machine. NVIDIA recommends using a host that is
dedicated only to running the License Server.
• The hosting platform must run a supported Windows OS.
Cisco UCS C240 M5 Server Installation and Service Guide
156
GPU Card Installation
Installing NVIDIA GRID License Server Software
• The hosting platform must have a constant IP address.
• The hosting platform must have at least one constant Ethernet MAC address.
• The hosting platform’s date and time must be set accurately.
Installing GRID License Server on Windows
The License Server requires a Java runtime environment and an Apache Tomcat installation. Apache Tomcat
is installed when you use the NVIDIA installation wizard for Windows.
Step 1
Download and install the latest Java 32-bit runtime environment from https://www.oracle.com/downloads/index.html.
Note
Install the 32-bit Java Runtime Environment, regardless of whether your platform is Windows 32-bit or
64-bit.
Step 2
Create a server interface:
a) On the NVIDIA Software Licensing Center dialog, click Grid Licensing > Create License Server.
b) On the Create Server dialog, fill in your desired server details.
c) Save the .bin file that is generated onto your license server for installation.
Step 3
Step 4
Unzip the NVIDIA License Server installer Zip file that you downloaded previously and run setup.exe.
Accept the EULA for the NVIDIA License Server software and the Apache Tomcat software. Tomcat is installed
automatically during the License Server installation.
Use the installer wizard to step through the installation.
Note
On the Choose Firewall Options dialog, select the ports to be opened in the firewall. NVIDIA recommends that
you use the default setting, which opens port 7070 but leaves port 8080 closed.
Verify the installation. Open a web browser on the License Server host and connect to the URL
http://localhost:8080/licserver. If the installation was successful, you see the NVIDIA License Client Manager interface.
Step 5
Step 6
Installing GRID License Server on Linux
The License Server requires a Java runtime environment and an Apache Tomcat installation. You must install
both separately before installing the License Server on Linux.
Step 1
Verify that Java was installed with your Linux installation. Use the following command:
java -version
If no Java version is displayed, use your Linux package manager to install with the following command:
sudo yum install java
Step 2
Use your Linux package manager to install the tomcat and tomcat-webapps packages:
a) Use the following command to install Tomcat:
sudo yum install tomcat
b) Enable the Tomcat service for automatic startup on boot:
Cisco UCS C240 M5 Server Installation and Service Guide
157
GPU Card Installation
Installing GRID Licenses From the NVIDIA Licensing Portal to the License Server
sudo systemctl enable tomcat.service
c) Start the Tomcat service:
sudo systemctl start tomcat.service
d) Verify that the Tomcat service is operational. Open a web browser on the License Server host and connect to the
URL http://localhost:8080. If the installation was successful, you see the Tomcat webapp.
Step 3
Install the License Server:
a) Unpack the License Server tar file using the following command:
tar xfz NVIDIA-linux-2015.09-0001.tgz
b) Run the unpacked setup binary as root:
sudo ./setup.bin
c) Accept the EULA and then continue with the installation wizard to finish the installation.
Note
On the Choose Firewall Options dialog, select the ports to be opened in the firewall. NVIDIA recommends
that you use the default setting, which opens port 7070 but leaves port 8080 closed.
Step 4
Verify the installation. Open a web browser on the License Server host and connect to the URL
http://localhost:8080/licserver. If the installation was successful, you see the NVIDIA License Client Manager interface.
Installing GRID Licenses From the NVIDIA Licensing Portal to the License
Server
Accessing the GRID License Server Management Interface
Open a web browser on the License Server host and access the URL http://localhost:8080/licserver.
If you configured the License Server host’s firewall to permit remote access to the License Server, the
management interface is accessible from remote machines at the URL http://hostname:8080/licserver
Reading Your License Server’s MAC Address
Your License Server’s Ethernet MAC address is used as an identifier when registering the License Server
with NVIDIA’s Licensing Portal.
Step 1
Step 2
Access the GRID License Server Management Interface in a browser.
In the left-side License Server panel, select Configuration.
The License Server Configuration panel opens. Next to Server host ID, a pull-down menu lists the possible Ethernet
MAC addresses.
Step 3
Select your License Server’s MAC address from the Server host ID pull-down.
Note
It is important to use the same Ethernet ID consistently to identify the server when generating licenses on
NVIDIA’s Licensing Portal. NVIDIA recommends that you select one entry for a primary, non-removable
Ethernet interface on the platform.
Cisco UCS C240 M5 Server Installation and Service Guide
158
GPU Card Installation
Installing GRID Licenses From the NVIDIA Licensing Portal to the License Server
Installing Licenses From the Licensing Portal
Step 1
Step 2
Access the GRID License Server Management Interface in a browser.
In the left-side License Server panel, select Configuration.
The License Server Configuration panel opens.
Step 3
Use the License Server Configuration menu to install the .bin file that you generated earlier.
a) Click Choose File.
b) Browse to the license .bin file that you want to install and click Open.
c) Click Upload.
The license file is installed on your License Server. When installation is complete, you see the confirmation message,
“Successfully applied license file to license server.”
Viewing Available GRID Licenses
Use the following procedure to view which licenses are installed and available, along with their properties.
Step 1
Step 2
Access the GRID License Server Management Interface in a browser.
In the left-side License Server panel, select Licensed Feature Usage.
Step 3
Click on a feature in the Feature column to see detailed information about the current usage of that feature.
Viewing Current License Usage
Use the following procedure to view information about which licenses are currently in-use and borrowed from
the server.
Step 1
Step 2
Access the GRID License Server Management Interface in a browser.
In the left-side License Server panel, select Licensed Clients.
Step 3
To view detailed information about a single licensed client, click on its Client ID in the list.
Cisco UCS C240 M5 Server Installation and Service Guide
159
GPU Card Installation
Managing GRID Licenses
Managing GRID Licenses
Features that require GRID licensing run at reduced capability until a GRID license is acquired.
Acquiring a GRID License on Windows
Step 1
Open the NVIDIA Control Panel using one of the following methods:
• Right-click on the Windows desktop and select NVIDIA Control Panel from the menu.
• Open Windows Control Panel and double-click the NVIDIA Control Panel icon.
Step 2
In the NVIDIA Control Panel left-pane under Licensing, select Manage License.
The Manage License task pane opens and shows the current license edition being used. The GRID software automatically
selects the license edition based on the features that you are using. The default is Tesla (unlicensed).
Step 3
If you want to acquire a license for GRID Virtual Workstation, under License Edition, select GRID Virtual Workstation.
Step 4
In the License Server field, enter the address of your local GRID License Server. The address can be a domain name
or an IP address.
In the Port Number field, enter your port number of leave it set to the default used by the server, which is 7070.
Step 5
Step 6
Select Apply.
The system requests the appropriate license edition from your configured License Server. After a license is successfully
acquired, the features of that license edition are enabled.
Note
After you configure licensing settings in the NVIDIA Control Panel, the settings persist across reboots.
Acquiring a GRID License on Linux
Step 1
Edit the configuration file /etc/nvidia/gridd.conf:
sudo vi /etc/nvidia/gridd.conf
Step 2
Edit the ServerUrl line with the address of your local GRID License Server.
The address can be a domain name or an IP address. See the example file below.
Step 3
Step 4
Append the port number (default 7070) to the end of the address with a colon. See the example file below.
Edit the FeatureType line with the integer for the license type. See the example file below.
• GRID vGPU = 1
• GRID Virtual Workstation = 2
Step 5
Restart the nvidia-gridd service.
sudo service nvidia-gridd restart
Cisco UCS C240 M5 Server Installation and Service Guide
160
GPU Card Installation
Using gpumodeswitch
The service automatically acquires the license edition that you specified in the FeatureType line. You can confirm this
in /var/log/messages.
Note
After you configure licensing settings in the NVIDIA Control Panel, the settings persist across reboots.
Sample configuration file:
# /etc/nvidia/gridd.conf - Configuration file for NVIDIA Grid Daemon
# Description: Set License Server URL
# Data type: string
# Format: "<address>:<port>"
ServerUrl=10.31.20.45:7070
# Description: Set Feature to be enabled
# Data type: integer
# Possible values:
# 1 => for GRID vGPU
# 2 => for GRID Virtual Workstation
FeatureType=2
Using gpumodeswitch
The command line utility gpumodeswitch can be run in the following environments:
• Windows 64-bit command prompt (requires administrator permissions)
• Linux 32/64-bit shell (including Citrix XenServer dom0) (requires root permissions)
Note
Consult NVIDIA product release notes for the latest information on compatibility with compute and
graphic modes.
The gpumodeswitch utility supports the following commands:
• --listgpumodes
Writes information to a log file named listgpumodes.txt in the current working directory.
• --gpumode
graphics
Switches to graphics mode. Switches mode of all supported GPUs in the server unless you specify
otherwise when prompted.
• --gpumode
compute
Switches to compute mode. Switches mode of all supported GPUs in the server unless you specify
otherwise when prompted.
Cisco UCS C240 M5 Server Installation and Service Guide
161
GPU Card Installation
Installing Drivers to Support the GPU Cards
Note
After you switch GPU mode, reboot the server to ensure that the modified resources of the GPU are
correctly accounted for by any OS or hypervisor running on the server.
Installing Drivers to Support the GPU Cards
After you install the hardware, you must update to the correct level of server BIOS and then install GPU
drivers and other software in this order:
1 Update the server BIOS.
2 Update the GPU drivers.
1. Updating the Server BIOS
Install the latest Cisco UCS C240 M4 server BIOS by using the Host Upgrade Utility for the Cisco UCS C240
M4 server.
Note
You must do this procedure before you update the NVIDIA drivers.
Step 1
Navigate to the following URL: http://www.cisco.com/cisco/software/navigator.html.
Step 2
Click Servers–Unified Computing in the middle column.
Step 3
Click Cisco UCS C-Series Rack-Mount Standalone Server Software in the right-hand column.
Step 4
Step 5
Click the name of your model of server in the right-hand column.
Click Unified Computing System (UCS) Server Firmware.
Step 6
Step 7
Click the release number.
Click Download Now to download the ucs-server
Step 8
Verify the information on the next page, and then click Proceed With Download.
Step 9
Continue through the subsequent screens to accept the license agreement and browse to a location where you want to
save the file.
Use the Host Upgrade Utility to update the server BIOS.
The user guides for the Host Upgrade Utility are at Utility User Guides.
Step 10
Cisco UCS C240 M5 Server Installation and Service Guide
162
platform-huu-version_number.iso
file.
GPU Card Installation
2. Updating the GPU Card Drivers
2. Updating the GPU Card Drivers
After you update the server BIOS, you can install GPU drivers to your hypervisor virtual machine.
Step 1
Step 2
Step 3
Install your hypervisor software on a computer. Refer to your hypervisor documentation for the installation instructions.
Create a virtual machine in your hypervisor. Refer to your hypervisor documentation for instructions.
Install the GPU drivers to the virtual machine. Download the drivers from either:
• http://www.nvidia.com/Download/index.aspx
• http://support.amd.com/en-us/download
Step 4
Step 5
Restart the server.
Check that the virtual machine is able to recognize the GPU card. In Windows, use the Device Manager and look under
Display Adapters.
Cisco UCS C240 M5 Server Installation and Service Guide
163
GPU Card Installation
2. Updating the GPU Card Drivers
Cisco UCS C240 M5 Server Installation and Service Guide
164
APPENDIX
D
Installation For Cisco UCS Manager Integration
• Installation For Cisco UCS Manager Integration, page 165
Installation For Cisco UCS Manager Integration
The Cisco UCS Manager integration instructions are in the integration guides found here:
Cisco UCS C-Series Server Integration with UCS Manager Configuration Guides
Refer to the guide that is for the version of Cisco UCS Manager that you are using.
Also refer to the release notes for Cisco UCS Manager software and C-Series Cisco IMC software for any
special considerations regarding integration in your release.
• Cisco UCS Manager Release Notes
• Cisco C-Series Software Release Notes
Cisco UCS C240 M5 Server Installation and Service Guide
165
Installation For Cisco UCS Manager Integration
Installation For Cisco UCS Manager Integration
Cisco UCS C240 M5 Server Installation and Service Guide
166
Download PDF
Similar pages