Fujitsu PRIMERGY CX2570 M1 Manual
Fujitsu PRIMERGY CX2570 M1 is a high-performance server node designed for demanding workloads. It features the latest Intel Xeon processors, up to 1TB of DDR4 memory, and a variety of storage options. The CX2570 M1 is ideal for use as a virtualization host, database server, or web server. It is also a great choice for high-performance computing applications.
Advertisement
Advertisement
Upgrade and Maintenance Manual - English
PRIMERGY CX2570 M1
Server Node
Upgrade and Maintenance Manual
Edition November 2015
Comments
…
Suggestions
…
Corrections
…
The User Documentation Department would like to know your opinion of this manual. Your feedback helps us optimize our documentation to suit your individual needs.
Feel free to send us your comments by e-mail to [email protected]
.
Certified documentation according to DIN EN ISO 9001:2008
To ensure a consistently high quality standard and user-friendliness, this documentation was created to meet the regulations of a quality management system which complies with the requirements of the standard
DIN EN ISO 9001:2008. cognitas. Gesellschaft für Technik-Dokumentation mbH www.cognitas.de
Copyright and Trademarks
Copyright © 2015 Fujitsu Technology Solutions GmbH.
All rights reserved.
Delivery subject to availability; right of technical modifications reserved.
All hardware and software names used are trademarks of their respective manufacturers.
– The contents of this manual may be revised without prior notice.
– Fujitsu assumes no liability for damages to third party copyrights or other rights arising from the use of any information in this manual.
– No part of this manual may be reproduced in any form without the prior written permission of Fujitsu.
Microsoft, Windows, Windows Server, and Hyper V are trademarks or registered trademarks of
Microsoft Corporation in the USA and other countries.
Intel and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the USA and other countries.
Before reading this manual
For your safety
This manual contains important information for safely and correctly using this product.
Carefully read the manual before using this product. Pay particular attention to the accompanying manual "Safety Notes and Regulations" and ensure these safety notes are understood before using the product. Keep this manual and the manual "Safety Notes and Regulations" in a safe place for easy reference while using this product.
Radio interference
This product is a "Class A" ITE (Information Technology Equipment). In a domestic environment this product may cause radio interference, in which case the user may be required to take appropriate measures.
VCCI-A
Aluminum electrolytic capacitors
The aluminum electrolytic capacitors used in the product's printed circuit board assemblies and in the mouse and keyboard are limited-life components. Use of these components beyond their operating life may result in electrolyte leakage or depletion, potentially causing emission of foul odor or smoke.
As a guideline, in a normal office environment (25°C) operating life is not expected to be reached within the maintenance support period (5 years).
However, operating life may be reached more quickly if, for example, the product is used in a hot environment. The customer shall bear the cost of replacing replaceable components which have exceeded their operating life.
Note that these are only guidelines, and do not constitute a guarantee of trouble-free operation during the maintenance support period.
High safety use
This product has been designed and manufactured to be used in commercial and/or industrial areas as a server.
When used as visual display workplace, it must not be placed in the direct field of view to avoid incommoding reflections (applies only to TX server systems).
The device has not been designed or manufactured for uses which demand an extremely high level of safety and carry a direct and serious risk of life or body if such safety cannot be assured.
CX2570 M1 Upgrade and Maintenance Manual
These uses include control of nuclear reactions in nuclear power plants, automatic airplane flight control, air traffic control, traffic control in mass transport systems, medical devices for life support, and missile guidance control in weapons systems (hereafter, "high safety use"). Customers should not use this product for high safety use unless measures are in place for ensuring the level of safety demanded of such use. Please consult the sales staff of Fujitsu if intending to use this product for high safety use.
Measures against momentary voltage drop
This product may be affected by a momentary voltage drop in the power supply caused by lightning. To prevent a momentary voltage drop, use of an AC uninterruptible power supply is recommended.
(This notice follows the guidelines of Voltage Dip Immunity of Personal
Computer issued by JEITA, the Japan Electronics and Information Technology
Industries Association.)
Technology controlled by the Foreign Exchange and Foreign Trade
Control Law of Japan
Documents produced by Fujitsu may contain technology controlled by the
Foreign Exchange and Foreign Trade Control Law of Japan. Documents which contain such technology should not be exported from Japan or transferred to non-residents of Japan without first obtaining authorization in accordance with the above law.
Harmonic Current Standards
This product conforms to harmonic current standard JIS C 61000-3-2.
Only for the Japanese market: About SATA hard disk drives
The SATA version of this server supports hard disk drives with SATA / BC-SATA storage interfaces. Please note that the usage and operation conditions differ depending on the type of hard disk drive used.
Please refer to the following internet address for further information on the usage and operation conditions of each available type of hard disk drive: http://primeserver.fujitsu.com/primergy/harddisk/
Upgrade and Maintenance Manual CX2570
Only for the Japanese market:
I
Although described in this manual, some sections do not apply to the
Japanese market. These options and routines include:
– CSS (Customer Self Service)
CX2570 M1 Upgrade and Maintenance Manual
Version history
Issue number
1.0 / October 2014
Reason for update
Initial release
2.0 / January 2015
3.0 / March 2015
Chapters 5.2.18, 8.2.7, 8.3.4, 9.2.2.3, 9.3.2.3,
9.3.1.5, 9.3.3.5
Chapters 2, 9, 10, 11
4.0 / November 2015 Chapters 7, 8, 11, 13
Upgrade and Maintenance Manual CX2570
Contents
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Notational conventions . . . . . . . . . . . . . . . . . . . . 16
Before you start . . . . . . . . . . . . . . . . . . . . . . . . 17
Classification of procedures . . . . . . . . . . . . . . . . . 19
Customer Replaceable Units (CRU) . . . . . . . . . . . . . . . 19
Upgrade and Repair Units (URU) . . . . . . . . . . . . . . . . 20
Field Replaceable Units (FRU) . . . . . . . . . . . . . . . . . 21
Average task duration . . . . . . . . . . . . . . . . . . . . . 22
Tools you need at hand . . . . . . . . . . . . . . . . . . . . 23
Documents you need at hand . . . . . . . . . . . . . . . . . 23
Documents for the server node . . . . . . . . . . . . . . . . . 25
Documents for the server enclosure . . . . . . . . . . . . . . . 26
Important information . . . . . . . . . . . . . . . . . . . . . 27
Safety instructions . . . . . . . . . . . . . . . . . . . . . . . 27
CE conformity . . . . . . . . . . . . . . . . . . . . . . . . . 35
FCC Class A Compliance Statement . . . . . . . . . . . . . 36
Environmental protection . . . . . . . . . . . . . . . . . . . 37
Basic hardware procedures . . . . . . . . . . . . . . . . . . 39
Shutting down the server node . . . . . . . . . . . . . . . . 39
Removing the server node from the server enclosure . . . 40
Removing the GPGPU extension . . . . . . . . . . . . . . . 41
Removing the riser module . . . . . . . . . . . . . . . . . . 42
Installing the riser module . . . . . . . . . . . . . . . . . . . 44
Replacing the riser card . . . . . . . . . . . . . . . . . . . . 46
CX2570 M1 Upgrade and Maintenance Manual
Contents
Mounting a controller to the riser module . . . . . . . . . . . 47
Removing a controller from the riser module . . . . . . . . . 48
Removing the memory slot air ducts . . . . . . . . . . . . . . 49
Installing the memory slot air ducts . . . . . . . . . . . . . . 50
Design of the memory air ducts . . . . . . . . . . . . . . . . . . 50
Installing the GPGPU extension . . . . . . . . . . . . . . . . 51
Installing the server node in the server enclosure . . . . . . 54
Controls and indicators on the server node . . . . . . . . . . 55
Concluding software tasks . . . . . . . . . . . . . . . . . . . 55
5 Basic software procedures . . . . . . . . . . . . . . . . . . . 57
Starting the maintenance task . . . . . . . . . . . . . . . . . 57
Suspending BitLocker functionality . . . . . . . . . . . . . . . . 57
Disabling SVOM boot watchdog functionality . . . . . . . . . . . 58
Viewing boot watchdog settings . . . . . . . . . . . . . . . . 58
Configuring boot watchdog settings . . . . . . . . . . . . . . 59
Configuring LAN teaming . . . . . . . . . . . . . . . . . . . . . 61
Note on server maintenance in a Multipath I/O environment . . . 61
Switching on the ID indicator . . . . . . . . . . . . . . . . . . . 64
Completing the maintenance task . . . . . . . . . . . . . . . 65
Updating or recovering the system board BIOS and iRMC . . . . 65
Updating or recovering the system board BIOS . . . . . . . . 65
Updating or recovering the iRMC . . . . . . . . . . . . . . . 69
Verifying system information backup / restore . . . . . . . . . . 71
Updating RAID controller firmware . . . . . . . . . . . . . . . . 71
Enabling Option ROM scan . . . . . . . . . . . . . . . . . . . . 72
Resetting the boot retry counter . . . . . . . . . . . . . . . . . 74
Viewing the boot retry counter . . . . . . . . . . . . . . . . 74
Resetting the boot retry counter . . . . . . . . . . . . . . . . 74
Enabling SVOM boot watchdog functionality . . . . . . . . . . . 76
Enabling replaced components in the system BIOS . . . . . . . 76
Verifying the memory mode . . . . . . . . . . . . . . . . . . . . 78
Verifying the system time settings . . . . . . . . . . . . . . . . 79
Viewing and clearing the System Event Log (SEL) . . . . . . . . 80
Viewing the SEL . . . . . . . . . . . . . . . . . . . . . . . . 80
Clearing the SEL . . . . . . . . . . . . . . . . . . . . . . . 81
Updating the NIC configuration file in a Linux environment . . . . 81
Upgrade and Maintenance Manual CX2570
Contents
Resuming BitLocker functionality . . . . . . . . . . . . . . . . 83
Performing a RAID array rebuild . . . . . . . . . . . . . . . . . 84
Looking up changed MAC / WWN addresses . . . . . . . . . . 84
Looking up MAC addresses . . . . . . . . . . . . . . . . . 84
Looking up WWN addresses . . . . . . . . . . . . . . . . . 85
Using the Chassis ID Prom Tool . . . . . . . . . . . . . . . . . 86
Configuring LAN teaming . . . . . . . . . . . . . . . . . . . . 86
After replacing / upgrading LAN controllers . . . . . . . . . 87
After replacing the system board . . . . . . . . . . . . . . . 87
Switching off the ID indicator . . . . . . . . . . . . . . . . . . 87
Performing a fan test . . . . . . . . . . . . . . . . . . . . . . 88
Memory modules . . . . . . . . . . . . . . . . . . . . . . . 90
Processors . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Expansion cards . . . . . . . . . . . . . . . . . . . . . . . . 95
Basic information . . . . . . . . . . . . . . . . . . . . . . . 96
Additional tasks . . . . . . . . . . . . . . . . . . . . . . . . 99
Mounting expansion card slot brackets . . . . . . . . . . . . . 99
General instructions . . . . . . . . . . . . . . . . . . . . . 99
Network adapter D2755 . . . . . . . . . . . . . . . . . . . 100
Handling SFP+ transceiver modules . . . . . . . . . . . . . . 102
Installing SFP+ transceiver modules . . . . . . . . . . . . . 102
Removing an SFP+ transceiver module . . . . . . . . . . . 107
Replacing SFP+ transceiver modules . . . . . . . . . . . . 110
Expansion cards in the riser module . . . . . . . . . . . . . 111
Installing expansion cards . . . . . . . . . . . . . . . . . . . . 112
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 112
Mounting a controller to the riser module . . . . . . . . . . 113
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 113
Removing expansion cards . . . . . . . . . . . . . . . . . . . 114
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 114
Removing a controller from the riser module . . . . . . . . 115
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 115
Replacing expansion cards . . . . . . . . . . . . . . . . . . . 116
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 116
Removing an expansion card . . . . . . . . . . . . . . . . 116
Installing an expansion card . . . . . . . . . . . . . . . . . 117
CX2570 M1 Upgrade and Maintenance Manual
Contents
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 117
Riser card . . . . . . . . . . . . . . . . . . . . . . . . . . . 118
Replacing the riser card . . . . . . . . . . . . . . . . . . . . . 118
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 118
Replacing the riser card . . . . . . . . . . . . . . . . . . . 119
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 120
Main memory . . . . . . . . . . . . . . . . . . . . . . . . . 121
Basic information . . . . . . . . . . . . . . . . . . . . . . . 122
Memory sequence . . . . . . . . . . . . . . . . . . . . . . . 122
Operation modes . . . . . . . . . . . . . . . . . . . . . . . . 124
Installing memory modules . . . . . . . . . . . . . . . . . . 125
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 125
Installing a memory module . . . . . . . . . . . . . . . . . . . 126
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 127
Removing memory modules . . . . . . . . . . . . . . . . . 128
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 128
Removing a memory module . . . . . . . . . . . . . . . . . . 129
Concluding step . . . . . . . . . . . . . . . . . . . . . . . . . 130
Replacing memory modules . . . . . . . . . . . . . . . . . 131
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 131
Removing a memory module . . . . . . . . . . . . . . . . . . 132
Installing a memory module . . . . . . . . . . . . . . . . . . . 132
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 132
Processors . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
Basic information . . . . . . . . . . . . . . . . . . . . . . . 134
Supported processors . . . . . . . . . . . . . . . . . . . . . 134
Processor locations . . . . . . . . . . . . . . . . . . . . . . . 134
Replacing processors . . . . . . . . . . . . . . . . . . . . . 135
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 135
Removing processor heat sinks . . . . . . . . . . . . . . . . 136
Removing the processor heat sinks . . . . . . . . . . . . . 136
Removing the processor . . . . . . . . . . . . . . . . . . . . 137
Installing the processor . . . . . . . . . . . . . . . . . . . . . 141
Applying thermal paste . . . . . . . . . . . . . . . . . . . . . 144
Upgrade and Maintenance Manual CX2570
Contents
Installing the processor heat sink . . . . . . . . . . . . . . . . 146
Processor heat sink CPU1 . . . . . . . . . . . . . . . . . . 146
Processor heat sink CPU2 . . . . . . . . . . . . . . . . . . 147
Installing the heat sinks . . . . . . . . . . . . . . . . . . . 147
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 149
Replacing the processor heat sink . . . . . . . . . . . . . . 150
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 150
Removing the processor heat sink . . . . . . . . . . . . . . . 150
Installing the processor heat sink . . . . . . . . . . . . . . . . 150
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 151
System board and components . . . . . . . . . . . . . . . . 153
Replacing the CMOS battery . . . . . . . . . . . . . . . . . 153
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 154
Localization of the CMOS battery . . . . . . . . . . . . . . 155
Removing the CMOS battery . . . . . . . . . . . . . . . . . . 156
Installing the CMOS battery . . . . . . . . . . . . . . . . . . . 157
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 158
SATA DOM . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
Installing the SATA DOM board . . . . . . . . . . . . . . . . . 159
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 159
Installing the SATA DOM . . . . . . . . . . . . . . . . . . . 160
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 164
Removing the SATA DOM . . . . . . . . . . . . . . . . . . . . 165
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 165
Removing the SATA DOM . . . . . . . . . . . . . . . . . . 166
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 167
Replacing the SATA DOM . . . . . . . . . . . . . . . . . . . . 168
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 168
Removing the SATA DOM . . . . . . . . . . . . . . . . . . 168
Re-installing the SATA DOM . . . . . . . . . . . . . . . . . 169
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 169
USB Flash Module (UFM) . . . . . . . . . . . . . . . . . . . 170
Installing the UFM board . . . . . . . . . . . . . . . . . . . . . 170
Required tools . . . . . . . . . . . . . . . . . . . . . . . . 170
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 170
Installing the UFM board . . . . . . . . . . . . . . . . . . . 171
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 174
Software configuration . . . . . . . . . . . . . . . . . . . . 174
CX2570 M1 Upgrade and Maintenance Manual
Contents
Removing the UFM board . . . . . . . . . . . . . . . . . . . 175
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 175
Removing the UFM board . . . . . . . . . . . . . . . . . . 176
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 177
Replacing the UFM board . . . . . . . . . . . . . . . . . . . . 178
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 178
Removing the UFM . . . . . . . . . . . . . . . . . . . . . 178
Re-installing the UFM . . . . . . . . . . . . . . . . . . . . 179
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 180
Software configuration . . . . . . . . . . . . . . . . . . . 180
iRMC microSD card . . . . . . . . . . . . . . . . . . . . . . 181
Installing the iRMC microSD card . . . . . . . . . . . . . . . . 181
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 181
Installing the iRMC microSD card . . . . . . . . . . . . . . 182
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 182
Removing the iRMC microSD card . . . . . . . . . . . . . . . 183
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 183
Removing the iRMC microSD card . . . . . . . . . . . . . 183
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 184
Replacing the iRMC microSD card . . . . . . . . . . . . . . . 185
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 185
Replacing the iRMC microSD card . . . . . . . . . . . . . 185
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 185
Replacing the system board . . . . . . . . . . . . . . . . . 186
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 187
Replacing the system board . . . . . . . . . . . . . . . . . . 187
Removing the system board . . . . . . . . . . . . . . . . 188
Installing the system board . . . . . . . . . . . . . . . . . 190
Swapping processors . . . . . . . . . . . . . . . . . . . . 191
Completing the system board . . . . . . . . . . . . . . . . 192
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 193
10 GPGPU Extension . . . . . . . . . . . . . . . . . . . . . . . 195
Basic information . . . . . . . . . . . . . . . . . . . . . . . 196
Installing Xeon Phi . . . . . . . . . . . . . . . . . . . . . . 197
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 197
Installing Xeon Phi to slot GPGPU 2 . . . . . . . . . . . . . . 197
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 199
Upgrade and Maintenance Manual CX2570
Contents
Removing Xeon Phi from slot GPGPU 2 . . . . . . . . . . . 199
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 199
Removing Xeon Phi . . . . . . . . . . . . . . . . . . . . . . . 200
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 201
Replacing Xeon Phi in slot GPGPU 2 . . . . . . . . . . . . . 202
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 202
Removing Xeon Phi . . . . . . . . . . . . . . . . . . . . . . . 202
Installing Xeon Phi . . . . . . . . . . . . . . . . . . . . . . . . 202
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 203
Installing Xeon Phi in slot GPGPU 1 . . . . . . . . . . . . . 203
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 203
Installing Xeon Phi (slot GPGPU 1) . . . . . . . . . . . . . . . 204
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 208
Removing Xeon Phi from slot GPGPU 1 . . . . . . . . . . . 209
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 209
Removing Xeon Phi (GPGPU1) . . . . . . . . . . . . . . . . . 209
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 211
Replacing GPGPU 1 . . . . . . . . . . . . . . . . . . . . . . 212
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 212
Removing the GPGPU 1 . . . . . . . . . . . . . . . . . . . . . 212
Installing the GPGPU 1 . . . . . . . . . . . . . . . . . . . . . 212
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 213
Power cables . . . . . . . . . . . . . . . . . . . . . . . . . . 214
11 Liquid cooling . . . . . . . . . . . . . . . . . . . . . . . . . 217
Liquid cooling kit for GPGPU extension . . . . . . . . . . . 217
Basic information . . . . . . . . . . . . . . . . . . . . . . . . 217
Replacing the liquid cooling kit . . . . . . . . . . . . . . . . . 220
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 220
Removing the liquid cooling kit . . . . . . . . . . . . . . . . 221
Installing a liquid cooling kit . . . . . . . . . . . . . . . . . 225
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 230
Liquid cooling kit for the server node . . . . . . . . . . . . 231
Basic information . . . . . . . . . . . . . . . . . . . . . . . . 231
Main components of the server node . . . . . . . . . . . . 231
Riser module for the liquid cooling kit . . . . . . . . . . . . 232
Liquid cooling kit . . . . . . . . . . . . . . . . . . . . . . . 232
CX2570 M1 Upgrade and Maintenance Manual
Contents
Replacing the liquid cooling kit . . . . . . . . . . . . . . . . . 233
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 233
Removing the liquid cooling kit . . . . . . . . . . . . . . . 233
Installing a liquid cooling kit . . . . . . . . . . . . . . . . . 236
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 242
Cooling pads on the memory modules . . . . . . . . . . . 243
Basic information . . . . . . . . . . . . . . . . . . . . . . . . 243
Adhesive rules for the memory cooling pads . . . . . . . . 244
Preparing the memory modules . . . . . . . . . . . . . . . . 246
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 246
Preparing a memory module . . . . . . . . . . . . . . . . 246
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 246
12 Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
Cabling overview . . . . . . . . . . . . . . . . . . . . . . . 250
Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
Cabling for HDD 2.5" . . . . . . . . . . . . . . . . . . . . . 252
Cabling onboard . . . . . . . . . . . . . . . . . . . . . . . . 252
Cabling with RAID-Controller . . . . . . . . . . . . . . . . . . 253
13 Appendix . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255
Mechanical overview . . . . . . . . . . . . . . . . . . . . . 255
CX2570 M1 server node complete system . . . . . . . . . . . 255
Server node interior . . . . . . . . . . . . . . . . . . . . . . . 256
Server node rear . . . . . . . . . . . . . . . . . . . . . . . . 257
Connectors and indicators . . . . . . . . . . . . . . . . . . 258
Connectors and indicators on the system board . . . . . . . . 258
Onboard connectors . . . . . . . . . . . . . . . . . . . . . 258
Onboard settings . . . . . . . . . . . . . . . . . . . . . . 260
Connector panel . . . . . . . . . . . . . . . . . . . . . . . . 262
Controls and indicators . . . . . . . . . . . . . . . . . . . 262
Control elements . . . . . . . . . . . . . . . . . . . . . . 262
Global error indicator, ID indicator, CSS indicator . . . . . . 263
LAN indicators . . . . . . . . . . . . . . . . . . . . . . . . 264
Minimum startup configuration . . . . . . . . . . . . . . . . 265
Upgrade and Maintenance Manual
1 Introduction
This Upgrade and Maintenance Manual provides instructions for the following procedures:
●
●
Upgrading the server configuration by adding optional hardware components
Upgrading the server configuration by replacing existing hardware components with superior ones.
● Replacing defective hardware components
This manual focuses on on-site maintenance tasks. It is recommended to prepare each service assignment following remote diagnostics procedures, as described in the "ServerView Suite Local Service Concept (LSC)" manual (see section
"Documents you need at hand" on page 23
.
V
CAUTION!
The document at hand comprises procedures of a wide range of complexity. Check the profile of qualification for technicians before assigning tasks. Before you start, carefully read
"Classification of procedures" on page 19
.
CX2570 M1 Upgrade and Maintenance Manual 15
Introduction
1.1
Notational conventions
The following notational conventions are used in this manual:
Text in italics fixed font indicates commands or menu items indicates system output indicates text to be entered by the user semi-bold fixed font
"Quotation marks" indicate names of chapters and terms that are being emphasized
Ê describes activities that must be performed in the order shown
[Abc] indicates keys on the keyboard
V
CAUTION!
Pay particular attention to texts marked with this symbol!
Failure to observe this warning may endanger your life, destroy the system or lead to the loss of data.
I indicates additional information, notes and tips indicates the procedure category in terms of complexity and qualification requirements, see
"Classification of procedures" on page 19
indicates the average task duration, see
"Average task duration" on page 22
16 Upgrade and Maintenance Manual CX2570
2 Before you start
Before you start any upgrade or maintenance task, please proceed as follows:
Ê
Carefully read the safety instructions in chapter "Important information" on page 27 .
Ê
Make sure that all necessary manuals are available. Refer to the documentation overview in section
"Documents you need at hand" on page 23 . Print the PDF files if required.
Ê
Make yourself familiar with the procedure categories introduced in section
"Classification of procedures" on page 19 .
Ê
Ensure that all required tools are available according to section
"Tools you need at hand" on page 23 .
V
CAUTION
In a system that has the Cool-safe
®
Advanced Thermal Design option, only components that support the higher operating range may be installed. Further information on this is available in the configurator.
The Cool-safe
®
Advanced Thermal Design option can only be ordered from the manufacturer and is indicated by the logo on the identification rating plate.
Installing optional components
The operating manual of your server node gives an introduction to server node features and provides an overview of available hardware options.
Use the Fujitsu ServerView Suite management software and the iRMC web frontend to prepare hardware expansions. ServerView Suite documentation is available online at http://manuals.ts.fujitsu.com
( http://jp.fujitsu.com/platform/server/primergy/manual/ for the Japanese market).
Please refer to the following ServerView Suite topics:
– Operation
– Virtualization
– Maintenance
– Out-Of-Band Management
CX2570 M1 Upgrade and Maintenance Manual 17
Before you start
I
For the latest information on hardware options, refer to your server’s hardware configurator available online at the following address: for the EMEA market: http://ts.fujitsu.com/products/standard_servers/index.htm
for the Japanese market: http://jp.fujitsu.com/platform/server/primergy/system/
Please contact your local Fujitsu customer service partner for details on how to order expansion kits or spare parts. Use the Fujitsu Illustrated Spares Catalog to identify the required spare part and obtain technical data and order information. Illustrated Spares catalogs are available online at http://manuals.ts.fujitsu.com/illustrated_spares (EMEA market only).
18 Upgrade and Maintenance Manual CX2570
Before you start
2.1
Classification of procedures
The complexity of maintenance procedures varies significantly. Procedures have been assigned to one of three unit categories, indicating the level of difficulty and required qualification.
At the beginning of each procedure, the involved unit type is indicated by one of the symbols introduced in this section.
I
Please ask your local Fujitsu service center for more detailed information.
2.1.1
Customer Replaceable Units (CRU)
Customer Replaceable Units (CRU)
Customer Replaceable Units are intended for customer self service and may be installed or replaced as hot-plug components during operation.
I
Components that the customer is entitled to replace may differ according to the service form in his country.
Hot-plug components increase system availability and guarantee a high degree of data integrity and fail-safe performance. Procedures can be carried out without shutting down the server or going offline.
Components that are handled as Customer Replaceable Units
– Hot-plug power supply units
– Hot-plug HDD / SSD modules
Peripherals that are handled as Customer Replaceable Units
– Keyboard
– Mouse
CX2570 M1 Upgrade and Maintenance Manual 19
Before you start
2.1.2
Upgrade and Repair Units (URU)
Upgrade and Repair Units (URU)
Upgrade and Repair Units are non hot-plug components that can be ordered separately to be installed as options ( Upgrade Units ) or are available to the customer through customer self service ( Repair Units ).
I
Server management error messages and diagnostic indicators on the front panel and system board will report defective Upgrade and Repair
Units as customer replaceable CSS components.
Upgrade and repair procedures involve shutting down and opening the server.
V
CAUTION!
The device may be seriously damaged or cause damage if it is opened without authorization or if repairs are attempted by unauthorized and untrained personnel.
Components that are handled as Upgrade Units
– Expansion cards
– Memory modules
– USB Flash Module (UFM)
– SATA DOM
– iRMC micro SD card
Components that are handled solely as Repair Units
– CMOS battery
20 Upgrade and Maintenance Manual CX2570
Before you start
2.1.3
Field Replaceable Units (FRU)
Field Replaceable Units (FRU)
Removing and installing Field Replaceable Units involves complex maintenance procedures on integral server components. Procedures will require shutting down, opening and disassembling the server.
V
CAUTION!
Maintenance procedures involving Field Replaceable Units must be performed exclusively by Fujitsu service personnel or technicians trained by Fujitsu. Please note that unauthorized interference with the system will void the warranty and exempt the manufacturer from all liability.
Components that are handled as Field Replaceable Units
– Processors (replacements)
– System board
I
Please ask your local Fujitsu service center for more detailed information.
CX2570 M1 Upgrade and Maintenance Manual 21
Before you start
2.2
Average task duration
Average task duration: 10 minutes
The average task duration including preliminary and concluding steps is indicated at the beginning of each procedure next to the procedure class.
Refer to table 1 on page 22 for an overview of steps taken into account for
calculating the average task duration:
Step
Server node shutdown
Rack removal, disassembly
Transport
Maintenance procedures
Transport
Assembly, rack installation
Starting up included Explanation
Shutdown time depends on hardware and software configuration and may vary significantly.
no
Software tasks necessary before maintenance are described in section
"Completing the maintenance task" on page 65
".
yes no yes
Making the server available, removing the server from the rack (if applicable).
Transporting the server to the service table
(where required) depends on local customer conditions.
Maintenance procedures including preliminary and concluding software tasks.
no yes no
Returning the server to its installation site
(where required) depends on local customer conditions.
Reassembling the server, installing the server in the rack (if applicable).
Booting time depends on hardware and software configuration and may vary significantly.
Table 1: Calculation of the average task duration
22 Upgrade and Maintenance Manual CX2570
Before you start
2.3
Tools you need at hand
When preparing the maintenance task, ensure that all required tools are available according to the overview below. You will find a list of required tools at the beginning of each procedure.
Screw driver /
Bit insert
Screw Usage Type
Phillips
PH1 / (+) No. 1
UFM / SATA
DOM nylon screw
M3 x 4.5 mm
(white)
A3C40109082
Phillips
PH2 / (+) No. 2 hexagonal cross
SW5 / PZ2
Network controller
M3 x 4.5 mm
GPGPU fixing bracket
C26192-Y10-C67 hexagonal cross
SW5
M3 x 4.5 mm
System board
C26192-Y10-C67
Table 2: List of required tools and used screws
2.4
Documents you need at hand
Maintenance procedures may include references to additional documentation.
When preparing the maintenance task, ensure that all required manuals are available according to the overview below.
I
– Ensure to store all printed manuals enclosed with your server in a save place for future reference.
– Unless stated otherwise, all manuals are available online at http://manuals.ts.fujitsu.com
under x86 servers .
CX2570 M1 Upgrade and Maintenance Manual 23
Before you start
For the Japanese market please use the following address: http://jp.fujitsu.com/platform/server/primergy/manual/
24 Upgrade and Maintenance Manual CX2570
Before you start
2.4.1
Documents for the server node
Document
"ServerView Quick Start Guide"
Description
Quick installation poster for initial operation, available online
"Safety notes and regulations" manual
" 安全上のご注意 " for the
Japanese market
"FUJITSU Server PRIMERGY
CX2570 M1 Server Node"
Operating Manual
"D3343 BIOS Setup Utility for
FUJITSU Server PRIMERGY
CX2570 M1" Reference Manual
Important safety information, available online or as a printed copy
Available online
Information on configurable BIOS options and parameters, available online
– "ServerView Suite Local Service
Concept (LSC)" user guide
Software documentation
Illustrated Spares catalog
– "ServerView Operations Manager -
Server Management" user guide
Spare parts identification and information system (EMEA market only), available for online use or download (Windows OS) at http://manuals.ts.fujitsu.com/illustrated_spares or from the CSS component view of the
ServerView Operations Manager
Available online Glossary
"Warranty" manual
" 保証書 " for the Japanese market
"Returning used devices" manual
"Service Desk" leaflet
Important information on warranty regulations, recycling and service, available online or as a printed copy
Recycling and contact information, available online or as a printed copy
" サポート&サービス " for the
Japanese market
Table 3: Documentation you need at hand for the server node
CX2570 M1 Upgrade and Maintenance Manual 25
Before you start
Document
Additional documentation
Third party documentation
Description
– RAID documentation, available online at http://manuals.ts.fujitsu.com
under x86 servers - Expansion Cards - Storage
Adapters
– Operating system documentation, online help
– Peripherals documentation
Table 3: Documentation you need at hand for the server node
2.4.2
Documents for the server enclosure
Document
"Quick Start Hardware -
FUJITSU Server PRIMERGY
CX400 M1" leaflet
"FUJITSU Server PRIMERGY
CX400 M1 Server Enclosure"
Upgrade and Maintenance
Manual
"FUJITSU Server PRIMERGY
CX400 M1 Server Enclosure"
Operating Manual
Description
Available online
Available online
Available online
Table 4: Documentation you need at hand for the server enclosure
26 Upgrade and Maintenance Manual CX2570
3 Important information
V
CAUTION!
Before installing and starting up a device, please observe the safety instructions listed in the following section. This will help you to avoid making serious errors that could impair your health, damage the device and endanger the data base.
3.1
Safety instructions
I
The following safety instructions are also provided in the manual "Safety
Notes and Regulations" or " 安全上のご注意 ".
This device meets the relevant safety regulations for IT equipment. If you have any questions about whether you can install the server in the intended environment, please contact your sales outlet or our customer service team.
● The actions described in this manual shall be performed by technical specialists. A technical specialist is a person who is trained to install the server including hardware and software.
●
●
●
Repairs to the device that do not relate to CSS failures shall be performed by service personnel. Please note that unauthorized interference with the system will void the warranty and exempt the manufacturer from all liability.
Any failure to observe the guidelines in this manual, and any improper repairs could expose the user to risks (electric shock, energy hazards, fire hazards) or damage the equipment.
Before installing/removing internal options to/from the server, turn off the server, all peripheral devices, and any other connected devices. Also unplug all power cords from the power outlet. Failure to do so can cause electric shock or damage.
CX2570 M1 Upgrade and Maintenance Manual 27
Important information
Before starting up
●
●
●
During installation and before operating the device, observe the instructions on environmental conditions for your device.
If the device is brought in from a cold environment, condensation may form both inside and on the outside of the device.
Wait until the device has acclimatized to room temperature and is absolutely dry before starting it up. Material damage may be caused to the device if this requirement is not observed.
Transport the device only in the original packaging or in packaging that protects it from knocks and jolts.
For the Japanese market, transporting the device in its original packaging does not apply.
Installation and operation
● This unit should not be operated in ambient temperatures above 35 °C. For servers with Cool-safe
®
Advanced Thermal Design the ambient temperature can increase to 40 °C.
●
●
If the unit is integrated into an installation that draws power from an industrial power supply network with an IEC309 connector, the power supply's fuse protection must comply with the requirements for non-industrial power supply networks for type A connectors.
The unit automatically adjusts itself to a mains voltage in a range of 100 VAC to 240 VAC. Ensure that the local mains voltage lies within these limits.
●
●
●
●
This device must only be connected to properly grounded power outlets or connected to the grounded rack internal power distribution system with tested and approved power cords.
Ensure that the device is connected to a properly grounded power outlet close to the device.
Ensure that the power sockets on the device and the properly grounded power outlets are easily accessible.
The On/Off button or the main power switch (if present) does not isolate the device from the mains power supply. In case of repair or servicing disconnect the device completely from the mains power supply, unplug all power plugs from the properly grounded power outlets.
28 Upgrade and Maintenance Manual CX2570
Important information
●
●
●
●
●
●
●
●
●
●
●
Always connect the server and the attached peripherals to the same power circuit. Otherwise you run the risk of losing data if, for example, the server is still running but a peripheral device (e.g. memory subsystem) fails during a power outage.
Data cables must be adequately shielded.
Ethernet cabling has to comply with EN 50173 and EN 50174-1/2 standards or ISO/IEC 11801 standard respectively. The minimum requirement is a
Category 5 shielded cable for 10/100 Ethernet, or a Category 5e cable for
Gigabit Ethernet.
Route the cables in such a way that they do not create a potential hazard
(make sure no-one can trip over them) and that they cannot be damaged.
When connecting the server, refer to the relevant instructions in this manual.
Never connect or disconnect data transmission lines during a storm (risk of lightning hazard).
Make sure that no objects (e.g. jewelry, paperclips etc.) or liquids can get inside the server (risk of electric shock, short circuit).
In emergencies (e.g. damaged casing, controls or cables, penetration of liquids or foreign bodies), contact the system administrator or your customer service team. Only disconnect the system from the mains power supply if there is no risk of harming yourself.
Proper operation of the system (in accordance with IEC 60950-1 resp.
EN 60950-1) is only ensured if the casing is completely assembled and the rear covers for the installation slots have been fitted (electric shock, cooling, fire protection, interference suppression).
Only install system expansions that satisfy the requirements and rules governing safety and electromagnetic compatibility and those relating to telecommunication terminals. If you install other expansions, they may damage the system or violate the safety regulations. Information on which system expansions are approved for installation can be obtained from our customer service center or your sales outlet.
The components marked with a warning notice (e.g. lightning symbol) may only be opened, removed or exchanged by authorized, qualified personnel.
Exception: CSS components can be replaced.
The warranty is void if the server is damaged during installation or replacement of system expansions.
CX2570 M1 Upgrade and Maintenance Manual 29
Important information
●
●
●
●
●
●
●
●
Only set screen resolutions and refresh rates that are specified in the operating manual for the monitor. Otherwise, you may damage your monitor.
If you are in any doubt, contact your sales outlet or customer service center.
Before installing/removing internal options to/from the server, turn off the server, all peripheral devices, and any other connected devices. Also unplug all power cords from the outlet. Failure to do so can cause electric shock.
Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock and will void the warranty and exempt the manufacturer from all liability.
Devices inside the server remain hot after shutdown. Wait for a while after shutdown before installing or removing internal options.
The circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. To ensure reliable protection, if you are wearing an earthing band on your wrist when working with this type of module, connect it to an unpainted, conducting metal part of the system.
Do not touch the circuitry on boards or soldered parts. Hold the metallic areas or the edges of the circuit boards.
Install the screw removed during installation/detaching internal options in former device/position. To use a screw of the different kind can cause a breakdown of equipment.
The installation indicated on this document is sometimes changed to the kind of possible options without notice.
Batteries
● Incorrect replacement of batteries may lead to a risk of explosion. The batteries may only be replaced with identical batteries or with a type recommended by the manufacturer.
●
●
Do not throw batteries into the trash can.
Batteries must be disposed of in accordance with local regulations concerning special waste.
●
●
Make sure that you insert the battery the right way round.
The battery used in this device may present a fire or chemical burn hazard if mistreated. Do not disassemble, heat about 100 °C (212F), or incinerate the battery.
30 Upgrade and Maintenance Manual CX2570
Important information
● All batteries containing pollutants are marked with a symbol (a crossed-out garbage can). In addition, the marking is provided with the chemical symbol of the heavy metal decisive for the classification as a pollutant:
Cd Cadmium
Hg Mercury
Pb Lead
Working with optical disk drives and media
When working with optical disk drives, these instructions must be followed.
V
CAUTION!
● Only use CDs/DVDs/BDs that are in perfect condition, in order to prevent data loss, equipment damage and injury.
● Check each CD/DVD/BD for damage, cracks, breakages etc. before inserting it in the drive.
Note that any additional labels applied may change the mechanical properties of a CD/DVD/BD and cause imbalance and vibrations.
Damaged and imbalanced CDs/DVDs/BDs can break at high drive speeds (data loss).
●
●
●
●
●
●
Under certain circumstances, sharp CD/DVD/BD fragments can pierce the cover of the optical disk drive (equipment damage) and can fly out of the device (danger of injury, particularly to uncovered body parts such as the face or neck).
High humidity and airborne dust levels are to be avoided. Electric shocks and/or server failures may be caused by liquids such as water, or metallic items, such as paper clips, entering a drive.
Shocks and vibrations are also to be avoided.
Do not insert any objects other than the specified CDs/DVDs/BDs.
Do not pull on, press hard, or otherwise handle the CD/DVD/BD tray roughly.
Do not disassemble the optical disk drive.
Before use, clean the optical disk tray using a soft, dry cloth.
CX2570 M1 Upgrade and Maintenance Manual 31
Important information
●
●
●
As a precaution, remove disks from the optical disk drive when the drive is not to be used for a long time. Keep the optical disk tray closed to prevent foreign matter, such as dust, from entering the optical disk drive.
Hold CDs/DVDs/BDs by their edges to avoid contact with the disk surface.
Do not contaminate the CD/DVD/BD surface with fingerprints, oil, dust, etc. If dirty, clean with a soft, dry cloth, wiping from the center to the edge. Do not use benzene, thinners, water, record sprays, antistatic agents, or silicone-impregnated cloth.
●
●
Be careful not to damage the CD/DVD/BD surface.
Keep the CDs/DVDs/BDs away from heat sources.
Do not bend or place heavy objects on CDs/DVDs/BDs.
●
●
●
●
Do not write with ballpoint pen or pencil on the label (printed) side.
When a CD/DVD/BD is moved from a cold place to a warm place, moisture condensation on the CD/DVD/BD surface can cause data read errors. In this case, wipe the CD/DVD/BD with a soft, dry cloth then let it air dry. Do not dry the CD/DVD/BD using devices such as a hair dryer.
To avoid dust, damage, and deformation, keep the CD/DVD/BD in its case whenever it is not in use.
● Do not store CDs/DVDs/BDs at high temperatures. Areas exposed to prolonged direct sunlight or near heating appliances are to be avoided.
I
You can prevent damage from the optical disk drive and the
CDs/DVDs/BDs, as well as premature wear of the disks, by observing the following suggestions:
– Only insert disks in the drive when needed and remove them after use.
– Store the disks in suitable sleeves.
– Protect the disks from exposure to heat and direct sunlight.
Laser information
The optical disk drive complies with IEC 60825-1 laser class 1.
32 Upgrade and Maintenance Manual CX2570
Important information
V
CAUTION!
The optical disk drive contains a light-emitting diode (LED), which under certain circumstances produces a laser beam stronger than laser class 1. Looking directly at this beam is dangerous.
Never remove parts of the optical disk drive casing!
Modules with Electrostatic-Sensitive Devices
Modules with electrostatic-sensitive devices are identified by the following sticker:
Figure 1: ESD label
When you handle components fitted with ESDs, you must always observe the following points:
● Switch off the system and remove the power plugs from the power outlets before installing or removing components with ESDs.
● The circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. To ensure reliable protection, you must wear an earthing band on your wrist when working with this type of module and connect it to an unpainted, conducting metal part of the system.
●
●
●
●
●
Any devices or tools that are used must be free of electrostatic charge.
Wear a suitable grounding cable that connects you to the external chassis of the system unit.
Always hold components with ESDs at the edges or at the points marked green (touch points).
Do not touch any connectors or conduction paths on an ESD.
Place all the components on a pad which is free of electrostatic charge.
CX2570 M1 Upgrade and Maintenance Manual 33
Important information
I
For a detailed description of how to handle ESD components, see the relevant European or international standards (EN 61340-5-1,
ANSI/ESD S20.20).
Transporting the server
●
●
Only transport the server in its original packaging or in packaging that protects it from impacts and jolts.
For the Japanese market, transporting the device in its original packaging does not apply.
Do not unpack the server until it is at its installation location.
34 Upgrade and Maintenance Manual CX2570
Important information
Notes on installing the server in the rack
●
●
●
●
●
●
●
●
For safety reasons, at least two people are required to install the server in the rack because of its weight and size.
(For the Japanese market, please refer to " 安全上のご注意 ".)
Never lift the server into the rack using the handles on the front panel.
When connecting and disconnecting cables, observe the relevant instructions in the "Important Information" chapter of the technical manual for the corresponding rack. The technical manual is supplied with the corresponding rack.
When installing the rack, make sure that the anti-tilt protection is correctly fitted.
For safety reasons, no more than one unit may be removed from the rack at any one time during installation and maintenance work.
If several units are simultaneously removed from the rack, there is a risk that the rack could tip over.
The rack must be connected to the power supply by an authorized specialist
(electrician).
If the server is integrated into an installation that draws power from an industrial power supply network with an IEC309 type connector, the power supply's fuse protection must comply with the requirements for nonindustrial power supply networks for the type A connector.
3.2
CE conformity
The system complies with the requirements of the EC directives
2004/108/EC regarding "Electromagnetic Compatibility" and
2006/95/EC "Low Voltage Directive" and the directive of the
European Parliament and Council 2011/65/EU. This is indicated by the CE marking (CE = Communauté Européenne).
CX2570 M1 Upgrade and Maintenance Manual 35
Important information
3.3
FCC Class A Compliance Statement
If there is an FCC statement on the device, it applies to the products covered in this manual, unless otherwise specified herein. The statement for other products will appear in the accompanying documentation.
NOTE:
This equipment has been tested and found to comply with the limits for a
"Class A" digital device, pursuant to Part 15 of the FCC rules and meets all requirements of the Canadian Interference-Causing Equipment Standard
ICES-003 for digital apparatus. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses and can radiate radio frequency energy and, if not installed and used in strict accordance with the instructions, may cause harmful interference to radio communications. However, there is no warranty that interference will not occur in a particular installation. If this equipment does cause harmful interference to radio or television reception, which can be determined by turning the equipment off and on, the user is encouraged to try to correct the interference by one or more of the following measures:
●
●
Reorient or relocate the receiving antenna.
Increase the separation between equipment and the receiver.
● Connect the equipment into an outlet on a circuit different from that to which the receiver is connected.
● Consult the dealer or an experienced radio/TV technician for help.
Fujitsu is not responsible for any radio or television interference caused by unauthorized modifications of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by Fujitsu. The correction of interferences caused by such unauthorized modification, substitution or attachment will be the responsibility of the user.
The use of shielded I/O cables is required when connecting this equipment to any and all optional peripheral or host devices. Failure to do so may violate FCC and ICES rules.
WARNING:
This is a class A product. In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures.
36 Upgrade and Maintenance Manual CX2570
Important information
3.4
Environmental protection
Environmentally-friendly product design and development
This product has been designed in accordance with the Fujitsu standard for
"environmentally friendly product design and development". This means that key factors such as durability, selection and labeling of materials, emissions, packaging, ease of dismantling and recycling have been taken into account.
This saves resources and thus reduces the harm done to the environment.
Further information can be found at:
– http://ts.fujitsu.com/products/standard_servers/index.html
(for the global market)
– http://jp.fujitsu.com/platform/server/primergy/concept/ (for the Japanese market)
Energy-saving information
Devices that do not need to be constantly switched on should be switched off until they are needed as well as during long breaks and after completion of work.
Packaging information
This packaging information doesn’t apply to the Japanese market.
Do not throw away the packaging. You may need it later for transporting the system. If possible, the equipment should only be transported in its original packaging.
Information on handling consumables
Please dispose of printer consumables and batteries in accordance with the applicable national regulations.
In accordance with EU directives, batteries must not be disposed of with unsorted domestic waste. They can be returned free of charge to the manufacturer, dealer or an authorized agent for recycling or disposal.
All batteries containing pollutants are marked with a symbol (a crossed-out garbage can). They are also marked with the chemical symbol for the heavy metal that causes them to be categorized as containing pollutants:
Cd Cadmium
Hg Mercury
Pb Lead
CX2570 M1 Upgrade and Maintenance Manual 37
Important information
Labels on plastic casing parts
Please avoid sticking your own labels on plastic parts wherever possible, since this makes it difficult to recycle them.
Returns, recycling and disposal
Please handle returns, recycling and disposal in accordance with local regulations.
The device must not be disposed of with domestic waste. This device is labeled in compliance with European directive
2002/96/EC on waste electrical and electronic equipment (WEEE).
This directive sets the framework for returning and recycling used equipment and is valid across the EU. When returning your used device, please use the return and collection systems available to you. Further information can be found at http://ts.fujitsu.com/recycling .
Details regarding the return and recycling of devices and consumables within
Europe can also be found in the "Returning used devices" manual, via your local
Fujitsu branch or from our recycling center in Paderborn:
Fujitsu Technology Solutions
Recycling Center
D-33106 Paderborn
Tel. +49 5251 525 1410
Fax +49 5251 525 32 1410
38 Upgrade and Maintenance Manual CX2570
4 Basic hardware procedures
4.1
Shutting down the server node
Safety notes
V
CAUTION!
For further safety information, please refer to chapter
"Important information" on page 27
.
I
This step is only required when upgrading or replacing non-hot plug components.
Ê
Inform the system administrator that the server node will be shut down and put offline.
Ê
Terminate all applications.
Ê
Press the On/Off button either on the rear or on the corresponding front panel to shut down the server node.
I
If the system is running an ACPI-compliant operating system, pressing the On / Off button will perform a graceful shutdown.
CX2570 M1 Upgrade and Maintenance Manual 39
Basic hardware procedures
4.2
Removing the server node from the server enclosure
V
CAUTION!
● Shut down the server node and disconnect all external cables.
● Follow the safety instructions in the chapter
"Important information" on page 27 .
Figure 2: Removing the server node
Ê
Undo the locking mechanism (1) of the release lever and pull the server node out of the slot (2).
40 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.3
Removing the GPGPU extension
Figure 3: Loosening the captive screws
Ê
Loosen the captive screws.
Figure 4: Removing the GPGPU extension
Ê
Swivel the GPGPU extension up (1) and remove it from the hinge rod (2).
CX2570 M1 Upgrade and Maintenance Manual 41
Basic hardware procedures
4.4
Removing the riser module
Figure 5: Removing the riser module at the left side
I
An expansion card can only be installed if the riser module has been removed.
Ê
Remove the riser module from the chassis by pulling the riser module out of the slot and the bolt out of the chassis sparing (see circle).
42 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
Figure 6: Riser module at the right side
Ê
Remove the riser module at the right side accordingly from the chassis by pulling the riser module out of the slot and the bolt out of the chassis sparing
(see circle).
CX2570 M1 Upgrade and Maintenance Manual 43
Basic hardware procedures
4.5
Installing the riser module
Figure 7: Installing the riser module
Ê
Install the riser module to the chassis by inserting the bolt into the chassis sparing (see circle) and press down the riser module until the connector of the riser card fits within the slot.
I
Make sure that the riser board connects within the slot properly.
44 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
Figure 8: Riser module at the right side
Ê
Install the riser module on the right side accordingly.
CX2570 M1 Upgrade and Maintenance Manual 45
Basic hardware procedures
4.6
Replacing the riser card
Figure 9: Replacing the riser card
The riser module consists of the riser metal bracket and the riser card.
The riser card is connected to the riser metal bracket with two rivets:
– Rivet (1).
– Rivet with bolt (2).
Ê
For removing the riser card loosen the two rivets and take off the riser card.
Ê
For installing the new riser card put the riser card on the riser metal bracket and fasten the two screws with a hexagonal SW6.
46 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.7
Mounting a controller to the riser module
Figure 10: Mounting a controller to the riser module
Ê
Plug the controller on the riser card connector (1).
I
Make sure that the metal pin of the controller bracket hooks into the recess of the riser bracket (see circle).
CX2570 M1 Upgrade and Maintenance Manual 47
Basic hardware procedures
4.8
Removing a controller from the riser module
Figure 11: Removing a controller from the riser module
Ê
Pull the controller out of the riser card connector (1).
I
Make sure that the metal pin of the controller bracket does not get stucked with the recess of the riser bracket (see circle).
48 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.9
Removing the memory slot air ducts
Figure 12: Removing the memory slot air ducts
Ê
Push the air ducts together (1) and pull them out (2).
CX2570 M1 Upgrade and Maintenance Manual 49
Basic hardware procedures
4.10 Installing the memory slot air ducts
Figure 13: Installing the memory slot air ducts
Ê
Press down on the air ducts (see1 and 2) until they snap into their location between the memory modules.
I
The air ducts only snap easily into place if all memory modules are installed properly.
4.10.1 Design of the memory air ducts
Figure 14: Design of the memory air duct
50 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.11
Installing the GPGPU extension
Figure 15: Attaching the metal rod
Ê
For upgrading a CX2550 M1 to a CX2570 M1 attach the metal rod to the
CX2550 M1 chassis using the delivered crosshead screws.
Figure 16: Foil on the CX2570 M1 chassis
Ê
Put the foil on the CX2570 M1 chassis.
CX2570 M1 Upgrade and Maintenance Manual 51
Basic hardware procedures
Figure 17: Foil - detail
Ê
Pay attention that the foil is placed correctly (see circle).
1
2
Figure 18: Installing the GPGPU extension
Ê
Plug the GPGPU extension notches (1) on the hinge rod (2).
Ê
Carefully swivel the GPGPU extension down (3).
52 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
Figure 19: View before the GPGPU extension is connected.
Figure 20: Fastening the captive screws
Ê
Fasten the captive screws.
CX2570 M1 Upgrade and Maintenance Manual 53
Basic hardware procedures
4.12 Installing the server node in the server enclosure
V
CAUTION!
● Follow the safety instructions in the chapter
"Important information" on page 27 .
Figure 21: Installing the server node
Ê
Push the server node at the handle into the server enclosure until the locking mechanism snaps into place.
Ê
If applicable, connect all external cables to the server node.
54 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.13 Controls and indicators on the server node
V
CAUTION!
●
Follow the safety instructions in chapter "Important information" on page 27
.
Ê
If applicable, connect all external cables to the server node.
Figure 22: Controls and indicators of the server node
1 Reset button (RST)
2 Global error LED
3 ID indicator
4 CSS indicator
I
The server nodes are controlled via related operating panel areas on the front side of the CX400 M1 server enclosure. See "FUJITSU Server
PRIMERGY CX400 M1 Server Enclosure Operating Manual".
4.14 Concluding software tasks
Ê
Perform the following software tasks to put the server back in operation:
–
"Verifying the system time settings" on page 79
–
"Viewing and clearing the System Event Log (SEL)" on page 80
–
"Updating the NIC configuration file in a Linux environment" on page 81
–
"Performing a RAID array rebuild" on page 84
–
"Looking up changed MAC / WWN addresses" on page 84
CX2570 M1 Upgrade and Maintenance Manual 55
Basic hardware procedures
56 Upgrade and Maintenance Manual CX2570
5 Basic software procedures
5.1
Starting the maintenance task
5.1.1
Suspending BitLocker functionality
BitLocker Drive Encryption provides protection for operating system and data drives by encrypting the contents and requiring users to authenticate their credentials to access the information. In the scenario described here, BitLocker uses the compatible Trusted Platform Module (TPM) to detect if the computer's startup process has been modified from its original state.
I
For additional information on how to use BitLocker on a computer without a compatible TPM, please refer to the "BitLocker Drive Encryption" documentation page at http://technet.microsoft.com/library/cc731549.aspx.
Suspending BitLocker Drive Encryption is a temporary method for removing
BitLocker protection without decrypting the drive Windows is installed on.
Suspend BitLocker before modifying the server’s hardware configuration or startup files. Resume BitLocker again after the maintenance procedure is complete.
V
CAUTION!
– With BitLocker features enabled, modifying the system configuration
(hardware or firmware settings) may render the system inaccessible.
The system may enter Recovery Mode and require a 48-digits recovery password to return to normal operation.
Ensure to suspend BitLocker drive encryption before maintaining the server.
– When suspended, BitLocker uses a plain text key instead of the
Trusted Platform Module (TPM) to read encrypted files. Keep in mind that information on this drive is not secure until BitLocker has been re-enabled.
Ê
Ask the system administrator to suspend BitLocker-protection on the system volume, using the BitLocker Drive Encryption control panel item.
I
This will temporarily disable BitLocker for maintenance purposes.
The volume will not be decrypted and no keys will be discarded.
CX2570 M1 Upgrade and Maintenance Manual 57
Basic software procedures
For Windows Server 2008:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking Security , and then clicking BitLocker Drive
Encryption .
Ê
Select the system volume, and click Turn Off BitLocker .
Ê
From the Turn Off BitLocker dialog box, click Disable BitLocker .
For Windows Server 2008 R2 and above:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking System and Security , and then clicking BitLocker
Drive Encryption .
Ê
Select the system volume, and click Suspend Protection .
Ê
Click Yes to confirm that your data will not be protected while BitLocker is suspended.
I
In order to determine which features are accessible through the
BitLocker setup wizard, it may be necessary to modify the BitLocker
Group Policy settings.
For further information on how to suspend BitLocker drive encryption, please refer to the Microsoft TechNet library at http://technet.microsoft.com/library/cc731549.aspx.
Fujitsu service partners will find additional information (also available in Japanese) on the Fujitsu Extranet web pages.
5.1.2
Disabling SVOM boot watchdog functionality
The ServerView Operations Manager boot watchdog determines whether the server boots within a preset time frame. If the watchdog timer expires, the system will automatically reboot.
5.1.2.1
Viewing boot watchdog settings
Viewing boot watchdog settings in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
58 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Under Boot Watchdog , you can obtain detailed information about the current watchdog status, time out intervals and actions that are triggered if watchdog time outs are exceeded.
I
For detailed information on BIOS settings, refer to the corresponding
BIOS Setup Utility reference manual.
Viewing boot watchdog settings in the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
Under Watchdog Settings , you can obtain detailed information about the current watchdog status, time out intervals and actions that are triggered if watchdog time outs are exceeded.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
Viewing boot watchdog settings in ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View select Maintenance from the Information / Operation menu.
Ê
Under ASR&R select the Watchdog tab to obtain detailed information about the current watchdog status, time out intervals and actions that are triggered if watchdog time outs are exceeded.
I
For more detailed information, refer to the "ServerView Operations
Manager - Server Management" user guide.
5.1.2.2
Configuring boot watchdog settings
If the system is to be started from removable boot media for firmware upgrade purposes, the Boot watchdog needs to be disabled before starting maintenance task. Otherwise, the Boot watchdog might initiate a system reboot before the flash process is complete.
V
CAUTION!
An incomplete firmware upgrade process may render the server inaccessible or result in damaged / destroyed hardware.
Timer settings can be configured in the BIOS or using the ServerView iRMC web frontend:
CX2570 M1 Upgrade and Maintenance Manual 59
Basic software procedures
Configuring boot watchdog settings in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Watchdog set the Action setting to Continue .
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
Configuring boot watchdog settings using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
Under Watchdog Settings select Continue from the Boot Watchdog drop down list.
Ê
Click Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
60 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.1.3
Configuring LAN teaming
Use ServerView Operations Manager to obtain detailed information on existing
LAN teams:
Ê
In ServerView Operations Manager Single System View select System Status from the Information / Operation menu.
Ê
Under Network Interfaces select LAN Teaming .
Ê
The Network Interfaces (Summary) overview shows all configured LAN teams and their components. Choose a LAN team to display further details:
– LAN Team Properties : Properties of the selected LAN team
– LAN Team Statistics : Available statistics about the selected LAN team
I
For more detailed information, refer to the "ServerView Operations
Manager - Server Management" user guide.
5.1.4
Note on server maintenance in a Multipath I/O environment
When booting your server offline from the ServerView Suite DVD to perform an offline BIOS / firmware update using the ServerView Update DVD or collect diagnostic data using PrimeCollect in a Multipath I/O environment, there is a risk of damaging the system configuration which may leave the system unable to boot.
I
This is a known restriction of Windows PE with Multipath drivers.
Using Update Manager Express
Ê
If performing an offline BIOS / firmware update, first of all prepare the
ServerView Update DVD or USB stick:
Ê
Download the latest ServerView Update DVD image from Fujitsu: for the EMEA market ftp://ftp.ts.fujitsu.com/images/serverview for the Japanese market: http://jp.fujitsu.com/platform/server/primergy/products/note/svsdvd/dvd/
Ê
Burn the image to a DVD.
CX2570 M1 Upgrade and Maintenance Manual 61
Basic software procedures
Ê
In order to create a bootable USB stick, please proceed as described in the "Local System Update for PRIMERGY Servers" user guide.
Ê
Before using the ServerView Update DVD or USB stick in an offline environment, properly shut down the server and disconnect all external I/O connections (like LAN, FC or SAS cables) from the system. Only keep mouse, keyboard, video cable and AC power cord connected.
I
Ensure that all external I/O connections are uniquely identified so that you can reconnect them into their original locations after concluding the task.
To start Update Manager Express from the (physical) Update DVD or from a
USB stick, proceed as follows:
Ê
Prepare your Update DVD or USB stick as described in the "Local System
Update for PRIMERGY Servers" user guide.
Ê
Boot the server from the prepared Update DVD or USB stick:
DVD:
Ê
Switch on the server.
Ê
Right after switching on the server, insert the Update DVD into the
DVD drive and close the tray.
USB:
Ê
Connect the USB stick to the server.
Ê
Switch on the server.
If the server does not boot from DVD or USB stick, proceed as follows:
Ê
Reboot the server, e.g. by pressing the reset button on the front or switching the server off and then on again after a few seconds.
Ê
Once the server has been started, press [F12] to enter the boot menu.
Ê
Use the Ê and Ë cursor keys to select your DVD drive or USB stick as boot device and press
[ENTER]
.
The server will now boot from the Update DVD or USB stick.
Ê
After the boot process is complete, select your preferred GUI language.
The Update Manager Express main window will be displayed.
Ê
Finish the intended maintenance task.
I
For further information, refer to the "Local System Update for
PRIMERGY Servers" user guide.
62 Upgrade and Maintenance Manual CX2570
Basic software procedures
Using PrimeCollect
To start PrimeCollect, proceed as follows:
Ê
Before using PrimeCollect in an offline environment, properly shut down the server and disconnect all external I/O connections (like LAN, FC or SAS cables) from the system. Only keep mouse, keyboard, video cable and AC power cord connected.
I
Ensure that all external I/O connections are uniquely identified so that you can reconnect them into their original locations after concluding the task.
Ê
Switch on the server.
Ê
Right after switching on the server, insert the ServerView Suite DVD into the
DVD drive and close the drive tray.
If the server does not boot from DVD, proceed as follows:
Ê
Reboot the server, e.g. by pressing the reset button on the front or switching the server off and then on again after a few seconds.
Ê
Once the server has been started, press [F12] to enter the boot menu.
Ê
Use the
Ê
and
Ë
cursor keys to select your DVD drive as boot device and press
[ENTER]
.
The server will now boot from the ServerView Suite DVD.
Ê
After the boot process is complete, select your preferred GUI language.
Ê
In the initial Installation Manager startup window, choose PrimeCollect from the Installation Manager mode section.
Ê
Click Continue to proceed.
Ê
Finish the intended maintenance task.
I
For further information, refer to the "PrimeCollect" user guide.
Concluding the procedure
Ê
After the update or diagnostic procedure has been completed, shut down the server, reconnect all external I/O connections and bring the system back to normal operation.
Ê
If necessary, perform this procedure for all remaining servers within the
Multipath environment.
CX2570 M1 Upgrade and Maintenance Manual 63
Basic software procedures
5.1.5
Switching on the ID indicator
When working in a datacenter environment, switch on the ID indicator on the front and rear connector panels of the server for easy identification.
I
For further information, refer to the "ServerView Suite Local Service
Concept (LSC)" and "Integrated Remote Management Controller" user guides.
Using the ID button on the front panel
Ê
Press the ID button on the front panel to switch on the system identification
LEDs.
Using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Under System Overview , click Identify LED On to switch on the ID indicators.
Using ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View press the Locate button in the title bar to switch on the ID indicators.
64 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2
Completing the maintenance task
5.2.1
Updating or recovering the system board BIOS and iRMC
After replacing the system board, it is essential to upgrade the BIOS and iRMC to the latest version. The latest BIOS and iRMC versions are available from the
Fujitsu support internet pages at: http://ts.fujitsu.com/support/ (EMEA market) http://jp.fujitsu.com/platform/server/primergy/downloads/ (Japanese market)
I
Fujitsu does not assume responsibility for any damage done to the server or for the loss of any data resulting from BIOS updates.
5.2.1.1
Updating or recovering the system board BIOS
Flash BIOS update
I
For the Japanese market, follow the instructions provided separately.
For Fujitsu PRIMERGY Servers you have basically the choice, to select between online flash and offline flash:
Online flash update:
Flash BIOS update is processed while operating system is running. The system is accessible via network, and Flash BIOS update might be controlled online by administrator.
Offline flash update:
Flash BIOS update is processed while system is shutdown. Physically presence might be required to perform Flash BIOS update using an additional booting device like USB stick. The system is not accessible via network, it is offline.
To perform a Flash BIOS update (online or offline) you must first download the necessary files from the internet.
Ê
Call up the following internet page: http://support.ts.fujitsu.com/Download .
Ê
Select Driver & Downloads .
CX2570 M1 Upgrade and Maintenance Manual 65
Basic software procedures
Ê
Select your system via Select Product or look under Product Search by Serial-
/Identnumber for your system.
Ê
Select your operating system.
Ê
Select Flash-BIOS.
For Online Flash
– Select Flash BIOS <System> (ASP for Windows/Linux)
– Download the ASP file (Autonomous Support Package) - a self-extracting package for online update under Windows/Linux.
For Offine Flash
– Select System Board - Admin package - Compressed Flash Files .
– Download the offered Admin package file for a Flash BIOS Update with a
USB stick.
I
If the operating system which you use is not selectable, select any operating system or choose OS independent and download the Admin package.
Process Flash BIOS Update
V
Caution
The BIOS is stored in a flash memory device. If an error occurs during the flash BIOS update procedure, the BIOS image in the flash memory may be destroyed. You can then only restore the BIOS using the Flash
replaced. Contact your customer support Service Desk.
Online Flash: Flash BIOS Update under Windows/Linux
Autonomous PRIMERGY Support Packages (ASP) are self-extracting packages for online update of BIOS and Firmware.
For Windows:
Ê
Double click on the exe-file for starting the installation process.
66 Upgrade and Maintenance Manual CX2570
Basic software procedures
For Linux:
Ê
Call "sh <ASP-name>.scexe [options ..]" from a command line interface.
Get more information about possible options by calling "<ASP-name>.scexe -help".
I
BIOS updates always require a closing system reboot.
Offline Flash: Flash BIOS Update with an USB stick
You need an USB stick on which the BIOS update files will be stored.
Ê
Make sure, that you have a bootable USB stick.
I
If your USB stick is not bootable proceed as follows:
Ê
Select on the download page the Admin package - Compressed Flash
Files and read the Installation Description.
Ê
Follow the instructions of the item Create a bootable FreeDOS USB
Flash Drive.
V
CAUTION
The data on the USB stick will be fully erased and overwritten. Make sure, that all data are saved before.
Ê
Unzip the downloaded zip file from Admin package - Compressed Flash Files and copy all files and directories to the root of your bootable USB stick.
Ê
Boot the system from the inserted bootable USB stick:
Ê
Wait until the screen output appears.
Ê
Press the function key
[F12]
and select the bootable USB stick with the arrow keys Ê or Ë .
Ê
Change the directory with cd DOS and start the Flash BIOS Update with the command
DosFlash.
Then follow the instructions on the screen.
Ê
After the Flash BIOS Update the system is restarted automatically. The system will be booted with the new BIOS revision.
Ê
Check the settings in the BIOS setup utility. If necessary, reconfigure the settings again.
CX2570 M1 Upgrade and Maintenance Manual 67
Basic software procedures
Flash Memory Recovery Mode
I
For the Japanese market, follow the instructions provided separately.
Ê
Prepare a bootable USB stick as described in section "Flash BIOS update" on page 65
.
Ê
Switch off the system and disconnect the power plug.
Ê
Open the chassis and switch on "Recovery" (BIOS-RCV) using the jumper /
DIP switch (X5-6) on the system board.
Ê
Reconnect the power plug.
Ê
Boot the system from the inserted bootable USB stick.
Ê
Change the directory with cd DOS and start the Flash BIOS Update with the command
DosFlash.
Then follow the instructions on the screen.
Ê
Observe the update process on the screen, until it is finished. The recovery update may take several minutes.
V
CAUTION!
Do not interrupt the BIOS flash process after it has started. If the process is interrupted, the system BIOS may be permanently corrupted.
Ê
Switch off the system and disconnect the power plug.
Ê
Remove the USB stick.
Ê
Return the "Recovery" (BIOS-RCV) jumper / DIP (X5-6) switch which have been changed to the initial position.
Ê
Reconnect the power plug and switch on the system.
Ê
The system will be booted with the new BIOS revision.
Ê
Check the settings in the BIOS setup utility. If necessary, reconfigure the settings again.
68 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.1.2
Updating or recovering the iRMC iRMC flash procedure
I
For the Japanese market, follow the instructions provided separately.
Ê
Prepare a USB stick including the bootable iRMC firmware update image.
Ê
Connect the USB stick to the USB port.
I
Ensure that only the USB device with the iRMC firmware is connected to the USB port. Remove all other USB devices temporarily.
Ê
Restart the server.
Ê
The system will detect the USB stick.
I
If the BIOS cannot identify the USB stick, the pop-up message
Failed to boot for Emergency flash. Please Reset now
. will show up in the center of the screen.
Ê
Choose one of the following options from the update tool menu to start the iRMC update process:
Normal Choose this option to update an existing system board.
Initial Choose this option if the system board has been replaced prior to the iRMC update procedure. This option will perform all relevant flash procedures in a row, including the iRMC firmware and bootloader.
V
CAUTION!
Do not interrupt the iRMC upgrade process after it has started. If the process is interrupted, the iRMC BIOS may be permanently corrupted.
I
If the iRMC does not work after flashing, disconnect the system from the mains and reconnect it again.
Ê
After completion of the flash process, remove the USB stick and restart the server.
iRMC recovery procedure
I
For the Japanese market, follow the instructions provided separately.
Ê
Prepare a USB stick including the bootable iRMC firmware update image.
CX2570 M1 Upgrade and Maintenance Manual 69
Basic software procedures
Ê
Ensure that the server has been shut down and disconnected from the
mains as described in section "Shutting down the server node" on page 39
.
Ê
Connect the USB stick to the USB port.
I
Ensure that only the USB device with the iRMC firmware is connected to the USB port. Remove all other USB devices temporarily.
Ê
Connect the server to the mains while pushing the ID button on the front panel. Ask a second person to help you if necessary.
Ê
Ensure that the Global Error indicator and the ID indicator are flashing to indicate that the server is entering the iRMC recovery state.
Ê
Press the Power On / Off button. The system starts the POST process.
I
In iRMC recovery mode, the “FUJITSU” logo does not show up.
Ê
The system will detect the USB stick.
I
If the BIOS cannot identify the USB stick, the pop-up message
Failed to boot for Emergency flash. Please Reset now
. will show up in the center of the screen.
Ê
Choose the Recovery_L option from the update tool menu to start the iRMC update process.
V
CAUTION!
Do not interrupt the iRMC upgrade process after it has started. If the process is interrupted, the iRMC BIOS may be permanently corrupted.
I
If the iRMC does not work after flashing, disconnect the system from the mains and reconnect it again.
Ê
Shut down the server by pressing the power On / Off button.
Ê
Disconnect the server from the mains to exit the iRMC recovery state.
70 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.2
Verifying system information backup / restore
To avoid the loss of non-default settings when replacing the system board, a backup copy of important system configuration data is automatically stored from the system board NVRAM to the Chassis ID EPROM. After replacing the system board the backup data is restored from the Chassis ID board to the new system board.
In order to verify whether the backup or restore process has been successful, check the System Event Log (SEL) using the ServerView Operations Manager
(see also section "Viewing and clearing the System Event Log (SEL)" on page 80 ).
After replacing the system board
Ê
Check the SEL log files as described in section "Viewing and clearing the
System Event Log (SEL)" on page 80
to verify whether the backup data on the Chassis ID EPROM has been restored to the system board:
Chassis IDPROM: Restore successful
After replacing the Chassis ID EPROM
I
In case of the PRIMERGY CX2570 M1 server, the Chassis ID EPROM is integrated on the chassis interface board.
Ê
Check the SEL log files as described in section "Viewing and clearing the
System Event Log (SEL)" on page 80
to verify whether a backup copy of the system board settings has been transferred to the Chassis ID EPROM:
Chassis IDPROM: Backup successful
5.2.3
Updating RAID controller firmware
After replacing the RAID controller, it is essential to upgrade the firmware to the latest version. The latest RAID controller firmware version is available from the
Fujitsu support web pages at: http://ts.fujitsu.com/support/ (EMEA market) http://jp.fujitsu.com/platform/server/primergy/downloads/ (Japanese market)
I
Fujitsu does not assume responsibility for any damage done to the server or for the loss of any data resulting from firmware updates.
For the Japanese market, follow the instructions provided separately.
CX2570 M1 Upgrade and Maintenance Manual 71
Basic software procedures
Using the ServerView Update Manager
For a detailed description on how to update the RAID controller firmware using the ServerView Update Manager or Update Manager Express (UME), please refer to the following manuals:
– ServerView Update Manager:
"ServerView Update Management" user guide
– ServerView Update Manager Express:
"Local System Update for PRIMERGY Servers" user guide
Using the flash tool
The latest firmware files are available as ASPs (Autonomous Support
Packages) for Windows or as DOS tools from the Fujitsu support web pages at: http://ts.fujitsu.com/support/ (EMEA market) http://jp.fujitsu.com/platform/server/primergy/downloads/ (Japanese market)
Ê
Select Drivers & Downloads .
Ê
From the Select Product drop down lists, choose your PRIMERGY server or enter its serial or ident number into the search field.
Ê
Select your operating system and version.
Ê
Select the desired component type (e.g. SAS RAID).
Ê
Select your controller from the device list to expand a compilation of available drivers and firmware.
Ê
Select the desired file and click Download for further instructions.
5.2.4
Enabling Option ROM scan
In order to configure an expansion card that has been installed or replaced, the card’s Option ROM has to be enabled in the system board BIOS. The card’s firmware is called by the system BIOS upon reboot and can be entered and configured.
Option ROM can be enabled permanently (e.g. in case of a boot controller that may require frequent setup) or temporarily for one-time configuration. When permanently enabling a controllers’s Option ROM, keep in mind that only two
Option ROMs can be activated in the system board BIOS at a time.
Ê
Enter the BIOS.
72 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
From the Advanced menu select Option ROM Configuration .
Ê
Identify the desired PCI slot and set its Launch Slot # OpROM setting to
Enabled.
Ê
Save your changes and exit the BIOS.
I
Up to two Option ROMs can be activated in the system board BIOS at a time.
For detailed information on how to access the BIOS and modify settings, refer to corresponding BIOS Setup Utility reference manual.
When the enabled expansion card is initialized during the POST phase of the boot sequence, a key combination is displayed temporarily to enter the expansion card’s firmware.
Ê
Press the displayed key combination.
Ê
Modify the expansion card firmware options as desired.
Ê
Save your changes and exit the firmware.
I
The expansion card’s option ROM can now be disabled in the system board BIOS.
Exception: If the expansion card controls a permanent boot device, the card’s Option ROM has to remain enabled.
CX2570 M1 Upgrade and Maintenance Manual 73
Basic software procedures
5.2.5
Resetting the boot retry counter
The boot retry counter is decremented from its preset value every time the
POST watchdog initiates a system reboot. When the value has reached ’0’, the system will shut down and power off.
5.2.5.1
Viewing the boot retry counter
The current boot retry counter status is available in the BIOS:
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Retry Counter the current number of remaining boot attempts is displayed. The value is further decremented with every failed boot attempt or system reboot resulting from critical system errors.
Ê
Exit the BIOS.
5.2.5.2
Resetting the boot retry counter
The boot retry counter should be reset to its original value concluding every service task.
I
Please note, if the customer does not know about the original boot retry values:
If the system boots up and no further errors occur within 6 hours after that successful boot attempt, the boot retry counter will automatically be reset to its default value. Please take into account, that the specified number of boot attempts can only be determined after this period of time.
If the customer knows about the original boot retry values, proceed as follows to reset or configure the boot retry counter:
Resetting the boot retry counter in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Retry Counter press the [+] or [-] keys to specify the maximum number of boot attempts (0 to 7).
Ê
Exit the BIOS.
74 Upgrade and Maintenance Manual CX2570
Basic software procedures
Resetting the boot retry counter using the ServerView Operations
Manager
Ê
In the ServerView Operations Manager Administration view, select Server
Configuration .
Ê
If more than one server is managed in SVOM, select the target server and click Next .
Ê
From the Server Configuration menu pane, choose Restart Options .
Ê
Under Reboot Retries , specify the maximum number of boot attempts (0 to 7) in the Default for reboot tries field.
Resetting the boot retry counter using iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
The following boot retry counter settings are available under ASR&R Options:
Ê
Under Retry counter max specify the maximum number of attempts to boot the operating system (0 to 7).
Ê
Under Retry counter the current number of remaining boot attempts is displayed. Overwrite this value with the maximum number of boot attempts specified above in order to reset the boot retry counter.
Ê
Click Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
CX2570 M1 Upgrade and Maintenance Manual 75
Basic software procedures
5.2.6
Enabling SVOM boot watchdog functionality
If ServerView Operations Manager boot watchdog functionality has been
disabled for firmware upgrade purposes (see section 5.1.2 on page 58 ), it has
to be re-enabled to complete the maintenance task.
Timer settings can be configured in the BIOS or using the ServerView iRMC web frontend:
Configuring boot watchdog settings in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Watchdog set the Action setting to Reset .
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
Configuring boot watchdog settings using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
Under Watchdog Settings ensure that the check box next to Boot Watchdog is selected. From the drop down list choose Reset and specify the desired timeout delay.
Ê
Click Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
5.2.7
Enabling replaced components in the system BIOS
When a processor, an expansion card, or a memory module fails, the defective component will be set to Disabled or Failed in the system BIOS. The server will then reboot with only the intact hardware components remaining in the system configuration. After replacing the defective component, it needs to be reenabled in the system board BIOS.
Ê
Enter the BIOS.
76 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Select the Advanced menu.
Ê
Select the status menu of the desired component:
– Processors: CPU Status
I
This option is only available for multi-processor systems.
– Memory: Memory Status
– Expansion cards: PCI Status
Ê
Reset replaced components to Enable .
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
CX2570 M1 Upgrade and Maintenance Manual 77
Basic software procedures
5.2.8
Verifying the memory mode
If a memory module fails, the server will reboot and the defective module will be disabled. As a result, the current operation mode (e.g. Mirrored Channel mode) may no longer be available due to a lack of identical memory module pairs. In this case, the operation mode will automatically revert to Independent Channel
Mode.
I
For detailed information on memory operation modes available for your
server, refer to section "Operation modes" on page 124
.
After replacing the defective module(s) the memory operation mode is automatically reset to its original state. It is recommended to verify that the operation mode has been correctly.
Ê
Enter the BIOS.
Ê
Select the Advanced menu.
Ê
Under Memory Status verify that none of the memory modules are marked as
Failed .
Ê
Save your changes (if applicable) and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
78 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.9
Verifying the system time settings
I
This task only applies to Linux environments.
After the system board has been replaced, the system time is set automatically.
By default, the RTC (Real Time Clock) time standard is set as the local time.
If a Linux OS is used and the hardware clock has been configured as UTC
(Universal Time, Coordinated) in the operating system, the iRMC local time may not be mapped correctly.
Ê
After replacing the system board, ask the system administrator whether the
RTC or UTC time standard is to be used as system time.
I
If the system time (RTC) is set to UTC, the SEL (System Event Log) time stamps may differ from the local time.
Ê
Enter the BIOS.
Ê
Select the Main menu.
Ê
Under System Time and System Date specify the correct time and date.
I
By default, the system time set in the BIOS is RTC (Real Time Clock) local time. If your IT infrastructure relies on universally accepted time standards, set the System Time to UTC (Universal Time, Coordinated) instead. Greenwich Mean Time (GMT) can be considered equivalent to UTC.
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual
CX2570 M1 Upgrade and Maintenance Manual 79
Basic software procedures
5.2.10 Viewing and clearing the System Event Log (SEL)
5.2.10.1 Viewing the SEL
You can view the System Event Log (SEL) using the ServerView Operations
Manager or the ServerView iRMC web frontend:
Viewing the SEL in ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View select Maintenance from the Information / Operation menu.
Ê
Under Maintenance select System Event Log .
Ê
Select the message type(s) you want to display:
– Critical events
– Major events
– Minor events
– Informational events
I
Note on the SVOM Driver Monitor
The Driver Monitor view gives you an overview of the monitored components as well as the associated events contained in the system event log on the managed server.
Under Monitored Components the monitored components are listed. If a component has the status Warning or Error , you can select it in the list and click Acknowledge . This confirms the event on the server side. You may have to log on to the server beforehand. The status of the component will then be reset to ok . To see the new status you must refresh the Driver Monitor view with Refresh .
I
For detailed information on how to view and sort the SEL using
ServerView Operations Manager, refer to the "ServerView Operations
Manager - Server Management" user guide.
80 Upgrade and Maintenance Manual CX2570
Basic software procedures
Viewing the SEL using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Event Log and choose the Internal Event Log submenu.
Ê
Under Internal Event Log Content the SEL is being displayed. In order to filter the list, select the check boxes next to the desired event types and press
Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
5.2.10.2 Clearing the SEL
You can clear the System Event Log (SEL) using the ServerView iRMC web frontend:
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Event Log and choose the Internal Event Log submenu.
Ê
Under Internal Event Log Information click Clear Internal Event Log to clear the
SEL.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
5.2.11 Updating the NIC configuration file in a Linux environment
In order to prevent errors caused by changing network device names ( eth<x> ), it is recommended to store the MAC address (hardware address) of a network interface card in the related NIC configuration file of the Linux OS.
When replacing a network controller or the system board with onboard LAN controllers in a server running Linux OS, the MAC address will change but not automatically be updated in the definition file.
In order to prevent communication problems, it is necessary to update the changed MAC address stored in the related ifcfg-eth<x> definition file.
To update the MAC address, proceed as follows:
CX2570 M1 Upgrade and Maintenance Manual 81
Basic software procedures
I
Procedures may differ depending on your Linux OS or the definition file on the client system. Use the following information as reference. Ask the system administrator to change the definition file.
Ê
After replacing a network controller or the system board, switch on and boot
the server as described in section "Controls and indicators on the server node" on page 55 .
kudzu , the hardware configuration tool for Red Hat Linux, will launch at boot and detect the new and / or changed hardware on your system.
I kudzu may not launch at boot depending on the client’s environment.
Ê
Select Keep Configuration and Ignore to complete the boot process.
Ê
Use the vi text editor to specify the MAC address in the
HWADDR
section of the ifcfg-eth<x> file:
I
The MAC address can be found on the type label attached to the system board or network controller.
Example:
In order to modify the definition file for network controller 1, enter the following command:
# vi /etc/sysconfig/network-scripts/ifcfg-eth1
In vi , specify the new MAC address as follows:
HWADDR=xx:xx:xx:xx:xx:xx
Ê
Save and close the definition file.
Ê
For the changes to take effect, you need to reboot the network by entering the following command:
# service network restart
I
If the system board or network controller offers multiple LAN ports, it is necessary to update the remaining ifcfg-eth<x> definition files accordingly.
Ê
Update the NIC configuration file to reflect the new card sequence and MAC address.
82 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.12 Resuming BitLocker functionality
If BitLocker Drive Encryption has been suspended for maintenance purposes
(see section
"Suspending BitLocker functionality" on page 57 ), it has to be re-
enabled to complete the service task.
I
If BitLocker Drive Encryption has been suspended prior to replacing components you won't be asked for a recovery key when rebooting the server after the maintenance task. However, if BitLocker functionality has not been suspended, Windows will enter recovery mode and ask you to input recovery key for further booting.
Ê
In this case, ask the system administrator to enter the recovery key in order to boot the operating system.
Ê
Ask the system administrator to enable the previously suspended BitLockerprotection on the system volume, using the BitLocker Drive Encryption control panel item:
For Windows Server 2008:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking Security , and then clicking BitLocker Drive
Encryption .
Ê
Select the system volume, and click Turn On BitLocker .
For Windows Server 2008 R2 and above:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking System and Security , and then clicking BitLocker
Drive Encryption .
Ê
Select the system volume, and click Resume Protection .
I
For further information on how to resume BitLocker drive encryption, please refer to the Microsoft TechNet library at http://technet.microsoft.com/library/cc731549.aspx.
Fujitsu service partners will find additional information (also available in Japanese) on the Fujitsu Extranet web pages.
CX2570 M1 Upgrade and Maintenance Manual 83
Basic software procedures
5.2.13 Performing a RAID array rebuild
After replacing a hard disk drive that has been combined into a RAID array,
RAID rebuild will be performed completely unattended as a background process.
Ê
Ensure that the RAID array rebuild has started normally. Wait until the progress bar has reached at least one percent.
Ê
Inform the customer about the remaining rebuild time, based on the displayed duration estimate.
Figure 23: Progress bar (RAID array rebuild)
V
CAUTION!
The system is now operational, however, data redundancy will not be available until the RAID array rebuild is complete. Depending on the hard disk drive capacity the overall process can take up to several hours, in some cases even days.
I
You may notice a slight performance impact during rebuild.
5.2.14 Looking up changed MAC / WWN addresses
When replacing a network controller, the MAC (Media Access Control) and
WWN (World Wide Name) addresses will change.
I
In addition to the procedures described below, MAC / WWN addresses can also be found on the type label attached to a network controller or system board.
5.2.14.1 Looking up MAC addresses
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the System Information menu.
84 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Under Network Inventory , you will find detailed information on each network controller in the managed PRIMERGY server, including its MAC address.
I
This information is only available with the iRMC S4 or above.
Only network controllers supporting the Command Line Protocol
(CLP) will be displayed.
Ê
Inform the customer about the changed MAC address.
5.2.14.2 Looking up WWN addresses
Emulex FC / FCoE adapters
Ê
Enable the network controller’s Option ROM in the system board BIOS as
described in section "Enabling Option ROM scan" on page 72 .
Ê
Restart the server.
Ê
During boot, as soon as the Emulex BIOS utility option appears, press
[ALT]
+
[E]
or
[CTRL]
+
[E]
.
Ê
Under Emulex Adapters in the System you will find all available Emulex adapters and their WWN addresses.
Ê
Note down the new 16-digit WWN address.
Ê
Press
[Esc]
to exit the Emulex BIOS utility.
Ê
Inform the customer about the changed WWN address.
QLogic FC adapters
Ê
Enable the network controller’s Option ROM in the system board BIOS as
described in section "Enabling Option ROM scan" on page 72 .
Ê
Restart the server.
Ê
During boot, as soon as the QLogic BIOS utility option appears, press
[ALT] + [Q] or [CTRL] + [Q] .
Ê
Under Select Host Adapter use the arrow keys
æ
/
Ë
to select the desired
FC / FCoE adapter and press
[Enter]
.
Ê
From the Fast!UTIL Options menu, select Configuration Settings , and press
[Enter] .
Ê
From the Configuration Settings menu, select Adapter Settings , and press
[Enter] .
CX2570 M1 Upgrade and Maintenance Manual 85
Basic software procedures
Ê
Note down the new 16-digit WWN address found under Adapter Port Name .
Ê
Press [Esc] to return to the main menu and exit the QLogic BIOS utility.
Ê
Inform the customer about the changed WWN address.
5.2.15 Using the Chassis ID Prom Tool
System information like server name and model, housing type, serial number and manufacturing data are stored in the system board.
In order to integrate your system into the ServerView management environment and to enable server installation using the ServerView Installation Manager, system data needs to be complete and correct.
After replacing the system board, system information has to be entered using the Chassis ID Prom tool. The tool and further instructions are available to maintenance personnel from the Fujitsu Technology Solutions Extranet: https://partners.ts.fujitsu.com/com/service/ps/Servers/PRIMERGY/
Ê
Select your PRIMERGY system from the main area of the page.
Ê
From the categories selection, choose Software & Tools Documentation .
Ê
In the Tools area click Tools: Chassis-IDProm Tool to download the file
( tool-chassis-Idprom-Tool.zip
).
I
For the Japanese market, follow the instructions provided separately.
5.2.16 Configuring LAN teaming
Use ServerView Operations Manager to obtain detailed information on existing
LAN teams:
Ê
In ServerView Operations Manager Single System View select System Status from the Information / Operation menu.
Ê
Under Network Interfaces select LAN Teaming .
Ê
The Network Interfaces (Summary) overview shows all configured LAN teams and their components. Choose a LAN team to display further details:
– LAN Team Properties : Properties of the selected LAN team
– LAN Team Statistics : Available statistics about the selected LAN team
86 Upgrade and Maintenance Manual CX2570
Basic software procedures
I
For more detailed information, refer to the "ServerView Operations
Manager - Server Management" user guide.
5.2.16.1 After replacing / upgrading LAN controllers
Please note when re-using a replaced LAN controller:
Ê
Confirm with the customer whether the LAN controller you have replaced has been used as part of a LAN teaming configuration.
Ê
If LAN teaming has been active, you will need to restore the configuration using the LAN driver utility after replacing the LAN controller.
Ensure that the controllers have been assigned as primary or secondary according to your requirements.
I
For details, refer to the relevant LAN driver manual.
5.2.16.2 After replacing the system board
Ê
Confirm with the customer whether the onboard LAN controller you have replaced has been used as part of a LAN teaming configuration.
Ê
If LAN teaming has been active, you will need to restore the configuration using the LAN driver utility after replacing the system board.
I
For details, refer to the relevant LAN driver manual.
5.2.17 Switching off the ID indicator
Press the ID button on the front panel, or use the iRMC web frontend or
ServerView Operations Manager to switch off the ID indicator after the maintenance task has been concluded successfully.
I
For further information, refer to the "ServerView Suite Local Service
Concept (LSC)" and "Integrated Remote Management Controller" user guides.
Using the ID button on the front panel
Ê
Press the ID button on the front panel to switch off the ID indicators.
CX2570 M1 Upgrade and Maintenance Manual 87
Basic software procedures
Using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Under System Overview , click Identify LED Off to switch off the ID indicators.
Using ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View and press the Locate button in the title bar to switch off the ID indicator.
5.2.18 Performing a fan test
I
Notes on replacing a defective fan
After replacing a defective system fan or power supply unit containing a defective fan, the fan error indicators will stay lit until the next fan test. By default, a fan test is automatically started every 24 hours. The first automatic fan test being performed after replacing a fan will turn off the fan error indicator.
If you want to start the fan test manually, you can do so by following the description below:
Executing the fan test via the iRMC Web interface
Ê
Log into the iRMC web interface.
Ê
Under Sensors select Fans .
Ê
Select the replaced fan in the system fans group and click Start Fan Test .
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
Executing the fan test via ServerView Operations Manager
Ê
Open the ServerView Operations Manager and log in.
Ê
Under Administration select Server Configuration .
Ê
In the hierarchy tree of the Server list tab, select the server to be configured.
Ê
In the right-hand side of the window, specify the details on the selected server and confirm your entries by clicking GO...
.
88 Upgrade and Maintenance Manual CX2570
Basic software procedures
In the left-hand section of the window, the Configuration tab is being activated.
Ê
In the navigation area of the Configuration tab, select Other Settings .
Ê
Under Daily Fan Test , set the daily fan test time to a few minutes from the current time. (Ensure to note down your previous setting.)
Ê
Click Save Page .
The fan test will be started at the specified time.
Ê
After the fan test is complete, restore the time setting to its initial value and click Save Page .
I
For more detailed information, refer to the "ServerView Operations
Manager" user guide.
For the Japanese market: Executing the fan test via Chassis ID Prom Tool
I
Please follow the instructions provided separately.
CX2570 M1 Upgrade and Maintenance Manual 89
Basic software procedures
5.2.19 Resetting the error status after replacing memory modules or processors
5.2.19.1 Memory modules
ServerView Operations Manager may report a defective memory module in case of a memory error.
I
Important note
After replacing a defective memory module, please check if the error counter has been reset automatically. If the memory slot is still marked as failed, please reset the error counter manually using one of the methods below.
Using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the System Information menu.
Ê
Under System Components , select the check boxes next to the affected memory modules.
Ê
From the drop down list, select Reset Error Counter .
Ê
Click Apply for the changes to take effect.
Using ServerView Maintenance Tools (Windows only)
Ê
Launch the ServerView Maintenance Tools:
– Windows Server 2008 R2 and below:
Start > (All) Programs > Fujitsu > ServerView Suite > Agents >
Maintenance Tools
– Windows Server 2012 and above:
Start > Apps > Fujitsu > Maintenance Tools
Ê
Choose the Memory status tab.
Ê
Select the memory module which shows the pre-failure status.
Ê
Click on Reset Status .
I
The Reset Status button will only be available if the selected memory module contains errors.
90 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
Using the command line interface (Linux only)
The memory error counter can be reset using the meclear
utility which is part of the ServerView agents for Linux.
I meclear
(Memory Module Error Counter Reset Utility) allows to reset the error count collected for a memory module, for example after it has been replaced.
For further details, please refer to the meclear
manual pages.
Ê
Log in as root.
Ê
Enter the command below, followed by [ENTER] :
/usr/sbin/meclear
Ê
Select the number of a memory module with a status other than "OK" or
"Not available".
Ê
Repeat the step above until all memory modules show the "OK" status.
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
5.2.19.2 Processors
ServerView Operations Manager may report a defective processor in case of a critical error.
I
Important note
After replacing a defective CPU, the error counter must be reset manually using one of the methods below.
Using ServerView Maintenance Tools (Windows only)
Ê
Launch the ServerView Maintenance Tools:
– Windows Server 2008 R2 and below:
Start > (All) Programs > Fujitsu > ServerView Suite > Agents >
Maintenance Tools
– Windows Server 2012 and above:
Start > Apps > Fujitsu > Maintenance Tools
CX2570 M1 Upgrade and Maintenance Manual 91
Basic software procedures
Ê
Choose the CPU status tab.
Ê
Select the CPU which shows the pre-failure status.
Ê
Click on Reset Status .
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
Using the command line (Linux only)
Proceed as follows to reset the error counter of a specific processor:
Ê
Log in as root.
Ê
Enter the command below, followed by
[ENTER]
:
– For rack and tower servers (RX and TX server series):
/usr/sbin/eecdcp -c oc=0609 oi=<CPU#>
– For blade and scale-out servers (BX and CX server series):
/usr/sbin/eecdcp -c oc=0609 oi=<CPU#> cab=<cabinet nr>
To identify the cabinet number, enter the following command:
/usr/sbin/eecdcp -c oc=E204
I
<CPU#>
parameters are "0" for CPU 1 and "1" for CPU 2.
Ê
If the error status cannot be reset with the method above, please use the following procedure for resetting the error counter of all processors:
Ê
Log in as root.
Ê
Enter the commands below, followed by
[ENTER]
:
1.
/etc/init.d/srvmagt stop
/etc/init.d/srvmagt_scs stop
/etc/init.d/eecd stop
/etc/init.d/eecd_mods_src stop
2.
cd /etc/srvmagt
3.
rm -f cehist.bin
4.
/etc/init.d/eecd_mods_src start
/etc/init.d/eecd start
/etc/init.d/srvmagt start
/etc/init.d/srvmagt_scs start
92 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
CX2570 M1 Upgrade and Maintenance Manual 93
Basic software procedures
94 Upgrade and Maintenance Manual CX2570
6 Expansion cards
Safety notes
V
CAUTION!
● Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock.
●
●
●
●
●
Devices and components inside the server node remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
If devices are installed or disassembled using methods other than those outlined in this chapter, the warranty will be invalidated.
For further information, please refer to chapter "Important information" on page 27 .
CX2570 M1 Upgrade and Maintenance Manual 95
Expansion cards
6.1
Basic information
The system board is equipped with two expansion slots:
Figure 24: PCI slot overview
Pos.
3
4
1
2
Slot Type Mechanical connector
11-14 PCI Gen3 x16
5-8 PCI Gen3 x16
1-4 PCI Gen3 x16
15-18 PCI Gen3 x16
Function
CPU2
CPU1 (GPGPU or Photonics)
CPU1
CPU2 (GPGPU)
96 Upgrade and Maintenance Manual CX2570
Expansion cards
Expansion card overview
Parts Supplier
GPGPU K20
GPGPU K20X
GPGPU K40
GPGPU K80
GK210-Duo
XeonPhi 3120P
XeonPhi 5110P
XeonPhi 7120P
Grid K1
Grid K2
PSAS CP400e
PSAS CP400i
PRAID CP400i (Lynx4)
PRAID EP400i 1GB cache
PRAID EP420i 2GB cache
PLAN CP 2x1Gbit Cu Intel I350-T2
PLAN CP 2x1Gbit Cu Intel I350-T4
2x10Gbit SFP+ D2755
2x10Gbit Cu Intel X540-AT2
2x16G FC LPe16002
2x8G FC LPe12002
1x8G FC LPe1250
2x16G FC Qlogic QLE2672
CNA OCe14102
IB Intel HCA 1port QLE7342 CK
IB Intel HCA 2port QLE7340 CK
IB HCA 40Gb 1port QDR CX3
IB HCA 40Gb 2port QDR CX3
IB HCA 56Gb 1port FDR
IB HCA 56Gb 2port FDR
IB HCA 100Gb EDR
NVIDIA -
NVIDIA -
NVIDIA -
NVIDIA -
NVIDIA -
Intel -
Intel -
Intel -
NVIDIA -
NVIDIA -
LSI
Fujitsu
Fujitsu
Fujitsu
Fujitsu
Intel
Intel
Fujitsu
Intel
Emulex
Emulex
Emulex
Qlogic
Emulex
Intel
Intel
Mellanox
Mellanox
Mellanox
Mellanox
Mellanox
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 2
1 1
1 1
1 1
1 1
1 2
1 2
1 2
-
-
-
-
-
-
-
-
- 2 1
- 2 1
- 2 1
- 2 1
- 2 1
- 2 1
- 2 1
- 2 1
-
-
- 2 1
- 2 1
2 1 -
1 - -
-
-
1 -
1 -
-
-
1 - -
2 1 -
2 1 -
2 1 -
-
-
-
-
-
-
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
2 1 -
-
-
-
-
-
-
-
-
-
-
-
-
-
CX2570 M1 Upgrade and Maintenance Manual 97
Expansion cards
I
The list may be changed due to new controllers.
For the latest information on supported expansion cards, refer your server’s hardware configurator available online at the following address: for the EMEA market: http://ts.fujitsu.com/products/standard_servers/index.htm
for the Japanese market: http://jp.fujitsu.com/platform/server/primergy/system/
98 Upgrade and Maintenance Manual CX2570
Expansion cards
6.2
Additional tasks
This section provides additional expansion card related information on how to install slot brackets and SFP+ transceiver modules.
I
For further instructions regarding controller settings, please refer to the accompanying documentation.
6.2.1
Mounting expansion card slot brackets
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
6.2.1.1
General instructions
Ê
Place the controller on the mounting tabs on the slot bracket.
Ê
Secure the slot bracket to the controller with two M3 x 4.5 mm screws.
Removal is carried out in reverse order.
CX2570 M1 Upgrade and Maintenance Manual 99
Expansion cards
6.2.1.2
Network adapter D2755
Figure 25: Placing the slot bracket - D2755
Ê
Place the controller on the mounting tabs on the slot bracket (1).
Ê
Carefully shift the slot bracket towards the controller until the plug shells engage with the cut-outs in the slot bracket connector panel (2).
Ê
Ensure that the ESD springs on the plug shells properly engage with the slot bracket as shown (see circles).
100 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 26: Fastening the slot bracket - D2755
Ê
Fasten the slot bracket to the controller with two M3 x 4.5 mm screws.
Figure 27: Assembled network adapter D2755
CX2570 M1 Upgrade and Maintenance Manual 101
Expansion cards
6.2.2
Handling SFP+ transceiver modules
6.2.2.1
Installing SFP+ transceiver modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
Preparing the SFP+ transceiver module
Figure 28: Removing the protective optical port plug
Ê
Remove the SFP+ transceiver module from its protective packaging.
Ê
Remove the optical port plug from the new / additional SFP+ transceiver module.
V
CAUTION!
– Always keep the protective port plugs attached to the transceiver optical bores and fiber-optic cable connectors until you are ready to make a connection.
– Save the protective port plug for future use.
102 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 29: Unlatching the locking bail
Ê
Carefully unlatch and fold down the locking bail on the SFP+ transceiver module.
CX2570 M1 Upgrade and Maintenance Manual 103
Expansion cards
Inserting the SFP+ transceiver module
Figure 30: Inserting the SFP+ transceiver module
Ê
Insert and slide the SFP+ transceiver module into the socket connector as far as it will go.
I
If only one slot is equipped with a SFP+ transceiver module, use the primary right connector as shown.
104 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 31: Latching the locking bail
Ê
Carefully fold up and latch the locking bail.
Figure 32: Attaching the protective optical port plug
Ê
If the SFP+ transceiver module is not immediately connected to an LC connector, attach the protective optical port plug to the transceiver optical bores.
CX2570 M1 Upgrade and Maintenance Manual 105
Expansion cards
Installing the secondary SFP+ transceiver module
Figure 33: Installing the secondary SFP+ transceiver module
Ê
If applicable, install the secondary SFP+ transceiver module accordingly.
106 Upgrade and Maintenance Manual CX2570
Expansion cards
6.2.2.2
Removing an SFP+ transceiver module
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
Figure 34: Removing the protective optical port plug
Ê
If present, remove the protective optical port plug from the SFP+ transceiver module.
V
CAUTION!
Save the protective port plug for future use.
CX2570 M1 Upgrade and Maintenance Manual 107
Expansion cards
Figure 35: Unlatching the locking bail
Ê
Carefully unlatch and fold down the locking bail on the SFP+ transceiver module to eject the transceiver from the socket connector.
108 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 36: Removing the SFP+ transceiver
Ê
Pull the SFP+ transceiver module out of its socket connector.
Ê
Reattach the protective optical port plug to the transceiver optical bores.
I
Place the removed SFP+ transceiver module in an antistatic bag or other protective environment.
CX2570 M1 Upgrade and Maintenance Manual 109
Expansion cards
6.2.2.3
Replacing SFP+ transceiver modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
Removing SFP+ transceiver modules
Ê
Remove the defective SFP+ transceiver module(s) as described in section
"Removing an SFP+ transceiver module" on page 107
.
Installing SFP+ transceiver modules
Ê
Unpack the new SFP+ transceiver module.
Ê
Verify that the new SFP+ transceiver module is the same type of transceiver you are replacing.
Ê
Install the new SFP+ transceiver module(s) as described in section
"Installing SFP+ transceiver modules" on page 102
.
Ê
Inform the customer about changed WWN and MAC addresses. For further information, refer to section
"Looking up changed MAC / WWN addresses" on page 84
.
I
By replacing SFP+ transceiver modules, WWN (World Wide Name) and MAC (Media Access Control) addresses will change.
110 Upgrade and Maintenance Manual CX2570
Expansion cards
6.3
Expansion cards in the riser module
Safety notes
V
CAUTION!
● Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock.
●
●
●
Devices and components inside the server remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
●
●
If devices are installed or disassembled using methods other than those outlined in this chapter, the warranty will be invalidated.
Follow the safety instructions in chapter "Important information" on page 27
.
CX2570 M1 Upgrade and Maintenance Manual 111
Expansion cards
6.3.1
Installing expansion cards
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
6.3.1.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
"Removing the riser module" on page 42
112 Upgrade and Maintenance Manual CX2570
6.3.1.2
Mounting a controller to the riser module
Expansion cards
Figure 37: Mounting a controller to the riser module
Ê
Plug the controller on the riser card connector (1).
I
Make sure that the metal pin of the controller bracket hooks into the recess of the riser bracket (see circle).
6.3.1.3
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 44
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
Reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Updating RAID controller firmware" on page 71
(if applicable)
CX2570 M1 Upgrade and Maintenance Manual 113
Expansion cards
Ê
"Enabling SVOM boot watchdog functionality" on page 76
6.3.2
Removing expansion cards
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
6.3.2.1
Preliminary steps
Perform the following procedures:
Ê
Locate the desired server node with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
Remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
"Removing the riser module" on page 42
114 Upgrade and Maintenance Manual CX2570
6.3.2.2
Removing a controller from the riser module
Expansion cards
Figure 38: Removing a controller from the riser module
Ê
Pull the controller out of the riser card connector (1).
I
Make sure that the metal pin of the controller bracket does not get stucked with the recess of the riser bracket (see circle).
6.3.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 44
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
"Controls and indicators on the server node" on page 55
CX2570 M1 Upgrade and Maintenance Manual 115
Expansion cards
6.3.3
Replacing expansion cards
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
Note on network settings recovery
I
When replacing network controllers or the system board, network configuration settings in the operating system will be lost and replaced by default values. This applies to all static IP address and LAN teaming configurations.
Ensure to note down your current network settings before replacing a controller or the system board.
6.3.3.1
Preliminary steps
Perform the following procedures:
Ê
Locate the desired server node with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
Remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
"Removing the riser module" on page 42
6.3.3.2
Removing an expansion card
Ê
Remove the defective expansion card as described in
"Removing a controller from the riser module" on page 115 .
Ê
If applicable, remove SFP+ transceiver modules from the expansion card, as described in section
"Removing an SFP+ transceiver module" on page 107
.
116 Upgrade and Maintenance Manual CX2570
Expansion cards
Ê
If the slot bracket on the defective expansion card is to be reused, remove it from the board as described in section
"Mounting expansion card slot brackets" on page 99
.
6.3.3.3
Installing an expansion card
Ê
If applicable, install a slot bracket on the new expansion card as described in section
"Mounting expansion card slot brackets" on page 99
.
Ê
If applicable, reinstall SFP+ transceiver modules on the new expansion card, as described in section
"Installing SFP+ transceiver modules" on page 102 .
Ê
.
Ê
If applicable, connect internal cables to the expansion card.
I
For a complete cabling overview, please refer to section "Cabling overview" on page 250
.
6.3.3.4
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 44
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
Reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Updating RAID controller firmware" on page 71
(if applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 76
Ê
"Updating the NIC configuration file in a Linux environment" on page 81
Ê
"Looking up changed MAC / WWN addresses" on page 84
CX2570 M1 Upgrade and Maintenance Manual 117
Expansion cards
6.4
Riser card
V
CAUTION!
Follow the safety instructions in chapter
"Important information" on page 27 .
6.4.1
Replacing the riser card
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – Phillips PH2 / (+) No. 2 screw driver
– Phillips PH2 / (+) No. 2 screw driver)
6.4.1.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
"Removing expansion cards" on page 114 (if applicable)
118 Upgrade and Maintenance Manual CX2570
6.4.1.2
Replacing the riser card
Expansion cards
Figure 39: Replacing the riser card
The riser module consists of the riser metal bracket and the riser card.
The riser card is connected to the riser metal bracket with two rivets:
– Rivet (1).
– Rivet with bolt (2).
Ê
For removing the riser card loosen the two rivets and take off the riser card.
Ê
For installing the new riser card put the riser card on the riser metal bracket and fasten the two screws.
CX2570 M1 Upgrade and Maintenance Manual 119
Expansion cards
6.4.1.3
Concluding steps
Perform the following procedures:
Ê
If applicable, re-install the expansion cards as described in section
"Installing expansion cards" on page 112 .
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
120 Upgrade and Maintenance Manual CX2570
7 Main memory
Safety notes
V
CAUTION!
● Do not install unsupported third party memory modules. For further information on supported memory modules, refer to section
"Basic information" on page 122
.
●
●
●
●
Memory modules remain hot after shutdown. Wait for components to cool down before installing or removing memory modules to prevent burns.
Do not insert and remove memory modules repeatedly. Doing so may cause failures.
Pressing out the securing clips on the memory module connector will eject the installed memory module. To prevent damage and injuries eject memory modules carefully without applying excessive force.
For further information, please refer to chapter "Important information" on page 27 .
CX2570 M1 Upgrade and Maintenance Manual 121
Main memory
7.1
Basic information
– Each CPU offers 8 Slots for DDR4 memory modules organized in 2 banks and 4 channels.
– Supported memory modules:
There are 2 different kinds of DDR4 Memory Modules available: RDIMM and
LRDIMM.
– RDIMM / LRDIMM offer different functionality. Mix of RDIMM / LRDIMM is not allowed.
– Depending on the amount of memory configured you can decide between 2 basic modes of operation: Independent and Performance mode .
– Max. DDR4 memory speed depends on the memory configuration on one memory channel and the speed of the CPU.
– The memory channel with the lowest speed defines the speed of all CPU channels in the system.
– "If memory modules with different capacities are used: Populate modules with higher capacities first.
– "If memory modules with different speeds are used: Populate modules with higher speed first.
– Populate same amounts of memory equally for both CPUs.
7.1.1
Memory sequence
– Populate memory slot 1 / channel A (DIMM-A1) first.
– Within the 4 channels, memory slot 1 must be populated prior to slot 2.
– If memory modules with different capacities are used:
– Install modules with higher capacities first.
– Within a channel, install modules in descending order of capacity.
– If memory modules with different speeds are used, the lowest clock rate applies for all DIMMs.
122 Upgrade and Maintenance Manual CX2570
Main memory
Minimum configuration
Minimum configuration is 2x CPU and 2x memory.
Maximum configurations
– 16x 64GB LRDIMM (quad rank modules) = 1024GB
– 16x 16GB RDIMM (dual rank modules) = 256GB
First Memory (one module) has to be selected for an orderable basic unit per
CPU.
– Memory upgrade is possible by 1x memory units.B
– SDDC (Chipkill) is supported for memory modules.
Figure 40: Memory overview
CX2570 M1 Upgrade and Maintenance Manual 123
Main memory
7.1.2
Operation modes
Independent Channel Mode
CPU
Channel
Color
Slot descriptor
No. of Modules
1
2
3
4
7
8
5
6
9
10
11
12
13
14
15
16
6
7
8
2
3
4
5
1A 2A 1B 2B
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
A
5
5
5
5
9
9
9
9
9
9
9
9
3
3
3
3
3
3
B
7
7
5
5
5
5
5
5
5
5
5 13
5 13
5 13
5 13
CPU 1
D C G H
2D 1D 2C 1C 1G 2G 1H 2H
1 CPU populated
8
4
4
4
4
4
7
7
7
7
7 11
7 11
7 11
7 11
15 7 11
15 7 11
6
6
6
2
2
2
2
2
2
2
2 CPU populated
3
3
3
3
3
3
3
3
3
3
3
3
3
3
4
4
4
4
4
4
4
4
4 12
4 12
4 12
4 12
4 12
8
8
8
8
8
8
8
8
8 16
CPU 2
2F
14
14
14
F
1F
6
6
2E
6
6
6 10
6 10
6 10
6 10
6 10
6 10
6 10
E
1E
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
Performance Channel Mode
CPU
Channel
Color
Slot
No. of Modules
4
8
8
12
16
A B
1A 2A 1B 2B
1
1
1
1
1 2
3
3
1
1
1
1
1
2
3
3
CPU 1
D C G H
2D 1D 2C 1C
1
1G 2G 1H 2H
1 CPU populated
1
2 1 2 1
2 CPU populated
1 2
3
3
1
1
1
3
3
1
1
2
2 4
2
2
2 4
CPU 2
2F
4
F
1F
2
2
2
2E
4
E
1E
2
2
2
124 Upgrade and Maintenance Manual CX2570
Main memory
7.2
Installing memory modules
I
If liquid cooling is installed, first prepare the memory modules as described in section
"Cooling pads on the memory modules" on page 243
.
Upgrade and Repair Unit
(URU)
Tools: tool-less
Hardware: 5 minutes
7.2.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
Disconnect the SATA cable(s) from the connectors on the system board
described in section "Cabling for HDD 2.5"" on page 252 , and take it out of
the chassis.
Ê
"Removing the memory slot air ducts" on page 49
Ê
Identify the correct memory slot according to the mounting order described in section
"Memory sequence" on page 122 .
CX2570 M1 Upgrade and Maintenance Manual 125
Main memory
7.2.2
Installing a memory module
Figure 41: Installing memory modules (A)
Ê
Press out the securing clip at each end of the memory module connector.
Figure 42: Installing memory modules (B)
Ê
Press down on the memory module until the securing clips snap into the cutouts at each end of the module.
V
CAUTION!
Install dummy modules in not used memory slots.
126
Figure 43: Memory dummy module
Upgrade and Maintenance Manual CX2570
Main memory
7.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the memory slot air ducts" on page 50
Ê
Connect the SATA cable(s) to the connectors on the system board described in section
"Cabling for HDD 2.5"" on page 252
and reroute the cables as described in section
.
Ê
Identify the correct memory slot according to the mounting order described in section
"Memory sequence" on page 122 .
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 76
Ê
"Verifying the memory mode" on page 78
(if applicable)
Ê
"Resetting the error status after replacing memory modules or processors" on page 90
CX2570 M1 Upgrade and Maintenance Manual 127
Main memory
7.3
Removing memory modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
7.3.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
Disconnect the SATA cable(s) from the connectors on the system board described in section
"Cabling for HDD 2.5"" on page 252
and take it out of the chassis.
Ê
"Removing the memory slot air ducts" on page 49
Ê
Identify the desired memory slot according to the mounting order described
in section "Memory sequence" on page 122
.
V
CAUTION!
Ensure to maintain an operational configuration when removing memory modules. For additional information, please refer to section
"Operation modes" on page 124 .
128 Upgrade and Maintenance Manual CX2570
7.3.2
Removing a memory module
Main memory
Figure 44: Removing memory modules (A)
Ê
Eject the desired memory module by pressing out the securing clips at each end of the memory module connector.
Figure 45: Removing memory modules (B)
Ê
Remove the ejected memory module.
CX2570 M1 Upgrade and Maintenance Manual 129
Main memory
7.3.3
Concluding step
Perform the following procedures:
Ê
"Installing the memory slot air ducts" on page 50
Ê
Connect the SATA cable(s) to the connectors on the system board described
in section "Cabling for HDD 2.5"" on page 252 and reroute the cables as
described in section
"Cabling onboard" on page 252 or
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65 (if
applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 76
Ê
"Verifying the memory mode" on page 78
(if applicable)
Ê
"Resetting the error status after replacing memory modules or processors" on page 90
130 Upgrade and Maintenance Manual CX2570
Main memory
7.4
Replacing memory modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
7.4.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
Disconnect the SATA cable(s) from the connectors on the system board
described in section "Cabling for HDD 2.5"" on page 252 and take it out of
the chassis.
Ê
"Removing the memory slot air ducts" on page 49
CX2570 M1 Upgrade and Maintenance Manual 131
Main memory
7.4.2
Removing a memory module
Ê
Identify the defective memory slot.
Ê
Remove the defective memory module as described in section "Removing memory modules" on page 128
.
7.4.3
Installing a memory module
Ê
Install the new memory module as described in section
"Installing memory modules" on page 125 .
7.4.4
Concluding steps
Perform the following procedures:
Ê
"Installing the memory slot air ducts" on page 50
Ê
Connect the SATA cable(s) to the connectors on the system board described
in section "Cabling for HDD 2.5"" on page 252 , and reroute the cables as
described in section
"Cabling onboard" on page 252 or
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65 (if
applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 76
Ê
"Verifying the memory mode" on page 78
(if applicable)
Ê
"Resetting the error status after replacing memory modules or processors" on page 90
132 Upgrade and Maintenance Manual CX2570
8 Processors
Safety notes
V
CAUTION!
● Do not install unsupported processors. For further information on
supported processors, refer to section "Basic information" on page 134
.
● Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs)
●
●
●
●
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
When removing or installing the processor, be careful not to touch or bend the spring contacts on the processor socket.
Never touch the underside of the processor. Even minor soiling such as grease from the skin can impair the processor’s operation or destroy the processor.
Follow the safety instructions in chapter "Important information" on page 27
.
CX2570 M1 Upgrade and Maintenance Manual 133
Processors
8.1
Basic information
8.1.1
Supported processors
– Intel Xeon E5-2600v3 processor series CPUs
– Socket type: LGA 2011 package
8.1.2
Processor locations
Figure 46: CPU slots on system board D3343
134 Upgrade and Maintenance Manual CX2570
Processors
8.2
Replacing processors
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: – tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
– Removing and installing the processor: tool-less
V
CAUTION!
Processors are extremely sensitive to electrostatic discharge and must be handled with care. After a processor has been removed from its protective sleeve or from its socket, place it upside down on a nonconducting, antistatic surface. Never push a processor over a surface.
8.2.1
Preliminary steps
Before replacing the processor, perform the following steps:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
If applicable, remove the liquid cooling kit from the server node as described in section
"Removing the liquid cooling kit" on page 233 .
CX2570 M1 Upgrade and Maintenance Manual 135
Processors
8.2.2
Removing processor heat sinks
8.2.2.1
Removing the processor heat sinks
Figure 47: Removing the processor heat sink
Ê
Carefully press on the middle of the heat sink and loosen the four captive screws in a crossover pattern according to the numbering.
Ê
Carefully turn the heat sink back and forth to detach it from the processor.
I
This may be necessary due to the adhesive quality of the thermal paste located between the heat sink and processor.
V
CAUTION!
Pay special attention not to damage any system board components surrounding the processor socket.
Ê
Lift the heat sink out of the chassis.
Ê
Thoroughly clean residual thermal paste from the surface of the heat sink and the processor using a lint-free cloth.
136 Upgrade and Maintenance Manual CX2570
8.2.3
Removing the processor
Processors
Figure 48: Opening socket release lever 1
Ê
Unlatch the socket release lever marked Open 1st by pushing it down and away from the socket (1).
Ê
The socket release lever will slightly lift up (2).
CX2570 M1 Upgrade and Maintenance Manual 137
Processors
Figure 49: Opening socket release lever 2
Ê
Unlatch the socket release lever marked Close 1st by pushing it down and away from the socket (1).
Ê
Fully fold back the second socket release lever (2).
138 Upgrade and Maintenance Manual CX2570
Processors
Figure 50: Opening the load plate (A)
Ê
Push down on the socket release lever marked Open 1st (1) to lift the load plate away from the socket (2).
CX2570 M1 Upgrade and Maintenance Manual 139
Processors
Figure 51: Opening the load plate (B)
Ê
Fully open the load plate.
V
CAUTION!
Be careful not to touch or bend the spring contacts on the processor socket.
– If the processor may be reused later, thoroughly clean residual thermal paste from the processor surface using a lint-free cloth and store the processor in a save place.
V
CAUTION!
Processors are extremely sensitive to electrostatic discharge and must be handled with care. After a processor has been removed from its protective sleeve or from its socket, place it upside down on a nonconducting, antistatic surface. Never push a processor over a surface.
140 Upgrade and Maintenance Manual CX2570
8.2.4
Installing the processor
Processors
Figure 52: Installing the processor (1)
Ê
Hold the processor with your thumb and index finger.
Ê
Make sure that the four notches on the processor align with the posts on the socket.
Ê
Lower the processor straight down without tilting or sliding it in the socket.
V
CAUTION!
– Ensure that the processor is level in the socket.
– Be careful not to touch or bend the pins on the processor socket.
– Never touch the underside of the processor. Even minor soiling such as grease from the skin can impair the processor’s operation or destroy the processor.
– Ensure not to scrape or dent the processor edges.
Ê
Carefully lower the load plate over the processor.
CX2570 M1 Upgrade and Maintenance Manual 141
Processors
Figure 53: Installing the processor (2)
V
CAUTION!
Always replace the socket cover if you remove the processor from the socket!
142 Upgrade and Maintenance Manual CX2570
Processors
Figure 54: Closing socket release lever 1 and 2
Ê
Fully close and hold shut the load plate.
Ê
Close the socket release lever marked Close 1st (1) and latch it under the load plate retention tab to lock down the load plate (2).
CX2570 M1 Upgrade and Maintenance Manual 143
Processors
8.2.5
Applying thermal paste
I
For the Japanese market, the service engineer must follow the instruction provided separately.
I
If the processor upgrade or replacement kit contains a new CPU heat sink, a thin layer of thermal compound has already been pre-applied to its lower surface. In this case, please proceed with section
"Installing the processor heat sink" on page 146 .
Figure 55: Thermal paste syringe
One thermal compound syringe contains thermal paste for two processors.
In order to determine the correct amount of thermal paste (equal to 1.0 gram), divide the grey area of the syringe up into two equal segments.
I
Add graduation marks to the syringe using a permanent marker to help you apply the thermal paste.
144 Upgrade and Maintenance Manual CX2570
Processors
Figure 56: Applying thermal paste
Ê
Apply a small streak of thermal paste (1.0 gram, see description above) to the center of the processor surface as shown.
V
CAUTION!
Do not mix different types of thermal paste.
CX2570 M1 Upgrade and Maintenance Manual 145
Processors
8.2.6
Installing the processor heat sink
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: – Preliminary and concluding steps: tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
8.2.6.1
Processor heat sink CPU1
Figure 57: Processor heat sink for CPU1
146 Upgrade and Maintenance Manual CX2570
8.2.6.2
Processor heat sink CPU2
Processors
Figure 58: Processor heat sink for CPU2
8.2.6.3
Installing the heat sinks
Figure 59: Installing the processor heat sinks
Ê
Carefully seat the heat sink on the four threaded holes as shown.
CX2570 M1 Upgrade and Maintenance Manual 147
Processors
V
CAUTION!
– Ensure that the screws on the heat sink are properly seated on the threaded holes (see circles).
– Ensure that the heat sink cooling fins match the direction of the airflow!
I
To avoid inclining of the heat sink carefully press on the middle of the heat sink.
Ê
Fasten the four captive screws on the heat sink in a crossover pattern according to the numbering (screw torque: 1.0 Nm, not applicable for the
Japanese market).
148 Upgrade and Maintenance Manual CX2570
Processors
8.2.7
Concluding steps
Perform the following steps:
Ê
If applicable, install the liquid cooling kit for the server node as described in section
"Installing a liquid cooling kit" on page 236
.
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
–
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
–
"Controls and indicators on the server node" on page 55
–
"Enabling SVOM boot watchdog functionality" on page 76
–
"Resetting the error status after replacing memory modules or processors" on page 90
CX2570 M1 Upgrade and Maintenance Manual 149
Processors
8.3
Replacing the processor heat sink
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: – Preliminary and concluding steps: tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
8.3.1
Preliminary steps
Before replacing the processor heat sink, perform the following steps:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
Ê
If applicable, remove the liquid cooling kit from the server node as described
in section "Removing the liquid cooling kit" on page 233 .
8.3.2
Removing the processor heat sink
Ê
Remove the processor heat sink as described in section
"Removing processor heat sinks" on page 136 .
8.3.3
Installing the processor heat sink
Ê
Remove the protective cover from the heat sink.
I
Ensure not to touch the thermal paste on the bottom of the heat sink.
Ê
Install the processor heat sink as described in section
"Installing the processor heat sink" on page 146
.
150 Upgrade and Maintenance Manual CX2570
Processors
8.3.4
Concluding steps
Perform the following steps:
Ê
If applicable, install the liquid cooling kit for the server node as described in section
"Installing a liquid cooling kit" on page 236
.
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
–
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
–
"Controls and indicators on the server node" on page 55
–
"Enabling SVOM boot watchdog functionality" on page 76
–
"Resetting the error status after replacing memory modules or processors" on page 90
CX2570 M1 Upgrade and Maintenance Manual 151
Processors
152 Upgrade and Maintenance Manual CX2570
9 System board and components
This chapter provides information on how to replace the system board module and system board components as its CMOS battery and the USB Flash Module
(UFM).
Safety notes
V
CAUTION!
● Devices and components inside the server remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
●
●
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
●
For further information, please refer to chapter "Important information" on page 27 .
9.1
Replacing the CMOS battery
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less; recommended: tooth pick
CMOS memory (volatile BIOS memory) and the real-time clock are powered by a lithium coin cell (CMOS battery). This cell lasts up to ten years, depending on ambient temperature and use.
If the CMOS battery is depleted or falls below minimum voltage levels, it need to be replaced immediately.
CX2570 M1 Upgrade and Maintenance Manual 153
System board and components
Safety notes
V
CAUTION!
● The CMOS battery must be replaced with an identical battery or with a battery type recommended by the manufacturer.
●
●
●
Keep lithium batteries away from children.
Do not throw batteries into the trash can. Lithium batteries must be disposed of in accordance with local regulations concerning special waste.
For further safety information, please refer to section "Environmental protection" in the PRIMERGY CX2570 M1 Operating Manual.
● Ensure to insert the CMOS battery with the positive pole facing up!
9.1.1
Preliminary steps
Perform the following procedures:
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
154 Upgrade and Maintenance Manual CX2570
System board and components
9.1.1.1
Localization of the CMOS battery
Figure 60: System board battery
CX2570 M1 Upgrade and Maintenance Manual 155
System board and components
9.1.2
Removing the CMOS battery
Figure 61: Removing the CMOS battery
Ê
Pull out the depleted CMOS battery of its socket.
156 Upgrade and Maintenance Manual CX2570
System board and components
9.1.3
Installing the CMOS battery
Figure 62: Installing the CMOS battery
Ê
Insert the new CMOS battery into its socket as shown.
V
CAUTION!
Ensure to insert the CMOS battery with the positive pole (label side) facing to you as shown (see close-up).
CX2570 M1 Upgrade and Maintenance Manual 157
System board and components
9.1.4
Concluding steps
Perform the following procedures:
Ê
Dispose of the CMOS battery in accordance with local regulations concerning special waste.
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Verifying the system time settings" on page 79
158 Upgrade and Maintenance Manual CX2570
System board and components
9.2
SATA DOM
The server node can be equipped with a SATA DOM.
9.2.1
Installing the SATA DOM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH1 / (+) No. 1 screw driver
9.2.1.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
CX2570 M1 Upgrade and Maintenance Manual 159
System board and components
9.2.1.2
Installing the SATA DOM
Figure 63: SATA DOM kit
1 SATA DOM
2 SATA DOM nylon spacer
160 Upgrade and Maintenance Manual CX2570
System board and components
Figure 64: SATA DOM mounting location
SATA DOM mounting location on the system board:
1
2
SATA DOM connector
SATA DOM spacer
CX2570 M1 Upgrade and Maintenance Manual 161
System board and components
Figure 65: Installing the SATA DOM spacer
Ê
Insert the spacer in the recess.
The spacer must audibly into place.
162 Upgrade and Maintenance Manual CX2570
System board and components
Figure 66: Installing the SATA DOM (A)
Ê
Connect the SATA DOM to the system board.
CX2570 M1 Upgrade and Maintenance Manual 163
System board and components
Figure 67: Installing the SATA DOM (B)
Ê
The SATA DOM on the SATA DOM spacer must audibly click into place (see arrow).
9.2.1.3
Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
164 Upgrade and Maintenance Manual CX2570
9.2.2
Removing the SATA DOM
System board and components
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – Preliminary and concluding steps: tool-less
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.2.2.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
CX2570 M1 Upgrade and Maintenance Manual 165
System board and components
9.2.2.2
Removing the SATA DOM
Figure 68: Removing the SATA DOM board (A)
Ê
Disconnect and remove the SATA DOM spacer of the defective SATA DOM board.
Ê
Disconnect and remove the defective SATA DOM board.
166 Upgrade and Maintenance Manual CX2570
System board and components
Figure 69: SATA DOM spacer
Ê
The SATA DOM spacer remains on the system board (1).
9.2.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 167
System board and components
9.2.3
Replacing the SATA DOM
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Software: 10 minutes
Tools: – Preliminary and concluding steps:
– combination pliers and flat nose pliers
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.2.3.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
9.2.3.2
Removing the SATA DOM
Ê
Remove the SATA DOM as described in section
"Removing the SATA DOM" on page 165
.
168 Upgrade and Maintenance Manual CX2570
System board and components
9.2.3.3
Re-installing the SATA DOM
Ê
Secure the SATA DOM module on the SATA DOM spacer with the nylon
screw as described in "Installing the SATA DOM board" on page 159 .
9.2.3.4
Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 169
System board and components
9.3
USB Flash Module (UFM)
The server node can be equipped with a USB Flash Module (UFM).
9.3.1
Installing the UFM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – Preliminary and concluding steps: tool-less
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.3.1.1
Required tools
– Preliminary and concluding steps: tool-less
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.3.1.2
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
170 Upgrade and Maintenance Manual CX2570
9.3.1.3
Installing the UFM board
System board and components
Figure 70: UFM kit
1
2
USB Flash Module (UFM)
UFM nylon spacer
CX2570 M1 Upgrade and Maintenance Manual 171
System board and components
Figure 71: UFM mounting location
UFM mounting location on the system board:
1 UFM connector
2 UFM spacer
172 Upgrade and Maintenance Manual CX2570
System board and components
Figure 72: Installing the UFM spacer
Ê
Insert the plastic spacer in the recess next to the multi-pin connector for the
TPM (see arrow).
The plastic spacer must audibly click into place.
Figure 73: Installing the UFM board (A)
Ê
Connect the UFM board to the system board.
CX2570 M1 Upgrade and Maintenance Manual 173
System board and components
Figure 74: Installing the UFM board (B)
Ê
The UFM module on the plastic spacer must audibly click into place (see arrow).
9.3.1.4
Concluding steps
Perform the following procedures:
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
9.3.1.5
Software configuration
In order to setup the ESXi configuration, the VMware ESXi Recovery Tools CD is required. An ISO image of the CD is available from the Fujitsu service partners portal at the following https address: https://globalpartners.ts.fujitsu.com/com/service/ps/Servers/PRIMERGY/
Pages/default.aspx
.
174 Upgrade and Maintenance Manual CX2570
System board and components
Ê
Sign in and choose your PRIMERGY server.
Ê
Select the Software & Tools Documentation category.
Ê
Download the desired ESXi Recovery CD ISO image, listed under Tools .
Ê
Unpack and burn the image to a CD.
Ê
Ensure that no other USB storage device is connected to the server beside the UFM.
Ê
Insert the Recovery Tools CD into your CD / DVD drive and reboot the server.
The server should now boot from the Recovery Tools CD.
Ê
Follow the on-screen instructions to initiate the installation.
After the flash process is complete, you will be asked to reboot the system.
I
For the Japanese market, follow the instructions provided separately.
9.3.2
Removing the UFM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – tool-less
– Phillips PH1 / (+) No. 1 screw driver
9.3.2.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
CX2570 M1 Upgrade and Maintenance Manual 175
System board and components
9.3.2.2
Removing the UFM board
Figure 75: Removing the UFM board (A)
Ê
Disconnect and remove the nylon spacer of the defective UFM board (1).
Ê
Disconnect and remove the defective UFM board (2).
Figure 76: UFM spacer
Ê
The UFM spacer remains on the system board (1).
176 Upgrade and Maintenance Manual CX2570
System board and components
9.3.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 177
System board and components
9.3.3
Replacing the UFM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
– combination pliers and flat nose pliers
– Phillips PH1 / (+) No. 1 screw driver
9.3.3.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
9.3.3.2
Removing the UFM
Ê
Remove the UFM as described in section "Removing the UFM board" on page 176
.
178 Upgrade and Maintenance Manual CX2570
System board and components
9.3.3.3
Re-installing the UFM
Ê
Connect the UFM board to the system board and secure the UFM module on the UFM spacer with the nylon screw as described in
"Installing the UFM board" on page 171 .
Destroying the defective UFM board
V
CAUTION!
The UFM board contains customer information (e.g. IP address, license numbers). After replacing the UFM, hand the defective UFM board over to the customer. If the customer requests disposal of the defective UFM board, proceed as follows:
Figure 77: Destroying the defective UFM board
Ê
Use a pair of combination pliers (1) and flat nose pliers (2) to break the UFM board in half as shown.
CX2570 M1 Upgrade and Maintenance Manual 179
System board and components
9.3.3.4
Concluding steps
Perform the following procedures:
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
9.3.3.5
Software configuration
In order to setup the ESXi configuration, the VMware ESXi Recovery Tools CD is required. An ISO image of the CD is available from the Fujitsu service partners portal at the following https address: https://globalpartners.ts.fujitsu.com/com/service/ps/Servers/PRIMERGY/
Pages/default.aspx
.
Ê
Sign in and choose your PRIMERGY server.
Ê
Select the Software & Tools Documentation category.
Ê
Download the desired ESXi Recovery CD ISO image, listed under Tools .
Ê
Unpack and burn the image to a CD.
Ê
Ensure that no other USB storage device is connected to the server beside the UFM.
Ê
Insert the Recovery Tools CD into your CD / DVD drive and reboot the server.
The server should now boot from the Recovery Tools CD.
Ê
Follow the on-screen instructions to initiate the installation.
After the flash process is complete, you will be asked to reboot the system.
I
For the Japanese market, follow the instructions provided separately.
180 Upgrade and Maintenance Manual CX2570
System board and components
9.4
iRMC microSD card
I
The iRMC microSD card is necessary for using the embedded Lifecycle
Management (eLCM) functionality of the iRMC. It requires a valid eLCM license key, which is always purchased together with the iRMC microSD card and activated through the iRMC web frontend.
For further information, please refer to the “ServerView embedded
Lifecycle Management (eLCM)” user guide.
9.4.1
Installing the iRMC microSD card
Upgrade and Repair Unit
(URU)
Average task duration:
5 minutes
Tools: tool-less
9.4.1.1
Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing a controller from the riser module" on page 48
CX2570 M1 Upgrade and Maintenance Manual 181
System board and components
9.4.1.2
Installing the iRMC microSD card
Figure 78: iRMC microSD card
Figure 79: Installing the iRMC microSD card
Ê
With the label facing up, insert the iRMC microSD card into the microSD card slot (1) as far as it will go (2).
I
The onboard position of the microSD card slot can be found in section
"Connectors and indicators" on page 258
.
9.4.1.3
Concluding steps
Ê
"Mounting a controller to the riser module" on page 47
Ê
"Installing the server node in the server enclosure" on page 54
Ê
"Enabling SVOM boot watchdog functionality" on page 76
182 Upgrade and Maintenance Manual CX2570
System board and components
9.4.2
Removing the iRMC microSD card
Upgrade and Repair Unit
(URU)
Average task duration:
5 minutes
Tools: tool-less
9.4.2.1
Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing a controller from the riser module" on page 48
9.4.2.2
Removing the iRMC microSD card
Figure 80: Removing the iRMC microSD card
Ê
To eject the iRMC microSD card, gently push it in and then let go (1).
Ê
Pull the iRMC microSD card straight out of its slot (2).
CX2570 M1 Upgrade and Maintenance Manual 183
System board and components
Destroying the defective iRMC microSD card
V
CAUTION!
The iRMC microSD card contains customer information. After replacing the iRMC microSD card, hand the defective card over to the customer. If the customer requests disposal of the defective iRMC microSD card, proceed as follows:
Ê
Using a pair of side-cutting pliers, cut the iRMC microSD card in half.
9.4.2.3
Concluding steps
Ê
"Mounting a controller to the riser module" on page 47
Ê
"Installing the server node in the server enclosure" on page 54
Ê
"Enabling SVOM boot watchdog functionality" on page 76
184 Upgrade and Maintenance Manual CX2570
System board and components
9.4.3
Replacing the iRMC microSD card
Upgrade and Repair Unit
(URU)
Average task duration:
5 minutes
Tools: tool-less
9.4.3.1
Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing a controller from the riser module" on page 48
9.4.3.2
Replacing the iRMC microSD card
Ê
Remove the defective iRMC microSD card as described in section
"Removing the iRMC microSD card" on page 183
.
Ê
Install the new iRMC microSD card as described in section
"Installing the iRMC microSD card" on page 181
.
9.4.3.3
Concluding steps
Ê
"Mounting a controller to the riser module" on page 47
Ê
"Installing the server node in the server enclosure" on page 54
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 185
System board and components
9.5
Replacing the system board
Field Replaceable Unit
(FRU)
Hardware: 50 minutes
Software: 10 minutes
Tools: – tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
– Removing and installing the UFM (if applicable):
– Phillips PH1 / (+) No. 1screw driver
– Removing and installing the processor: tool-less
Note on system information backup / restore
I
If AVR (Advanced Video Redirection) of iRMC Web IF is used, it is necessary to set the activation key for iRMC S4 advanced pack manually after replacing the system board. Fujitsu service personnel has to ask customer to put the activation key.
The chassis interface board contains the Chassis ID EPROM that contains system information like server name and model, housing type, serial number and manufacturing data.
To avoid the loss of non-default settings when replacing the system board, a backup copy of important system configuration data is automatically stored from the system board NVRAM to the Chassis ID
EPROM. After replacing the system board the backup data is restored from the Chassis ID board to the new system board.
Note on network settings recovery
I
When replacing network controllers or the system board, network configuration settings in the operating system will be lost and replaced by default values. This applies to all static IP address and LAN teaming configurations.
Ensure to note down your current network settings before replacing a controller or the system board.
186 Upgrade and Maintenance Manual CX2570
System board and components
9.5.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
9.5.2
Replacing the system board
Ê
Remove all cables from the system board.
Ê
"Removing memory modules" on page 128
I
Ensure to take note of the memory modules’ mounting positions for reassembly.
Ê
Remove all expansion cards as described in chapter
"GPGPU Extension" on page 195 (if applicable)
I
Ensure to take note of the controllers’ mounting positions and cable connections for reassembly.
Ê
"Removing the UFM board" on page 176 (if applicable)
Ê
"Removing the SATA DOM" on page 166 (if applicable)
Ê
"Removing the iRMC microSD card" on page 183
(if applicable)
Ê
"Removing the riser module" on page 42
CX2570 M1 Upgrade and Maintenance Manual 187
System board and components
9.5.2.1
Removing the system board
Figure 81: Removing the screw of the system board
Ê
Remove the screw from the system board (see circle).
188 Upgrade and Maintenance Manual CX2570
System board and components
Figure 82: Removing the system board
Ê
Carefully shift the system board in the direction of the arrow until the plug shells disengage from the cut-outs in the connector panel (see circles).
Ê
Hold the defective system board by the memory module ejectors and at a slight angle lift it out of the chassis.
CX2570 M1 Upgrade and Maintenance Manual 189
System board and components
9.5.2.2
Installing the system board
Figure 83: Installing the system board
Ê
Hold the new system board by the memory module ejectors.
V
CAUTION!
– Do not lift or handle the system board by any of its heat sinks!
– Ensure not to damage the EMI springs to comply with applicable
EMC regulations and satisfy cooling requirements and fire protection measures.
Ê
At a slight angle, lower the system board into the chassis.
Ê
Carefully shift the system board in the direction of the arrow until the plug shells engage with the cut-outs in the connector panel (see circles).
Ê
Lower the system board down.
190 Upgrade and Maintenance Manual CX2570
System board and components
Figure 84: Securing the screw of the system board
Ê
Secure the system board with the screw (see circle).
9.5.2.3
Swapping processors
Preparing the processor socket load plates on the new system board
Ê
"Installing the processor" on page 141
Removing processors from the defective system board
Ê
Carefully remove the processors from their sockets on the defective system board as described in
"Removing the processor" on page 137 .
V
CAUTION!
Remove and reinstall one processor at a time. Do not remove the second processor from the defective system board until the first processor has been installed on the new system board.
CX2570 M1 Upgrade and Maintenance Manual 191
System board and components
Installing processors on the new system board
Ê
"Installing the processor" on page 141
.
Installing protective socket covers on the defective system board
I
Since the defective system board is sent back for repair, protect the delicate processor socket springs with a socket cover.
Ê
"Installing the processor" on page 141
9.5.2.4
Completing the system board
Ê
"Replacing the riser card" on page 46
Ê
"Installing the UFM board" on page 171
(if applicable)
Ê
"Installing the SATA DOM board" on page 159
(if applicable)
Ê
"Installing the iRMC microSD card" on page 182
(if applicable)
Ê
Install all expansion cards as described in chapter
(if applicable)
I
Install the expansion cards into their original slots.
Ê
"Installing a memory module" on page 126
I
Install the memory modules into their original slots.
Ê
Reconnect all cables to the system board. For a complete cabling overview,
please refer to section "Cabling overview" on page 250 .
192 Upgrade and Maintenance Manual CX2570
System board and components
9.5.3
Concluding steps
Perform the following steps:
Ê
"Installing the GPGPU extension" on page 51
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 55
Ê
"Using the Chassis ID Prom Tool" on page 86
Ê
"Enabling SVOM boot watchdog functionality" on page 76 (if applicable)
Ê
"Verifying system information backup / restore" on page 71
Ê
"Verifying the system time settings" on page 79
Ê
Inform the customer about changed WWN and MAC addresses. For further information, refer to section
"Looking up changed MAC / WWN addresses" on page 84 .
Ê
After replacing the system board in a server running Linux OS, update the
MAC address of the onboard network controller in the related NIC definition file as described in section
"Updating the NIC configuration file in a Linux environment" on page 81
.
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 193
System board and components
194 Upgrade and Maintenance Manual CX2570
10 GPGPU Extension
Safety notes
V
CAUTION!
● Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock.
●
●
●
●
●
Devices and components inside the server node remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
If devices are installed or disassembled using methods other than those outlined in this chapter, the warranty will be invalidated.
For further information, please refer to chapter "Important information" on page 27 .
CX2570 M1 Upgrade and Maintenance Manual 195
GPGPU Extension
10.1 Basic information
With the GPGPU extension, the system offers two slots for GPGPU, Xeon Phi and GRID Kx.
5
6
3
4
Figure 85: GPGPU extension overview
1
2
GPGPU 2 (for GPGPU/Xeon Phi/GRID Kx)
PCI slot for GPGPU 1, connected to PCIe slot 5-8 on system board (see figure
"PCI slot overview" on page 96
)
Power connector for GPGPU 2 (not visible)
GPGPU 1 (for GPGPU/Xeon Phi/GRID Kx)
Power connector for GPGPU 1
PCI slot for GPGPU 2, connected to PCIe slot 15-18 on system board (see figure
"PCI slot overview" on page 96
)
I
For information about available GPGPU, Xeon Phi and GRID Kx please refer section
"Expansion card overview" on page 97 .
I
Install in slot GPGPU 2 always first.
196 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.2 Installing Xeon Phi
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.2.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
10.2.2 Installing Xeon Phi to slot GPGPU 2
Figure 86: Connecting the Xeon Phi to the PCI connector
Ê
Plug in the Xeon Phi to the PCI slot 2 (1).
CX2570 M1 Upgrade and Maintenance Manual 197
GPGPU Extension
Figure 87: Securing Xeon Phi
Ê
Attach the fixing bracket to chassis with two crosshead screws (see circles).
– Tighten the screws only loosely.
Ê
Push the bracket to the Xeon Phi.
Ê
Fasten the screws.
Figure 88: Connecting the power cable
Ê
Connect the power cable (see circles).
198 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.2.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
10.3 Removing Xeon Phi from slot GPGPU 2
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.3.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
CX2570 M1 Upgrade and Maintenance Manual 199
GPGPU Extension
10.3.2 Removing Xeon Phi
Figure 89: Disconnecting the power cable
Ê
Disconnect the power cable (see circles).
Figure 90: Removing the fixing bracket
Ê
Remove the two screws (see circle) and remove the fixing bracket.
200 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 91: Disconnecting the Xeon Phi
Ê
Disconnect the Xeon Phi from the PCI slot and remove the Xeon Phi.
10.3.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 201
GPGPU Extension
10.4 Replacing Xeon Phi in slot GPGPU 2
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.4.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
Ê
If applicable,
"Removing Xeon Phi from slot GPGPU 1" on page 209
10.4.2 Removing Xeon Phi
Ê
Remove the Xeon Phi as described in section "Removing Xeon Phi" on page 200
.
10.4.3 Installing Xeon Phi
Ê
Install the new Xeon Phi as described in section "Installing Xeon Phi" on page 197
.
202 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.4.4 Concluding steps
Perform the following procedures:
Ê
If applicable, "Installing Xeon Phi (slot GPGPU 1)" on page 204
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
10.5 Installing Xeon Phi in slot GPGPU 1
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.5.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
CX2570 M1 Upgrade and Maintenance Manual 203
GPGPU Extension
10.5.2 Installing Xeon Phi (slot GPGPU 1)
Figure 92: Threading the cable tie
Ê
Thread the cable tie through the eyelet of the chassis.
204 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 93: Connecting GPGPU 1 to the PCI connector
Ê
Plug the Xeon Phi in PCI slot 1 (1).
CX2570 M1 Upgrade and Maintenance Manual 205
GPGPU Extension
Figure 94: Securing Xeon Phi
Ê
Attach the fixing bracket to chassis with two crosshead screws (see circles).
– Tighten the screws only loosely.
Ê
Push the bracket to the Xeon Phi.
Ê
Fasten the screws.
206 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 95: Connecting the power cable
Ê
Connect the power cable (see circles).
CX2570 M1 Upgrade and Maintenance Manual 207
GPGPU Extension
Figure 96: Securing the power cable
Ê
Pull the power cable tight at the GPGPU connector (1).
Ê
Loop the cable tie around the power cable (2).
Ê
Close the cable tie around the power cable (2) and pull tight (3) to secure the power cable.
Ê
Shorten the cable tie (4).
10.5.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65 (if
applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
208 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.6 Removing Xeon Phi from slot GPGPU 1
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.6.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
10.6.2 Removing Xeon Phi (GPGPU1)
Figure 97: Opening the cable tie
Ê
Open on the locking lever on the cable clamp (see arrow).
CX2570 M1 Upgrade and Maintenance Manual 209
GPGPU Extension
Figure 98: Disconnecting the power cable
Ê
Disconnect the power cable (see circles).
Figure 99: Removing the fixing bracket
Ê
Remove the two screws (see circle) and remove the fixing bracket (1).
210 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 100: Disconnecting the Xeon Phi
Ê
Disconnect the Xeon Phi from the PCI slot and remove the Xeon Phi.
10.6.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 211
GPGPU Extension
10.7 Replacing GPGPU 1
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.7.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 39
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 40
10.7.2 Removing the GPGPU 1
Ê
Remove the GPGPU as described in section
10.7.3 Installing the GPGPU 1
Ê
Install the new GPGPU as described in section
.
212 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.7.4 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 54
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 213
GPGPU Extension
10.8 Power cables
Figure 101: Power cable for GPGPU, Xeon Phi and GRID Kx
I
All GPGPU and Xeon Phi cards need both power connections:
– 1: 8pin connector
– 2: 6pin connector
The GRID Kx cards need only the 6pin connector (2). The 8pin connector
(1) is folded back and fixed with the cable tie.
214 Upgrade and Maintenance Manual CX2570
Figure 102: Power cable for GPGPU K80 with single 8pin connector
GPGPU Extension
CX2570 M1 Upgrade and Maintenance Manual 215
GPGPU Extension
216 Upgrade and Maintenance Manual CX2570
11 Liquid cooling
11.1
Liquid cooling kit for GPGPU extension
11.1.1 Basic information
Figure 103: GPGPU liquid cooling kit with one pump - top side
Pos. Component
1 Pump
2 Power cable
3 Fixing bracket
4 Flexible tubes with protective caps
5 Screws
Figure 104: GPGPU liquid cooling kit with one pump - bottom side
CX2570 M1 Upgrade and Maintenance Manual 217
Liquid cooling
Pos. Component
1 Area with thermal paste, at delivery covered with a protector
Figure 105: GPGPU - top side
Figure 106: GPGPU - bottom side
218 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 107: Connectors used for liquid cooling
Pos. Component
1 Connector X5, left side
2 PCI slot 1, left side
3 Connector X53, left side
4 Connector X53, right side
5 Connector X5, right side
6 PCI slot 2, right side
CX2570 M1 Upgrade and Maintenance Manual 219
Liquid cooling
Figure 108: Power cable for GPGPU
Pos. Component
1 8-pin connector
2 16-pin connector
11.1.2 Replacing the liquid cooling kit
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
11.1.2.1 Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
Disconnect the tubes from the tube system of the rack as described in the
"RackCDU
TM
Service Manual".
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the GPGPU extension" on page 41
220 Upgrade and Maintenance Manual CX2570
11.1.2.2 Removing the liquid cooling kit
Liquid cooling
Figure 109: Disconnecting the power cable
Ê
Disconnect the power cable from connector X5 (see circle), see figure
Figure 110: Removing the pump
Ê
Remove the four screws in a crossover pattern (1, 2, 3, 4).
CX2570 M1 Upgrade and Maintenance Manual 221
Liquid cooling
Figure 111: Disconnecting the power cable for GPGPU from connector X53
Ê
Disconnect the power cable for GPGPU from connector X53 (see circle), see figure
.
Figure 112: Disconnecting the power cable for GPGPU from the GPGPU
Ê
Disconnect the power cable for GPGPU from the GPGPU (see circle).
222 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 113: Removing the GPGPU with liquid cooling kit (A)
Ê
Remove the two screws (see circles).
Figure 114: Removing the GPGPU with liquid cooling kit (B)
Ê
Remove the three screws (see circles).
Ê
Pull the flexible tubes through the holes (see arrows).
CX2570 M1 Upgrade and Maintenance Manual 223
Liquid cooling
Figure 115: Removing the GPGPU with liquid cooling kit (C)
Ê
Carefully disconnect the GPGPU from the PCI slot (1).
Ê
Take the GPGPU with the liquid cooling kit out off the chassis (2).
Figure 116: Removing the liquid cooling kit from the GPGPU (A)
Ê
Remove the four screws (see circles).
224 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 117: Removing the liquid cooling kit from the GPGPU (B)
Ê
Carefully take the GPGPU off the liquid cooling kit.
11.1.2.3 Installing a liquid cooling kit
I
If new GPGPU Liquid cooling kits are applied, a thin layer of thermal compound has already been pre-applied to its surface. In this case, please follow the consecutive steps.
If new GPGPU Liquid cooling kits are NOT applied, see
"Applying thermal paste" on page 144 .
Ê
If applicable, carefully remove the thermal paste protector from a new liquid cooling kit.
CX2570 M1 Upgrade and Maintenance Manual 225
Liquid cooling
Figure 118: Mounting the liquid cooling kit to the GPGPU (A)
Ê
Place the GPGPU on the liquid cooling kit as shown.
Figure 119: Mounting the liquid cooling kit to the GPGPU (B)
Ê
Fasten the liquid cooling kit with four screws (see circles).
226 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 120: Installing the GPGPU with the liquid cooling kit (A)
Ê
Place the GPGPU with the liquid cooling kit into the chassis (1).
Ê
Carefully connect the GPGPU to the PCI slot (2).
Figure 121: Installing the GPGPU with the liquid cooling kit (B)
Ê
Push the flexible tubes through the holes (see arrows).
Ê
Fasten the three screws (see circles).
CX2570 M1 Upgrade and Maintenance Manual 227
Liquid cooling
Figure 122: Installing the GPGPU with the liquid cooling kit (C)
Ê
Tighten the two screws of the fixing bracket loosely (see circles).
Ê
Push the fixing bracket to the GPGPU and fasten the screws.
Figure 123: Connecting the power cable for GPGPU to the GPGPU
Ê
Connect the power cable for GPGPU to the GPGPU (see circle).
228 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 124: Connecting the power cable for GPGPU to connector X53
Ê
Connect the power cable for GPGPU to connector X53 (see circle), see
Figure 125: Installing the liquid cooling pump
Ê
Fasten the liquid cooling pump with four screws in a crossover pattern (1, 2,
3, 4).
CX2570 M1 Upgrade and Maintenance Manual 229
Liquid cooling
Figure 126: Connecting the power cable
Ê
Connect the power cable from connector X5 (see circle), see figure
11.1.2.4 Concluding steps
Ê
Install the GPGPU extension with the installed liquid cooling kit as described in chapter
"Installing the GPGPU extension" on page 51 .
I
Before powering on the server node connect the tubes to the tube system of the rack as described in the "RackCDU
TM
Service Manual".
–
"Installing the server node in the server enclosure" on page 54
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
230 Upgrade and Maintenance Manual CX2570
Liquid cooling
This information is only regarding to the change of CPU configuration.
There is no technical problem.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
11.2
Liquid cooling kit for the server node
11.2.1 Basic information
11.2.1.1 Main components of the server node
The following figure shows the position of the main components of the
PRIMERGY CX2570 M1 server node.
Slot 11-14
Slot 5-8
Memory Memory
CPU1 CPU2
Memory
Slot 1-4
Slot 15-18
Figure 127: Main components of the PRIMERGY CX2570 M1 server node
I
If liquid cooling is installed, slot 1-4 for modular RAID will not be supported.
CX2570 M1 Upgrade and Maintenance Manual 231
Liquid cooling
11.2.1.2 Riser module for the liquid cooling kit
Figure 128: Riser module for liquid cooling kit
For installing the riser module see chapter
"Installing the riser module" on page 44 .
11.2.1.3 Liquid cooling kit
Figure 129: PRIMERGY CX2570 M1 server node - liquid cooling kit
Pos. Component
1 Memory cover for DIMM channels C, D, E, F
2 Memory cover for DIMM channel A, B, G, H
3 Memory cooling tubes
4 Flexible tubes
5 Pump for CPU 2
6 Pump for CPU 1
7 Power cables for the pumps
232 Upgrade and Maintenance Manual CX2570
Liquid cooling
11.2.2 Replacing the liquid cooling kit
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
11.2.2.1 Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
Disconnect the tubes from the tube system of the rack as described in the
"RackCDU
TM
Service Manual".
Ê
"Removing the server node from the server enclosure" on page 40
11.2.2.2 Removing the liquid cooling kit
Figure 130: Removing the riser module
Ê
Remove both riser modules (1, 2) as described in chapter
"Removing the riser module" on page 42
.
I
The connection of the flexible tubes to the liquid cooling system of the rack you may find in the corresponding manual of the rack.
CX2570 M1 Upgrade and Maintenance Manual 233
Liquid cooling
Figure 131: Removing the memory covers
Ê
Remove both memory covers from the DIMM channels.
CPU 2 CPU 1
Figure 132: Removing the pumps
Ê
First remove the four screws for CPU 1 in a crossover pattern (1, 2, 3, 4).
Ê
Second remove the four screws for CPU 2 in a crossover pattern (1, 2, 3, 4).
234 Upgrade and Maintenance Manual
Liquid cooling
Figure 133: Removing the riser module
Ê
Disconnect the power cable of the pump for CPU 2 from the connector (1) on the system board.
Ê
Disconnect the power cable of the pump for CPU 1 from the connector (2) on the system board.
Ê
Remove the protective caps (3).
Ê
Remove the riser module with the liquid cooling kit from the chassis (see arrow).
CX2570 M1 Upgrade and Maintenance Manual 235
Liquid cooling
Figure 134: Removing the flexible tubes (A)
Ê
Remove the three screws from the liquid cooling kit riser module.
Figure 135: Removing the flexible tubes (B)
Ê
Pull the flexible tubes through the holes of the liquid cooling kit riser module.
11.2.2.3 Installing a liquid cooling kit
I
If a new liquid cooling kit is used, a thin layer of thermal paste is applied to the lower surface . (Remove the thermal paste protective cover .
)
236 Upgrade and Maintenance Manual
Liquid cooling
Ê
If using the liquid cooling kit removed before, see section "Applying thermal paste" on page 144
.
Figure 136: Removing the memory covers from the liquid cooling kit
Ê
If applicable, remove both memory covers from the liquid cooling kit.
I
Keep the memory covers for future use.
Figure 137: Removing the protective caps
Ê
If applicable, remove both protective caps (see arrows).
I
Keep the protective caps for future use. Mount the protective caps immediately after installing the riser module.
CX2570 M1 Upgrade and Maintenance Manual 237
Liquid cooling
Figure 138: Installing the flexible tubes (A)
Ê
Push the flexible tubes through the holes of the liquid cooling kit riser module
(see arrow).
Figure 139: Installing the flexible tubes (B)
Ê
Fasten the screws of the bracket.
238 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 140: Installing the riser module (A)
Ê
Insert the riser module with the liquid cooling kit at a slight angle (1).
Ê
Carefully place the pumps (2) of the liquid cooling kit on the eight threaded holes without fastening the screws.
Ê
Carefully place the memory cooling tubes (3) between the memory slots.
I
– Pay attention to the flexible tubes. The flexible tubes must not be squeezed by the riser module.
– For an easier installing of the liquid cooling kit disconnect the SATA cables from the front connectors (non-PCI-side) temporally!
CPU 2 CPU 1
Figure 141: Installing the pumps
Ê
First fasten the four screws for CPU 2 in a crossover pattern (1, 2, 3, 4).
Ê
Second fasten the four screws for CPU 1 in a crossover pattern (1, 2, 3, 4).
CX2570 M1 Upgrade and Maintenance Manual 239
Liquid cooling
Figure 142: Installing the memory covers
Ê
Install both memory covers over the DIMM channels.
I
Make sure not to damage anything when installing the memory covers (see arrow).
Figure 143: Installing the riser module (B)
Pos. Component
1 Power connector for power cable of pump 2
2 Power connector for power cable of pump 1
240 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 144: Installing the riser module (C)
Ê
Press down the riser module (see arrow).
I
– Make sure that the bolt snaps into the chassis sparing (see circle) and the connector of the riser card fits within the slot.
– If SATA cables are already installed in server node, make sure that all connectors are connected properly.
Ê
Mount the protective caps (3) for the tubes.
Ê
Connect the power cable of pump for CPU 2 to the connector (1) on the system board.
Ê
Connect the power cable of pump for CPU 1 to the connector (2) on the system board.
CX2570 M1 Upgrade and Maintenance Manual 241
Liquid cooling
Figure 145: Power cable routing
Ê
Run the power cable of pump as shown.
Figure 146: Installing the second riser module
Ê
11.2.2.4 Concluding steps
I
Before powering on the server node connect the tubes to the tube system of the rack as described in the "RackCDU
TM
Service Manual".
Ê
"Installing the server node in the server enclosure" on page 54
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
242 Upgrade and Maintenance Manual CX2570
Liquid cooling
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
11.3
Cooling pads on the memory modules
11.3.1 Basic information
I
Before installing new memory modules prepare the memory modules with the cooling pads.
Figure 147: Memory cooling pads
CX2570 M1 Upgrade and Maintenance Manual 243
Liquid cooling
11.3.1.1 Adhesive rules for the memory cooling pads
Memory modules 1A, 1C, 1E, 1G
Figure 148: Memory modules 1A, 1C, 1E, 1G: joining face for the cooling pad
The cooling pad must be stuck on the above shown side of the memory module.
Memory modules 2B, 2D, 2H, 2F
Figure 149: Memory modules 2B, 2D, 2H, 2F: joining face for the cooling pad
The cooling pad must be stuck on the above shown side of the memory module.
Memory modules 1B, 1D, 1F, 1H, 2A, 2C, 2E, 2G
The cooling pads must be stuck on both sides of the memory module.
244 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 150: Example: Memory modules with cooling pads built-in
Pos.
1
2, 3
4, 5
6
Memory module
1C
2C
1D
2D
Number of cooling pads
1 cooling pad
2 cooling pads
2 cooling pads
1 cooling pad
CX2570 M1 Upgrade and Maintenance Manual 245
Liquid cooling
11.3.2 Preparing the memory modules
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
11.3.2.1 Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 58
Ê
"Shutting down the server node" on page 39
Ê
Disconnect the tubes from the tube system of the rack as described in the
"RackCDU
TM
Service Manual".
Ê
"Removing the server node from the server enclosure" on page 40
Ê
"Removing the liquid cooling kit" on page 233
Ê
"Removing memory modules" on page 128
11.3.2.2 Preparing a memory module
Figure 151: Prepared memory module
Ê
Stick the cooling pad(s) on one or two sides of the memory modules, see
"Adhesive rules for the memory cooling pads" on page 244 .
11.3.2.3 Concluding steps
I
Before powering on the server node connect the tubes to the tube system of the rack as described in the "RackCDU
TM
Service Manual".
246 Upgrade and Maintenance Manual CX2570
Liquid cooling
Ê
Install the memory modules as described in section
"Installing memory modules" on page 125
Ê
"Installing a liquid cooling kit" on page 236
Ê
"Installing the server node in the server enclosure" on page 54
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 65
(if applicable)
Ê
"Controls and indicators on the server node" on page 55
Ê
"Enabling SVOM boot watchdog functionality" on page 76
CX2570 M1 Upgrade and Maintenance Manual 247
Liquid cooling
248 Upgrade and Maintenance Manual CX2570
12 Cabling
This chapter provides information on how to connect, disconnect and route cables.
Safety notes
V
CAUTION!
● Always hold cables by their connectors when disconnecting them.
Never pull on the cable to disconnect cables.
●
●
●
Ensure that none of the cables are scraped, strained or otherwise damaged while replacing system components.
Immediately replace cables with damaged shielding.
Always use shielded network cables.
CX2570 M1 Upgrade and Maintenance Manual 249
Cabling
12.1 Cabling overview
No. Part number (Label) Description
C1 T26139-Y4040-V13 Onboard SATA
C2 T26139-Y4040-V12 RAID controller
C3 T26139-Y3946-V606 GPGPU
C3 T26139-Y3946-V609 GPGPU K80
Table 5: List of used cables
12.2 Cabling
Cabling onboard
Note
CBL PCH-BP
CBL CGR4-BP
CBL GPU PWR
CBL GPU PWR
SATA Onboard
SATA 0-3
SATA Onboard
SATA 4-5
D3343
D3343
MoBo
SAS 0 - 3
SAS 0 - 3
SAS 4 - 5
SAS 4 - 5
GPGPU Riser Card
X53
GPGPU Riser Card
X53
C1
C1
C3
C3
GPGPU 1
PWD
GPGPU 2
PWD
Figure 152: Cabling onboard
250 Upgrade and Maintenance Manual CX2570
Cabling with RAID controller
D3343
MoBo
SAS 0 - 3
SAS 0 - 3
SAS 4 - 5
SAS 4 - 5
GPGPU Riser Card
X53
GPGPU Riser Card
X53
C2
C2
C3
C3
Figure 153: Cabling with RAID controller
Cabling
RAID controller
MLC1
RAID controller
MLC2
GPGPU 1
PWD
GPGPU 2
PWD
CX2570 M1 Upgrade and Maintenance Manual 251
Cabling
12.3 Cabling for HDD 2.5"
12.3.1 Cabling onboard
Figure 154: Cabling onboard with cable T26139-Y4040-V13
Ê
Plug one end of the SATA cable on the SAS connector (SAS 0-3) on the system board (1).
Ê
Plug the other end of the SATA cable on the other SATA connector (SATA 0-
3) on the system board (2).
Ê
Proceed with the second SATA cable as described before but plug it into the other SAS/SATA connector (SAS 4-5/SATA 4-5) on the system board.
Figure 155: Cable T26139-Y4040-V13
252 Upgrade and Maintenance Manual CX2570
12.3.2 Cabling with RAID-Controller
Cabling
Figure 156: Cabling with RAID controller with cable T26139-Y4040-V12
Ê
Plug one end of the SATA cable on the SAS connector (SAS 0-3) on the system board (1).
Ê
Plug the other end of the SATA cable to the connector on the RAID controller
(2).
Ê
Proceed with the second SATA cable as described before but plug it into the other SAS connector (SAS 4-5) on the system board.
Figure 157: Cable T26139-Y4040-V12
CX2570 M1 Upgrade and Maintenance Manual 253
Cabling
254 Upgrade and Maintenance Manual CX2570
13 Appendix
13.1 Mechanical overview
13.1.1 CX2570 M1 server node complete system
Figure 158: CX2570 M1 complete system
Pos. Component
1 CX2570 server node
2 GPGPU extension
CX2570 M1 Upgrade and Maintenance Manual 255
Appendix
13.1.2 Server node interior
Figure 159: PRIMERGY CX2570 M1 server node interior
Pos. Component
1 USB Flash Module (UFM)
2 SATA DOM (not visible, located under the riser module
3 Riser module on the left side
4 Memory slots for CPU1
5 CPU1 with heat sink
6 Memory air duct
7 CPU2 with heat sink
8 Memory slots for CPU2
9 Memory slots for CPU2
10 Memory air duct
11 Memory slots for CPU1
12 Riser module on the right side
13 Network Controller
256 Upgrade and Maintenance Manual CX2570
Appendix
13.1.3 Server node rear
Figure 160: Connection panel of the server node
1 Shared LAN connector (LAN 1) 5 Video connector
2 Standard LAN connector (LAN 2) 6 PCI2 (connected to PCI slot 11-14 on system)
3 Management LAN connector 7 PCI1 (connected to PCI slot 1-4 on system)
4 2 x USB 3.0 connectors
CX2570 M1 Upgrade and Maintenance Manual 257
Appendix
13.2 Connectors and indicators
13.2.1 Connectors and indicators on the system board
13.2.1.1 Onboard connectors
Figure 161: Internal connectors of system board D3343
258 Upgrade and Maintenance Manual CX2570
Appendix
No. Print
1 RST
2 PWR
3 CSS
4 ID LED
5 GEL
Description
Reset button
Power button
CSS (orange)
Identify (blue)
Global Error LED (orange)
6 LAN 1
7 LAN 2
8 LAN M
9 UFM
10 PCI Slot 11-14
LAN connector 1
LAN connector 2
Management LAN connector
UFM connector
PCI Slot 11-14 (connected to PCI2)
11 SATA DOM SATA Disk on module
12 Jumper Jumper
13 PCI Slot 5-8
14 MicroSD
PCI Slot 5-8 (connected to GPGPU1) iRMC microSD card
15 Indicate CSS
16 SATA 0-3
17 SAS 0-3
18 SAS 4-5
19 SATA 4-5
20 LC pump
21 PCI Slot 15-18
22 BATT
23 PCI Slot 1-4
24 USB 1
25 USB 2
26 VGA
Indicate CSS
SATA connectors 0-3
SAS connectors 0-3
SAS connectors 4-5
SATA connectors 4-5
Liquid cooling connectors
PCI Slot 15-18 (connected to GPGPU2)
Battery
PCI Slot 1-4 (connected to PCI1)
USB connector 1
USB connector 2
Video connector
CX2570 M1 Upgrade and Maintenance Manual 259
Appendix
13.2.1.2 Onboard settings
Figure 162: Jumper on system board
Reset RTC
Jumper position Function
1-2 no jumper
Table 6: Reset RTC
Reset RTC enabled
Reset RTC disabled
Password Skip
Jumper position Function
3-4 no jumper
Table 7: Password skip
PASSWORD CLEAR (SKIP)
NORMAL MODE
Default setting o
Default setting o
260 Upgrade and Maintenance Manual CX2570
BIOS Recovery
Jumper position Function
5-6 no jumper
Table 8: BIOS Recovery
BIOS Recovery enabled
BIOS Recovery disabled
BIOS Write Protect
Jumper position Function
9-10 no jumper
Flash Write Protect enabled
Flash Write Protect disabled
Table 9: BIOS Write Protect
Appendix
Default setting o
Default setting o
CX2570 M1 Upgrade and Maintenance Manual 261
Appendix
13.2.2 Connector panel
13.2.2.1 Controls and indicators
Figure 163: Controls and indicators of the server node
1 RST button
2 Global error indicator
3 ID indicator
4 CSS indicator
I
The server nodes are controlled via related operating panel areas on the front side of the CX400 M1 server enclosure. See "FUJITSU Server
PRIMERGY CX400 M1 Server Enclosure Operating Manual".
13.2.2.2 Control elements
RST Reset button
Pressing the reset button reboots the system.
V
CAUTION!
Risk of loss of data!
I
The server nodes are controlled via related operating panel areas on the front side of the CX400 M1 server enclosure. See "FUJITSU Server
PRIMERGY CX400 M1 Server Enclosure Operating Manual".
262 Upgrade and Maintenance Manual CX2570
Appendix
13.2.2.3 Global error indicator, ID indicator, CSS indicator
!
ID
Global error indicator (orange)
– Lights up orange if a prefailure event has been detected that requires (precautionary) service intervention.
– Flashes orange if an error was detected that requires service intervention.
– Does not light up if there is no critical event.
If the event is still acute after a power cycle, the indicator is activated after the restart.
The indicator also lights up in standby mode.
You can find more details on the indicated errors in the System
Event Log (SEL), in the ServerView Operations Manager or via the iRMC S4's Web interface.
ID indicator (blue)
Lights up blue when the system has been selected by pressing the ID button. To deactivate, press the button again.
The ID indicator can also be activated via the ServerView
Operations Manager and the iRMC S4 Web interface and its status reported to the ServerView Operations Manager and the iRMC S4.
CSS indicator (orange)
– Lights up orange if a prefailure event was detected for a CSS component that you can fix yourself (for reasons of precaution) with the CSS concept.
– Flashes orange if an error was detected that you can fix yourself with the CSS concept.
– Does not light up when the supervised components are OK.
If the event is still acute after a power cycle, the indicator is activated after the restart.
The indicator also lights up in standby mode.
CX2570 M1 Upgrade and Maintenance Manual 263
Appendix
13.2.2.4 LAN indicators
Figure 164: LAN indicators
No Indicator
1 LAN link/transfer
2 LAN speed
Description
Steady green signal when a LAN connection exists.
Remains dark when no LAN connection exists.
Flashes green when LAN transfer takes place.
Steady orange signal in the event of a LAN transfer rate of 1 Gbit/s
Steady green signal in the event of a LAN transfer rate of 100 Mbit/s.
Remains dark in the event of a LAN transfer rate of
10 Mbit/s.
I
Depending on the settings in the BIOS, the standard LAN connector 1 may also be used as a Management LAN connector. You will find further information in the "D3343 BIOS Setup Utility for FUJITSU Server
PRIMERGY CX2570 M1 Reference Manual".
264 Upgrade and Maintenance Manual CX2570
Appendix
13.3 Minimum startup configuration
Field Replaceable Units (FRU)
If the server does not start up or other problems occur, it may be necessary to take the system down to its most basic configuration in order to isolate the defective component.
The minimum startup configuration consists of the following components and cables:
Component
System board
CPU1 and CPU2 with CPU heat sink
Notes and reference no TPM or expansion cards installed
2 memory modules installed in slot A1 or E1, see section
2 Power supply units
Table 10: Minimum startup configuration - components
Cable
2 SATA cables
Notes and reference
Table 11: Minimum startup configuration - cables
Ê
Shut down the server as described in section
"Shutting down the server node" on page 39
.
Ê
Take the system down to its minimum startup configuration.
Ê
Connect a keyboard, mouse and display to the server.
Ê
V
CAUTION!
Since the fan module is not included in the minimum startup configuration, the server must be shut down immediately after the diagnostic process is complete (POST phase has been passed).
CX2570 M1 Upgrade and Maintenance Manual 265
Appendix
The minimum startup configuration must be used exclusively for diagnostic purposes by maintenance personnel, never in daily operation!
266 Upgrade and Maintenance Manual CX2570

Public link updated
The public link to your chat has been updated.
Advertisement
Key features
- Latest Intel Xeon processors
- Up to 1TB of DDR4 memory
- Variety of storage options
- Ideal for virtualization, database, and web serving
- Suitable for high-performance computing