Fujitsu PRIMERGY CX2570 M2 Manual
Fujitsu PRIMERGY CX2570 M2 is a reliable and efficient server node designed for diverse workloads in small and medium-sized businesses, branch offices, and edge computing environments. It combines exceptional performance, scalability, and security features to meet the evolving demands of modern IT landscapes. With its compact 1U form factor, it offers a space-saving solution for data centers and server rooms. The CX2570 M2 empowers organizations to optimize their IT infrastructure, enhance productivity, and drive innovation.
Advertisement
Advertisement
Upgrade and Maintenance Manual - English
PRIMERGY CX2570 M2
Server Node
Upgrade and Maintenance Manual
Edition March 2016
Comments
…
Suggestions
…
Corrections
…
The User Documentation Department would like to know your opinion of this manual. Your feedback helps us optimize our documentation to suit your individual needs.
Feel free to send us your comments by e-mail to [email protected]
.
Certified documentation according to DIN EN ISO 9001:2008
To ensure a consistently high quality standard and user-friendliness, this documentation was created to meet the regulations of a quality management system which complies with the requirements of the standard
DIN EN ISO 9001:2008. cognitas. Gesellschaft für Technik-Dokumentation mbH www.cognitas.de
Copyright and Trademarks
Copyright 2016 FUJITSU LIMITED
All rights reserved.
Delivery subject to availability; right of technical modifications reserved.
All hardware and software names used are trademarks of their respective manufacturers.
– The contents of this manual may be revised without prior notice.
– Fujitsu assumes no liability for damages to third party copyrights or other rights arising from the use of any information in this manual.
– No part of this manual may be reproduced in any form without the prior written permission of Fujitsu.
Microsoft, Windows, Windows Server, and Hyper V are trademarks or registered trademarks of
Microsoft Corporation in the USA and other countries.
Intel and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the USA and other countries.
Before reading this manual
For your safety
This manual contains important information for safely and correctly using this product.
Carefully read the manual before using this product. Pay particular attention to the accompanying manual "Safety Notes and Regulations" and ensure these safety notes are understood before using the product. Keep this manual and the manual "Safety Notes and Regulations" in a safe place for easy reference while using this product.
Radio interference
This product is a "Class A" ITE (Information Technology Equipment). In a domestic environment this product may cause radio interference, in which case the user may be required to take appropriate measures.
VCCI-A
Aluminum electrolytic capacitors
The aluminum electrolytic capacitors used in the product's printed circuit board assemblies and in the mouse and keyboard are limited-life components. Use of these components beyond their operating life may result in electrolyte leakage or depletion, potentially causing emission of foul odor or smoke.
As a guideline, in a normal office environment (25°C) operating life is not expected to be reached within the maintenance support period (5 years).
However, operating life may be reached more quickly if, for example, the product is used in a hot environment. The customer shall bear the cost of replacing replaceable components which have exceeded their operating life.
Note that these are only guidelines, and do not constitute a guarantee of trouble-free operation during the maintenance support period.
High safety use
This product has been designed and manufactured to be used in commercial and/or industrial areas as a server.
When used as visual display workplace, it must not be placed in the direct field of view to avoid incommoding reflections (applies only to TX server systems).
The device has not been designed or manufactured for uses which demand an extremely high level of safety and carry a direct and serious risk of life or body if such safety cannot be assured.
CX2570 M2 Upgrade and Maintenance Manual
These uses include control of nuclear reactions in nuclear power plants, automatic airplane flight control, air traffic control, traffic control in mass transport systems, medical devices for life support, and missile guidance control in weapons systems (hereafter, "high safety use"). Customers should not use this product for high safety use unless measures are in place for ensuring the level of safety demanded of such use. Please consult the sales staff of Fujitsu if intending to use this product for high safety use.
Measures against momentary voltage drop
This product may be affected by a momentary voltage drop in the power supply caused by lightning. To prevent a momentary voltage drop, use of an AC uninterruptible power supply is recommended.
(This notice follows the guidelines of Voltage Dip Immunity of Personal
Computer issued by JEITA, the Japan Electronics and Information Technology
Industries Association.)
Technology controlled by the Foreign Exchange and Foreign Trade
Control Law of Japan
Documents produced by Fujitsu may contain technology controlled by the
Foreign Exchange and Foreign Trade Control Law of Japan. Documents which contain such technology should not be exported from Japan or transferred to non-residents of Japan without first obtaining authorization in accordance with the above law.
Harmonic Current Standards
This product conforms to harmonic current standard JIS C 61000-3-2.
Only for the Japanese market: About SATA hard disk drives
The SATA version of this server supports hard disk drives with SATA / BC-SATA storage interfaces. Please note that the usage and operation conditions differ depending on the type of hard disk drive used.
Please refer to the following internet address for further information on the usage and operation conditions of each available type of hard disk drive: http://primeserver.fujitsu.com/primergy/harddisk/
Upgrade and Maintenance Manual CX2570
Only for the Japanese market:
I
Although described in this manual, some sections do not apply to the
Japanese market. These options and routines include:
– CSS (Customer Self Service)
CX2570 M2 Upgrade and Maintenance Manual
Version history
Issue number
1.0 / March 2016
Reason for update
Initial release
Upgrade and Maintenance Manual CX2570
Contents
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Notational conventions . . . . . . . . . . . . . . . . . . . . 18
Before you start . . . . . . . . . . . . . . . . . . . . . . . . 19
Classification of procedures . . . . . . . . . . . . . . . . . 21
Customer Replaceable Units (CRU) . . . . . . . . . . . . . . . 21
Upgrade and Repair Units (URU) . . . . . . . . . . . . . . . . 22
Field Replaceable Units (FRU) . . . . . . . . . . . . . . . . . 23
Average task duration . . . . . . . . . . . . . . . . . . . . . 24
Tools you need at hand . . . . . . . . . . . . . . . . . . . . 25
Documents you need at hand . . . . . . . . . . . . . . . . . 25
Documents for the server node . . . . . . . . . . . . . . . . . 27
Documents for the server enclosure . . . . . . . . . . . . . . . 28
Important information . . . . . . . . . . . . . . . . . . . . . 29
Safety instructions . . . . . . . . . . . . . . . . . . . . . . . 29
CE conformity . . . . . . . . . . . . . . . . . . . . . . . . . 37
FCC Class A Compliance Statement . . . . . . . . . . . . . 38
Environmental protection . . . . . . . . . . . . . . . . . . . 39
Basic hardware procedures . . . . . . . . . . . . . . . . . . 41
Shutting down the server node . . . . . . . . . . . . . . . . 41
Removing the server node from the server enclosure . . . 42
Removing the GPGPU extension . . . . . . . . . . . . . . . 43
Removing the riser module . . . . . . . . . . . . . . . . . . 44
Installing the riser module . . . . . . . . . . . . . . . . . . . 46
Replacing the riser card . . . . . . . . . . . . . . . . . . . . 48
CX2570 M2 Upgrade and Maintenance Manual
Contents
Mounting a controller to the riser module . . . . . . . . . . . 49
Removing a controller from the riser module . . . . . . . . . 50
Removing the memory slot air ducts . . . . . . . . . . . . . . 51
Installing the memory slot air ducts . . . . . . . . . . . . . . 52
Design of the memory air ducts . . . . . . . . . . . . . . . . . . 52
Installing the GPGPU extension . . . . . . . . . . . . . . . . 53
Installing the server node in the server enclosure . . . . . . 56
Controls and indicators on the server node . . . . . . . . . . 57
Concluding software tasks . . . . . . . . . . . . . . . . . . . 57
5 Basic software procedures . . . . . . . . . . . . . . . . . . . 59
Starting the maintenance task . . . . . . . . . . . . . . . . . 59
Suspending BitLocker functionality . . . . . . . . . . . . . . . . 59
Disabling SVOM boot watchdog functionality . . . . . . . . . . . 60
Viewing boot watchdog settings . . . . . . . . . . . . . . . . 60
Configuring boot watchdog settings . . . . . . . . . . . . . . 61
Configuring LAN teaming . . . . . . . . . . . . . . . . . . . . . 63
Note on server maintenance in a Multipath I/O environment . . . 63
Switching on the ID indicator . . . . . . . . . . . . . . . . . . . 66
Completing the maintenance task . . . . . . . . . . . . . . . 67
Updating or recovering the system board BIOS and iRMC . . . . 67
Updating or recovering the system board BIOS . . . . . . . . 67
Updating or recovering the iRMC . . . . . . . . . . . . . . . 71
Verifying system information backup / restore . . . . . . . . . . 73
Updating RAID controller firmware . . . . . . . . . . . . . . . . 73
Enabling Option ROM scan . . . . . . . . . . . . . . . . . . . . 74
Resetting the boot retry counter . . . . . . . . . . . . . . . . . 76
Viewing the boot retry counter . . . . . . . . . . . . . . . . 76
Resetting the boot retry counter . . . . . . . . . . . . . . . . 76
Enabling SVOM boot watchdog functionality . . . . . . . . . . . 78
Enabling replaced components in the system BIOS . . . . . . . 78
Verifying the memory mode . . . . . . . . . . . . . . . . . . . . 80
Verifying the system time settings . . . . . . . . . . . . . . . . 81
Viewing and clearing the System Event Log (SEL) . . . . . . . . 82
Viewing the SEL . . . . . . . . . . . . . . . . . . . . . . . . 82
Clearing the SEL . . . . . . . . . . . . . . . . . . . . . . . 83
Updating the NIC configuration file in a Linux environment . . . . 83
Upgrade and Maintenance Manual CX2570
Contents
Resuming BitLocker functionality . . . . . . . . . . . . . . . . 85
Performing a RAID array rebuild . . . . . . . . . . . . . . . . . 86
Looking up changed MAC / WWN addresses . . . . . . . . . . 86
Looking up MAC addresses . . . . . . . . . . . . . . . . . 86
Looking up WWN addresses . . . . . . . . . . . . . . . . . 87
Using the Chassis ID Prom Tool . . . . . . . . . . . . . . . . . 88
Configuring LAN teaming . . . . . . . . . . . . . . . . . . . . 88
After replacing / upgrading LAN controllers . . . . . . . . . 89
After replacing the system board . . . . . . . . . . . . . . . 89
Switching off the ID indicator . . . . . . . . . . . . . . . . . . 89
Performing a fan test . . . . . . . . . . . . . . . . . . . . . . 90
Memory modules . . . . . . . . . . . . . . . . . . . . . . . 92
Processors . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Expansion cards . . . . . . . . . . . . . . . . . . . . . . . . 97
Basic information . . . . . . . . . . . . . . . . . . . . . . . 98
Additional tasks . . . . . . . . . . . . . . . . . . . . . . . . 101
Mounting expansion card slot brackets . . . . . . . . . . . . . 101
General instructions . . . . . . . . . . . . . . . . . . . . . 101
Network adapter D2755 . . . . . . . . . . . . . . . . . . . 102
Handling SFP+ transceiver modules . . . . . . . . . . . . . . 104
Installing SFP+ transceiver modules . . . . . . . . . . . . . 104
Removing an SFP+ transceiver module . . . . . . . . . . . 109
Replacing SFP+ transceiver modules . . . . . . . . . . . . 112
Expansion cards in the riser module . . . . . . . . . . . . . 113
Installing expansion cards . . . . . . . . . . . . . . . . . . . . 114
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 114
Mounting a controller to the riser module . . . . . . . . . . 115
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 115
Removing expansion cards . . . . . . . . . . . . . . . . . . . 116
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 116
Removing a controller from the riser module . . . . . . . . 117
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 117
Replacing expansion cards . . . . . . . . . . . . . . . . . . . 118
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 118
Removing an expansion card . . . . . . . . . . . . . . . . 118
Installing an expansion card . . . . . . . . . . . . . . . . . 119
CX2570 M2 Upgrade and Maintenance Manual
Contents
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 119
Riser card . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
Replacing the riser card . . . . . . . . . . . . . . . . . . . . . 120
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 120
Replacing the riser card . . . . . . . . . . . . . . . . . . . 121
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 122
Main memory . . . . . . . . . . . . . . . . . . . . . . . . . 123
Basic information . . . . . . . . . . . . . . . . . . . . . . . 124
Memory sequence . . . . . . . . . . . . . . . . . . . . . . . 124
Operation modes . . . . . . . . . . . . . . . . . . . . . . . . 126
Installing memory modules . . . . . . . . . . . . . . . . . . 127
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 127
Installing a memory module . . . . . . . . . . . . . . . . . . . 128
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 129
Removing memory modules . . . . . . . . . . . . . . . . . 130
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 130
Removing a memory module . . . . . . . . . . . . . . . . . . 131
Concluding step . . . . . . . . . . . . . . . . . . . . . . . . . 132
Replacing memory modules . . . . . . . . . . . . . . . . . 133
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 133
Removing a memory module . . . . . . . . . . . . . . . . . . 134
Installing a memory module . . . . . . . . . . . . . . . . . . . 134
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 134
Processors . . . . . . . . . . . . . . . . . . . . . . . . . . . 135
Basic information . . . . . . . . . . . . . . . . . . . . . . . 136
Supported processors . . . . . . . . . . . . . . . . . . . . . 136
Processor locations . . . . . . . . . . . . . . . . . . . . . . . 136
Replacing processors . . . . . . . . . . . . . . . . . . . . . 137
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 137
Removing processor heat sinks . . . . . . . . . . . . . . . . 138
Removing the processor heat sinks . . . . . . . . . . . . . 138
Removing the processor . . . . . . . . . . . . . . . . . . . . 139
Installing the processor . . . . . . . . . . . . . . . . . . . . . 143
Applying thermal paste . . . . . . . . . . . . . . . . . . . . . 146
Upgrade and Maintenance Manual CX2570
Contents
Installing the processor heat sink . . . . . . . . . . . . . . . . 148
Processor heat sink CPU1 . . . . . . . . . . . . . . . . . . 148
Processor heat sink CPU2 . . . . . . . . . . . . . . . . . . 149
Installing the heat sinks . . . . . . . . . . . . . . . . . . . 149
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 151
Replacing the processor heat sink . . . . . . . . . . . . . . 152
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 152
Removing the processor heat sink . . . . . . . . . . . . . . . 152
Installing the processor heat sink . . . . . . . . . . . . . . . . 152
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 153
System board and components . . . . . . . . . . . . . . . . 155
Replacing the CMOS battery . . . . . . . . . . . . . . . . . 155
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 156
Localization of the CMOS battery . . . . . . . . . . . . . . 157
Removing the CMOS battery . . . . . . . . . . . . . . . . . . 158
Installing the CMOS battery . . . . . . . . . . . . . . . . . . . 159
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 160
SATA DOM . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
Installing the SATA DOM board . . . . . . . . . . . . . . . . . 161
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 161
Installing the SATA DOM . . . . . . . . . . . . . . . . . . . 162
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 166
Removing the SATA DOM . . . . . . . . . . . . . . . . . . . . 167
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 167
Removing the SATA DOM . . . . . . . . . . . . . . . . . . 168
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 169
Replacing the SATA DOM . . . . . . . . . . . . . . . . . . . . 170
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 170
Removing the SATA DOM . . . . . . . . . . . . . . . . . . 170
Re-installing the SATA DOM . . . . . . . . . . . . . . . . . 171
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 171
USB Flash Module (UFM) . . . . . . . . . . . . . . . . . . . 172
Installing the UFM board . . . . . . . . . . . . . . . . . . . . . 172
Required tools . . . . . . . . . . . . . . . . . . . . . . . . 172
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 172
Installing the UFM board . . . . . . . . . . . . . . . . . . . 173
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 176
Software configuration . . . . . . . . . . . . . . . . . . . . 176
CX2570 M2 Upgrade and Maintenance Manual
Contents
Removing the UFM board . . . . . . . . . . . . . . . . . . . 177
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 177
Removing the UFM board . . . . . . . . . . . . . . . . . . 178
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 179
Replacing the UFM board . . . . . . . . . . . . . . . . . . . . 180
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 180
Removing the UFM . . . . . . . . . . . . . . . . . . . . . 180
Re-installing the UFM . . . . . . . . . . . . . . . . . . . . 181
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 182
Software configuration . . . . . . . . . . . . . . . . . . . 182
iRMC microSD card . . . . . . . . . . . . . . . . . . . . . . 183
Installing the iRMC microSD card . . . . . . . . . . . . . . . . 183
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 183
Installing the iRMC microSD card . . . . . . . . . . . . . . 184
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 184
Removing the iRMC microSD card . . . . . . . . . . . . . . . 185
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 185
Removing the iRMC microSD card . . . . . . . . . . . . . 185
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 186
Replacing the iRMC microSD card . . . . . . . . . . . . . . . 187
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 187
Replacing the iRMC microSD card . . . . . . . . . . . . . 187
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 187
Replacing the system board . . . . . . . . . . . . . . . . . 188
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 189
Replacing the system board . . . . . . . . . . . . . . . . . . 189
Removing the system board . . . . . . . . . . . . . . . . 190
Installing the system board . . . . . . . . . . . . . . . . . 192
Swapping processors . . . . . . . . . . . . . . . . . . . . 193
Completing the system board . . . . . . . . . . . . . . . . 194
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 195
10 GPGPU Extension . . . . . . . . . . . . . . . . . . . . . . . 197
Basic information . . . . . . . . . . . . . . . . . . . . . . . 198
Installing GPGPU extension . . . . . . . . . . . . . . . . . 199
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 199
Installing Xeon Phi to slot GPGPU 2 . . . . . . . . . . . . . . 199
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 201
Upgrade and Maintenance Manual CX2570
Contents
Removing Xeon Phi from slot GPGPU 2 . . . . . . . . . . . 201
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 201
Removing Xeon Phi . . . . . . . . . . . . . . . . . . . . . . . 202
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 203
Replacing the GPGPU 2 . . . . . . . . . . . . . . . . . . . . 204
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 204
Removing the GPGPU 2 . . . . . . . . . . . . . . . . . . . . . 204
Installing the GPGPU 2 . . . . . . . . . . . . . . . . . . . . . 204
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 205
Installing Xeon Phi in slot GPGPU 1 . . . . . . . . . . . . . 205
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 205
Installing Xeon Phi (slot GPGPU 1) . . . . . . . . . . . . . . . 206
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 210
Removing Xeon Phi from slot GPGPU 1 . . . . . . . . . . . 211
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 211
Removing Xeon Phi (GPGPU1) . . . . . . . . . . . . . . . . . 211
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 213
Replacing GPGPU 1 . . . . . . . . . . . . . . . . . . . . . . 214
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 214
Removing the GPGPU 1 . . . . . . . . . . . . . . . . . . . . . 214
Installing the GPGPU 1 . . . . . . . . . . . . . . . . . . . . . 214
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 215
Power cables . . . . . . . . . . . . . . . . . . . . . . . . . . 216
GPGPU Riser . . . . . . . . . . . . . . . . . . . . . . . . . . 218
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . . 218
Removing the GPGPU riser . . . . . . . . . . . . . . . . . . . 218
Installing the GPGPU riser . . . . . . . . . . . . . . . . . . . . 219
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . . 220
11 Liquid cooling . . . . . . . . . . . . . . . . . . . . . . . . . 221
Liquid cooling kit for GPGPU extension . . . . . . . . . . . 221
Basic information . . . . . . . . . . . . . . . . . . . . . . . . 221
Replacing the liquid cooling kit . . . . . . . . . . . . . . . . . 224
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . . 224
Removing the liquid cooling kit . . . . . . . . . . . . . . . . 225
Installing a liquid cooling kit . . . . . . . . . . . . . . . . . 229
Concluding steps . . . . . . . . . . . . . . . . . . . . . . . 234
CX2570 M2 Upgrade and Maintenance Manual
Contents
Liquid cooling kit for the server node . . . . . . . . . . . . 235
Basic information . . . . . . . . . . . . . . . . . . . . . . . . 235
Main components of the server node . . . . . . . . . . . . 235
Riser module for the liquid cooling kit . . . . . . . . . . . . 236
Liquid cooling kit . . . . . . . . . . . . . . . . . . . . . . . 236
Replacing the liquid cooling kit . . . . . . . . . . . . . . . . . 237
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 237
Removing the liquid cooling kit . . . . . . . . . . . . . . . 237
Installing a liquid cooling kit . . . . . . . . . . . . . . . . . 240
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 246
Cooling pads on the memory modules . . . . . . . . . . . 247
Basic information . . . . . . . . . . . . . . . . . . . . . . . . 247
Adhesive rules for the memory cooling pads . . . . . . . . 248
Preparing the memory modules . . . . . . . . . . . . . . . . 250
Preliminary steps . . . . . . . . . . . . . . . . . . . . . . 250
Preparing a memory module . . . . . . . . . . . . . . . . 250
Concluding steps . . . . . . . . . . . . . . . . . . . . . . 250
12 Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253
Cabling overview . . . . . . . . . . . . . . . . . . . . . . . 254
Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
Cabling for HDD 2.5" . . . . . . . . . . . . . . . . . . . . . 256
Cabling onboard . . . . . . . . . . . . . . . . . . . . . . . . 256
Cabling with RAID-Controller . . . . . . . . . . . . . . . . . . 257
13 Appendix . . . . . . . . . . . . . . . . . . . . . . . . . . . . 259
Mechanical overview . . . . . . . . . . . . . . . . . . . . . 259
CX2570 M2 server node complete system . . . . . . . . . . . 259
Server node interior . . . . . . . . . . . . . . . . . . . . . . . 260
Server node rear . . . . . . . . . . . . . . . . . . . . . . . . 261
Connectors and indicators . . . . . . . . . . . . . . . . . . 262
Connectors and indicators on the system board . . . . . . . . 262
Onboard connectors . . . . . . . . . . . . . . . . . . . . . 262
Onboard settings . . . . . . . . . . . . . . . . . . . . . . 264
Connector panel . . . . . . . . . . . . . . . . . . . . . . . . 266
Controls and indicators . . . . . . . . . . . . . . . . . . . 266
Control elements . . . . . . . . . . . . . . . . . . . . . . 266
Upgrade and Maintenance Manual CX2570
Contents
Global error indicator, ID indicator, CSS indicator . . . . . . 267
LAN indicators . . . . . . . . . . . . . . . . . . . . . . . . 268
Minimum startup configuration . . . . . . . . . . . . . . . . 269
CX2570 M2 Upgrade and Maintenance Manual
Contents
Upgrade and Maintenance Manual CX2570
1 Introduction
This Upgrade and Maintenance Manual provides instructions for the following procedures:
●
●
Upgrading the server configuration by adding optional hardware components
Upgrading the server configuration by replacing existing hardware components with superior ones.
● Replacing defective hardware components
This manual focuses on on-site maintenance tasks. It is recommended to prepare each service assignment following remote diagnostics procedures, as described in the "ServerView Suite Local Service Concept (LSC)" manual (see section
"Documents you need at hand" on page 25
.
V
CAUTION!
The document at hand comprises procedures of a wide range of complexity. Check the profile of qualification for technicians before assigning tasks. Before you start, carefully read
"Classification of procedures" on page 21
.
CX2570 M2 Upgrade and Maintenance Manual 17
Introduction
1.1
Notational conventions
The following notational conventions are used in this manual:
Text in italics fixed font indicates commands or menu items indicates system output indicates text to be entered by the user semi-bold fixed font
"Quotation marks" indicate names of chapters and terms that are being emphasized
Ê describes activities that must be performed in the order shown
[Abc] indicates keys on the keyboard
V
CAUTION!
Pay particular attention to texts marked with this symbol!
Failure to observe this warning may endanger your life, destroy the system or lead to the loss of data.
I indicates additional information, notes and tips indicates the procedure category in terms of complexity and qualification requirements, see
"Classification of procedures" on page 21
indicates the average task duration, see
"Average task duration" on page 24
18 Upgrade and Maintenance Manual CX2570
2 Before you start
Before you start any upgrade or maintenance task, please proceed as follows:
Ê
Carefully read the safety instructions in chapter "Important information" on page 29 .
Ê
Make sure that all necessary manuals are available. Refer to the documentation overview in section
"Documents you need at hand" on page 25 . Print the PDF files if required.
Ê
Make yourself familiar with the procedure categories introduced in section
"Classification of procedures" on page 21 .
Ê
Ensure that all required tools are available according to section
"Tools you need at hand" on page 25 .
V
CAUTION
In a system that has the Cool-safe
®
Advanced Thermal Design option, only components that support the higher operating range may be installed. Further information on this is available in the configurator.
The Cool-safe
®
Advanced Thermal Design option can only be ordered from the manufacturer and is indicated by the logo on the identification rating plate.
Installing optional components
The operating manual of your server node gives an introduction to server node features and provides an overview of available hardware options.
Use the Fujitsu ServerView Suite management software and the iRMC web frontend to prepare hardware expansions. ServerView Suite documentation is available online at http://manuals.ts.fujitsu.com
( http://jp.fujitsu.com/platform/server/primergy/manual/ for the Japanese market).
Please refer to the following ServerView Suite topics:
– Operation
– Virtualization
– Maintenance
– Out-Of-Band Management
CX2570 M2 Upgrade and Maintenance Manual 19
Before you start
I
For the latest information on hardware options, refer to your server’s hardware configurator available online at the following address: for the EMEA market: http://ts.fujitsu.com/products/standard_servers/index.htm
for the Japanese market: http://jp.fujitsu.com/platform/server/primergy/system/
Please contact your local Fujitsu customer service partner for details on how to order expansion kits or spare parts. Use the Fujitsu Illustrated Spares Catalog to identify the required spare part and obtain technical data and order information. Illustrated Spares catalogs are available online at http://manuals.ts.fujitsu.com/illustrated_spares (EMEA market only).
20 Upgrade and Maintenance Manual CX2570
Before you start
2.1
Classification of procedures
The complexity of maintenance procedures varies significantly. Procedures have been assigned to one of three unit categories, indicating the level of difficulty and required qualification.
At the beginning of each procedure, the involved unit type is indicated by one of the symbols introduced in this section.
I
Please ask your local Fujitsu service center for more detailed information.
2.1.1
Customer Replaceable Units (CRU)
Customer Replaceable Units (CRU)
Customer Replaceable Units are intended for customer self service and may be installed or replaced as hot-plug components during operation.
I
Components that the customer is entitled to replace may differ according to the service form in his country.
Hot-plug components increase system availability and guarantee a high degree of data integrity and fail-safe performance. Procedures can be carried out without shutting down the server or going offline.
Components that are handled as Customer Replaceable Units
– Hot-plug power supply units
– Hot-plug HDD / SSD modules
Peripherals that are handled as Customer Replaceable Units
– Keyboard
– Mouse
CX2570 M2 Upgrade and Maintenance Manual 21
Before you start
2.1.2
Upgrade and Repair Units (URU)
Upgrade and Repair Units (URU)
Upgrade and Repair Units are non hot-plug components that can be ordered separately to be installed as options ( Upgrade Units ) or are available to the customer through customer self service ( Repair Units ).
I
Server management error messages and diagnostic indicators on the front panel and system board will report defective Upgrade and Repair
Units as customer replaceable CSS components.
Upgrade and repair procedures involve shutting down and opening the server.
V
CAUTION!
The device may be seriously damaged or cause damage if it is opened without authorization or if repairs are attempted by unauthorized and untrained personnel.
Components that are handled as Upgrade Units
– Expansion cards
– Memory modules
– USB Flash Module (UFM)
– SATA DOM
– iRMC micro SD card
Components that are handled solely as Repair Units
– CMOS battery
22 Upgrade and Maintenance Manual CX2570
Before you start
2.1.3
Field Replaceable Units (FRU)
Field Replaceable Units (FRU)
Removing and installing Field Replaceable Units involves complex maintenance procedures on integral server components. Procedures will require shutting down, opening and disassembling the server.
V
CAUTION!
Maintenance procedures involving Field Replaceable Units must be performed exclusively by Fujitsu service personnel or technicians trained by Fujitsu. Please note that unauthorized interference with the system will void the warranty and exempt the manufacturer from all liability.
Components that are handled as Field Replaceable Units
– Processors (replacements)
– System board
I
Please ask your local Fujitsu service center for more detailed information.
CX2570 M2 Upgrade and Maintenance Manual 23
Before you start
2.2
Average task duration
Average task duration: 10 minutes
The average task duration including preliminary and concluding steps is indicated at the beginning of each procedure next to the procedure class.
Refer to table 1 on page 24 for an overview of steps taken into account for
calculating the average task duration:
Step
Server node shutdown
Rack removal, disassembly
Transport
Maintenance procedures
Transport
Assembly, rack installation
Starting up included Explanation
Shutdown time depends on hardware and software configuration and may vary significantly.
no
Software tasks necessary before maintenance are described in section
"Completing the maintenance task" on page 67
".
yes no yes
Making the server available, removing the server from the rack (if applicable).
Transporting the server to the service table
(where required) depends on local customer conditions.
Maintenance procedures including preliminary and concluding software tasks.
no yes no
Returning the server to its installation site
(where required) depends on local customer conditions.
Reassembling the server, installing the server in the rack (if applicable).
Booting time depends on hardware and software configuration and may vary significantly.
Table 1: Calculation of the average task duration
24 Upgrade and Maintenance Manual CX2570
Before you start
2.3
Tools you need at hand
When preparing the maintenance task, ensure that all required tools are available according to the overview below. You will find a list of required tools at the beginning of each procedure.
Screw driver /
Bit insert
Screw Usage Type
Phillips
PH1 / (+) No. 1
UFM / SATA
DOM nylon screw
M3 x 4.5 mm
(white)
A3C40109082
Phillips
PH2 / (+) No. 2 hexagonal cross
SW5 / PZ2
Network controller
M3 x 4.5 mm
GPGPU fixing bracket
C26192-Y10-C67 hexagonal cross
SW5
M3 x 4.5 mm
System board
C26192-Y10-C67
Table 2: List of required tools and used screws
2.4
Documents you need at hand
Maintenance procedures may include references to additional documentation.
When preparing the maintenance task, ensure that all required manuals are available according to the overview below.
I
– Ensure to store all printed manuals enclosed with your server in a save place for future reference.
– Unless stated otherwise, all manuals are available online at http://manuals.ts.fujitsu.com
under x86 servers .
CX2570 M2 Upgrade and Maintenance Manual 25
Before you start
For the Japanese market please use the following address: http://jp.fujitsu.com/platform/server/primergy/manual/
26 Upgrade and Maintenance Manual CX2570
Before you start
2.4.1
Documents for the server node
Document
"ServerView Quick Start Guide"
Description
Quick installation poster for initial operation, available online
"Safety notes and regulations" manual
" 安全上のご注意 " for the
Japanese market
"FUJITSU Server PRIMERGY
CX2570 M2 Server Node"
Operating Manual
"D3343 BIOS Setup Utility for
FUJITSU Server PRIMERGY
CX2570 M2" Reference Manual
Important safety information, available online or as a printed copy
Available online
Information on configurable BIOS options and parameters, available online
– "ServerView Suite Local Service
Concept (LSC)" user guide
Software documentation
Illustrated Spares catalog
– "ServerView Operations Manager -
Server Management" user guide
Spare parts identification and information system (EMEA market only), available for online use or download (Windows OS) at http://manuals.ts.fujitsu.com/illustrated_spares or from the CSS component view of the
ServerView Operations Manager
Available online Glossary
"Warranty" manual
" 保証書 " for the Japanese market
"Returning used devices" manual
"Service Desk" leaflet
Important information on warranty regulations, recycling and service, available online or as a printed copy
Recycling and contact information, available online or as a printed copy
" サポート&サービス " for the
Japanese market
Table 3: Documentation you need at hand for the server node
CX2570 M2 Upgrade and Maintenance Manual 27
Before you start
Document
Additional documentation
Third party documentation
Description
– RAID documentation, available online at http://manuals.ts.fujitsu.com
under x86 servers - Expansion Cards - Storage
Adapters
– Operating system documentation, online help
– Peripherals documentation
Table 3: Documentation you need at hand for the server node
2.4.2
Documents for the server enclosure
Document
"Quick Start Hardware -
FUJITSU Server PRIMERGY
CX400 M1" leaflet
"FUJITSU Server PRIMERGY
CX400 M1 Server Enclosure"
Upgrade and Maintenance
Manual
"FUJITSU Server PRIMERGY
CX400 M1 Server Enclosure"
Operating Manual
Description
Available online
Available online
Available online
Table 4: Documentation you need at hand for the server enclosure
28 Upgrade and Maintenance Manual CX2570
3 Important information
V
CAUTION!
Before installing and starting up a device, please observe the safety instructions listed in the following section. This will help you to avoid making serious errors that could impair your health, damage the device and endanger the data base.
3.1
Safety instructions
I
The following safety instructions are also provided in the manual "Safety
Notes and Regulations" or " 安全上のご注意 ".
This device meets the relevant safety regulations for IT equipment. If you have any questions about whether you can install the server in the intended environment, please contact your sales outlet or our customer service team.
● The actions described in this manual shall be performed by technical specialists. A technical specialist is a person who is trained to install the server including hardware and software.
●
●
●
Repairs to the device that do not relate to CSS failures shall be performed by service personnel. Please note that unauthorized interference with the system will void the warranty and exempt the manufacturer from all liability.
Any failure to observe the guidelines in this manual, and any improper repairs could expose the user to risks (electric shock, energy hazards, fire hazards) or damage the equipment.
Before installing/removing internal options to/from the server, turn off the server, all peripheral devices, and any other connected devices. Also unplug all power cords from the power outlet. Failure to do so can cause electric shock or damage.
CX2570 M2 Upgrade and Maintenance Manual 29
Important information
Before starting up
●
●
●
During installation and before operating the device, observe the instructions on environmental conditions for your device.
If the device is brought in from a cold environment, condensation may form both inside and on the outside of the device.
Wait until the device has acclimatized to room temperature and is absolutely dry before starting it up. Material damage may be caused to the device if this requirement is not observed.
Transport the device only in the original packaging or in packaging that protects it from knocks and jolts.
For the Japanese market, transporting the device in its original packaging does not apply.
Installation and operation
● This unit should not be operated in ambient temperatures above 35 °C. For servers with Cool-safe
®
Advanced Thermal Design the ambient temperature can increase to 40 °C.
●
●
If the unit is integrated into an installation that draws power from an industrial power supply network with an IEC309 connector, the power supply's fuse protection must comply with the requirements for non-industrial power supply networks for type A connectors.
The unit automatically adjusts itself to a mains voltage in a range of 100 VAC to 240 VAC. Ensure that the local mains voltage lies within these limits.
●
●
●
●
This device must only be connected to properly grounded power outlets or connected to the grounded rack internal power distribution system with tested and approved power cords.
Ensure that the device is connected to a properly grounded power outlet close to the device.
Ensure that the power sockets on the device and the properly grounded power outlets are easily accessible.
The On/Off button or the main power switch (if present) does not isolate the device from the mains power supply. In case of repair or servicing disconnect the device completely from the mains power supply, unplug all power plugs from the properly grounded power outlets.
30 Upgrade and Maintenance Manual CX2570
Important information
●
●
●
●
●
●
●
●
●
●
●
Always connect the server and the attached peripherals to the same power circuit. Otherwise you run the risk of losing data if, for example, the server is still running but a peripheral device (e.g. memory subsystem) fails during a power outage.
Data cables must be adequately shielded.
Ethernet cabling has to comply with EN 50173 and EN 50174-1/2 standards or ISO/IEC 11801 standard respectively. The minimum requirement is a
Category 5 shielded cable for 10/100 Ethernet, or a Category 5e cable for
Gigabit Ethernet.
Route the cables in such a way that they do not create a potential hazard
(make sure no-one can trip over them) and that they cannot be damaged.
When connecting the server, refer to the relevant instructions in this manual.
Never connect or disconnect data transmission lines during a storm (risk of lightning hazard).
Make sure that no objects (e.g. jewelry, paperclips etc.) or liquids can get inside the server (risk of electric shock, short circuit).
In emergencies (e.g. damaged casing, controls or cables, penetration of liquids or foreign bodies), contact the system administrator or your customer service team. Only disconnect the system from the mains power supply if there is no risk of harming yourself.
Proper operation of the system (in accordance with IEC 60950-1 resp.
EN 60950-1) is only ensured if the casing is completely assembled and the rear covers for the installation slots have been fitted (electric shock, cooling, fire protection, interference suppression).
Only install system expansions that satisfy the requirements and rules governing safety and electromagnetic compatibility and those relating to telecommunication terminals. If you install other expansions, they may damage the system or violate the safety regulations. Information on which system expansions are approved for installation can be obtained from our customer service center or your sales outlet.
The components marked with a warning notice (e.g. lightning symbol) may only be opened, removed or exchanged by authorized, qualified personnel.
Exception: CSS components can be replaced.
The warranty is void if the server is damaged during installation or replacement of system expansions.
CX2570 M2 Upgrade and Maintenance Manual 31
Important information
●
●
●
●
●
●
●
●
Only set screen resolutions and refresh rates that are specified in the operating manual for the monitor. Otherwise, you may damage your monitor.
If you are in any doubt, contact your sales outlet or customer service center.
Before installing/removing internal options to/from the server, turn off the server, all peripheral devices, and any other connected devices. Also unplug all power cords from the outlet. Failure to do so can cause electric shock.
Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock and will void the warranty and exempt the manufacturer from all liability.
Devices inside the server remain hot after shutdown. Wait for a while after shutdown before installing or removing internal options.
The circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. To ensure reliable protection, if you are wearing an earthing band on your wrist when working with this type of module, connect it to an unpainted, conducting metal part of the system.
Do not touch the circuitry on boards or soldered parts. Hold the metallic areas or the edges of the circuit boards.
Install the screw removed during installation/detaching internal options in former device/position. To use a screw of the different kind can cause a breakdown of equipment.
The installation indicated on this document is sometimes changed to the kind of possible options without notice.
Batteries
● Incorrect replacement of batteries may lead to a risk of explosion. The batteries may only be replaced with identical batteries or with a type recommended by the manufacturer.
●
●
Do not throw batteries into the trash can.
Batteries must be disposed of in accordance with local regulations concerning special waste.
●
●
Make sure that you insert the battery the right way round.
The battery used in this device may present a fire or chemical burn hazard if mistreated. Do not disassemble, heat about 100 °C (212F), or incinerate the battery.
32 Upgrade and Maintenance Manual CX2570
Important information
● All batteries containing pollutants are marked with a symbol (a crossed-out garbage can). In addition, the marking is provided with the chemical symbol of the heavy metal decisive for the classification as a pollutant:
Cd Cadmium
Hg Mercury
Pb Lead
Working with optical disk drives and media
When working with optical disk drives, these instructions must be followed.
V
CAUTION!
● Only use CDs/DVDs/BDs that are in perfect condition, in order to prevent data loss, equipment damage and injury.
● Check each CD/DVD/BD for damage, cracks, breakages etc. before inserting it in the drive.
Note that any additional labels applied may change the mechanical properties of a CD/DVD/BD and cause imbalance and vibrations.
Damaged and imbalanced CDs/DVDs/BDs can break at high drive speeds (data loss).
●
●
●
●
●
●
Under certain circumstances, sharp CD/DVD/BD fragments can pierce the cover of the optical disk drive (equipment damage) and can fly out of the device (danger of injury, particularly to uncovered body parts such as the face or neck).
High humidity and airborne dust levels are to be avoided. Electric shocks and/or server failures may be caused by liquids such as water, or metallic items, such as paper clips, entering a drive.
Shocks and vibrations are also to be avoided.
Do not insert any objects other than the specified CDs/DVDs/BDs.
Do not pull on, press hard, or otherwise handle the CD/DVD/BD tray roughly.
Do not disassemble the optical disk drive.
Before use, clean the optical disk tray using a soft, dry cloth.
CX2570 M2 Upgrade and Maintenance Manual 33
Important information
●
●
●
As a precaution, remove disks from the optical disk drive when the drive is not to be used for a long time. Keep the optical disk tray closed to prevent foreign matter, such as dust, from entering the optical disk drive.
Hold CDs/DVDs/BDs by their edges to avoid contact with the disk surface.
Do not contaminate the CD/DVD/BD surface with fingerprints, oil, dust, etc. If dirty, clean with a soft, dry cloth, wiping from the center to the edge. Do not use benzene, thinners, water, record sprays, antistatic agents, or silicone-impregnated cloth.
●
●
Be careful not to damage the CD/DVD/BD surface.
Keep the CDs/DVDs/BDs away from heat sources.
Do not bend or place heavy objects on CDs/DVDs/BDs.
●
●
●
●
Do not write with ballpoint pen or pencil on the label (printed) side.
When a CD/DVD/BD is moved from a cold place to a warm place, moisture condensation on the CD/DVD/BD surface can cause data read errors. In this case, wipe the CD/DVD/BD with a soft, dry cloth then let it air dry. Do not dry the CD/DVD/BD using devices such as a hair dryer.
To avoid dust, damage, and deformation, keep the CD/DVD/BD in its case whenever it is not in use.
● Do not store CDs/DVDs/BDs at high temperatures. Areas exposed to prolonged direct sunlight or near heating appliances are to be avoided.
I
You can prevent damage from the optical disk drive and the
CDs/DVDs/BDs, as well as premature wear of the disks, by observing the following suggestions:
– Only insert disks in the drive when needed and remove them after use.
– Store the disks in suitable sleeves.
– Protect the disks from exposure to heat and direct sunlight.
Laser information
The optical disk drive complies with IEC 60825-1 laser class 1.
34 Upgrade and Maintenance Manual CX2570
Important information
V
CAUTION!
The optical disk drive contains a light-emitting diode (LED), which under certain circumstances produces a laser beam stronger than laser class 1. Looking directly at this beam is dangerous.
Never remove parts of the optical disk drive casing!
Modules with Electrostatic-Sensitive Devices
Modules with electrostatic-sensitive devices are identified by the following sticker:
Figure 1: ESD label
When you handle components fitted with ESDs, you must always observe the following points:
● Switch off the system and remove the power plugs from the power outlets before installing or removing components with ESDs.
● The circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. To ensure reliable protection, you must wear an earthing band on your wrist when working with this type of module and connect it to an unpainted, conducting metal part of the system.
●
●
●
●
●
Any devices or tools that are used must be free of electrostatic charge.
Wear a suitable grounding cable that connects you to the external chassis of the system unit.
Always hold components with ESDs at the edges or at the points marked green (touch points).
Do not touch any connectors or conduction paths on an ESD.
Place all the components on a pad which is free of electrostatic charge.
CX2570 M2 Upgrade and Maintenance Manual 35
Important information
I
For a detailed description of how to handle ESD components, see the relevant European or international standards (EN 61340-5-1,
ANSI/ESD S20.20).
Transporting the server
●
●
Only transport the server in its original packaging or in packaging that protects it from impacts and jolts.
For the Japanese market, transporting the device in its original packaging does not apply.
Do not unpack the server until it is at its installation location.
36 Upgrade and Maintenance Manual CX2570
Important information
Notes on installing the server in the rack
●
●
●
●
●
●
●
●
For safety reasons, at least two people are required to install the server in the rack because of its weight and size.
(For the Japanese market, please refer to " 安全上のご注意 ".)
Never lift the server into the rack using the handles on the front panel.
When connecting and disconnecting cables, observe the relevant instructions in the "Important Information" chapter of the technical manual for the corresponding rack. The technical manual is supplied with the corresponding rack.
When installing the rack, make sure that the anti-tilt protection is correctly fitted.
For safety reasons, no more than one unit may be removed from the rack at any one time during installation and maintenance work.
If several units are simultaneously removed from the rack, there is a risk that the rack could tip over.
The rack must be connected to the power supply by an authorized specialist
(electrician).
If the server is integrated into an installation that draws power from an industrial power supply network with an IEC309 type connector, the power supply's fuse protection must comply with the requirements for nonindustrial power supply networks for the type A connector.
3.2
CE conformity
The system complies with the requirements of the EC directives
2004/108/EC regarding "Electromagnetic Compatibility" and
2006/95/EC "Low Voltage Directive" and the directive of the
European Parliament and Council 2011/65/EU. This is indicated by the CE marking (CE = Communauté Européenne).
CX2570 M2 Upgrade and Maintenance Manual 37
Important information
3.3
FCC Class A Compliance Statement
If there is an FCC statement on the device, it applies to the products covered in this manual, unless otherwise specified herein. The statement for other products will appear in the accompanying documentation.
NOTE:
This equipment has been tested and found to comply with the limits for a
"Class A" digital device, pursuant to Part 15 of the FCC rules and meets all requirements of the Canadian Interference-Causing Equipment Standard
ICES-003 for digital apparatus. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses and can radiate radio frequency energy and, if not installed and used in strict accordance with the instructions, may cause harmful interference to radio communications. However, there is no warranty that interference will not occur in a particular installation. If this equipment does cause harmful interference to radio or television reception, which can be determined by turning the equipment off and on, the user is encouraged to try to correct the interference by one or more of the following measures:
●
●
Reorient or relocate the receiving antenna.
Increase the separation between equipment and the receiver.
● Connect the equipment into an outlet on a circuit different from that to which the receiver is connected.
● Consult the dealer or an experienced radio/TV technician for help.
Fujitsu is not responsible for any radio or television interference caused by unauthorized modifications of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by Fujitsu. The correction of interferences caused by such unauthorized modification, substitution or attachment will be the responsibility of the user.
The use of shielded I/O cables is required when connecting this equipment to any and all optional peripheral or host devices. Failure to do so may violate FCC and ICES rules.
WARNING:
This is a class A product. In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures.
38 Upgrade and Maintenance Manual CX2570
Important information
3.4
Environmental protection
Environmentally-friendly product design and development
This product has been designed in accordance with the Fujitsu standard for
"environmentally friendly product design and development". This means that key factors such as durability, selection and labeling of materials, emissions, packaging, ease of dismantling and recycling have been taken into account.
This saves resources and thus reduces the harm done to the environment.
Further information can be found at:
– http://ts.fujitsu.com/products/standard_servers/index.html
(for the global market)
– http://jp.fujitsu.com/platform/server/primergy/concept/ (for the Japanese market)
Energy-saving information
Devices that do not need to be constantly switched on should be switched off until they are needed as well as during long breaks and after completion of work.
Packaging information
This packaging information doesn’t apply to the Japanese market.
Do not throw away the packaging. You may need it later for transporting the system. If possible, the equipment should only be transported in its original packaging.
Information on handling consumables
Please dispose of printer consumables and batteries in accordance with the applicable national regulations.
In accordance with EU directives, batteries must not be disposed of with unsorted domestic waste. They can be returned free of charge to the manufacturer, dealer or an authorized agent for recycling or disposal.
All batteries containing pollutants are marked with a symbol (a crossed-out garbage can). They are also marked with the chemical symbol for the heavy metal that causes them to be categorized as containing pollutants:
Cd Cadmium
Hg Mercury
Pb Lead
CX2570 M2 Upgrade and Maintenance Manual 39
Important information
Labels on plastic casing parts
Please avoid sticking your own labels on plastic parts wherever possible, since this makes it difficult to recycle them.
Returns, recycling and disposal
Please handle returns, recycling and disposal in accordance with local regulations.
The device must not be disposed of with domestic waste. This device is labeled in compliance with European directive
2002/96/EC on waste electrical and electronic equipment (WEEE).
This directive sets the framework for returning and recycling used equipment and is valid across the EU. When returning your used device, please use the return and collection systems available to you. Further information can be found at http://ts.fujitsu.com/recycling .
Details regarding the return and recycling of devices and consumables within
Europe can also be found in the "Returning used devices" manual, via your local
Fujitsu branch or from our recycling center in Paderborn:
Fujitsu Technology Solutions
Recycling Center
D-33106 Paderborn
Tel. +49 5251 525 1410
Fax +49 5251 525 32 1410
40 Upgrade and Maintenance Manual CX2570
4 Basic hardware procedures
4.1
Shutting down the server node
Safety notes
V
CAUTION!
For further safety information, please refer to chapter "Important information" on page 29
.
I
This step is only required when upgrading or replacing non-hot plug components.
Ê
Inform the system administrator that the server node will be shut down and put offline.
Ê
Terminate all applications.
Ê
Press the On/Off button either on the rear or on the corresponding front panel to shut down the server node.
I
If the system is running an ACPI-compliant operating system, pressing the On / Off button will perform a graceful shutdown.
CX2570 M2 Upgrade and Maintenance Manual 41
Basic hardware procedures
4.2
Removing the server node from the server enclosure
V
CAUTION!
● Shut down the server node and disconnect all external cables.
●
●
Follow the safety instructions in the chapter
"Important information" on page 29 .
The server node slot must not be left open for more than 60 minutes.
Figure 2: Removing the server node
Ê
Undo the locking mechanism (1) of the release lever and pull the server node out of the slot (2).
42 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.3
Removing the GPGPU extension
Figure 3: Loosening the captive screws
Ê
Loosen the captive screws.
Figure 4: Removing the GPGPU extension
Ê
Swivel the GPGPU extension up (1) and remove it from the hinge rod (2).
CX2570 M2 Upgrade and Maintenance Manual 43
Basic hardware procedures
4.4
Removing the riser module
Figure 5: Removing the riser module at the left side
I
An expansion card can only be installed if the riser module has been removed.
Ê
Remove the riser module from the chassis by pulling the riser module out of the slot and the bolt out of the chassis sparing (see circle).
44 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
Figure 6: Riser module at the right side
Ê
Remove the riser module at the right side accordingly from the chassis by pulling the riser module out of the slot and the bolt out of the chassis sparing
(see circle).
CX2570 M2 Upgrade and Maintenance Manual 45
Basic hardware procedures
4.5
Installing the riser module
Figure 7: Installing the riser module
Ê
Install the riser module to the chassis by inserting the bolt into the chassis sparing (see circle) and press down the riser module until the connector of the riser card fits within the slot.
I
Make sure that the riser board connects within the slot properly.
46 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
Figure 8: Riser module at the right side
Ê
Install the riser module on the right side accordingly.
CX2570 M2 Upgrade and Maintenance Manual 47
Basic hardware procedures
4.6
Replacing the riser card
Figure 9: Replacing the riser card
The riser module consists of the riser metal bracket and the riser card.
The riser card is connected to the riser metal bracket with two rivets:
– Rivet (1).
– Rivet with bolt (2).
Ê
For removing the riser card loosen the two rivets and take off the riser card.
Ê
For installing the new riser card put the riser card on the riser metal bracket and fasten the two screws with a hexagonal SW6.
48 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.7
Mounting a controller to the riser module
Figure 10: Mounting a controller to the riser module
Ê
Plug the controller on the riser card connector (1).
I
Make sure that the metal pin of the controller bracket hooks into the recess of the riser bracket (see circle).
CX2570 M2 Upgrade and Maintenance Manual 49
Basic hardware procedures
4.8
Removing a controller from the riser module
Figure 11: Removing a controller from the riser module
Ê
Pull the controller out of the riser card connector (1).
I
Make sure that the metal pin of the controller bracket does not get stucked with the recess of the riser bracket (see circle).
50 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.9
Removing the memory slot air ducts
Figure 12: Removing the memory slot air ducts
Ê
Push the air ducts together (1) and pull them out (2).
CX2570 M2 Upgrade and Maintenance Manual 51
Basic hardware procedures
4.10 Installing the memory slot air ducts
Figure 13: Installing the memory slot air ducts
Ê
Press down on the air ducts (see1 and 2) until they snap into their location between the memory modules.
I
The air ducts only snap easily into place if all memory modules are installed properly.
4.10.1 Design of the memory air ducts
Figure 14: Design of the memory air duct
52 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.11
Installing the GPGPU extension
Figure 15: Attaching the metal rod
Ê
For upgrading a CX2550 M2 to a CX2570 M2 attach the metal rod to the
CX2550 M2 chassis using the delivered crosshead screws.
Figure 16: Foil on the CX2570 M2 chassis
Ê
Put the foil on the CX2570 M2 chassis.
CX2570 M2 Upgrade and Maintenance Manual 53
Basic hardware procedures
Figure 17: Foil - detail
Ê
Pay attention that the foil is placed correctly (see circle).
1
2
Figure 18: Installing the GPGPU extension
Ê
Plug the GPGPU extension notches (1) on the hinge rod (2).
Ê
Carefully swivel the GPGPU extension down (3).
54 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
Figure 19: View before the GPGPU extension is connected.
Figure 20: Fastening the captive screws
Ê
Fasten the captive screws.
CX2570 M2 Upgrade and Maintenance Manual 55
Basic hardware procedures
4.12 Installing the server node in the server enclosure
V
CAUTION!
● Follow the safety instructions in the chapter
"Important information" on page 29 .
Figure 21: Installing the server node
Ê
Push the server node at the handle into the server enclosure until the locking mechanism snaps into place.
Ê
If applicable, connect all external cables to the server node.
56 Upgrade and Maintenance Manual CX2570
Basic hardware procedures
4.13 Controls and indicators on the server node
V
CAUTION!
●
Follow the safety instructions in chapter "Important information" on page 29
.
Ê
If applicable, connect all external cables to the server node.
Figure 22: Controls and indicators of the server node
1 Reset button (RST)
2 Global error LED
3 ID indicator
4 CSS indicator
I
The server nodes are controlled via related operating panel areas on the front side of the CX400 M1 server enclosure. See "FUJITSU Server
PRIMERGY CX400 M1 Server Enclosure Operating Manual".
4.14 Concluding software tasks
Ê
Perform the following software tasks to put the server back in operation:
–
"Verifying the system time settings" on page 81
–
"Viewing and clearing the System Event Log (SEL)" on page 82
–
"Updating the NIC configuration file in a Linux environment" on page 83
–
"Performing a RAID array rebuild" on page 86
–
"Looking up changed MAC / WWN addresses" on page 86
CX2570 M2 Upgrade and Maintenance Manual 57
Basic hardware procedures
58 Upgrade and Maintenance Manual CX2570
5 Basic software procedures
5.1
Starting the maintenance task
5.1.1
Suspending BitLocker functionality
BitLocker Drive Encryption provides protection for operating system and data drives by encrypting the contents and requiring users to authenticate their credentials to access the information. In the scenario described here, BitLocker uses the compatible Trusted Platform Module (TPM) to detect if the computer's startup process has been modified from its original state.
I
For additional information on how to use BitLocker on a computer without a compatible TPM, please refer to the "BitLocker Drive Encryption" documentation page at http://technet.microsoft.com/library/cc731549.aspx.
Suspending BitLocker Drive Encryption is a temporary method for removing
BitLocker protection without decrypting the drive Windows is installed on.
Suspend BitLocker before modifying the server’s hardware configuration or startup files. Resume BitLocker again after the maintenance procedure is complete.
V
CAUTION!
– With BitLocker features enabled, modifying the system configuration
(hardware or firmware settings) may render the system inaccessible.
The system may enter Recovery Mode and require a 48-digits recovery password to return to normal operation.
Ensure to suspend BitLocker drive encryption before maintaining the server.
– When suspended, BitLocker uses a plain text key instead of the
Trusted Platform Module (TPM) to read encrypted files. Keep in mind that information on this drive is not secure until BitLocker has been re-enabled.
Ê
Ask the system administrator to suspend BitLocker-protection on the system volume, using the BitLocker Drive Encryption control panel item.
I
This will temporarily disable BitLocker for maintenance purposes.
The volume will not be decrypted and no keys will be discarded.
CX2570 M2 Upgrade and Maintenance Manual 59
Basic software procedures
For Windows Server 2008:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking Security , and then clicking BitLocker Drive
Encryption .
Ê
Select the system volume, and click Turn Off BitLocker .
Ê
From the Turn Off BitLocker dialog box, click Disable BitLocker .
For Windows Server 2008 R2 and above:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking System and Security , and then clicking BitLocker
Drive Encryption .
Ê
Select the system volume, and click Suspend Protection .
Ê
Click Yes to confirm that your data will not be protected while BitLocker is suspended.
I
In order to determine which features are accessible through the
BitLocker setup wizard, it may be necessary to modify the BitLocker
Group Policy settings.
For further information on how to suspend BitLocker drive encryption, please refer to the Microsoft TechNet library at http://technet.microsoft.com/library/cc731549.aspx.
Fujitsu service partners will find additional information (also available in Japanese) on the Fujitsu Extranet web pages.
5.1.2
Disabling SVOM boot watchdog functionality
The ServerView Operations Manager boot watchdog determines whether the server boots within a preset time frame. If the watchdog timer expires, the system will automatically reboot.
5.1.2.1
Viewing boot watchdog settings
Viewing boot watchdog settings in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
60 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Under Boot Watchdog , you can obtain detailed information about the current watchdog status, time out intervals and actions that are triggered if watchdog time outs are exceeded.
I
For detailed information on BIOS settings, refer to the corresponding
BIOS Setup Utility reference manual.
Viewing boot watchdog settings in the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
Under Watchdog Settings , you can obtain detailed information about the current watchdog status, time out intervals and actions that are triggered if watchdog time outs are exceeded.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
Viewing boot watchdog settings in ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View select Maintenance from the Information / Operation menu.
Ê
Under ASR&R select the Watchdog tab to obtain detailed information about the current watchdog status, time out intervals and actions that are triggered if watchdog time outs are exceeded.
I
For more detailed information, refer to the "ServerView Operations
Manager - Server Management" user guide.
5.1.2.2
Configuring boot watchdog settings
If the system is to be started from removable boot media for firmware upgrade purposes, the Boot watchdog needs to be disabled before starting maintenance task. Otherwise, the Boot watchdog might initiate a system reboot before the flash process is complete.
V
CAUTION!
An incomplete firmware upgrade process may render the server inaccessible or result in damaged / destroyed hardware.
Timer settings can be configured in the BIOS or using the ServerView iRMC web frontend:
CX2570 M2 Upgrade and Maintenance Manual 61
Basic software procedures
Configuring boot watchdog settings in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Watchdog set the Action setting to Continue .
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
Configuring boot watchdog settings using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
Under Watchdog Settings select Continue from the Boot Watchdog drop down list.
Ê
Click Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
62 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.1.3
Configuring LAN teaming
Use ServerView Operations Manager to obtain detailed information on existing
LAN teams:
Ê
In ServerView Operations Manager Single System View select System Status from the Information / Operation menu.
Ê
Under Network Interfaces select LAN Teaming .
Ê
The Network Interfaces (Summary) overview shows all configured LAN teams and their components. Choose a LAN team to display further details:
– LAN Team Properties : Properties of the selected LAN team
– LAN Team Statistics : Available statistics about the selected LAN team
I
For more detailed information, refer to the "ServerView Operations
Manager - Server Management" user guide.
5.1.4
Note on server maintenance in a Multipath I/O environment
When booting your server offline from the ServerView Suite DVD to perform an offline BIOS / firmware update using the ServerView Update DVD or collect diagnostic data using PrimeCollect in a Multipath I/O environment, there is a risk of damaging the system configuration which may leave the system unable to boot.
I
This is a known restriction of Windows PE with Multipath drivers.
Using Update Manager Express
Ê
If performing an offline BIOS / firmware update, first of all prepare the
ServerView Update DVD or USB stick:
Ê
Download the latest ServerView Update DVD image from Fujitsu: for the EMEA market ftp://ftp.ts.fujitsu.com/images/serverview for the Japanese market: http://jp.fujitsu.com/platform/server/primergy/products/note/svsdvd/dvd/
Ê
Burn the image to a DVD.
CX2570 M2 Upgrade and Maintenance Manual 63
Basic software procedures
Ê
In order to create a bootable USB stick, please proceed as described in the "Local System Update for PRIMERGY Servers" user guide.
Ê
Before using the ServerView Update DVD or USB stick in an offline environment, properly shut down the server and disconnect all external I/O connections (like LAN, FC or SAS cables) from the system. Only keep mouse, keyboard, video cable and AC power cord connected.
I
Ensure that all external I/O connections are uniquely identified so that you can reconnect them into their original locations after concluding the task.
To start Update Manager Express from the (physical) Update DVD or from a
USB stick, proceed as follows:
Ê
Prepare your Update DVD or USB stick as described in the "Local System
Update for PRIMERGY Servers" user guide.
Ê
Boot the server from the prepared Update DVD or USB stick:
DVD:
Ê
Switch on the server.
Ê
Right after switching on the server, insert the Update DVD into the
DVD drive and close the tray.
USB:
Ê
Connect the USB stick to the server.
Ê
Switch on the server.
If the server does not boot from DVD or USB stick, proceed as follows:
Ê
Reboot the server, e.g. by pressing the reset button on the front or switching the server off and then on again after a few seconds.
Ê
Once the server has been started, press [F12] to enter the boot menu.
Ê
Use the Ê and Ë cursor keys to select your DVD drive or USB stick as boot device and press
[ENTER]
.
The server will now boot from the Update DVD or USB stick.
Ê
After the boot process is complete, select your preferred GUI language.
The Update Manager Express main window will be displayed.
Ê
Finish the intended maintenance task.
I
For further information, refer to the "Local System Update for
PRIMERGY Servers" user guide.
64 Upgrade and Maintenance Manual CX2570
Basic software procedures
Using PrimeCollect
To start PrimeCollect, proceed as follows:
Ê
Before using PrimeCollect in an offline environment, properly shut down the server and disconnect all external I/O connections (like LAN, FC or SAS cables) from the system. Only keep mouse, keyboard, video cable and AC power cord connected.
I
Ensure that all external I/O connections are uniquely identified so that you can reconnect them into their original locations after concluding the task.
Ê
Switch on the server.
Ê
Right after switching on the server, insert the ServerView Suite DVD into the
DVD drive and close the drive tray.
If the server does not boot from DVD, proceed as follows:
Ê
Reboot the server, e.g. by pressing the reset button on the front or switching the server off and then on again after a few seconds.
Ê
Once the server has been started, press [F12] to enter the boot menu.
Ê
Use the
Ê
and
Ë
cursor keys to select your DVD drive as boot device and press
[ENTER]
.
The server will now boot from the ServerView Suite DVD.
Ê
After the boot process is complete, select your preferred GUI language.
Ê
In the initial Installation Manager startup window, choose PrimeCollect from the Installation Manager mode section.
Ê
Click Continue to proceed.
Ê
Finish the intended maintenance task.
I
For further information, refer to the "PrimeCollect" user guide.
Concluding the procedure
Ê
After the update or diagnostic procedure has been completed, shut down the server, reconnect all external I/O connections and bring the system back to normal operation.
Ê
If necessary, perform this procedure for all remaining servers within the
Multipath environment.
CX2570 M2 Upgrade and Maintenance Manual 65
Basic software procedures
5.1.5
Switching on the ID indicator
When working in a datacenter environment, switch on the ID indicator on the front and rear connector panels of the server for easy identification.
I
For further information, refer to the "ServerView Suite Local Service
Concept (LSC)" and "Integrated Remote Management Controller" user guides.
Using the ID button on the front panel
Ê
Press the ID button on the front panel to switch on the system identification
LEDs.
Using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Under System Overview , click Identify LED On to switch on the ID indicators.
Using ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View press the Locate button in the title bar to switch on the ID indicators.
66 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2
Completing the maintenance task
5.2.1
Updating or recovering the system board BIOS and iRMC
After replacing the system board, it is essential to upgrade the BIOS and iRMC to the latest version. The latest BIOS and iRMC versions are available from the
Fujitsu support internet pages at: http://ts.fujitsu.com/support/ (EMEA market) http://jp.fujitsu.com/platform/server/primergy/downloads/ (Japanese market)
I
Fujitsu does not assume responsibility for any damage done to the server or for the loss of any data resulting from BIOS updates.
5.2.1.1
Updating or recovering the system board BIOS
Flash BIOS update
I
For the Japanese market, follow the instructions provided separately.
For Fujitsu PRIMERGY Servers you have basically the choice, to select between online flash and offline flash:
Online flash update:
Flash BIOS update is processed while operating system is running. The system is accessible via network, and Flash BIOS update might be controlled online by administrator.
Offline flash update:
Flash BIOS update is processed while system is shutdown. Physically presence might be required to perform Flash BIOS update using an additional booting device like USB stick. The system is not accessible via network, it is offline.
To perform a Flash BIOS update (online or offline) you must first download the necessary files from the internet.
Ê
Call up the following internet page: http://support.ts.fujitsu.com/Download .
Ê
Select Driver & Downloads .
CX2570 M2 Upgrade and Maintenance Manual 67
Basic software procedures
Ê
Select your system via Select Product or look under Product Search by Serial-
/Identnumber for your system.
Ê
Select your operating system.
Ê
Select Flash-BIOS.
For Online Flash
– Select Flash BIOS <System> (ASP for Windows/Linux)
– Download the ASP file (Autonomous Support Package) - a self-extracting package for online update under Windows/Linux.
For Offine Flash
– Select System Board - Admin package - Compressed Flash Files .
– Download the offered Admin package file for a Flash BIOS Update with a
USB stick.
I
If the operating system which you use is not selectable, select any operating system or choose OS independent and download the Admin package.
Process Flash BIOS Update
V
Caution
The BIOS is stored in a flash memory device. If an error occurs during the flash BIOS update procedure, the BIOS image in the flash memory may be destroyed. You can then only restore the BIOS using the Flash
replaced. Contact your customer support Service Desk.
Online Flash: Flash BIOS Update under Windows/Linux
Autonomous PRIMERGY Support Packages (ASP) are self-extracting packages for online update of BIOS and Firmware.
For Windows:
Ê
Double click on the exe-file for starting the installation process.
68 Upgrade and Maintenance Manual CX2570
Basic software procedures
For Linux:
Ê
Call "sh <ASP-name>.scexe [options ..]" from a command line interface.
Get more information about possible options by calling "<ASP-name>.scexe -help".
I
BIOS updates always require a closing system reboot.
Offline Flash: Flash BIOS Update with an USB stick
You need an USB stick on which the BIOS update files will be stored.
Ê
Make sure, that you have a bootable USB stick.
I
If your USB stick is not bootable proceed as follows:
Ê
Select on the download page the Admin package - Compressed Flash
Files and read the Installation Description.
Ê
Follow the instructions of the item Create a bootable FreeDOS USB
Flash Drive.
V
CAUTION
The data on the USB stick will be fully erased and overwritten. Make sure, that all data are saved before.
Ê
Unzip the downloaded zip file from Admin package - Compressed Flash Files and copy all files and directories to the root of your bootable USB stick.
Ê
Boot the system from the inserted bootable USB stick:
Ê
Wait until the screen output appears.
Ê
Press the function key
[F12]
and select the bootable USB stick with the arrow keys Ê or Ë .
Ê
Change the directory with cd DOS and start the Flash BIOS Update with the command
DosFlash.
Then follow the instructions on the screen.
Ê
After the Flash BIOS Update the system is restarted automatically. The system will be booted with the new BIOS revision.
Ê
Check the settings in the BIOS setup utility. If necessary, reconfigure the settings again.
CX2570 M2 Upgrade and Maintenance Manual 69
Basic software procedures
Flash Memory Recovery Mode
I
For the Japanese market, follow the instructions provided separately.
Ê
Prepare a bootable USB stick as described in section "Flash BIOS update" on page 67
.
Ê
Switch off the system and disconnect the power plug.
Ê
Open the chassis and switch on "Recovery" (BIOS-RCV) using the jumper /
DIP switch (X5-6) on the system board.
Ê
Reconnect the power plug.
Ê
Boot the system from the inserted bootable USB stick.
Ê
Change the directory with cd DOS and start the Flash BIOS Update with the command
DosFlash.
Then follow the instructions on the screen.
Ê
Observe the update process on the screen, until it is finished. The recovery update may take several minutes.
V
CAUTION!
Do not interrupt the BIOS flash process after it has started. If the process is interrupted, the system BIOS may be permanently corrupted.
Ê
Switch off the system and disconnect the power plug.
Ê
Remove the USB stick.
Ê
Return the "Recovery" (BIOS-RCV) jumper / DIP (X5-6) switch which have been changed to the initial position.
Ê
Reconnect the power plug and switch on the system.
Ê
The system will be booted with the new BIOS revision.
Ê
Check the settings in the BIOS setup utility. If necessary, reconfigure the settings again.
70 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.1.2
Updating or recovering the iRMC iRMC flash procedure
I
For the Japanese market, follow the instructions provided separately.
Ê
Prepare a USB stick including the bootable iRMC firmware update image.
Ê
Connect the USB stick to the USB port.
I
Ensure that only the USB device with the iRMC firmware is connected to the USB port. Remove all other USB devices temporarily.
Ê
Restart the server.
Ê
The system will detect the USB stick.
I
If the BIOS cannot identify the USB stick, the pop-up message
Failed to boot for Emergency flash. Please Reset now
. will show up in the center of the screen.
Ê
Choose one of the following options from the update tool menu to start the iRMC update process:
Normal Choose this option to update an existing system board.
Initial Choose this option if the system board has been replaced prior to the iRMC update procedure. This option will perform all relevant flash procedures in a row, including the iRMC firmware and bootloader.
V
CAUTION!
Do not interrupt the iRMC upgrade process after it has started. If the process is interrupted, the iRMC BIOS may be permanently corrupted.
I
If the iRMC does not work after flashing, disconnect the system from the mains and reconnect it again.
Ê
After completion of the flash process, remove the USB stick and restart the server.
iRMC recovery procedure
I
For the Japanese market, follow the instructions provided separately.
Ê
Prepare a USB stick including the bootable iRMC firmware update image.
CX2570 M2 Upgrade and Maintenance Manual 71
Basic software procedures
Ê
Ensure that the server has been shut down and disconnected from the
mains as described in section "Shutting down the server node" on page 41
.
Ê
Connect the USB stick to the USB port.
I
Ensure that only the USB device with the iRMC firmware is connected to the USB port. Remove all other USB devices temporarily.
Ê
Connect the server to the mains while pushing the ID button on the front panel. Ask a second person to help you if necessary.
Ê
Ensure that the Global Error indicator and the ID indicator are flashing to indicate that the server is entering the iRMC recovery state.
Ê
Press the Power On / Off button. The system starts the POST process.
I
In iRMC recovery mode, the “FUJITSU” logo does not show up.
Ê
The system will detect the USB stick.
I
If the BIOS cannot identify the USB stick, the pop-up message
Failed to boot for Emergency flash. Please Reset now
. will show up in the center of the screen.
Ê
Choose the Recovery_L option from the update tool menu to start the iRMC update process.
V
CAUTION!
Do not interrupt the iRMC upgrade process after it has started. If the process is interrupted, the iRMC BIOS may be permanently corrupted.
I
If the iRMC does not work after flashing, disconnect the system from the mains and reconnect it again.
Ê
Shut down the server by pressing the power On / Off button.
Ê
Disconnect the server from the mains to exit the iRMC recovery state.
72 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.2
Verifying system information backup / restore
To avoid the loss of non-default settings when replacing the system board, a backup copy of important system configuration data is automatically stored from the system board NVRAM to the Chassis ID EPROM. After replacing the system board the backup data is restored from the Chassis ID board to the new system board.
In order to verify whether the backup or restore process has been successful, check the System Event Log (SEL) using the ServerView Operations Manager
(see also section "Viewing and clearing the System Event Log (SEL)" on page 82 ).
After replacing the system board
Ê
Check the SEL log files as described in section "Viewing and clearing the
System Event Log (SEL)" on page 82
to verify whether the backup data on the Chassis ID EPROM has been restored to the system board:
Chassis IDPROM: Restore successful
After replacing the Chassis ID EPROM
I
In case of the PRIMERGY CX2570 M2 server, the Chassis ID EPROM is integrated on the chassis interface board.
Ê
Check the SEL log files as described in section "Viewing and clearing the
System Event Log (SEL)" on page 82
to verify whether a backup copy of the system board settings has been transferred to the Chassis ID EPROM:
Chassis IDPROM: Backup successful
5.2.3
Updating RAID controller firmware
After replacing the RAID controller, it is essential to upgrade the firmware to the latest version. The latest RAID controller firmware version is available from the
Fujitsu support web pages at: http://ts.fujitsu.com/support/ (EMEA market) http://jp.fujitsu.com/platform/server/primergy/downloads/ (Japanese market)
I
Fujitsu does not assume responsibility for any damage done to the server or for the loss of any data resulting from firmware updates.
For the Japanese market, follow the instructions provided separately.
CX2570 M2 Upgrade and Maintenance Manual 73
Basic software procedures
Using the ServerView Update Manager
For a detailed description on how to update the RAID controller firmware using the ServerView Update Manager or Update Manager Express (UME), please refer to the following manuals:
– ServerView Update Manager:
"ServerView Update Management" user guide
– ServerView Update Manager Express:
"Local System Update for PRIMERGY Servers" user guide
Using the flash tool
The latest firmware files are available as ASPs (Autonomous Support
Packages) for Windows or as DOS tools from the Fujitsu support web pages at: http://ts.fujitsu.com/support/ (EMEA market) http://jp.fujitsu.com/platform/server/primergy/downloads/ (Japanese market)
Ê
Select Drivers & Downloads .
Ê
From the Select Product drop down lists, choose your PRIMERGY server or enter its serial or ident number into the search field.
Ê
Select your operating system and version.
Ê
Select the desired component type (e.g. SAS RAID).
Ê
Select your controller from the device list to expand a compilation of available drivers and firmware.
Ê
Select the desired file and click Download for further instructions.
5.2.4
Enabling Option ROM scan
In order to configure an expansion card that has been installed or replaced, the card’s Option ROM has to be enabled in the system board BIOS. The card’s firmware is called by the system BIOS upon reboot and can be entered and configured.
Option ROM can be enabled permanently (e.g. in case of a boot controller that may require frequent setup) or temporarily for one-time configuration. When permanently enabling a controllers’s Option ROM, keep in mind that only two
Option ROMs can be activated in the system board BIOS at a time.
Ê
Enter the BIOS.
74 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
From the Advanced menu select Option ROM Configuration .
Ê
Identify the desired PCI slot and set its Launch Slot # OpROM setting to
Enabled.
Ê
Save your changes and exit the BIOS.
I
Up to two Option ROMs can be activated in the system board BIOS at a time.
For detailed information on how to access the BIOS and modify settings, refer to corresponding BIOS Setup Utility reference manual.
When the enabled expansion card is initialized during the POST phase of the boot sequence, a key combination is displayed temporarily to enter the expansion card’s firmware.
Ê
Press the displayed key combination.
Ê
Modify the expansion card firmware options as desired.
Ê
Save your changes and exit the firmware.
I
The expansion card’s option ROM can now be disabled in the system board BIOS.
Exception: If the expansion card controls a permanent boot device, the card’s Option ROM has to remain enabled.
CX2570 M2 Upgrade and Maintenance Manual 75
Basic software procedures
5.2.5
Resetting the boot retry counter
The boot retry counter is decremented from its preset value every time the
POST watchdog initiates a system reboot. When the value has reached ’0’, the system will shut down and power off.
5.2.5.1
Viewing the boot retry counter
The current boot retry counter status is available in the BIOS:
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Retry Counter the current number of remaining boot attempts is displayed. The value is further decremented with every failed boot attempt or system reboot resulting from critical system errors.
Ê
Exit the BIOS.
5.2.5.2
Resetting the boot retry counter
The boot retry counter should be reset to its original value concluding every service task.
I
Please note, if the customer does not know about the original boot retry values:
If the system boots up and no further errors occur within 6 hours after that successful boot attempt, the boot retry counter will automatically be reset to its default value. Please take into account, that the specified number of boot attempts can only be determined after this period of time.
If the customer knows about the original boot retry values, proceed as follows to reset or configure the boot retry counter:
Resetting the boot retry counter in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Retry Counter press the [+] or [-] keys to specify the maximum number of boot attempts (0 to 7).
Ê
Exit the BIOS.
76 Upgrade and Maintenance Manual CX2570
Basic software procedures
Resetting the boot retry counter using the ServerView Operations
Manager
Ê
In the ServerView Operations Manager Administration view, select Server
Configuration .
Ê
If more than one server is managed in SVOM, select the target server and click Next .
Ê
From the Server Configuration menu pane, choose Restart Options .
Ê
Under Reboot Retries , specify the maximum number of boot attempts (0 to 7) in the Default for reboot tries field.
Resetting the boot retry counter using iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
The following boot retry counter settings are available under ASR&R Options:
Ê
Under Retry counter max specify the maximum number of attempts to boot the operating system (0 to 7).
Ê
Under Retry counter the current number of remaining boot attempts is displayed. Overwrite this value with the maximum number of boot attempts specified above in order to reset the boot retry counter.
Ê
Click Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
CX2570 M2 Upgrade and Maintenance Manual 77
Basic software procedures
5.2.6
Enabling SVOM boot watchdog functionality
If ServerView Operations Manager boot watchdog functionality has been
disabled for firmware upgrade purposes (see section 5.1.2 on page 60 ), it has
to be re-enabled to complete the maintenance task.
Timer settings can be configured in the BIOS or using the ServerView iRMC web frontend:
Configuring boot watchdog settings in the BIOS
Ê
Enter the BIOS.
Ê
Select the Server Mgmt menu.
Ê
Under Boot Watchdog set the Action setting to Reset .
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
Configuring boot watchdog settings using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Server Management menu.
Ê
Under Watchdog Settings ensure that the check box next to Boot Watchdog is selected. From the drop down list choose Reset and specify the desired timeout delay.
Ê
Click Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
5.2.7
Enabling replaced components in the system BIOS
When a processor, an expansion card, or a memory module fails, the defective component will be set to Disabled or Failed in the system BIOS. The server will then reboot with only the intact hardware components remaining in the system configuration. After replacing the defective component, it needs to be reenabled in the system board BIOS.
Ê
Enter the BIOS.
78 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Select the Advanced menu.
Ê
Select the status menu of the desired component:
– Processors: CPU Status
I
This option is only available for multi-processor systems.
– Memory: Memory Status
– Expansion cards: PCI Status
Ê
Reset replaced components to Enable .
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
CX2570 M2 Upgrade and Maintenance Manual 79
Basic software procedures
5.2.8
Verifying the memory mode
If a memory module fails, the server will reboot and the defective module will be disabled. As a result, the current operation mode (e.g. Mirrored Channel mode) may no longer be available due to a lack of identical memory module pairs. In this case, the operation mode will automatically revert to Independent Channel
Mode.
I
For detailed information on memory operation modes available for your
server, refer to section "Operation modes" on page 126
.
After replacing the defective module(s) the memory operation mode is automatically reset to its original state. It is recommended to verify that the operation mode has been correctly.
Ê
Enter the BIOS.
Ê
Select the Advanced menu.
Ê
Under Memory Status verify that none of the memory modules are marked as
Failed .
Ê
Save your changes (if applicable) and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual.
80 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.9
Verifying the system time settings
I
This task only applies to Linux environments.
After the system board has been replaced, the system time is set automatically.
By default, the RTC (Real Time Clock) time standard is set as the local time.
If a Linux OS is used and the hardware clock has been configured as UTC
(Universal Time, Coordinated) in the operating system, the iRMC local time may not be mapped correctly.
Ê
After replacing the system board, ask the system administrator whether the
RTC or UTC time standard is to be used as system time.
I
If the system time (RTC) is set to UTC, the SEL (System Event Log) time stamps may differ from the local time.
Ê
Enter the BIOS.
Ê
Select the Main menu.
Ê
Under System Time and System Date specify the correct time and date.
I
By default, the system time set in the BIOS is RTC (Real Time Clock) local time. If your IT infrastructure relies on universally accepted time standards, set the System Time to UTC (Universal Time, Coordinated) instead. Greenwich Mean Time (GMT) can be considered equivalent to UTC.
Ê
Save your changes and exit the BIOS.
I
For detailed information on how to access the BIOS and modify settings, refer to the corresponding BIOS Setup Utility reference manual
CX2570 M2 Upgrade and Maintenance Manual 81
Basic software procedures
5.2.10 Viewing and clearing the System Event Log (SEL)
5.2.10.1 Viewing the SEL
You can view the System Event Log (SEL) using the ServerView Operations
Manager or the ServerView iRMC web frontend:
Viewing the SEL in ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View select Maintenance from the Information / Operation menu.
Ê
Under Maintenance select System Event Log .
Ê
Select the message type(s) you want to display:
– Critical events
– Major events
– Minor events
– Informational events
I
Note on the SVOM Driver Monitor
The Driver Monitor view gives you an overview of the monitored components as well as the associated events contained in the system event log on the managed server.
Under Monitored Components the monitored components are listed. If a component has the status Warning or Error , you can select it in the list and click Acknowledge . This confirms the event on the server side. You may have to log on to the server beforehand. The status of the component will then be reset to ok . To see the new status you must refresh the Driver Monitor view with Refresh .
I
For detailed information on how to view and sort the SEL using
ServerView Operations Manager, refer to the "ServerView Operations
Manager - Server Management" user guide.
82 Upgrade and Maintenance Manual CX2570
Basic software procedures
Viewing the SEL using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Event Log and choose the Internal Event Log submenu.
Ê
Under Internal Event Log Content the SEL is being displayed. In order to filter the list, select the check boxes next to the desired event types and press
Apply for the changes to take effect.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
5.2.10.2 Clearing the SEL
You can clear the System Event Log (SEL) using the ServerView iRMC web frontend:
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the Event Log and choose the Internal Event Log submenu.
Ê
Under Internal Event Log Information click Clear Internal Event Log to clear the
SEL.
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
5.2.11 Updating the NIC configuration file in a Linux environment
In order to prevent errors caused by changing network device names ( eth<x> ), it is recommended to store the MAC address (hardware address) of a network interface card in the related NIC configuration file of the Linux OS.
When replacing a network controller or the system board with onboard LAN controllers in a server running Linux OS, the MAC address will change but not automatically be updated in the definition file.
In order to prevent communication problems, it is necessary to update the changed MAC address stored in the related ifcfg-eth<x> definition file.
To update the MAC address, proceed as follows:
CX2570 M2 Upgrade and Maintenance Manual 83
Basic software procedures
I
Procedures may differ depending on your Linux OS or the definition file on the client system. Use the following information as reference. Ask the system administrator to change the definition file.
Ê
After replacing a network controller or the system board, switch on and boot
the server as described in section "Controls and indicators on the server node" on page 57 .
kudzu , the hardware configuration tool for Red Hat Linux, will launch at boot and detect the new and / or changed hardware on your system.
I kudzu may not launch at boot depending on the client’s environment.
Ê
Select Keep Configuration and Ignore to complete the boot process.
Ê
Use the vi text editor to specify the MAC address in the
HWADDR
section of the ifcfg-eth<x> file:
I
The MAC address can be found on the type label attached to the system board or network controller.
Example:
In order to modify the definition file for network controller 1, enter the following command:
# vi /etc/sysconfig/network-scripts/ifcfg-eth1
In vi , specify the new MAC address as follows:
HWADDR=xx:xx:xx:xx:xx:xx
Ê
Save and close the definition file.
Ê
For the changes to take effect, you need to reboot the network by entering the following command:
# service network restart
I
If the system board or network controller offers multiple LAN ports, it is necessary to update the remaining ifcfg-eth<x> definition files accordingly.
Ê
Update the NIC configuration file to reflect the new card sequence and MAC address.
84 Upgrade and Maintenance Manual CX2570
Basic software procedures
5.2.12 Resuming BitLocker functionality
If BitLocker Drive Encryption has been suspended for maintenance purposes
(see section
"Suspending BitLocker functionality" on page 59 ), it has to be re-
enabled to complete the service task.
I
If BitLocker Drive Encryption has been suspended prior to replacing components you won't be asked for a recovery key when rebooting the server after the maintenance task. However, if BitLocker functionality has not been suspended, Windows will enter recovery mode and ask you to input recovery key for further booting.
Ê
In this case, ask the system administrator to enter the recovery key in order to boot the operating system.
Ê
Ask the system administrator to enable the previously suspended BitLockerprotection on the system volume, using the BitLocker Drive Encryption control panel item:
For Windows Server 2008:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking Security , and then clicking BitLocker Drive
Encryption .
Ê
Select the system volume, and click Turn On BitLocker .
For Windows Server 2008 R2 and above:
Ê
Open BitLocker Drive Encryption by clicking the Start button, clicking
Control Panel , clicking System and Security , and then clicking BitLocker
Drive Encryption .
Ê
Select the system volume, and click Resume Protection .
I
For further information on how to resume BitLocker drive encryption, please refer to the Microsoft TechNet library at http://technet.microsoft.com/library/cc731549.aspx.
Fujitsu service partners will find additional information (also available in Japanese) on the Fujitsu Extranet web pages.
CX2570 M2 Upgrade and Maintenance Manual 85
Basic software procedures
5.2.13 Performing a RAID array rebuild
After replacing a hard disk drive that has been combined into a RAID array,
RAID rebuild will be performed completely unattended as a background process.
Ê
Ensure that the RAID array rebuild has started normally. Wait until the progress bar has reached at least one percent.
Ê
Inform the customer about the remaining rebuild time, based on the displayed duration estimate.
Figure 23: Progress bar (RAID array rebuild)
V
CAUTION!
The system is now operational, however, data redundancy will not be available until the RAID array rebuild is complete. Depending on the hard disk drive capacity the overall process can take up to several hours, in some cases even days.
I
You may notice a slight performance impact during rebuild.
5.2.14 Looking up changed MAC / WWN addresses
When replacing a network controller, the MAC (Media Access Control) and
WWN (World Wide Name) addresses will change.
I
In addition to the procedures described below, MAC / WWN addresses can also be found on the type label attached to a network controller or system board.
5.2.14.1 Looking up MAC addresses
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the System Information menu.
86 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Under Network Inventory , you will find detailed information on each network controller in the managed PRIMERGY server, including its MAC address.
I
This information is only available with the iRMC S4 or above.
Only network controllers supporting the Command Line Protocol
(CLP) will be displayed.
Ê
Inform the customer about the changed MAC address.
5.2.14.2 Looking up WWN addresses
Emulex FC / FCoE adapters
Ê
Enable the network controller’s Option ROM in the system board BIOS as
described in section "Enabling Option ROM scan" on page 74 .
Ê
Restart the server.
Ê
During boot, as soon as the Emulex BIOS utility option appears, press
[ALT]
+
[E]
or
[CTRL]
+
[E]
.
Ê
Under Emulex Adapters in the System you will find all available Emulex adapters and their WWN addresses.
Ê
Note down the new 16-digit WWN address.
Ê
Press
[Esc]
to exit the Emulex BIOS utility.
Ê
Inform the customer about the changed WWN address.
QLogic FC adapters
Ê
Enable the network controller’s Option ROM in the system board BIOS as
described in section "Enabling Option ROM scan" on page 74 .
Ê
Restart the server.
Ê
During boot, as soon as the QLogic BIOS utility option appears, press
[ALT]
+
[Q]
or
[CTRL]
+
[Q]
.
Ê
Under Select Host Adapter use the arrow keys
æ
/
Ë
to select the desired
FC / FCoE adapter and press
[Enter]
.
Ê
From the Fast!UTIL Options menu, select Configuration Settings , and press
[Enter] .
Ê
From the Configuration Settings menu, select Adapter Settings , and press
[Enter] .
CX2570 M2 Upgrade and Maintenance Manual 87
Basic software procedures
Ê
Note down the new 16-digit WWN address found under Adapter Port Name .
Ê
Press [Esc] to return to the main menu and exit the QLogic BIOS utility.
Ê
Inform the customer about the changed WWN address.
5.2.15 Using the Chassis ID Prom Tool
System information like server name and model, housing type, serial number and manufacturing data are stored in the system board.
In order to integrate your system into the ServerView management environment and to enable server installation using the ServerView Installation Manager, system data needs to be complete and correct.
After replacing the system board, system information has to be entered using the Chassis ID Prom tool. The tool and further instructions are available to maintenance personnel from the Fujitsu Technology Solutions Extranet: https://partners.ts.fujitsu.com/com/service/ps/Servers/PRIMERGY/
Ê
Select your PRIMERGY system from the main area of the page.
Ê
From the categories selection, choose Software & Tools Documentation .
Ê
In the Tools area click Tools: Chassis-IDProm Tool to download the file
( tool-chassis-Idprom-Tool.zip
).
I
For the Japanese market, follow the instructions provided separately.
5.2.16 Configuring LAN teaming
Use ServerView Operations Manager to obtain detailed information on existing
LAN teams:
Ê
In ServerView Operations Manager Single System View select System Status from the Information / Operation menu.
Ê
Under Network Interfaces select LAN Teaming .
Ê
The Network Interfaces (Summary) overview shows all configured LAN teams and their components. Choose a LAN team to display further details:
– LAN Team Properties : Properties of the selected LAN team
– LAN Team Statistics : Available statistics about the selected LAN team
88 Upgrade and Maintenance Manual CX2570
Basic software procedures
I
For more detailed information, refer to the "ServerView Operations
Manager - Server Management" user guide.
5.2.16.1 After replacing / upgrading LAN controllers
Please note when re-using a replaced LAN controller:
Ê
Confirm with the customer whether the LAN controller you have replaced has been used as part of a LAN teaming configuration.
Ê
If LAN teaming has been active, you will need to restore the configuration using the LAN driver utility after replacing the LAN controller.
Ensure that the controllers have been assigned as primary or secondary according to your requirements.
I
For details, refer to the relevant LAN driver manual.
5.2.16.2 After replacing the system board
Ê
Confirm with the customer whether the onboard LAN controller you have replaced has been used as part of a LAN teaming configuration.
Ê
If LAN teaming has been active, you will need to restore the configuration using the LAN driver utility after replacing the system board.
I
For details, refer to the relevant LAN driver manual.
5.2.17 Switching off the ID indicator
Press the ID button on the front panel, or use the iRMC web frontend or
ServerView Operations Manager to switch off the ID indicator after the maintenance task has been concluded successfully.
I
For further information, refer to the "ServerView Suite Local Service
Concept (LSC)" and "Integrated Remote Management Controller" user guides.
Using the ID button on the front panel
Ê
Press the ID button on the front panel to switch off the ID indicators.
CX2570 M2 Upgrade and Maintenance Manual 89
Basic software procedures
Using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Under System Overview , click Identify LED Off to switch off the ID indicators.
Using ServerView Operations Manager
Ê
In ServerView Operations Manager Single System View and press the Locate button in the title bar to switch off the ID indicator.
5.2.18 Performing a fan test
I
Notes on replacing a defective fan
After replacing a defective system fan or power supply unit containing a defective fan, the fan error indicators will stay lit until the next fan test. By default, a fan test is automatically started every 24 hours. The first automatic fan test being performed after replacing a fan will turn off the fan error indicator.
If you want to start the fan test manually, you can do so by following the description below:
Executing the fan test via the iRMC Web interface
Ê
Log into the iRMC web interface.
Ê
Under Sensors select Fans .
Ê
Select the replaced fan in the system fans group and click Start Fan Test .
I
For detailed information on iRMC settings, refer to the "Integrated
Remote Management Controller" user guide.
Executing the fan test via ServerView Operations Manager
Ê
Open the ServerView Operations Manager and log in.
Ê
Under Administration select Server Configuration .
Ê
In the hierarchy tree of the Server list tab, select the server to be configured.
Ê
In the right-hand side of the window, specify the details on the selected server and confirm your entries by clicking GO...
.
90 Upgrade and Maintenance Manual CX2570
Basic software procedures
In the left-hand section of the window, the Configuration tab is being activated.
Ê
In the navigation area of the Configuration tab, select Other Settings .
Ê
Under Daily Fan Test , set the daily fan test time to a few minutes from the current time. (Ensure to note down your previous setting.)
Ê
Click Save Page .
The fan test will be started at the specified time.
Ê
After the fan test is complete, restore the time setting to its initial value and click Save Page .
I
For more detailed information, refer to the "ServerView Operations
Manager" user guide.
For the Japanese market: Executing the fan test via Chassis ID Prom Tool
I
Please follow the instructions provided separately.
CX2570 M2 Upgrade and Maintenance Manual 91
Basic software procedures
5.2.19 Resetting the error status after replacing memory modules or processors
5.2.19.1 Memory modules
ServerView Operations Manager may report a defective memory module in case of a memory error.
I
Important note
After replacing a defective memory module, please check if the error counter has been reset automatically. If the memory slot is still marked as failed, please reset the error counter manually using one of the methods below.
Using the iRMC web frontend
Ê
Enter the ServerView iRMC web frontend.
Ê
Select the System Information menu.
Ê
Under System Components , select the check boxes next to the affected memory modules.
Ê
From the drop down list, select Reset Error Counter .
Ê
Click Apply for the changes to take effect.
Using ServerView Maintenance Tools (Windows only)
Ê
Launch the ServerView Maintenance Tools:
– Windows Server 2008 R2 and below:
Start > (All) Programs > Fujitsu > ServerView Suite > Agents >
Maintenance Tools
– Windows Server 2012 and above:
Start > Apps > Fujitsu > Maintenance Tools
Ê
Choose the Memory status tab.
Ê
Select the memory module which shows the pre-failure status.
Ê
Click on Reset Status .
I
The Reset Status button will only be available if the selected memory module contains errors.
92 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
Using the command line interface (Linux only)
The memory error counter can be reset using the meclear
utility which is part of the ServerView agents for Linux.
I meclear
(Memory Module Error Counter Reset Utility) allows to reset the error count collected for a memory module, for example after it has been replaced.
For further details, please refer to the meclear
manual pages.
Ê
Log in as root.
Ê
Enter the command below, followed by [ENTER] :
/usr/sbin/meclear
Ê
Select the number of a memory module with a status other than "OK" or
"Not available".
Ê
Repeat the step above until all memory modules show the "OK" status.
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
5.2.19.2 Processors
ServerView Operations Manager may report a defective processor in case of a critical error.
I
Important note
After replacing a defective CPU, the error counter must be reset manually using one of the methods below.
Using ServerView Maintenance Tools (Windows only)
Ê
Launch the ServerView Maintenance Tools:
– Windows Server 2008 R2 and below:
Start > (All) Programs > Fujitsu > ServerView Suite > Agents >
Maintenance Tools
– Windows Server 2012 and above:
Start > Apps > Fujitsu > Maintenance Tools
CX2570 M2 Upgrade and Maintenance Manual 93
Basic software procedures
Ê
Choose the CPU status tab.
Ê
Select the CPU which shows the pre-failure status.
Ê
Click on Reset Status .
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
Using the command line (Linux only)
Proceed as follows to reset the error counter of a specific processor:
Ê
Log in as root.
Ê
Enter the command below, followed by
[ENTER]
:
– For rack and tower servers (RX and TX server series):
/usr/sbin/eecdcp -c oc=0609 oi=<CPU#>
– For blade and scale-out servers (BX and CX server series):
/usr/sbin/eecdcp -c oc=0609 oi=<CPU#> cab=<cabinet nr>
To identify the cabinet number, enter the following command:
/usr/sbin/eecdcp -c oc=E204
I
<CPU#>
parameters are "0" for CPU 1 and "1" for CPU 2.
Ê
If the error status cannot be reset with the method above, please use the following procedure for resetting the error counter of all processors:
Ê
Log in as root.
Ê
Enter the commands below, followed by
[ENTER]
:
1.
/etc/init.d/srvmagt stop
/etc/init.d/srvmagt_scs stop
/etc/init.d/eecd stop
/etc/init.d/eecd_mods_src stop
2.
cd /etc/srvmagt
3.
rm -f cehist.bin
4.
/etc/init.d/eecd_mods_src start
/etc/init.d/eecd start
/etc/init.d/srvmagt start
/etc/init.d/srvmagt_scs start
94 Upgrade and Maintenance Manual CX2570
Basic software procedures
Ê
Ensure that all pre-fail / fail status issues have been resolved in ServerView
Operations Manager.
CX2570 M2 Upgrade and Maintenance Manual 95
Basic software procedures
96 Upgrade and Maintenance Manual CX2570
6 Expansion cards
Safety notes
V
CAUTION!
● Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock.
●
●
●
●
●
Devices and components inside the server node remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
If devices are installed or disassembled using methods other than those outlined in this chapter, the warranty will be invalidated.
For further information, please refer to chapter "Important information" on page 29 .
CX2570 M2 Upgrade and Maintenance Manual 97
Expansion cards
6.1
Basic information
The system board is equipped with two expansion slots:
Figure 24: PCI slot overview
Pos.
1
2
3
4
Slot Type Mechanical connector
11-14 PCI Gen3 x16
5-8 PCI Gen3 x16
1-4 PCI Gen3 x16
15-18 PCI Gen3 x16
Function
CPU2
CPU1 (connected to GPGPU1 or
Photonics)
CPU1
CPU2 (connected to GPGPU2)
98 Upgrade and Maintenance Manual CX2570
Expansion cards
Expansion card overview
Parts Supplier
GPGPU K40
GPGPU K80
XeonPhi 3120P
XeonPhi 5110P
XeonPhi 7120P
Grid K1
Grid K2
Tesla M60
PSAS CP400i
PLAN CP 2x1Gbit Cu Intel I350-T2
PLAN CP 2x1Gbit Cu Intel I350-T4
NVIDIA
NVIDIA
Intel
Intel
Intel
NVIDIA
NVIDIA
NVIDIA
LSI
Intel
Intel
PLAN EP OCe14102 2x10GBase-T
LP
PCNA EP OCe14102 2x10Gb DMF
LP
PCNA EP OCe14401 1x40Gb LP
Eth Ctrl 2x10Gbase-T PCIe x8 X540-
T2
2x10Gbit SFP+ D2755
2x10Gbit Cu Intel X540-AT2
Emulex
Emulex
Emulex
Emulex
Fujitsu
Intel
2x16G FC LPe16002
2x8G FC LPe12002
1x8G FC LPe1250
2x16G FC Qlogic QLE2672
IB Intel HCA 1port QLE7340 CK
IB Intel HCA 2port QLE7342 CK
IB HCA 40Gb 1port QDR CX3
IB HCA 40Gb 2port QDR CX3
IB HCA 56Gb 1port FDR
IB HCA 56Gb 2port FDR
IB HCA 100Gb EDR
GPGPU K20
GPGPU K20X
Emulex
Emulex
Emulex
Qlogic
Intel
Intel
Mellanox
Mellanox
Mellanox
Mellanox
Mellanox
NVIDIA
NVIDIA
-
-
-
-
-
-
9
9
9
9
-
-
9
9
9
9
9
9
9
9
9
9
9
9
9
9
-
-
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9
9 2
1
2
1
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
-
-
-
-
-
-
2
2
2
-
2
2
2
2
2
-
-
-
-
-
-
-
-
-
-
-
-
-
2
2
1
1
1
-
1
1
-
-
-
1
-
-
-
-
-
1
1
1
1
1
1
1
1
1
1
1
1
1
-
-
2
1
2
1
2
2
-
-
-
2
-
-
-
-
-
2
2
2
2
2
2
2
2
2
2
2
2
2
-
-
-
-
-
-
-
-
1
1
1
-
1
1
1
1
1
-
-
-
-
-
-
-
-
-
-
-
-
-
1
1
CX2570 M2 Upgrade and Maintenance Manual 99
Expansion cards
I
The list may be changed due to new controllers.
For the latest information on supported expansion cards, refer your server’s hardware configurator available online at the following address: for the EMEA market: http://ts.fujitsu.com/products/standard_servers/index.htm
for the Japanese market: http://jp.fujitsu.com/platform/server/primergy/system/
100 Upgrade and Maintenance Manual CX2570
Expansion cards
6.2
Additional tasks
This section provides additional expansion card related information on how to install slot brackets and SFP+ transceiver modules.
I
For further instructions regarding controller settings, please refer to the accompanying documentation.
6.2.1
Mounting expansion card slot brackets
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
6.2.1.1
General instructions
Ê
Place the controller on the mounting tabs on the slot bracket.
Ê
Secure the slot bracket to the controller with two M3 x 4.5 mm screws.
Removal is carried out in reverse order.
CX2570 M2 Upgrade and Maintenance Manual 101
Expansion cards
6.2.1.2
Network adapter D2755
Figure 25: Placing the slot bracket - D2755
Ê
Place the controller on the mounting tabs on the slot bracket (1).
Ê
Carefully shift the slot bracket towards the controller until the plug shells engage with the cut-outs in the slot bracket connector panel (2).
Ê
Ensure that the ESD springs on the plug shells properly engage with the slot bracket as shown (see circles).
102 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 26: Fastening the slot bracket - D2755
Ê
Fasten the slot bracket to the controller with two M3 x 4.5 mm screws.
Figure 27: Assembled network adapter D2755
CX2570 M2 Upgrade and Maintenance Manual 103
Expansion cards
6.2.2
Handling SFP+ transceiver modules
6.2.2.1
Installing SFP+ transceiver modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
Preparing the SFP+ transceiver module
Figure 28: Removing the protective optical port plug
Ê
Remove the SFP+ transceiver module from its protective packaging.
Ê
Remove the optical port plug from the new / additional SFP+ transceiver module.
V
CAUTION!
– Always keep the protective port plugs attached to the transceiver optical bores and fiber-optic cable connectors until you are ready to make a connection.
– Save the protective port plug for future use.
104 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 29: Unlatching the locking bail
Ê
Carefully unlatch and fold down the locking bail on the SFP+ transceiver module.
CX2570 M2 Upgrade and Maintenance Manual 105
Expansion cards
Inserting the SFP+ transceiver module
Figure 30: Inserting the SFP+ transceiver module
Ê
Insert and slide the SFP+ transceiver module into the socket connector as far as it will go.
I
If only one slot is equipped with a SFP+ transceiver module, use the primary right connector as shown.
106 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 31: Latching the locking bail
Ê
Carefully fold up and latch the locking bail.
Figure 32: Attaching the protective optical port plug
Ê
If the SFP+ transceiver module is not immediately connected to an LC connector, attach the protective optical port plug to the transceiver optical bores.
CX2570 M2 Upgrade and Maintenance Manual 107
Expansion cards
Installing the secondary SFP+ transceiver module
Figure 33: Installing the secondary SFP+ transceiver module
Ê
If applicable, install the secondary SFP+ transceiver module accordingly.
108 Upgrade and Maintenance Manual CX2570
Expansion cards
6.2.2.2
Removing an SFP+ transceiver module
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
Figure 34: Removing the protective optical port plug
Ê
If present, remove the protective optical port plug from the SFP+ transceiver module.
V
CAUTION!
Save the protective port plug for future use.
CX2570 M2 Upgrade and Maintenance Manual 109
Expansion cards
Figure 35: Unlatching the locking bail
Ê
Carefully unlatch and fold down the locking bail on the SFP+ transceiver module to eject the transceiver from the socket connector.
110 Upgrade and Maintenance Manual CX2570
Expansion cards
Figure 36: Removing the SFP+ transceiver
Ê
Pull the SFP+ transceiver module out of its socket connector.
Ê
Reattach the protective optical port plug to the transceiver optical bores.
I
Place the removed SFP+ transceiver module in an antistatic bag or other protective environment.
CX2570 M2 Upgrade and Maintenance Manual 111
Expansion cards
6.2.2.3
Replacing SFP+ transceiver modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
Removing SFP+ transceiver modules
Ê
Remove the defective SFP+ transceiver module(s) as described in section
"Removing an SFP+ transceiver module" on page 109
.
Installing SFP+ transceiver modules
Ê
Unpack the new SFP+ transceiver module.
Ê
Verify that the new SFP+ transceiver module is the same type of transceiver you are replacing.
Ê
Install the new SFP+ transceiver module(s) as described in section
"Installing SFP+ transceiver modules" on page 104
.
Ê
Inform the customer about changed WWN and MAC addresses. For further information, refer to section
"Looking up changed MAC / WWN addresses" on page 86
.
I
By replacing SFP+ transceiver modules, WWN (World Wide Name) and MAC (Media Access Control) addresses will change.
112 Upgrade and Maintenance Manual CX2570
Expansion cards
6.3
Expansion cards in the riser module
Safety notes
V
CAUTION!
● Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock.
●
●
●
Devices and components inside the server remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
●
●
If devices are installed or disassembled using methods other than those outlined in this chapter, the warranty will be invalidated.
Follow the safety instructions in chapter "Important information" on page 29
.
CX2570 M2 Upgrade and Maintenance Manual 113
Expansion cards
6.3.1
Installing expansion cards
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
6.3.1.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
"Removing the server node from the server enclosure" on page 42
Ê
Remove all external cables from the server node
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
114 Upgrade and Maintenance Manual CX2570
6.3.1.2
Mounting a controller to the riser module
Expansion cards
Figure 37: Mounting a controller to the riser module
Ê
Plug the controller on the riser card connector (1).
Ê
If applicable, reinstall SFP+ transceiver modules on the new expansion card, as described in section
"Installing SFP+ transceiver modules" on page 104 .
I
Make sure that the metal pin of the controller bracket hooks into the recess of the riser bracket (see circle).
6.3.1.3
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
CX2570 M2 Upgrade and Maintenance Manual 115
Expansion cards
Ê
Reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Updating RAID controller firmware" on page 73
(if applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 78
6.3.2
Removing expansion cards
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
6.3.2.1
Preliminary steps
Perform the following procedures:
Ê
Locate the desired server node with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
Remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
116 Upgrade and Maintenance Manual CX2570
6.3.2.2
Removing a controller from the riser module
Expansion cards
Figure 38: Removing a controller from the riser module
Ê
If the slot bracket on the defective expansion card is to be reused, remove it from the board as described in section
"Mounting expansion card slot brackets" on page 101
.
Ê
Pull the controller out of the riser card connector (1).
I
Make sure that the metal pin of the controller bracket does not get stucked with the recess of the riser bracket (see circle).
6.3.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
Reconnect all external cables.
CX2570 M2 Upgrade and Maintenance Manual 117
Expansion cards
Ê
"Controls and indicators on the server node" on page 57
6.3.3
Replacing expansion cards
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
Note on network settings recovery
I
When replacing network controllers or the system board, network configuration settings in the operating system will be lost and replaced by default values. This applies to all static IP address and LAN teaming configurations.
Ensure to note down your current network settings before replacing a controller or the system board.
6.3.3.1
Preliminary steps
Perform the following procedures:
Ê
Locate the desired server node with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
Remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
6.3.3.2
Removing an expansion card
Ê
Remove the defective expansion card as described in
"Removing a controller from the riser module" on page 117 .
Ê
If applicable, remove SFP+ transceiver modules from the expansion card, as described in section
"Removing an SFP+ transceiver module" on page 109
.
118 Upgrade and Maintenance Manual CX2570
Expansion cards
Ê
If the slot bracket on the defective expansion card is to be reused, remove it from the board as described in section
"Mounting expansion card slot brackets" on page 101
.
6.3.3.3
Installing an expansion card
Ê
If applicable, install a slot bracket on the new expansion card as described in section
"Mounting expansion card slot brackets" on page 101
.
Ê
If applicable, reinstall SFP+ transceiver modules on the new expansion card, as described in section
"Installing SFP+ transceiver modules" on page 104 .
Ê
.
Ê
If applicable, connect internal cables to the expansion card.
I
For a complete cabling overview, please refer to section "Cabling overview" on page 254
.
6.3.3.4
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
Reconnect all external cables.
Ê
"Enabling replaced components in the system BIOS" on page 78
Ê
"Controls and indicators on the server node" on page 57
Ê
"Updating RAID controller firmware" on page 73
(if applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 78
Ê
"Updating the NIC configuration file in a Linux environment" on page 83
Ê
"Looking up changed MAC / WWN addresses" on page 86
CX2570 M2 Upgrade and Maintenance Manual 119
Expansion cards
6.4
Riser card
V
CAUTION!
Follow the safety instructions in chapter
"Important information" on page 29 .
6.4.1
Replacing the riser card
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – Phillips PH2 / (+) No. 2 screw driver
– Phillips PH2 / (+) No. 2 screw driver)
6.4.1.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
Ê
"Removing expansion cards" on page 116 (if applicable)
120 Upgrade and Maintenance Manual CX2570
6.4.1.2
Replacing the riser card
Expansion cards
Figure 39: Replacing the riser card
The riser module consists of the riser metal bracket and the riser card.
The riser card is connected to the riser metal bracket with two rivets:
– Rivet (1).
– Rivet with bolt (2).
Ê
For removing the riser card loosen the two rivets and take off the riser card.
Ê
For installing the new riser card put the riser card on the riser metal bracket and fasten the two screws.
CX2570 M2 Upgrade and Maintenance Manual 121
Expansion cards
6.4.1.3
Concluding steps
Perform the following procedures:
Ê
If applicable, re-install the expansion cards as described in section
"Installing expansion cards" on page 114 .
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
122 Upgrade and Maintenance Manual CX2570
7 Main memory
Safety notes
V
CAUTION!
● Do not install unsupported third party memory modules. For further information on supported memory modules, refer to section
"Basic information" on page 124
.
●
●
●
●
Memory modules remain hot after shutdown. Wait for components to cool down before installing or removing memory modules to prevent burns.
Do not insert and remove memory modules repeatedly. Doing so may cause failures.
Pressing out the securing clips on the memory module connector will eject the installed memory module. To prevent damage and injuries eject memory modules carefully without applying excessive force.
For further information, please refer to chapter "Important information" on page 29 .
CX2570 M2 Upgrade and Maintenance Manual 123
Main memory
7.1
Basic information
– Each CPU offers 8 Slots for DDR4 memory modules organized in 2 banks and 4 channels.
– Supported memory modules:
There are 2 different kinds of DDR4 Memory Modules available: RDIMM and
LRDIMM.
– RDIMM / LRDIMM offer different functionality. Mix of RDIMM / LRDIMM is not allowed.
– Depending on the amount of memory configured you can decide between 2 basic modes of operation: Independent and Performance mode .
– Max. DDR4 memory speed depends on the memory configuration on one memory channel and the speed of the CPU.
– The memory channel with the lowest speed defines the speed of all CPU channels in the system.
– "If memory modules with different capacities are used: Populate modules with higher capacities first.
– "If memory modules with different speeds are used: Populate modules with higher speed first.
– Populate same amounts of memory equally for both CPUs.
7.1.1
Memory sequence
– Populate memory slot 1 / channel A (DIMM-1A) first.
– Within the 4 channels, memory slot 1 must be populated prior to slot 2.
– If memory modules with different capacities are used:
– Install modules with higher capacities first.
– Within a channel, install modules in descending order of capacity.
– If memory modules with different speeds are used, the lowest clock rate applies for all DIMMs.
124 Upgrade and Maintenance Manual CX2570
Main memory
Minimum configuration
Minimum configuration is 2x CPU and 2x memory.
Maximum configurations
– 16x 64GB LRDIMM (quad rank modules) = 1024GB
– 16x 16GB RDIMM (dual rank modules) = 256GB
First Memory (one module) has to be selected for an orderable basic unit per
CPU.
– Memory upgrade is possible by 1x memory units.B
– SDDC (Chipkill) is supported for memory modules.
Figure 40: Memory overview
CX2570 M2 Upgrade and Maintenance Manual 125
Main memory
7.1.2
Operation modes
Independent Channel Mode
CPU
Channel
Color
Slot descriptor
No. of Modules
1
2
3
4
7
8
5
6
9
10
11
12
13
14
15
16
6
7
8
2
3
4
5
1A 2A 1B 2B
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
A
5
5
5
5
9
9
9
9
9
9
9
9
3
3
3
3
3
3
B
7
7
5
5
5
5
5
5
5
5
5 13
5 13
5 13
5 13
CPU 1
D C G H
2D 1D 2C 1C 1G 2G 1H 2H
1 CPU populated
8
4
4
4
4
4
7
7
7
7
7 11
7 11
7 11
7 11
15 7 11
15 7 11
6
6
6
2
2
2
2
2
2
2
2 CPU populated
3
3
3
3
3
3
3
3
3
3
3
3
3
3
4
4
4
4
4
4
4
4
4 12
4 12
4 12
4 12
4 12
8
8
8
8
8
8
8
8
8 16
CPU 2
2F
14
14
14
F
1F
6
6
2E
6
6
6 10
6 10
6 10
6 10
6 10
6 10
6 10
E
1E
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
Performance Channel Mode
CPU
Channel
Color
Slot
No. of Modules
4
8
8
12
16
A B
1A 2A 1B 2B
1
1
1
1
1 2
3
3
1
1
1
1
1
2
3
3
CPU 1
D C G H
2D 1D 2C 1C
1
1G 2G 1H 2H
1 CPU populated
1
2 1 2 1
2 CPU populated
1 2
3
3
1
1
1
3
3
1
1
2
2 4
2
2
2 4
CPU 2
2F
4
F
1F
2
2
2
2E
4
E
1E
2
2
2
126 Upgrade and Maintenance Manual CX2570
Main memory
7.2
Installing memory modules
I
If liquid cooling is installed, first prepare the memory modules as described in section
"Cooling pads on the memory modules" on page 247
.
Upgrade and Repair Unit
(URU)
Tools: tool-less
Hardware: 5 minutes
7.2.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
Disconnect the SATA cable(s) from the connectors on the system board
described in section "Cabling for HDD 2.5"" on page 256 , and take it out of
the chassis.
Ê
"Removing the memory slot air ducts" on page 51
Ê
Identify the correct memory slot according to the mounting order described in section
"Memory sequence" on page 124 .
CX2570 M2 Upgrade and Maintenance Manual 127
Main memory
7.2.2
Installing a memory module
Figure 41: Installing memory modules (A)
Ê
Press out the securing clip at each end of the memory module connector.
Figure 42: Installing memory modules (B)
Ê
Press down on the memory module until the securing clips snap into the cutouts at each end of the module.
V
CAUTION!
Install dummy modules in not used memory slots.
128
Figure 43: Memory dummy module
Upgrade and Maintenance Manual CX2570
Main memory
7.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the memory slot air ducts" on page 52
Ê
Connect the SATA cable(s) to the connectors on the system board described in section
"Cabling for HDD 2.5"" on page 256
and reroute the cables as described in section
.
Ê
Identify the correct memory slot according to the mounting order described in section
"Memory sequence" on page 124 .
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 78
Ê
"Verifying the memory mode" on page 80
(if applicable)
Ê
"Resetting the error status after replacing memory modules or processors" on page 92
CX2570 M2 Upgrade and Maintenance Manual 129
Main memory
7.3
Removing memory modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
7.3.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
Disconnect the SATA cable(s) from the connectors on the system board described in section
"Cabling for HDD 2.5"" on page 256
and take it out of the chassis.
Ê
"Removing the memory slot air ducts" on page 51
Ê
Identify the desired memory slot according to the mounting order described
in section "Memory sequence" on page 124
.
V
CAUTION!
Ensure to maintain an operational configuration when removing memory modules. For additional information, please refer to section
"Operation modes" on page 126 .
130 Upgrade and Maintenance Manual CX2570
7.3.2
Removing a memory module
Main memory
Figure 44: Removing memory modules (A)
Ê
Eject the desired memory module by pressing out the securing clips at each end of the memory module connector.
Figure 45: Removing memory modules (B)
Ê
Remove the ejected memory module.
CX2570 M2 Upgrade and Maintenance Manual 131
Main memory
7.3.3
Concluding step
Perform the following procedures:
Ê
"Installing the memory slot air ducts" on page 52
Ê
Connect the SATA cable(s) to the connectors on the system board described
in section "Cabling for HDD 2.5"" on page 256 and reroute the cables as
described in section
"Cabling onboard" on page 256 or
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67 (if
applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 78
Ê
"Verifying the memory mode" on page 80
(if applicable)
Ê
"Resetting the error status after replacing memory modules or processors" on page 92
132 Upgrade and Maintenance Manual CX2570
Main memory
7.4
Replacing memory modules
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
7.4.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
Disconnect the SATA cable(s) from the connectors on the system board
described in section "Cabling for HDD 2.5"" on page 256 and take it out of
the chassis.
Ê
"Removing the memory slot air ducts" on page 51
CX2570 M2 Upgrade and Maintenance Manual 133
Main memory
7.4.2
Removing a memory module
Ê
Identify the defective memory slot.
Ê
Remove the defective memory module as described in section "Removing memory modules" on page 130
.
7.4.3
Installing a memory module
Ê
Install the new memory module as described in section
"Installing memory modules" on page 127 .
7.4.4
Concluding steps
Perform the following procedures:
Ê
"Installing the memory slot air ducts" on page 52
Ê
Connect the SATA cable(s) to the connectors on the system board described
in section "Cabling for HDD 2.5"" on page 256 , and reroute the cables as
described in section
"Cabling onboard" on page 256 or
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Enabling replaced components in the system BIOS" on page 78
Ê
"Controls and indicators on the server node" on page 57
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67 (if
applicable)
Ê
"Enabling SVOM boot watchdog functionality" on page 78
Ê
"Verifying the memory mode" on page 80
(if applicable)
Ê
"Resetting the error status after replacing memory modules or processors" on page 92
134 Upgrade and Maintenance Manual CX2570
8 Processors
Safety notes
V
CAUTION!
● Do not install unsupported processors. For further information on
supported processors, refer to section "Basic information" on page 136
.
● Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs)
●
●
●
●
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
When removing or installing the processor, be careful not to touch or bend the spring contacts on the processor socket.
Never touch the underside of the processor. Even minor soiling such as grease from the skin can impair the processor’s operation or destroy the processor.
Follow the safety instructions in chapter "Important information" on page 29
.
CX2570 M2 Upgrade and Maintenance Manual 135
Processors
8.1
Basic information
8.1.1
Supported processors
– Intel Xeon E5-2600v4 processor series CPUs
– Socket type: LGA 2011 package
8.1.2
Processor locations
Figure 46: CPU slots on system board D3343
136 Upgrade and Maintenance Manual CX2570
Processors
8.2
Replacing processors
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: – tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
– Removing and installing the processor: tool-less
V
CAUTION!
Processors are extremely sensitive to electrostatic discharge and must be handled with care. After a processor has been removed from its protective sleeve or from its socket, place it upside down on a nonconducting, antistatic surface. Never push a processor over a surface.
8.2.1
Preliminary steps
Before replacing the processor, perform the following steps:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
If applicable, remove the liquid cooling kit from the server node as described in section
"Removing the liquid cooling kit" on page 237 .
CX2570 M2 Upgrade and Maintenance Manual 137
Processors
8.2.2
Removing processor heat sinks
8.2.2.1
Removing the processor heat sinks
Figure 47: Removing the processor heat sink
Ê
Carefully press on the middle of the heat sink and loosen the four captive screws in a crossover pattern according to the numbering.
Ê
Carefully turn the heat sink back and forth to detach it from the processor.
I
This may be necessary due to the adhesive quality of the thermal paste located between the heat sink and processor.
V
CAUTION!
Pay special attention not to damage any system board components surrounding the processor socket.
Ê
Lift the heat sink out of the chassis.
Ê
Thoroughly clean residual thermal paste from the surface of the heat sink and the processor using a lint-free cloth.
138 Upgrade and Maintenance Manual CX2570
8.2.3
Removing the processor
Processors
Figure 48: Opening socket release lever 1
Ê
Unlatch the socket release lever marked Open 1st by pushing it down and away from the socket (1).
Ê
The socket release lever will slightly lift up (2).
CX2570 M2 Upgrade and Maintenance Manual 139
Processors
Figure 49: Opening socket release lever 2
Ê
Unlatch the socket release lever marked Close 1st by pushing it down and away from the socket (1).
Ê
Fully fold back the second socket release lever (2).
140 Upgrade and Maintenance Manual CX2570
Processors
Figure 50: Opening the load plate (A)
Ê
Push down on the socket release lever marked Open 1st (1) to lift the load plate away from the socket (2).
CX2570 M2 Upgrade and Maintenance Manual 141
Processors
Figure 51: Opening the load plate (B)
Ê
Fully open the load plate.
V
CAUTION!
Be careful not to touch or bend the spring contacts on the processor socket.
– If the processor may be reused later, thoroughly clean residual thermal paste from the processor surface using a lint-free cloth and store the processor in a save place.
V
CAUTION!
Processors are extremely sensitive to electrostatic discharge and must be handled with care. After a processor has been removed from its protective sleeve or from its socket, place it upside down on a nonconducting, antistatic surface. Never push a processor over a surface.
142 Upgrade and Maintenance Manual CX2570
8.2.4
Installing the processor
Processors
Figure 52: Installing the processor (1)
Ê
Hold the processor with your thumb and index finger.
Ê
Make sure that the four notches on the processor align with the posts on the socket.
Ê
Lower the processor straight down without tilting or sliding it in the socket.
V
CAUTION!
– Ensure that the processor is level in the socket.
– Be careful not to touch or bend the pins on the processor socket.
– Never touch the underside of the processor. Even minor soiling such as grease from the skin can impair the processor’s operation or destroy the processor.
– Ensure not to scrape or dent the processor edges.
Ê
Carefully lower the load plate over the processor.
CX2570 M2 Upgrade and Maintenance Manual 143
Processors
Figure 53: Installing the processor (2)
V
CAUTION!
Always replace the socket cover if you remove the processor from the socket!
144 Upgrade and Maintenance Manual CX2570
Processors
Figure 54: Closing socket release lever 1 and 2
Ê
Fully close and hold shut the load plate.
Ê
Close the socket release lever marked Close 1st (1) and latch it under the load plate retention tab to lock down the load plate (2).
CX2570 M2 Upgrade and Maintenance Manual 145
Processors
8.2.5
Applying thermal paste
I
For the Japanese market, the service engineer must follow the instruction provided separately.
I
If the processor upgrade or replacement kit contains a new CPU heat sink, a thin layer of thermal compound has already been pre-applied to its lower surface. In this case, please proceed with section
"Installing the processor heat sink" on page 148 .
Figure 55: Thermal paste syringe
One thermal compound syringe contains thermal paste for two processors.
In order to determine the correct amount of thermal paste (equal to 1.0 gram), divide the grey area of the syringe up into two equal segments.
I
Add graduation marks to the syringe using a permanent marker to help you apply the thermal paste.
146 Upgrade and Maintenance Manual CX2570
Processors
Figure 56: Applying thermal paste
Ê
Apply a small streak of thermal paste (1.0 gram, see description above) to the center of the processor surface as shown.
V
CAUTION!
Do not mix different types of thermal paste.
CX2570 M2 Upgrade and Maintenance Manual 147
Processors
8.2.6
Installing the processor heat sink
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: – Preliminary and concluding steps: tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
8.2.6.1
Processor heat sink CPU1
Figure 57: Processor heat sink for CPU1
148 Upgrade and Maintenance Manual CX2570
8.2.6.2
Processor heat sink CPU2
Processors
Figure 58: Processor heat sink for CPU2
8.2.6.3
Installing the heat sinks
Figure 59: Installing the processor heat sinks
Ê
Carefully seat the heat sink on the four threaded holes as shown.
CX2570 M2 Upgrade and Maintenance Manual 149
Processors
V
CAUTION!
– Ensure that the screws on the heat sink are properly seated on the threaded holes (see circles).
– Ensure that the heat sink cooling fins match the direction of the airflow!
I
To avoid inclining of the heat sink carefully press on the middle of the heat sink.
Ê
Fasten the four captive screws on the heat sink in a crossover pattern according to the numbering (screw torque: 1.0 Nm, not applicable for the
Japanese market).
150 Upgrade and Maintenance Manual CX2570
Processors
8.2.7
Concluding steps
Perform the following steps:
Ê
If applicable, install the liquid cooling kit for the server node as described in section
"Installing a liquid cooling kit" on page 240
.
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
–
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
–
"Controls and indicators on the server node" on page 57
–
"Enabling SVOM boot watchdog functionality" on page 78
–
"Enabling replaced components in the system BIOS" on page 78
–
"Resetting the error status after replacing memory modules or processors" on page 92
CX2570 M2 Upgrade and Maintenance Manual 151
Processors
8.3
Replacing the processor heat sink
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: – Preliminary and concluding steps: tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
8.3.1
Preliminary steps
Before replacing the processor heat sink, perform the following steps:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
If applicable, remove the liquid cooling kit from the server node as described
in section "Removing the liquid cooling kit" on page 237 .
8.3.2
Removing the processor heat sink
Ê
Remove the processor heat sink as described in section
"Removing processor heat sinks" on page 138 .
8.3.3
Installing the processor heat sink
Ê
Remove the protective cover from the heat sink.
I
Ensure not to touch the thermal paste on the bottom of the heat sink.
Ê
Install the processor heat sink as described in section
"Installing the processor heat sink" on page 148
.
152 Upgrade and Maintenance Manual CX2570
Processors
8.3.4
Concluding steps
Perform the following steps:
Ê
If applicable, install the liquid cooling kit for the server node as described in section
"Installing a liquid cooling kit" on page 240
.
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
–
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
–
"Controls and indicators on the server node" on page 57
–
"Enabling SVOM boot watchdog functionality" on page 78
–
"Resetting the error status after replacing memory modules or processors" on page 92
CX2570 M2 Upgrade and Maintenance Manual 153
Processors
154 Upgrade and Maintenance Manual CX2570
9 System board and components
This chapter provides information on how to replace the system board module and system board components as its CMOS battery and the USB Flash Module
(UFM).
Safety notes
V
CAUTION!
● Devices and components inside the server remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
●
●
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
●
For further information, please refer to chapter "Important information" on page 29 .
9.1
Replacing the CMOS battery
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less; recommended: tooth pick
CMOS memory (volatile BIOS memory) and the real-time clock are powered by a lithium coin cell (CMOS battery). This cell lasts up to ten years, depending on ambient temperature and use.
If the CMOS battery is depleted or falls below minimum voltage levels, it need to be replaced immediately.
CX2570 M2 Upgrade and Maintenance Manual 155
System board and components
Safety notes
V
CAUTION!
● The CMOS battery must be replaced with an identical battery or with a battery type recommended by the manufacturer.
●
●
●
Keep lithium batteries away from children.
Do not throw batteries into the trash can. Lithium batteries must be disposed of in accordance with local regulations concerning special waste.
For further safety information, please refer to section "Environmental protection" in the PRIMERGY CX2570 M2 Operating Manual.
● Ensure to insert the CMOS battery with the positive pole facing up!
9.1.1
Preliminary steps
Perform the following procedures:
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
156 Upgrade and Maintenance Manual CX2570
System board and components
9.1.1.1
Localization of the CMOS battery
Figure 60: System board battery
CX2570 M2 Upgrade and Maintenance Manual 157
System board and components
9.1.2
Removing the CMOS battery
Figure 61: Removing the CMOS battery
Ê
Pull out the depleted CMOS battery of its socket.
158 Upgrade and Maintenance Manual CX2570
System board and components
9.1.3
Installing the CMOS battery
Figure 62: Installing the CMOS battery
Ê
Insert the new CMOS battery into its socket as shown.
V
CAUTION!
Ensure to insert the CMOS battery with the positive pole (label side) facing to you as shown (see close-up).
CX2570 M2 Upgrade and Maintenance Manual 159
System board and components
9.1.4
Concluding steps
Perform the following procedures:
Ê
Dispose of the CMOS battery in accordance with local regulations concerning special waste.
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Verifying the system time settings" on page 81
160 Upgrade and Maintenance Manual CX2570
System board and components
9.2
SATA DOM
The server node can be equipped with a SATA DOM.
9.2.1
Installing the SATA DOM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: Phillips PH1 / (+) No. 1 screw driver
9.2.1.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
CX2570 M2 Upgrade and Maintenance Manual 161
System board and components
9.2.1.2
Installing the SATA DOM
Figure 63: SATA DOM kit
1 SATA DOM
2 SATA DOM nylon spacer
162 Upgrade and Maintenance Manual CX2570
System board and components
Figure 64: SATA DOM mounting location
SATA DOM mounting location on the system board:
1
2
SATA DOM connector
SATA DOM spacer
CX2570 M2 Upgrade and Maintenance Manual 163
System board and components
Figure 65: Installing the SATA DOM spacer
Ê
Insert the spacer in the recess.
The spacer must audibly into place.
164 Upgrade and Maintenance Manual CX2570
System board and components
Figure 66: Installing the SATA DOM (A)
Ê
Connect the SATA DOM to the system board.
CX2570 M2 Upgrade and Maintenance Manual 165
System board and components
Figure 67: Installing the SATA DOM (B)
Ê
The SATA DOM on the SATA DOM spacer must audibly click into place (see arrow).
9.2.1.3
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
166 Upgrade and Maintenance Manual CX2570
9.2.2
Removing the SATA DOM
System board and components
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – Preliminary and concluding steps: tool-less
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.2.2.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the riser module" on page 44
CX2570 M2 Upgrade and Maintenance Manual 167
System board and components
9.2.2.2
Removing the SATA DOM
Figure 68: Removing the SATA DOM board (A)
Ê
Disconnect and remove the SATA DOM spacer of the defective SATA DOM board.
Ê
Disconnect and remove the defective SATA DOM board.
168 Upgrade and Maintenance Manual CX2570
System board and components
Figure 69: SATA DOM spacer
Ê
The SATA DOM spacer remains on the system board (1).
9.2.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 169
System board and components
9.2.3
Replacing the SATA DOM
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Software: 10 minutes
Tools: – Preliminary and concluding steps:
– combination pliers and flat nose pliers
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.2.3.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the riser module" on page 44
9.2.3.2
Removing the SATA DOM
Ê
Remove the SATA DOM as described in section
"Removing the SATA DOM" on page 168
.
170 Upgrade and Maintenance Manual CX2570
System board and components
9.2.3.3
Re-installing the SATA DOM
Ê
Secure the SATA DOM module on the SATA DOM spacer with the nylon
screw as described in "Installing the SATA DOM" on page 162
.
9.2.3.4
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 171
System board and components
9.3
USB Flash Module (UFM)
The server node can be equipped with a USB Flash Module (UFM).
9.3.1
Installing the UFM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – Preliminary and concluding steps: tool-less
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.3.1.1
Required tools
– Preliminary and concluding steps: tool-less
– Main steps:
– Phillips PH1 / (+) No. 1 screw driver
9.3.1.2
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
172 Upgrade and Maintenance Manual CX2570
9.3.1.3
Installing the UFM board
System board and components
Figure 70: UFM kit
1
2
USB Flash Module (UFM)
UFM nylon spacer
CX2570 M2 Upgrade and Maintenance Manual 173
System board and components
Figure 71: UFM mounting location
UFM mounting location on the system board:
1 UFM connector
2 UFM spacer
174 Upgrade and Maintenance Manual CX2570
System board and components
Figure 72: Installing the UFM spacer
Ê
Insert the plastic spacer in the recess next to the multi-pin connector for the
TPM (see arrow).
The plastic spacer must audibly click into place.
Figure 73: Installing the UFM board (A)
Ê
Connect the UFM board to the system board.
CX2570 M2 Upgrade and Maintenance Manual 175
System board and components
Figure 74: Installing the UFM board (B)
Ê
The UFM module on the plastic spacer must audibly click into place (see arrow).
9.3.1.4
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
9.3.1.5
Software configuration
In order to setup the ESXi configuration, the VMware ESXi Recovery Tools CD is required. An ISO image of the CD is available from the Fujitsu service partners portal at the following https address:
176 Upgrade and Maintenance Manual CX2570
System board and components https://globalpartners.ts.fujitsu.com/com/service/ps/Servers/PRIMERGY/
Pages/default.aspx
.
Ê
Sign in and choose your PRIMERGY server.
Ê
Select the Software & Tools Documentation category.
Ê
Download the desired ESXi Recovery CD ISO image, listed under Tools .
Ê
Unpack and burn the image to a CD.
Ê
Ensure that no other USB storage device is connected to the server beside the UFM.
Ê
Insert the Recovery Tools CD into your CD / DVD drive and reboot the server.
The server should now boot from the Recovery Tools CD.
Ê
Follow the on-screen instructions to initiate the installation.
After the flash process is complete, you will be asked to reboot the system.
I
For the Japanese market, follow the instructions provided separately.
9.3.2
Removing the UFM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: – tool-less
– Phillips PH1 / (+) No. 1 screw driver
9.3.2.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
CX2570 M2 Upgrade and Maintenance Manual 177
System board and components
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
9.3.2.2
Removing the UFM board
Figure 75: Removing the UFM board (A)
Ê
Disconnect and remove the nylon spacer of the defective UFM board (1).
Ê
Disconnect and remove the defective UFM board (2).
Figure 76: UFM spacer
178 Upgrade and Maintenance Manual CX2570
System board and components
Ê
The UFM spacer remains on the system board (1).
9.3.2.3
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 179
System board and components
9.3.3
Replacing the UFM board
Upgrade and Repair Unit
(URU)
Hardware: 5 minutes
Tools: tool-less
– combination pliers and flat nose pliers
– Phillips PH1 / (+) No. 1 screw driver
9.3.3.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
9.3.3.2
Removing the UFM
Ê
Remove the UFM as described in section "Removing the UFM board" on page 178
.
180 Upgrade and Maintenance Manual CX2570
System board and components
9.3.3.3
Re-installing the UFM
Ê
Connect the UFM board to the system board and secure the UFM module on the UFM spacer with the nylon screw as described in
"Installing the UFM board" on page 173 .
Destroying the defective UFM board
V
CAUTION!
The UFM board contains customer information (e.g. IP address, license numbers). After replacing the UFM, hand the defective UFM board over to the customer. If the customer requests disposal of the defective UFM board, proceed as follows:
Figure 77: Destroying the defective UFM board
Ê
Use a pair of combination pliers (1) and flat nose pliers (2) to break the UFM board in half as shown.
CX2570 M2 Upgrade and Maintenance Manual 181
System board and components
9.3.3.4
Concluding steps
Perform the following procedures:
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
9.3.3.5
Software configuration
In order to setup the ESXi configuration, the VMware ESXi Recovery Tools CD is required. An ISO image of the CD is available from the Fujitsu service partners portal at the following https address: https://globalpartners.ts.fujitsu.com/com/service/ps/Servers/PRIMERGY/
Pages/default.aspx
.
Ê
Sign in and choose your PRIMERGY server.
Ê
Select the Software & Tools Documentation category.
Ê
Download the desired ESXi Recovery CD ISO image, listed under Tools .
Ê
Unpack and burn the image to a CD.
Ê
Ensure that no other USB storage device is connected to the server beside the UFM.
Ê
Insert the Recovery Tools CD into your CD / DVD drive and reboot the server.
The server should now boot from the Recovery Tools CD.
Ê
Follow the on-screen instructions to initiate the installation.
After the flash process is complete, you will be asked to reboot the system.
I
For the Japanese market, follow the instructions provided separately.
182 Upgrade and Maintenance Manual CX2570
System board and components
9.4
iRMC microSD card
I
The iRMC microSD card is necessary for using the embedded Lifecycle
Management (eLCM) functionality of the iRMC. It requires a valid eLCM license key, which is always purchased together with the iRMC microSD card and activated through the iRMC web frontend.
For further information, please refer to the “ServerView embedded
Lifecycle Management (eLCM)” user guide.
9.4.1
Installing the iRMC microSD card
Upgrade and Repair Unit
(URU)
Average task duration:
5 minutes
Tools: tool-less
9.4.1.1
Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
CX2570 M2 Upgrade and Maintenance Manual 183
System board and components
9.4.1.2
Installing the iRMC microSD card
Figure 78: iRMC microSD card
Figure 79: Installing the iRMC microSD card
Ê
With the label facing up, insert the iRMC microSD card into the microSD card slot (1) as far as it will go (2).
I
The onboard position of the microSD card slot can be found in section
"Connectors and indicators" on page 262
.
9.4.1.3
Concluding steps
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
"Enabling SVOM boot watchdog functionality" on page 78
184 Upgrade and Maintenance Manual CX2570
System board and components
9.4.2
Removing the iRMC microSD card
Upgrade and Repair Unit
(URU)
Average task duration:
5 minutes
Tools: tool-less
9.4.2.1
Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing the riser module" on page 44
9.4.2.2
Removing the iRMC microSD card
Figure 80: Removing the iRMC microSD card
Ê
To eject the iRMC microSD card, gently push it in and then let go (1).
Ê
Pull the iRMC microSD card straight out of its slot (2).
CX2570 M2 Upgrade and Maintenance Manual 185
System board and components
Destroying the defective iRMC microSD card
V
CAUTION!
The iRMC microSD card contains customer information. After replacing the iRMC microSD card, hand the defective card over to the customer. If the customer requests disposal of the defective iRMC microSD card, proceed as follows:
Ê
Using a pair of side-cutting pliers, cut the iRMC microSD card in half.
9.4.2.3
Concluding steps
Ê
"Installing the riser module" on page 46
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
"Enabling SVOM boot watchdog functionality" on page 78
186 Upgrade and Maintenance Manual CX2570
System board and components
9.4.3
Replacing the iRMC microSD card
Upgrade and Repair Unit
(URU)
Average task duration:
5 minutes
Tools: tool-less
9.4.3.1
Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
9.4.3.2
Replacing the iRMC microSD card
Ê
Remove the defective iRMC microSD card as described in section
"Removing the iRMC microSD card" on page 185
.
Ê
Install the new iRMC microSD card as described in section
"Installing the iRMC microSD card" on page 183
.
9.4.3.3
Concluding steps
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 187
System board and components
9.5
Replacing the system board
Field Replaceable Unit
(FRU)
Hardware: 50 minutes
Software: 10 minutes
Tools: – tool-less
– Removing and installing the processor heat sink:
– Phillips PH2 / (+) No. 2 screw driver
– Removing and installing the UFM (if applicable):
– Phillips PH1 / (+) No. 1screw driver
– Removing and installing the processor: tool-less
Note on system information backup / restore
I
The chassis interface board contains the Chassis ID EPROM that contains system information like server name and model, housing type, serial number and manufacturing data.
To avoid the loss of non-default settings when replacing the system board, a backup copy of important system configuration data is automatically stored from the system board NVRAM to the Chassis ID
EPROM. After replacing the system board the backup data is restored from the Chassis ID board to the new system board.
Note on network settings recovery
I
When replacing network controllers or the system board, network configuration settings in the operating system will be lost and replaced by default values. This applies to all static IP address and LAN teaming configurations.
Ensure to note down your current network settings before replacing a controller or the system board.
188 Upgrade and Maintenance Manual CX2570
System board and components
9.5.1
Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server with the ID button.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
9.5.2
Replacing the system board
Ê
Remove all cables from the system board.
Ê
"Removing memory modules" on page 130
I
Ensure to take note of the memory modules’ mounting positions for reassembly.
Ê
"Removing the riser module" on page 44
I
Ensure to take note of the controllers’ mounting positions and cable connections for reassembly.
Ê
"Removing the UFM board" on page 178 (if applicable)
Ê
"Removing the SATA DOM" on page 168 (if applicable)
Ê
"Removing the iRMC microSD card" on page 185
(if applicable)
CX2570 M2 Upgrade and Maintenance Manual 189
System board and components
9.5.2.1
Removing the system board
Figure 81: Removing the screw of the system board
Ê
Remove the screw from the system board (see circle).
190 Upgrade and Maintenance Manual CX2570
System board and components
Figure 82: Removing the system board
Ê
Carefully shift the system board in the direction of the arrow until the plug shells disengage from the cut-outs in the connector panel (see circles).
Ê
Hold the defective system board by the memory module ejectors and at a slight angle lift it out of the chassis.
CX2570 M2 Upgrade and Maintenance Manual 191
System board and components
9.5.2.2
Installing the system board
Figure 83: Installing the system board
Ê
Hold the new system board by the memory module ejectors.
V
CAUTION!
– Do not lift or handle the system board by any of its heat sinks!
– Ensure not to damage the EMI springs to comply with applicable
EMC regulations and satisfy cooling requirements and fire protection measures.
Ê
At a slight angle, lower the system board into the chassis.
Ê
Carefully shift the system board in the direction of the arrow until the plug shells engage with the cut-outs in the connector panel (see circles).
Ê
Lower the system board down.
192 Upgrade and Maintenance Manual CX2570
System board and components
Figure 84: Securing the screw of the system board
Ê
Secure the system board with the screw (see circle).
9.5.2.3
Swapping processors
Preparing the processor socket load plates on the new system board
Ê
"Installing the processor" on page 143
Removing processors from the defective system board
Ê
Carefully remove the processors from their sockets on the defective system board as described in
"Removing the processor" on page 139 .
V
CAUTION!
Remove and reinstall one processor at a time. Do not remove the second processor from the defective system board until the first processor has been installed on the new system board.
CX2570 M2 Upgrade and Maintenance Manual 193
System board and components
Installing processors on the new system board
Ê
"Installing the processor" on page 143
.
Installing protective socket covers on the defective system board
I
Since the defective system board is sent back for repair, protect the delicate processor socket springs with a socket cover.
Ê
"Installing the processor" on page 143
9.5.2.4
Completing the system board
Ê
"Installing the UFM board" on page 173
(if applicable)
Ê
"Installing the SATA DOM board" on page 161
(if applicable)
Ê
"Installing the iRMC microSD card" on page 184
(if applicable)
Ê
Install all expansion cards as described in chapter
(if applicable)
I
Install the expansion cards into their original slots.
Ê
"Installing the riser module" on page 46
Ê
"Installing a memory module" on page 128
I
Install the memory modules into their original slots.
Ê
Reconnect all cables to the system board. For a complete cabling overview,
please refer to section "Cabling overview" on page 254 .
194 Upgrade and Maintenance Manual CX2570
System board and components
9.5.3
Concluding steps
Perform the following steps:
Ê
"Installing the GPGPU extension" on page 53
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, reconnect all external cables.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Using the Chassis ID Prom Tool" on page 88
Ê
"Enabling SVOM boot watchdog functionality" on page 78 (if applicable)
Ê
"Verifying system information backup / restore" on page 73
Ê
"Verifying the system time settings" on page 81
Ê
Inform the customer about changed WWN and MAC addresses. For further information, refer to section
"Looking up changed MAC / WWN addresses" on page 86 .
Ê
After replacing the system board in a server running Linux OS, update the
MAC address of the onboard network controller in the related NIC definition file as described in section
"Updating the NIC configuration file in a Linux environment" on page 83 .
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 195
System board and components
196 Upgrade and Maintenance Manual CX2570
10 GPGPU Extension
Safety notes
V
CAUTION!
● Do not damage or modify internal cables or devices. Doing so may cause a device failure, fire, or electric shock.
●
●
●
●
●
Devices and components inside the server node remain hot after shutdown. After shutting down the server, wait for hot components to cool down before installing or removing internal options.
Circuit boards and soldered parts of internal options are exposed and can be damaged by static electricity. Always discharge static build-up
(e.g. by touching a grounded object) before handling electrostaticsensitive devices (ESDs).
Do not touch the circuitry on boards or soldered parts. Hold circuit boards by their metallic areas or edges.
If devices are installed or disassembled using methods other than those outlined in this chapter, the warranty will be invalidated.
For further information, please refer to chapter "Important information" on page 29 .
CX2570 M2 Upgrade and Maintenance Manual 197
GPGPU Extension
10.1 Basic information
With the GPGPU extension, the system offers two slots for GPGPU, Xeon Phi and GRID Kx.
5
6
3
4
Figure 85: GPGPU extension overview
1
2
GPGPU 2 (for GPGPU/Xeon Phi/GRID Kx)
PCI slot for GPGPU 1, connected to PCIe slot 5-8 on system board (see figure
"PCI slot overview" on page 98
)
Power connector for GPGPU 2 (not visible)
GPGPU 1 (for GPGPU/Xeon Phi/GRID Kx)
Power connector for GPGPU 1
PCI slot for GPGPU 2, connected to PCIe slot 15-18 on system board (see figure
"PCI slot overview" on page 98
)
I
For information about available GPGPU, Xeon Phi and GRID Kx please refer section
"Expansion card overview" on page 99 .
I
Install in slot GPGPU 2 always first.
198 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.2 Installing GPGPU extension
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.2.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
10.2.2 Installing Xeon Phi to slot GPGPU 2
Figure 86: Connecting the Xeon Phi to the PCI connector
Ê
Plug in the Xeon Phi to the PCI slot 2 (1).
CX2570 M2 Upgrade and Maintenance Manual 199
GPGPU Extension
Figure 87: Securing Xeon Phi
Ê
Attach the fixing bracket to chassis with two crosshead screws (see circles).
– Tighten the screws only loosely.
Ê
Push the bracket to the Xeon Phi.
Ê
Fasten the screws.
Figure 88: Connecting the power cable
Ê
Connect the power cable (see circles).
200 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.2.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
10.3 Removing Xeon Phi from slot GPGPU 2
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.3.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
CX2570 M2 Upgrade and Maintenance Manual 201
GPGPU Extension
10.3.2 Removing Xeon Phi
Figure 89: Disconnecting the power cable
Ê
Disconnect the power cable (see circles).
Figure 90: Removing the fixing bracket
Ê
Remove the two screws (see circle) and remove the fixing bracket.
202 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 91: Disconnecting the Xeon Phi
Ê
Disconnect the Xeon Phi from the PCI slot and remove the Xeon Phi.
10.3.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 203
GPGPU Extension
10.4 Replacing the GPGPU 2
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.4.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
If applicable,
"Removing Xeon Phi from slot GPGPU 1" on page 211
10.4.2 Removing the GPGPU 2
Ê
Remove the Xeon Phi as described in section "Removing Xeon Phi" on page 202
.
10.4.3 Installing the GPGPU 2
Ê
Install the new Xeon Phi as described in section "Installing GPGPU extension" on page 199 .
204 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.4.4 Concluding steps
Perform the following procedures:
Ê
If applicable, "Installing Xeon Phi (slot GPGPU 1)" on page 206
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
10.5 Installing Xeon Phi in slot GPGPU 1
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.5.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
CX2570 M2 Upgrade and Maintenance Manual 205
GPGPU Extension
10.5.2 Installing Xeon Phi (slot GPGPU 1)
Figure 92: Threading the cable tie
Ê
Thread the cable tie through the eyelet of the chassis.
206 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 93: Connecting GPGPU 1 to the PCI connector
Ê
Plug the Xeon Phi in PCI slot 1 (1).
CX2570 M2 Upgrade and Maintenance Manual 207
GPGPU Extension
Figure 94: Securing Xeon Phi
Ê
Attach the fixing bracket to chassis with two crosshead screws (see circles).
– Tighten the screws only loosely.
Ê
Push the bracket to the Xeon Phi.
Ê
Fasten the screws.
208 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 95: Connecting the power cable
Ê
Connect the power cable (see circles).
CX2570 M2 Upgrade and Maintenance Manual 209
GPGPU Extension
Figure 96: Securing the power cable
Ê
Pull the power cable tight at the GPGPU connector (1).
Ê
Loop the cable tie around the power cable (2).
Ê
Close the cable tie around the power cable (2) and pull tight (3) to secure the power cable.
Ê
Shorten the cable tie (4).
10.5.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67 (if
applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
210 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.6 Removing Xeon Phi from slot GPGPU 1
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.6.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
10.6.2 Removing Xeon Phi (GPGPU1)
Figure 97: Opening the cable tie
Ê
Open on the locking lever on the cable clamp (see arrow).
CX2570 M2 Upgrade and Maintenance Manual 211
GPGPU Extension
Figure 98: Disconnecting the power cable
Ê
Disconnect the power cable (see circles).
Figure 99: Removing the fixing bracket
Ê
Remove the two screws (see circle) and remove the fixing bracket (1).
212 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 100: Disconnecting the Xeon Phi
Ê
Disconnect the Xeon Phi from the PCI slot and remove the Xeon Phi.
10.6.3 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 213
GPGPU Extension
10.7 Replacing GPGPU 1
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Tools: Preliminary and concluding steps: tool-less
Main steps: PH2 / (+) No. 2 screw
10.7.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
10.7.2 Removing the GPGPU 1
Ê
Remove the GPGPU as described in section
10.7.3 Installing the GPGPU 1
Ê
Install the new GPGPU as described in section
.
214 Upgrade and Maintenance Manual CX2570
GPGPU Extension
10.7.4 Concluding steps
Perform the following procedures:
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, connect all external cables to the server node.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M2 Upgrade and Maintenance Manual 215
GPGPU Extension
10.8 Power cables
Figure 101: Power cable for GPGPU, Xeon Phi and GRID Kx
I
All GPGPU and Xeon Phi cards need both power connections:
– 1: 8pin connector
– 2: 6pin connector
The GRID Kx cards need only the 6pin connector (2). The 8pin connector
(1) is folded back and fixed with the cable tie.
216 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 102: Power cable for GPGPU K80 and Tesla M60 with single 8pin connector
CX2570 M2 Upgrade and Maintenance Manual 217
GPGPU Extension
10.9 GPGPU Riser
10.9.1 Preliminary steps
Perform the following procedures:
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
Locate the desired server node.
Ê
"Shutting down the server node" on page 41
Ê
If applicable, remove all external cables from the server node.
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
Ê
"Removing Xeon Phi from slot GPGPU 2" on page 201 (if applicable)
Ê
"Removing Xeon Phi from slot GPGPU 1" on page 211 (if applicable)
10.9.2 Removing the GPGPU riser
Figure 103: GPGPU Riser - left (GPGPU1)
218 Upgrade and Maintenance Manual CX2570
GPGPU Extension
Figure 104: GPGPU Riser - Right (GPGPU2)
Ê
Remove the screw - see circle (1).
Ê
Shift the GPGPU Riser in the direction of the arrow (2).
10.9.3 Installing the GPGPU riser
Figure 105: GPGPU Riser - left (GPGPU1)
CX2570 M2 Upgrade and Maintenance Manual 219
GPGPU Extension
Figure 106: GPGPU riser - right (GPGPU2)
Ê
Shift the GPGPU riser in the direction of the arrow (1).
Ê
Secure GPGPU riser with the screw - see circle (2).
10.9.4 Concluding steps
Perform the following procedures:
Ê
"Installing Xeon Phi in slot GPGPU 1" on page 205
(if applicable)
Ê
"Installing Xeon Phi to slot GPGPU 2" on page 199 (if applicable)
Ê
"Installing the server node in the server enclosure" on page 56
Ê
If applicable, connect all external cables to the server node.
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
220 Upgrade and Maintenance Manual CX2570
11 Liquid cooling
11.1
Liquid cooling kit for GPGPU extension
11.1.1 Basic information
Figure 107: GPGPU liquid cooling kit with one pump - top side
Pos. Component
1 Pump
2 Power cable
3 Fixing bracket
4 Flexible tubes with protective caps
5 Screws
Figure 108: GPGPU liquid cooling kit with one pump - bottom side
CX2570 M2 Upgrade and Maintenance Manual 221
Liquid cooling
Pos. Component
1 Area with thermal paste, at delivery covered with a protector
Figure 109: GPGPU - top side
Figure 110: GPGPU - bottom side
222 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 111: Connectors used for liquid cooling
Pos. Component
1 Connector X5, left side
2 PCI slot 1, left side
3 Connector X53, left side
4 Connector X53, right side
5 Connector X5, right side
6 PCI slot 2, right side
CX2570 M1 Upgrade and Maintenance Manual 223
Liquid cooling
Figure 112: Power cable for GPGPU
Pos. Component
1 8-pin connector
2 16-pin connector
11.1.2 Replacing the liquid cooling kit
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
11.1.2.1 Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
Disconnect the tubes from the tube system of the rack as described in the
"RackCDU
TM
Service Manual".
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the GPGPU extension" on page 43
224 Upgrade and Maintenance Manual CX2570
11.1.2.2 Removing the liquid cooling kit
Liquid cooling
Figure 113: Disconnecting the power cable
Ê
Disconnect the power cable from connector X5 (see circle), see figure
.
Figure 114: Removing the pump
Ê
Remove the four screws in a crossover pattern (1, 2, 3, 4).
CX2570 M1 Upgrade and Maintenance Manual 225
Liquid cooling
Figure 115: Disconnecting the power cable for GPGPU from connector X53
Ê
Disconnect the power cable for GPGPU from connector X53 (see circle), see figure
.
Figure 116: Disconnecting the power cable for GPGPU from the GPGPU
Ê
Disconnect the power cable for GPGPU from the GPGPU (see circle).
226 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 117: Removing the GPGPU with liquid cooling kit (A)
Ê
Remove the two screws (see circles).
Figure 118: Removing the GPGPU with liquid cooling kit (B)
Ê
Remove the three screws (see circles).
Ê
Pull the flexible tubes through the holes (see arrows).
CX2570 M1 Upgrade and Maintenance Manual 227
Liquid cooling
Figure 119: Removing the GPGPU with liquid cooling kit (C)
Ê
Carefully disconnect the GPGPU from the PCI slot (1).
Ê
Take the GPGPU with the liquid cooling kit out off the chassis (2).
Figure 120: Removing the liquid cooling kit from the GPGPU (A)
Ê
Remove the four screws (see circles).
228 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 121: Removing the liquid cooling kit from the GPGPU (B)
Ê
Carefully take the GPGPU off the liquid cooling kit.
11.1.2.3 Installing a liquid cooling kit
I
If new GPGPU Liquid cooling kits are applied, a thin layer of thermal compound has already been pre-applied to its surface. In this case, please follow the consecutive steps.
If new GPGPU Liquid cooling kits are NOT applied, see
"Applying thermal paste" on page 146 .
Ê
If applicable, carefully remove the thermal paste protector from a new liquid cooling kit.
CX2570 M1 Upgrade and Maintenance Manual 229
Liquid cooling
Figure 122: Mounting the liquid cooling kit to the GPGPU (A)
Ê
Place the GPGPU on the liquid cooling kit as shown.
Figure 123: Mounting the liquid cooling kit to the GPGPU (B)
Ê
Fasten the liquid cooling kit with four screws (see circles).
230 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 124: Installing the GPGPU with the liquid cooling kit (A)
Ê
Place the GPGPU with the liquid cooling kit into the chassis (1).
Ê
Carefully connect the GPGPU to the PCI slot (2).
Figure 125: Installing the GPGPU with the liquid cooling kit (B)
Ê
Push the flexible tubes through the holes (see arrows).
Ê
Fasten the three screws (see circles).
CX2570 M1 Upgrade and Maintenance Manual 231
Liquid cooling
Figure 126: Installing the GPGPU with the liquid cooling kit (C)
Ê
Tighten the two screws of the fixing bracket loosely (see circles).
Ê
Push the fixing bracket to the GPGPU and fasten the screws.
Figure 127: Connecting the power cable for GPGPU to the GPGPU
Ê
Connect the power cable for GPGPU to the GPGPU (see circle).
232 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 128: Connecting the power cable for GPGPU to connector X53
Ê
Connect the power cable for GPGPU to connector X53 (see circle), see
Figure 129: Installing the liquid cooling pump
Ê
Fasten the liquid cooling pump with four screws in a crossover pattern (1, 2,
3, 4).
CX2570 M1 Upgrade and Maintenance Manual 233
Liquid cooling
Figure 130: Connecting the power cable
Ê
Connect the power cable from connector X5 (see circle), see figure
.
11.1.2.4 Concluding steps
Ê
Install the GPGPU extension with the installed liquid cooling kit as described in chapter
"Installing the GPGPU extension" on page 53 .
I
Before powering on the server node connect the tubes to the tube system of the rack as described in the "RackCDU
TM
Service Manual".
–
"Installing the server node in the server enclosure" on page 56
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
234 Upgrade and Maintenance Manual CX2570
Liquid cooling
This information is only regarding to the change of CPU configuration.
There is no technical problem.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
11.2
Liquid cooling kit for the server node
11.2.1 Basic information
11.2.1.1 Main components of the server node
The following figure shows the position of the main components of the
PRIMERGY CX2570 M2 Server Node server node.
Slot 11-14
Slot 5-8
Memory Memory
CPU1 CPU2
Memory
Slot 1-4
Slot 15-18
Figure 131: Main components of the PRIMERGY CX2570 M2 Server Node server node
I
If liquid cooling is installed, slot 1-4 for modular RAID will not be supported.
CX2570 M1 Upgrade and Maintenance Manual 235
Liquid cooling
11.2.1.2 Riser module for the liquid cooling kit
Figure 132: Riser module for liquid cooling kit
For installing the riser module see chapter
"Installing the riser module" on page 46
.
11.2.1.3 Liquid cooling kit
Figure 133: PRIMERGY CX2570 M2 server node - liquid cooling kit
Pos. Component
1 Memory cover for DIMM channels C, D, E, F
2 Memory cover for DIMM channel A, B, G, H
3 Memory cooling tubes
4 Flexible tubes
5 Pump for CPU 2
6 Pump for CPU 1
7 Power cables for the pumps
236 Upgrade and Maintenance Manual CX2570
Liquid cooling
11.2.2 Replacing the liquid cooling kit
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
11.2.2.1 Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
Disconnect the tubes from the tube system of the rack as described in the
"RackCDU
TM
Service Manual".
Ê
"Removing the server node from the server enclosure" on page 42
11.2.2.2 Removing the liquid cooling kit
Figure 134: Removing the riser module
Ê
Remove both riser modules (1, 2) as described in chapter
"Removing the riser module" on page 44 .
I
The connection of the flexible tubes to the liquid cooling system of the rack you may find in the corresponding manual of the rack.
CX2570 M1 Upgrade and Maintenance Manual 237
Liquid cooling
Figure 135: Removing the memory covers
Ê
Remove both memory covers from the DIMM channels.
CPU 2 CPU 1
Figure 136: Removing the pumps
Ê
First remove the four screws for CPU 1 in a crossover pattern (1, 2, 3, 4).
Ê
Second remove the four screws for CPU 2 in a crossover pattern (1, 2, 3, 4).
238 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 137: Removing the riser module
Ê
Disconnect the power cable of the pump for CPU 2 from the connector (1) on the system board.
Ê
Disconnect the power cable of the pump for CPU 1 from the connector (2) on the system board.
Ê
Remove the protective caps (3).
Ê
Remove the riser module with the liquid cooling kit from the chassis (see arrow).
CX2570 M1 Upgrade and Maintenance Manual 239
Liquid cooling
Figure 138: Removing the flexible tubes (A)
Ê
Remove the three screws from the liquid cooling kit riser module.
Figure 139: Removing the flexible tubes (B)
Ê
Pull the flexible tubes through the holes of the liquid cooling kit riser module.
11.2.2.3 Installing a liquid cooling kit
I
If a new liquid cooling kit is used, a thin layer of thermal paste is applied to the lower surface. (Remove the thermal paste protective cover).
240 Upgrade and Maintenance Manual CX2570
Liquid cooling
Ê
If using the liquid cooling kit removed before, see section "Applying thermal paste" on page 146
.
Figure 140: Removing the memory covers from the liquid cooling kit
Ê
If applicable, remove both memory covers from the liquid cooling kit.
I
Keep the memory covers for future use.
Figure 141: Removing the protective caps
Ê
If applicable, remove both protective caps (see arrows).
I
Keep the protective caps for future use. Mount the protective caps immediately after installing the riser module.
CX2570 M1 Upgrade and Maintenance Manual 241
Liquid cooling
Figure 142: Installing the flexible tubes (A)
Ê
Push the flexible tubes through the holes of the liquid cooling kit riser module
(see arrow).
Figure 143: Installing the flexible tubes (B)
Ê
Fasten the screws of the bracket.
242 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 144: Installing the riser module (A)
Ê
Insert the riser module with the liquid cooling kit at a slight angle (1).
Ê
Carefully place the pumps (2) of the liquid cooling kit on the eight threaded holes without fastening the screws.
Ê
Carefully place the memory cooling tubes (3) between the memory slots.
I
– Pay attention to the flexible tubes. The flexible tubes must not be squeezed by the riser module.
– For an easier installing of the liquid cooling kit disconnect the SATA cables from the front connectors (non-PCI-side) temporally!
CPU 2 CPU 1
Figure 145: Installing the pumps
Ê
First fasten the four screws for CPU 2 in a crossover pattern (1, 2, 3, 4).
Ê
Second fasten the four screws for CPU 1 in a crossover pattern (1, 2, 3, 4).
CX2570 M1 Upgrade and Maintenance Manual 243
Liquid cooling
Figure 146: Installing the memory covers
Ê
Install both memory covers over the DIMM channels.
I
Make sure not to damage anything when installing the memory covers (see arrow).
Figure 147: Installing the riser module (B)
Pos. Component
1 Power connector for power cable of pump 2
2 Power connector for power cable of pump 1
244 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 148: Installing the riser module (C)
Ê
Press down the riser module (see arrow).
I
– Make sure that the bolt snaps into the chassis sparing (see circle) and the connector of the riser card fits within the slot.
– If SATA cables are already installed in server node, make sure that all connectors are connected properly.
Ê
Mount the protective caps (3) for the tubes.
Ê
Connect the power cable of pump for CPU 2 to the connector (1) on the system board.
Ê
Connect the power cable of pump for CPU 1 to the connector (2) on the system board.
CX2570 M1 Upgrade and Maintenance Manual 245
Liquid cooling
Figure 149: Power cable routing
Ê
Run the power cable of pump as shown.
Figure 150: Installing the second riser module
Ê
11.2.2.4 Concluding steps
I
Before powering on the server node connect the tubes to the tube system of the rack as described in the "RackCDU
TM
Service Manual".
Ê
"Installing the server node in the server enclosure" on page 56
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
246 Upgrade and Maintenance Manual CX2570
Liquid cooling
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
11.3
Cooling pads on the memory modules
11.3.1 Basic information
I
Before installing new memory modules prepare the memory modules with the cooling pads.
Figure 151: Memory cooling pads
CX2570 M1 Upgrade and Maintenance Manual 247
Liquid cooling
11.3.1.1 Adhesive rules for the memory cooling pads
Memory modules 1A, 1C, 1E, 1G
Figure 152: Memory modules 1A, 1C, 1E, 1G: joining face for the cooling pad
The cooling pad must be stuck on the above shown side of the memory module.
Memory modules 2B, 2D, 2H, 2F
Figure 153: Memory modules 2B, 2D, 2H, 2F: joining face for the cooling pad
The cooling pad must be stuck on the above shown side of the memory module.
Memory modules 1B, 1D, 1F, 1H, 2A, 2C, 2E, 2G
The cooling pads must be stuck on both sides of the memory module.
248 Upgrade and Maintenance Manual CX2570
Liquid cooling
Figure 154: Example: Memory modules with cooling pads built-in
Pos.
1
2, 3
4, 5
6
Memory module
1C
2C
1D
2D
Number of cooling pads
1 cooling pad
2 cooling pads
2 cooling pads
1 cooling pad
CX2570 M1 Upgrade and Maintenance Manual 249
Liquid cooling
11.3.2 Preparing the memory modules
Field Replaceable Unit
(FRU)
Hardware: 15 minutes
Software: 5 minutes
Tools: Phillips PH2 / (+) No. 2 screw driver
11.3.2.1 Preliminary steps
Ê
"Disabling SVOM boot watchdog functionality" on page 60
Ê
"Shutting down the server node" on page 41
Ê
Disconnect the tubes from the tube system of the rack as described in the
"RackCDU
TM
Service Manual".
Ê
"Removing the server node from the server enclosure" on page 42
Ê
"Removing the liquid cooling kit" on page 237
Ê
"Removing memory modules" on page 130
11.3.2.2 Preparing a memory module
Figure 155: Prepared memory module
Ê
Stick the cooling pad(s) on one or two sides of the memory modules, see
"Adhesive rules for the memory cooling pads" on page 248 .
11.3.2.3 Concluding steps
I
Before powering on the server node connect the tubes to the tube system of the rack as described in the "RackCDU
TM
Service Manual".
250 Upgrade and Maintenance Manual CX2570
Liquid cooling
Ê
Install the memory modules as described in section "Installing memory modules" on page 127
Ê
"Installing a liquid cooling kit" on page 240
Ê
"Installing the server node in the server enclosure" on page 56
I
If the Global LED is flashing with error message "CPU has been changed" on display after the system is powered on, please follow the procedure below.
Ê
Restart the system and wait until the screen output appears.
Ê
Press the [F2] function key.
Ê
If a password is assigned, enter this password and confirm with the
[Enter] key.
The BIOS setup Main menu will be displayed on the screen.
Ê
Select "Save Changes and Exit" or "Save Changes and Reset" on
Save & Exit menu.
Ê
Confirm LED no flashing.
This information is only regarding to the change of CPU configuration.
There is no technical problem.
Ê
"Updating or recovering the system board BIOS and iRMC" on page 67
(if applicable)
Ê
"Controls and indicators on the server node" on page 57
Ê
"Enabling SVOM boot watchdog functionality" on page 78
CX2570 M1 Upgrade and Maintenance Manual 251
Liquid cooling
252 Upgrade and Maintenance Manual CX2570
12 Cabling
This chapter provides information on how to connect, disconnect and route cables.
Safety notes
V
CAUTION!
● Always hold cables by their connectors when disconnecting them.
Never pull on the cable to disconnect cables.
●
●
●
Ensure that none of the cables are scraped, strained or otherwise damaged while replacing system components.
Immediately replace cables with damaged shielding.
Always use shielded network cables.
CX2570 M2 Upgrade and Maintenance Manual 253
Cabling
12.1 Cabling overview
No. Part number (Label) Description
C1 T26139-Y4040-V13 Onboard SATA
C2 T26139-Y4040-V12 RAID controller
Note
CBL PCH-BP
CBL CGR4-BP
C3 T26139-Y3946-V606 GPGPU CBL GPU PWR
C3 T26139-Y3946-V609 GPGPU K80 / Tesla M60 CBL GPU PWR
Table 5: List of used cables
12.2 Cabling
Cabling onboard
D3343
D3343
MoBo
SAS 0 - 3
SAS 0 - 3
SAS 4 - 5
SAS 4 - 5
GPGPU Riser Card
X53
GPGPU Riser Card
X53
C1
C1
C3
C3
SATA Onboard
SATA 0-3
SATA Onboard
SATA 4-5
GPGPU 1
PWD
GPGPU 2
PWD
Figure 156: Cabling onboard
254 Upgrade and Maintenance Manual CX2570
Cabling with RAID controller
D3343
MoBo
SAS 0 - 3
SAS 0 - 3
SAS 4 - 5
SAS 4 - 5
GPGPU Riser Card
X53
GPGPU Riser Card
X53
C2
C2
C3
C3
Figure 157: Cabling with RAID controller
Cabling
RAID controller
MLC1
RAID controller
MLC2
GPGPU 1
PWD
GPGPU 2
PWD
CX2570 M2 Upgrade and Maintenance Manual 255
Cabling
12.3 Cabling for HDD 2.5"
12.3.1 Cabling onboard
Figure 158: Cabling onboard with cable T26139-Y4040-V13
Ê
Plug one end of the SATA cable on the SAS connector (SAS 0-3) on the system board (1).
Ê
Plug the other end of the SATA cable on the other SATA connector (SATA 0-
3) on the system board (2).
Ê
Proceed with the second SATA cable as described before but plug it into the other SAS/SATA connector (SAS 4-5/SATA 4-5) on the system board.
Figure 159: Cable T26139-Y4040-V13
256 Upgrade and Maintenance Manual CX2570
12.3.2 Cabling with RAID-Controller
Cabling
Figure 160: Cabling with RAID controller with cable T26139-Y4040-V12
Ê
Plug one end of the SATA cable on the SAS connector (SAS 0-3) on the system board (1).
Ê
Plug the other end of the SATA cable to the connector on the RAID controller
(2).
Ê
Proceed with the second SATA cable as described before but plug it into the other SAS connector (SAS 4-5) on the system board.
Figure 161: Cable T26139-Y4040-V12
CX2570 M2 Upgrade and Maintenance Manual 257
Cabling
258 Upgrade and Maintenance Manual CX2570
13 Appendix
13.1 Mechanical overview
13.1.1 CX2570 M2 server node complete system
Figure 162: CX2570 M2 complete system
Pos. Component
1 CX2570 server node
2 GPGPU extension
CX2570 M2 Upgrade and Maintenance Manual 259
Appendix
13.1.2 Server node interior
Figure 163: PRIMERGY CX2570 M2 server node interior
Pos. Component
1 USB Flash Module (UFM)
2 SATA DOM (not visible, located under the riser module
3 Riser module on the left side
4 Memory slots for CPU1
5 CPU1 with heat sink
6 Memory air duct
7 CPU2 with heat sink
8 Memory slots for CPU2
9 Memory slots for CPU2
10 Memory air duct
11 Memory slots for CPU1
12 Riser module on the right side
13 Network Controller
260 Upgrade and Maintenance Manual CX2570
Appendix
13.1.3 Server node rear
Figure 164: Connection panel of the server node
1 Shared LAN connector (LAN 1) 5 Video connector
2 Standard LAN connector (LAN 2) 6 PCI2 (connected to PCI slot 11-14 on system)
3 Management LAN connector 7 PCI1 (connected to PCI slot 1-4 on system)
4 2 x USB 3.0 connectors
CX2570 M2 Upgrade and Maintenance Manual 261
Appendix
13.2 Connectors and indicators
13.2.1 Connectors and indicators on the system board
13.2.1.1 Onboard connectors
Figure 165: Internal connectors of system board D3343
262 Upgrade and Maintenance Manual CX2570
Appendix
No. Print
1 RST
2 PWR
3 CSS
4 ID LED
5 GEL
Description
Reset button
Power button
CSS (orange)
Identify (blue)
Global Error LED (orange)
6 LAN 1
7 LAN 2
8 LAN M
9 UFM
10 PCI Slot 11-14
LAN connector 1
LAN connector 2
Management LAN connector
UFM connector
PCI Slot 11-14 (connected to PCI2)
11 SATA DOM SATA Disk on module
12 Jumper Jumper
13 PCI Slot 5-8
14 MicroSD
PCI Slot 5-8 (connected to GPGPU1) iRMC microSD card
15 Indicate CSS
16 SATA 0-3
17 SAS 0-3
18 SAS 4-5
19 SATA 4-5
20 LC pump
21 PCI Slot 15-18
22 BATT
23 PCI Slot 1-4
24 USB 1
25 USB 2
26 VGA
Indicate CSS
SATA connectors 0-3
SAS connectors 0-3
SAS connectors 4-5
SATA connectors 4-5
Liquid cooling connectors
PCI Slot 15-18 (connected to GPGPU2)
Battery
PCI Slot 1-4 (connected to PCI1)
USB connector 1
USB connector 2
Video connector
CX2570 M2 Upgrade and Maintenance Manual 263
Appendix
13.2.1.2 Onboard settings
Figure 166: Jumper on system board
Reset RTC
Jumper position Function
1-2 no jumper
Table 6: Reset RTC
Reset RTC enabled
Reset RTC disabled
Password Skip
Jumper position Function
3-4 no jumper
Table 7: Password skip
PASSWORD CLEAR (SKIP)
NORMAL MODE
Default setting o
Default setting o
264 Upgrade and Maintenance Manual CX2570
BIOS Recovery
Jumper position Function
5-6 no jumper
Table 8: BIOS Recovery
BIOS Recovery enabled
BIOS Recovery disabled
BIOS Write Protect
Jumper position Function
9-10 no jumper
Flash Write Protect enabled
Flash Write Protect disabled
Table 9: BIOS Write Protect
Appendix
Default setting o
Default setting o
CX2570 M2 Upgrade and Maintenance Manual 265
Appendix
13.2.2 Connector panel
13.2.2.1 Controls and indicators
Figure 167: Controls and indicators of the server node
1 RST button
2 Global error indicator
3 ID indicator
4 CSS indicator
I
The server nodes are controlled via related operating panel areas on the front side of the CX400 M1 server enclosure. See "FUJITSU Server
PRIMERGY CX400 M1 Server Enclosure Operating Manual".
13.2.2.2 Control elements
RST Reset button
Pressing the reset button reboots the system.
V
CAUTION!
Risk of loss of data!
I
The server nodes are controlled via related operating panel areas on the front side of the CX400 M1 server enclosure. See "FUJITSU Server
PRIMERGY CX400 M1 Server Enclosure Operating Manual".
266 Upgrade and Maintenance Manual CX2570
Appendix
13.2.2.3 Global error indicator, ID indicator, CSS indicator
!
ID
Global error indicator (orange)
– Lights up orange if a prefailure event has been detected that requires (precautionary) service intervention.
– Flashes orange if an error was detected that requires service intervention.
– Does not light up if there is no critical event.
If the event is still acute after a power cycle, the indicator is activated after the restart.
The indicator also lights up in standby mode.
You can find more details on the indicated errors in the System
Event Log (SEL), in the ServerView Operations Manager or via the iRMC S4's Web interface.
ID indicator (blue)
Lights up blue when the system has been selected by pressing the ID button. To deactivate, press the button again.
The ID indicator can also be activated via the ServerView
Operations Manager and the iRMC S4 Web interface and its status reported to the ServerView Operations Manager and the iRMC S4.
CSS indicator (orange)
– Lights up orange if a prefailure event was detected for a CSS component that you can fix yourself (for reasons of precaution) with the CSS concept.
– Flashes orange if an error was detected that you can fix yourself with the CSS concept.
– Does not light up when the supervised components are OK.
If the event is still acute after a power cycle, the indicator is activated after the restart.
The indicator also lights up in standby mode.
CX2570 M2 Upgrade and Maintenance Manual 267
Appendix
13.2.2.4 LAN indicators
Figure 168: LAN indicators
No Indicator
1 LAN link/transfer
2 LAN speed
Description
Steady green signal when a LAN connection exists.
Remains dark when no LAN connection exists.
Flashes green when LAN transfer takes place.
Steady orange signal in the event of a LAN transfer rate of 1 Gbit/s
Steady green signal in the event of a LAN transfer rate of 100 Mbit/s.
Remains dark in the event of a LAN transfer rate of
10 Mbit/s.
I
Depending on the settings in the BIOS, the standard LAN connector 1 may also be used as a Management LAN connector. You will find further information in the "D3343 BIOS Setup Utility for FUJITSU Server
PRIMERGY CX2570 M2 Reference Manual".
268 Upgrade and Maintenance Manual CX2570
Appendix
13.3 Minimum startup configuration
Field Replaceable Units (FRU)
If the server does not start up or other problems occur, it may be necessary to take the system down to its most basic configuration in order to isolate the defective component.
The minimum startup configuration consists of the following components and cables:
Component
System board
CPU1 with CPU heat sink
Notes and reference no TPM or expansion cards installed
1 memory modules
installed in slot 1A, see section "Memory sequence" on page 124
1 Power supply units
Table 10: Minimum startup configuration - components
Cable
2 SATA cables
Notes and reference
Table 11: Minimum startup configuration - cables
Ê
Shut down the server as described in section
"Shutting down the server node" on page 41
.
Ê
Take the system down to its minimum startup configuration.
Ê
Connect a keyboard, mouse and display to the server.
Ê
V
CAUTION!
Since the fan module is not included in the minimum startup configuration, the server must be shut down immediately after the diagnostic process is complete (POST phase has been passed).
CX2570 M2 Upgrade and Maintenance Manual 269
Appendix
The minimum startup configuration must be used exclusively for diagnostic purposes by maintenance personnel, never in daily operation!
270 Upgrade and Maintenance Manual CX2570

Public link updated
The public link to your chat has been updated.
Advertisement
Key features
- High-performance computing with Intel Xeon Scalable processors
- Scalable memory architecture with up to 1.5 TB of DDR4 memory
- Integrated RAID controller for enhanced data protection
- Flexible storage options with support for NVMe, SAS, and SATA drives
- Advanced remote management capabilities with iRMC S5
- Comprehensive security features with Trusted Platform Module (TPM) 2.0
- Energy-efficient design with 80 PLUS Platinum certified power supplies