648-Port InfiniBand FDR SwitchX® Switch Platform Hardware User

648-Port InfiniBand FDR SwitchX®
Switch Platform Hardware User Manual
PN:MSX6536-10R,MSX6536-NR
Rev 1.7
www.mellanox.com
2
Mellanox Technologies
Document Number: 3490
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Table of Contents
List of Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Chapter 1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
1.1 Product Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
1.1.1 Serial Number and Product Version Information . . . . . . . . . . . . . . . . . . . 12
1.1.2 Management Module MAC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
1.1.3 Product Physical Specifications and Power . . . . . . . . . . . . . . . . . . . . . . . 13
1.2 Features List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
1.3 InfiniBand FDR and FDR10 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
1.4 Power Supply Redundancy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
1.4.1 1000W Power Supply Units . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
1.4.2 1600W Power Supply Units . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Chapter 2 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
2.1
2.2
2.3
2.4
2.5
2.6
2.7
Installation Safety Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Environmental and Safety Recommendations. . . . . . . . . . . . . . . . . . . . .
Chassis Package Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Leaf Package Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Spine Package Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Management Package Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Physical Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
18
23
23
24
24
24
24
2.7.1
2.7.2
2.7.3
2.7.4
2.7.5
25
26
26
43
44
Starting with the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
ESD Connection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Installation Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Installing the Cable Holder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Ground Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.8 Power Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
2.8.1 Powering Up the Switch Platform. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
2.9 InfiniBand QSFP Cable Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
2.9.1 Supported Approved Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
2.9.2 Cable Power Classes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
2.10 Hot Swap Insertion and Extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
2.10.1 Power Supply Units . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.10.2 Leaf Boards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.10.3 Spine Boards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.10.4 Fan Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.10.5 Management Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.10.6 Switch Shut-Down Procedures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
48
50
54
58
61
64
Chapter 3 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
3.1 LED Status Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
3.1.1 Power Supply Unit LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
3.1.2 Leaf Board LED Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Mellanox Technologies
3
InfiniBand FDR Switch Platform Hardware User Manual
3.1.3
3.1.4
3.1.5
3.1.6
Spine Board LED Indicators. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Spine Side Panel Display LED Indicators . . . . . . . . . . . . . . . . . . . . . . . .
Management Module LED Indicators. . . . . . . . . . . . . . . . . . . . . . . . . . . .
Port Connector Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Rev 1.7
68
70
71
73
3.2 Air Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
3.3 QSFP Cable Power Budget Classification. . . . . . . . . . . . . . . . . . . . . . . . 74
3.4 Management Module Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
3.4.1
3.4.2
3.4.3
3.4.4
3.4.5
I2C . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
CONSOLE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
MGT– Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
USB . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Reset – RST. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
74
74
75
75
75
Chapter 4 Chassis Power Up. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
4.1 Power Supply and Spine Board Indicator Status at Power ON . . . . . . . . 77
Chapter 5 Switch Management Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
5.1
5.2
5.3
5.4
InfiniBand Subnet Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Fabric Inspector (Diagnostics) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Accessing the CPU via the Ethernet Connector . . . . . . . . . . . . . . . . . . .
Upgrading Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
79
79
79
79
Chapter 6 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
6.1
6.2
6.3
6.4
6.5
Power Supply Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Leaf Board . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Management Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Spine Board . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
MLNX-OS® Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
80
80
81
82
82
Chapter 7 Disassembly and Disposal. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
7.1 Disassembling the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
7.1.1 Removing the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
7.1.2 Removing the Bottom Shelf . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
7.2 Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88
Appendix A Specification Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
A.1
A.2
A.3
Appendix B
Appendix C
Appendix D
Appendix E
Appendix F
Appendix G
EMI Certification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Approved Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
EMC Certifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Thermal Threshold Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Calculating the Weight of a Customized Chassis . . . . . . . . . . . . 94
Calculating the Power of a Chassis . . . . . . . . . . . . . . . . . . . . . . . 95
QSFP Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
Replacement Parts Ordering Numbers . . . . . . . . . . . . . . . . . . . . . 98
Installation Safety Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
G.1
G.2
G.3
G.4
G.5
G.6
G.7
Mellanox Technologies
Installation Safety Warnings (English) . . . . . . . . . . . . . . . . . . . . . . . 100
⸘孬⸘⏷㊶巵⛙ (Chinese) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Avertissements de sécurité pour l'installation (French). . . . . . . . . . . 110
Installation Sicherheitshinweise(German). . . . . . . . . . . . . . . . . . . . . 114
Advertencias de seguridad de instalación (Spanish) . . . . . . . . . . . . 118
Предупреждения по технике безопасности при установке (Russian) 123
Avertismente privind siguranţa la instalare (Romanian) . . . . . . . . . . 127
4
InfiniBand FDR Switch Platform Hardware User Manual
G.8
Mellanox Technologies
Rev 1.7
Sigurnosna upozorenja za instaliranje (Croatian) . . . . . . . . . . . . . . . 131
5
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
List of Tables
Table 1:
Revision History of this User’s Manual. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Table 2:
Reference Documents and Websites. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Table 3:
OPNs for Power Supply Units . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Table 4:
Leaf Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Table 5:
Bad Port LED Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Table 6:
Connector Physical and Logical Link Indications . . . . . . . . . . . . . . . . . . . . . . . . 67
Table 7:
Spine Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Table 8:
Spine Fan Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Table 9:
Spine to Leaf IB Link Status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Table 10: Bad Port LED Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Table 11: LEDs Display for Normal Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Table 12: LEDs Display for Normal Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Table 13:
Management Module PSU LED Configurations . . . . . . . . . . . . . . . . . . . . . . . . 72
Table 14:
Management Module S.Fan LED Configurations . . . . . . . . . . . . . . . . . . . . . . . 73
Table 15:
Management Module L.Fan LED Configurations . . . . . . . . . . . . . . . . . . . . . . . 73
Table 16:
Management Module MASTER LED Configurations . . . . . . . . . . . . . . . . . . . . 73
Table 17: Switch Specification SX6536[FT]-[10R, NR] . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
Table 18: Power Consumption of Chassis Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
Table 19: InfiniBand QSFP Connector Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
Table 20: Replacement Parts Ordering Numbers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Mellanox Technologies
6
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
List of Figures
Figure 1: Product Label . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Figure 2: Product Label Tab Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Figure 3: Management Module MAC Address Location . . . . . . . . . . . . . . . . . . . . . . . . . 13
Figure 4: SX6536 Switch Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Figure 5: Distance Between the Vertical Supports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
Figure 6: Installation Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Figure 7: Shock and Tilt Stickers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Figure 8: Container Screws . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Figure 9: Vertical Rack Supports Dimension . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Figure 10: Placement of Chassis in Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Figure 11: Adjustable Shelf Brackets
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Figure 12: Placing the Shelf Bracket . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Figure 13: Caged Nut Locations for the Shelf Brackets . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Figure 14: Shelf Brackets
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Figure 15: U Numbering Above Shelf . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Figure 16: Putting the Chassis in the Rack Using a Fork Lift . . . . . . . . . . . . . . . . . . . . . . . 35
Figure 17: Putting the Chassis in the Rack Using a Mechanical Lift . . . . . . . . . . . . . . . . . 35
Figure 18: Place the Upper Bracket Offset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Figure 19: Attach the Shelf Extension . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Figure 20: Place Caged Nuts
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Figure 21: Location for the Lock-Down Bar . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Figure 22: Fork Lift . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Figure 23: Mechanical Lift . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Figure 24: Face Plate Mounting Bolt Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Figure 25: Upper Bracket Installation
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Figure 26: Upper Brackets and Offset Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Figure 27: Offset to Upper Bracket Bolts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Figure 28: Location for the Lock-Down Bar . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Figure 29: Lock-Down Bar . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Figure 30: Lock-Down Bars Bolt and Washer Order . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Figure 31: Spine Side with Filler Panels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Figure 32: Cable Holder
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Figure 33: Ground Connection
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
Figure 34: Multiple Power Inlets – Electric Caution Notification . . . . . . . . . . . . . . . . . . . . . 45
Figure 35: Spine Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Figure 36: Power Cord Numbering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Figure 37: PSU and Outlet Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Mellanox Technologies
7
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 38: Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Figure 39: Leaf Board Numbering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Figure 40: Ejector Handle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Figure 41: Leaf Release . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Figure 42: Intact vs Defected Signal Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Figure 43: Intact vs Defected Power Pin Holders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Figure 44: Management Module Numbering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Figure 45: Spine Board Extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Figure 46: Intact vs Defected Mechanics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Figure 47: Intact vs Defected Side Signal Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Figure 48: Intact vs Defected Middle Signal Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Figure 49: Intact vs Defected Power Pin Holders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Figure 50: Spine Board Insertion Caution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Figure 51: Leaf Fan Locations on the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Figure 52: Leaf Fan Module Extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Figure 53: Spine Fan Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Figure 54: Fan Status LED on the Spine Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Figure 55: Management Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Figure 56: Intact vs Defected Signal Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Figure 57: Intact vs Defected Power Pin Holders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Figure 58: Power Supply Unit Status Indications
Figure 59: PSU Cover On and Off
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Figure 60: Leaf Board Led Indicators
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Figure 61: Spine Status LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Figure 62: Spine Side Panel Display Status Indications . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Figure 63: Management Module Status Indications
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Figure 64: Management Module LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Figure 65: Port Numbering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Figure 66: Top and Bottom Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Figure 67: Management Module Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Figure 68: Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Figure 69: Spine Side Panel Display Status Indications . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Figure 70: Management Module Status Indications for Normal Operation . . . . . . . . . . . . . 77
Figure 71: Lock-down Bar . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
Figure 72: Face Plate Mounting Bolt Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
Figure 73: Mechanical Lifting Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Figure 74: InfiniBand QSFP Connector Symbol . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Figure 75: QSFP Connector Male and Female Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Mellanox Technologies
8
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Revision History
Table 1 - Revision History of this User’s Manual
Revision
1.7
Date
Details
January 2014 Rearranged document: Consolidated installation sections under
Chapter 2, “Installation,” on page 18; updated Chapter 1, “Overview,”
on page 12; and re-ordered sections).
Added:
•
Figure 64, “Management Module LEDs,” on page 72
Updated:
•
•
•
•
•
•
•
•
•
•
•
Section 1.4, “Power Supply Redundancy,” on page 15
Figure 6, “Installation Kit Parts,” on page 27
Section 2.7.3.5, “Installing the Shelf,” on page 30
Section 2.7.3.6, “Inserting the Chassis,” on page 35
Section 2.7.4, “Installing the Cable Holder,” on page 43
FDR note in Section 2.9, “InfiniBand QSFP Cable Installation,” on
page 46
Section 2.10, “Hot Swap Insertion and Extraction,” on page 47
Section 7.1, “Disassembling the Chassis,” on page 84
Table 17, “Switch Specification SX6536[FT]-[10R, NR],” on page 89
Appendix D, “Calculating the Power of a Chassis,” on page 95
Appendix G, “Installation Safety Warnings,” on page 100
Replaced Visio drawings with mechanical drawings.
Added note to insert spines from the bottom up.
Added Figure 2.7.5
1.6
November
2012
•
•
•
1.5
July 2012
Fixed broken link.
1.4
July 2012
•
•
•
•
•
•
•
•
Added explanation to N+2 Power Numbers. Updated power numbers.
Added EMI explanation to Appendix.
PCN change to power cord.
Added second version of lift tool.
On page 54 added instructions to use the socket wrench to tighten the upper
bracket.
On page 69 Section 5.3 added Note.
Page 70 added notes and warnings.
On page 72 Section 5.4 added note.
1.3
January 2012 Explained minimum number of PSUs for N+1 and N+N.
1.2
January 2012 •
•
•
•
1.1
January 2012 •
•
•
1.0
Mellanox Technologies
July 2011
Added Shock and Tilt sticker section.
More detailed explanation of N+N and N+1 redundancy
Added supported cables section.
Added N+N Power supply.
Added Appendix Thermal Definitions.
Changed Spec sheet format.
Explained spine hot swapping complications regarding spine #1 and spine
#2.
Initial Release
9
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
About this Manual
This manual provides an overview of the SwitchX® based SX6536 modular InfiniBand
chassis switch, and guidelines for its operation.
Intended Audience
This manual is intended for users and system administrators responsible for installing
and setting up the chassis platform.
The manual assumes familiarity with the InfiniBand® architecture specification.
Related Documentation
The documentation set accompanying the QSFP Chassis InfiniBand Switch platform
includes the following:
Table 2 - Reference Documents and Websites
Document Name
Description
InfiniBand Architecture Specification, Vol. 1, Release 1.2.1
The InfiniBand Architecture Specification that is provided by
IBTA
Switch Product Release Notes
For possible hardware issues see the switch support product
page. This requires a customer support login. Look up the relevant SwitchX®-based switch system/series release note file.
Mellanox MLNX-OS® SwitchX®
Software User Manual
This document contains information regarding configuring and
managing Mellanox Technologies' SwitchX® Switch Platforms.
MLNX-OS® Software Command Ref- Command Reference Guide for MLNX-OS listing all of the
erence Guide
commands available through MLNX-OS with explanations and
examples.
Conventions
Throughout this manual, the name SX6536 and the terms chassis and switch are used to
describe the 648 port QSFP InfiniBand chassis, unless explicitly indicated otherwise.
The following icons are used throughout this document to indicate information that is
important to the user.
This symbol makes recommendations to the user.
This symbol indicates information that is helpful to the user.
Mellanox Technologies
10
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
This symbol indicates a situation that can potentially cause damage to hardware or
software.
Warning! This symbol indicates a situation that can potentially cause personal injury
and / or damage to hardware or software.
Mellanox Part Numbering Legend
Place
Field
M
Decoder
Mellanox Technologies
SX
System Type
SwitchX® Switch
PR
Data Transfer Protocol
(1, 2, 3, 4) = Ethernet (5, 6, 7, 8) = InfiniBand
G
Module Generation
5, 6, 7, 8
FF
Number of leafs
36, 18, 12, 06
C
Data Rate
B = 40Gb/s Ethernet
F = FDR, T = FDR10, Q = QDR, D = DDR
-
Separator
P
# Power Supplies
N = N+N redundant
1=1PSU, 2=2PSUs, ...
R
Chip Generation
R – SwitchX®
S – SwitchX®-2
Mellanox Technologies
11
InfiniBand FDR Switch Platform Hardware User Manual
1
Rev 1.7
Overview
This User Manual provides an overview of the SX6536 QSFP Modular InfiniBand
Switch Platform (known in this document as ‘the chassis or switch’) and its operational
environment.
Mellanox SX6536 switch systems provide the highest performing fabric solution by
delivering high bandwidth and low latency to Enterprise Data Centers (EDC), High-Performance Computing (HPC) and Embedded environments. Networks built with the
SX6536 system can carry converged traffic with the combination of assured bandwidth
and granular quality of service. Built with Mellanox’s 5th generation SwitchX® VPI
switch device, SX6536 systems provide up to 56Gb/s full bidirectional bandwidth per
port. With up to 648 ports in a 31U rack space, these systems are among the densest
switching systems available.
The switch platform comes pre-installed with all necessary firmware for standard operation within an InfiniBand fabric and requires an InfiniBand compliant Subnet Manager
running from one of the hosts or the management module of the switch system. The initial configuration procedure should be followed to initialize the switch before connecting
it to the network after which normal operation can proceed. (See the installation guide
for details regarding the initial configuration.) Once connected to the network, the Subnet Management software automatically discovers and configures the fabric and begins
utilizing the switch.
The Mellanox Operating System (MLNX-OS®) software package provides a subnet
manager and network management tools as well as connectivity software for servers and
storage, and is available on the Mellanox web site.
Basic installation is covered in Chapter 2, “Installation” on page 18.
Hot-swapping components and hardware maintenance is covered in Chapter 2.10, “Hot
Swap Insertion and Extraction” on page 47.
1.1
Product Information
1.1.1
Serial Number and Product Version Information
The serial number, GUID identifier and product version information are found on the
label attached to the pull-out tab below the Mellanox logo on the spine side of the chassis.
Figure 1: Product Label
Mellanox Technologies
12
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
The GUID is the System Image GUID according to the IB spec. It is burned on the board
which is in the chassis. All the boards and the management software look for this GUID
in addition to their own Node GUID.
Figure 2: Product Label Tab Location
Here is the tab with
the product label
1.1.2
Management Module MAC
Each management module has a label with its MAC address. See Figure 3 for the location of this label.
Figure 3: Management Module MAC Address Location
MAC address location
1.1.3
Product Physical Specifications and Power
The switch itself is 29U tall but requires an extra 2U for installing the shelf.
The switch ships in a minimum base configuration plus additional modules depending on
the chosen customer configuration. Optional modules included:
•
Leaf boards
•
Management modules
•
Spine boards
Mellanox Technologies
13
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
The following figure shows the connector and spine sides fully populated.
Figure 4: SX6536 Switch Views
Leaf fan module with four
internal fans.
Two management modules.
Leafs
Each leaf has 18 ports and up to 36
leafs can fit in the chassis.
Spines
Power supply
units
Up to 10 power supply units
18 spine modules
Four leaf fan modules on each side
of the chassis.
36 leaf modules
2 management modules
Mellanox Technologies
14
InfiniBand FDR Switch Platform Hardware User Manual
1.2
Rev 1.7
Features List
•
648 FDR (56Gb/s) InfiniBand ports in a 29U switch
•
72.52 Tb/s aggregate data switching capacity with ultra low latency
•
IBTA 1.3 and 1.2.1 compliant
•
SDR/DDR/QDR/FDR10/FDR link speed
•
N+N power supply
•
Congestion control 1
• Adaptive routing1
1.3
•
Port mirroring1
•
Chassis High Availability
•
sMB High Availability
InfiniBand FDR and FDR10 Overview
The Mellanox SX6536 switch system supports FDR, standard InfiniBand data rate,
where each lane of a 4X port runs a bit rate of 14.0625Gb/s with a 64b/66b encoding,
resulting in an effective bandwidth of 54.54Gb/s. The FDR physical layer is an IBTA
specified physical layer using different block types, deskew mechanism and framing
rules.
The SX6536 switch also supports FDR10, a non-standard InfiniBand data rate, where
each lane of a 4X port runs a bit rate of 10.3125Gb/s with a 64b/66b encoding, resulting
in an effective bandwidth of 40Gb/s.
FDR10 supports 20% more bandwidth over regular QDR using the same QSFP cables/
connectors.
Both FDR and FDR10 support Forward Error Correction (FEC), as described in IEEE
Std 802.3ap-2007 (Amendment to IEEE Std 802.3-2005) chapter 74.
FDR and FDR10 are only guaranteed to work with approved Mellanox cables.
FDR10 is only guaranteed to work with approved Mellanox ConnectX-3 adapters.
1.4
Power Supply Redundancy
The SX6536 platform comes standard with ten power supplies and has two order
options:
•
SX6536-10R - N+1 redundancy
•
SX6536-NR - N+N redundancy
1. Features for a future release.
Mellanox Technologies
15
InfiniBand FDR Switch Platform Hardware User Manual
1.4.1
Rev 1.7
1000W Power Supply Units
The 1000W power supply units (PSUs) deliver 1000W at 48V. The AC source to each
PSU must be able to provide 1176.5W in order to output 1000W in DC.
With 1000W PSUs the only redundancy option is N+2. In this configuration 2 PSUs can
be extracted without bringing down the system. When using the 1000W PSUs, the minimum complement of PSUs at start-up is 10 and the chassis will continue to run at full
capacity with only 8 PSUs.
1.4.2
1600W Power Supply Units
The 1600W power supply units (PSUs) deliver 1600W at 48V. The AC source to each
PSU must be able to provide 1882.4W in order to output 1600W in DC.
When using the 1600W PSUs, the minimum complement of PSUs which allows the
chassis to run at full capacity is 5.
The 1600W PSUs can implement the following two redundancy options:
•
N+1 configuration
The chassis when supplied by a single power grid can be configured for N+1 times 5. This
means that all PSUs are supplied from a single power source usually the commercial electric
grid. This enables 5 power supply redundancy.
•
N+N configuration
N+N redundancy ONLY works with a supply voltage of 220V.
The chassis PSUs are fed by two power grids for high availability. The second power grid
must be supplied by any of the following:
• a backup power supply grid
• a generator
• a battery backup system
• any combination of the above
Connecting 5 power supplies to one power supply grid and the remaining 5 power supplies to
a secondary power supply grid will create N+N redundancy. This is High Availability. Under
these conditions should a power supply fail (an electric company power failure or blackout
for example) power grid High Availability will continue to keep the chassis running at full
capacity through the secondary or backup power supply grid.
With N+N optional PSU grid redundancy the chassis can run on 1/2 of the full complement of
PSUs. N+N allows the chassis to run on 5 PSUs supplied from one power grid while 5 are
connected to a second power grid.
With power grid A charged with current and power grid B not charged there is only
grid redundancy and not PSU redundancy.
MLNX-OS® may power down some leafs. If this happens it may be necessary to reboot
the chassis once the defective PSU has been replaced. Two simple ways to reboot is to
use the reboot command in the CLI or reboot through the WebUI.
Mellanox Technologies
16
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
The form is identical between the two PSU types while the 1000W PSU weighs 0.3kg
more than the 1600W PSU.
Table 3 - OPNs for Power Supply Units
OPN
PSU
Wattage
Description
MTP005001
1000W
Supplies N+1 redundancy
MTP006002
1600W
Supplies N+N redundancy for all switch chassis at 220 Volts
Mellanox Technologies
17
InfiniBand FDR Switch Platform Hardware User Manual
2
Rev 1.7
Installation
This chassis can be installed in standard 19” racks that have depths between 65cm and
80cm between the vertical supports of the rack.
Installation and initialization of the chassis is a simple process requiring attention to the
normal mechanical, power, and thermal precautions for rack-mounted equipment. Your
chassis comes only with the power supplies and fans pre-installed. The rest of the openings are populated with blanks. All of the leafs, spines, and management modules come
shipped in a separate package.
The chassis requires initial configuration to get the chassis and Fabric management up
and running through remote management. See the Installation Guide that is packed in the
box for the instructions to make the initial configuration.
This unit is intended for installation in a Restricted Access Location. A restricted
access area can be accessed only through the use of a special tool, lock and key, or
other means of security.
2.1
Installation Safety Warnings
These safety warnings are in English. For French, German, Spanish, Russian, and Romanian see the Appendixes.
1. Installation Instructions
Read all installation instructions before connecting the equipment to the power source.
2. Bodily Injury Due to Weight
Use enough people to safely lift this product.
Mellanox Technologies
18
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
3. Heavy Equipment
This equipment is very heavy and should be moved using a mechanical lift to avoid
injuries.
4. Installation in Restricted Access Location
This unit is intended for installation in a Restricted Access Location.
5. Risk of Electric Shock!
Risk of Electric Shock!
With the fan module removed power pins are accessible within the module cavity.
DO NOT insert tools or body parts into the fan module cavity.
6. Over-temperature
This equipment should not be operated in an area with an ambient temperature exceeding the maximum recommended: 45°C (113°F). Moreover, to guarantee proper air
flow, allow at least 8cm (3 inches) of clearance around the ventilation openings.
7. Stacking the Chassis
The chassis should not be stacked on any other equipment. If the chassis falls, it can
cause bodily injury and equipment damage.
8. Redundant Power Supply Connection - Electrical Hazard
This product includes a redundant power or a blank in its place. In case of a blank
power supply, do not operate the product with the blank cover removed or not securely
fastened.
9. Double Pole/Neutral Fusing
This system has double pole/neutral fusing. Remove all power cords before opening
the cover of this product or touching any internal parts.
Mellanox Technologies
19
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
10. Multiple Power Inlets ,
Risk of electric shock and energy hazard.
The PSUs are all independent.
Disconnect all power supplies to ensure a powered down state inside of the switch
platform.
11. During Lightning - Electrical Hazard
During periods of lightning activity, do not work on the equipment or connect or disconnect cables.
12. Copper InfiniBand Cable Connecting/Disconnecting
Copper InfiniBand cables are heavy and not flexible, as such they should be carefully
attached to or detached from the connectors. Refer to the cable manufacturer for special warnings/instructions.
13. Rack Mounting and Servicing
When this product is mounted or serviced in a rack, special precautions must be taken
to ensure that the system remains stable. In general you should fill the rack with equipment starting from the bottom to the top.
14. Equipment Installation
This equipment should be installed, replaced, and/or serviced only by trained and qualified personnel.
15. Equipment Disposal
Disposal of this equipment should be in accordance to all national laws and regulations.
16. Local and National Electrical Codes
This equipment should be installed in compliance with local and national electrical
codes.
Mellanox Technologies
20
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
17. Installation Codes
This device must be installed according to the latest version of the country
national electrical codes. For North America, equipment must be installed in
accordance to the applicable requirements in the US National Electrical Code
and the Canadian Electrical Code.
18. Battery Replacement
Warning: Replace only with UL Recognized battery, certified for maximum
abnormal charging current not less than 4mA
There is a risk of explosion should the battery be replaced with a battery of an
incorrect type.
Dispose of used batteries according to the instructions.
19. UL Listed and CSA Certified Power Supply Cord
For North American power connection, select a power supply cord that is UL Listed
and CSA Certified, 3 - conductor, [16 AWG], terminated with a molded plug rated at
125 V, [13 A], with a minimum length of 1.5m [six feet] but no longer than 4.5m.
For European connection, select a power supply cord that is internationally
harmonized and marked “<HAR>”, 3 - conductor, minimum 1.0 mm2 wire,
rated at 300 V, with a PVC insulated jacket. The cord must have a molded plug
rated at 250 V, 10 A.
20. High Leakage Current
Warning: High leakage current; Earth connection essential before connecting supply.
21. Add GND connection information
Before connecting this device to the power line, the protective earth terminal screws of
this device must be connected to the protective earth in the building installation.
(GND Connection Information):
The building installation shall provide a means for a connection to protective earth;
and the equipment shall be permanently connected to that by a service person.
A SERVICE PERSON shall check whether or not the socket - outlet from which the
equipment is to be powered provides a connection to the building protective earth. If
not, the SERVICE PERSON shall arrange for the installation of a PROTECTIVE
EARTHING CONDUCTOR from the separate protective earthing terminal to the protective earth wire in the building. The equipment shall be installed in area where equipotential bonding exists ((such as a telecommunication centre or a dedicated computer
room).
22. Installation codes
This device must be installed according to the latest version of the country national
electrical codes. For North America, equipment must be installed in accordance to the
applicable requirements in the US National Electrical Code and the Canadian Electrical Code.
Mellanox Technologies
21
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
23. Interconnection Of Units
Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL
certified type DP-1 or DP-2. (Note- when residing in non LPS circuit)
Overcurrent Protection: A readily accessible Listed branch circuit overcurrent
protective device rated 20 A must be incorporated in the building wiring.
24. Hazardous Radiation Exposure
Caution – Use of controls or adjustment or performance of procedures other
than those specified herein may result in hazardous radiation exposure.
CLASS 1 LASER PRODUCT and reference to the most recent laser standards
IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+
A2:2001
25. Proper Enclosure
A suitable electrical, mechanical and fire enclosure shall be provided by the end product manufacturer and or the end user.
26. Do Not Use the Switch as a Shelf or Work Space
Caution: Slide/rail mounted equipment is not to be used as a shelf or a work space. The
rails are not intended for sliding the unit away from the rack. It is for permanent installation at final resting place only, not used for service and maintenance
27. WEEE Directive
According to the WEEE Directive 2002/96/EC, all waste electrical and electronic
equipment (EEE) should be collected separately and not disposed of with regular
household waste.
Dispose of this product and all of its parts in a responsible and environmentally
friendly way.
28. Country of Norway Power Restrictions
This unit is intended for connection to a TN power system and an IT power system of
Norway only.
Mellanox Technologies
22
InfiniBand FDR Switch Platform Hardware User Manual
2.2
Rev 1.7
Environmental and Safety Recommendations
The following are Mellanox recommendations.
Recommended ambient temperature in the System room is 20o ± 5o C.
Recommended humidity range is 40% ± 15% without condensing.
It is highly recommended that the installation sites be as isolated as possible from all
sources of radio transmissions and electrical interference.
It is highly recommended that the installation site building be equipped with a lightning rod.
It is highly recommended that the installation site be equipped with smoke detectors
and a fire alarm warning system.
The system requires a KVA rated UPS system. It is recommended that a UPS system
be installed to protect the equipment in the event of unexpected power failure.
Make sure that the outlets and circuits will not be overloaded. Spread out the load over
at least two or three circuits or use a 3 phase circuit.
2.3
Chassis Package Contents
The package includes:
•
1 chassis with the following modules installed:
• 8 fans
• 10 PSUs
•
1 installation guide
•
1 box containing various other parts
•
1 installation kit box
•
1 box containing 10 power cords 250v 15a 2.0M, C14 to C13, USA UL Standard
•
1 cable management kit
Mellanox Technologies
23
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Before you install your new SX6536 series chassis, unpack the system and check to
make sure that all the parts have been sent, check this against the parts list. Check the
parts for visible damage that may have occurred during shipping.
If anything is damaged or missing, contact your customer representative immediately.
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Guarantee proper ventilation, by leaving 8cm (3”) of space to the front and rear of the switch.
This will ensure proper air flow through the chassis. This is crucial for maintaining
good airflow at ambient temperature. In particular, route cables such that they do not
impede the air into or out of the chassis.
2.4
Leaf Package Contents
The leafs are ordered by the customer and are shipped 4 to a box. The customer will
receive as many boxes as needed to fill the order.
2.5
Spine Package Contents
The spines are shipped 3 to a box. The customer will receive as many boxes as needed to
fill the chassis with a full complement of spines.
Insert the bottom spine board first.
2.6
Management Package Contents
The package includes:
2.7
•
all of the management modules ordered by the customer
•
1 RJ45 to DB9 harness for each management module received
Physical Installation
Warning: This equipment is very heavy. Safety is the first concern. Make sure that
adequate manpower and proper equipment is used for transporting and moving the
chassis.
The fully loaded chassis weighs:
327.15kg (721.24 LBS.) full configuration
128.97kg (284.33 LBS.) empty configuration
157.57kg (347 LBS.) shipped configuration
The switch platform uses 31U of rack space in a standard 19” rack, 29U for the chassis
and 2U for the shelf. The switch ships from the factory with mounting holes on the spine
side. There are upper brackets to connect the leaf side to the rack near the top of the chassis, and there are two lock-down bars to secure the chassis to the shelf. The weight of the
switch is supported from underneath the unit by the shelf.
Mellanox Technologies
24
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
This chassis can be installed in standard 19” racks that have between 65cm and 80cm
between the vertical supports of the rack. Make sure that a fully populated rack including
cables will have sufficient air flow for cooling.
Choose a rack which is able to support the mechanical and environmental characteristics of a fully populated switch chassis.
2.7.1
Starting with the Rack
2.7.1.1 Rack Recommendation
Due to the space required by up to 648 connector cables Mellanox recommends a rack
that is 120 cm long and 80cm wide. This will allow for proper cable management and
enough ventilation to properly cool the chassis.
2.7.1.2 Preparing the Rack
The rack may need to be modified to accommodate the SX6536 chassis. The distance
between the vertical supports must be between 65 and 80cm.
Figure 5: Distance Between the Vertical Supports
Vertical
supports
Between 65 and 80 cm.
This edge of the
shelf must be as
close as possible to
the inside of the
door when closed.
The vertical supports may have to be moved so that the vertical support closest to the
door is a minimum of 6 cm from the inside of the door. This is required so that the shelf
will not hit the door.
If you move the vertical supports make sure that you reinstall them vertically
plumb.
Mellanox Technologies
25
InfiniBand FDR Switch Platform Hardware User Manual
2.7.2
Rev 1.7
ESD Connection
Before starting any procedure on the SX6536 switch system:
1. Put an ESD prevention wrist strap on your wrist, and make sure there is good contact
between your body and the strap.
2. Plug the other end of the wrist strap to a valid ground. Make sure that this is a tight
fit.
2.7.3
Installation Procedure
Installing the chassis will be a lot easier if you can remove the sides of the rack.
You will need a fork lift, to move and insert the chassis into the rack.
2.7.3.1 Requirements
You will need:
• #2 phillips screwdriver
• a fork lift
• measuring tape
• #3 phillips screwdriver
• a grounding lug
• ground wire of sufficient length and gauge to properly ground the
chassis
The installation will be much easier with a power screwdriver.
It is recommended to use AWG6 or 4mm diameter wire for grounding purposes.
It is recommended to have at least two people for the duration of the installation procedure. Use a mechanical lift to raise this chassis. If not, use enough manpower to ensure
the safety and wellbeing of all of the people involved in the installation.
2.7.3.2 Installation and Cable Management Kit Parts
•
Parts included in the installation kit:
- 1 shelf with brackets pre-installed
- 1 left side upper bracket offset
- 2 lock down bars
Mellanox Technologies
- 1 shelf extension
- 1 right side upper bracket offset
- 2 upper bracket washers
26
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
- 8 lock washers for the upper brackets to
vertical support
- 12 hex head bolts – 8 for the upper
brackets and 4 for the shelf extension
- 34 pan head screws for the caged nuts 20
for the shelf and 14 for the chassis faceplate and 6 for the filler panels
- 32 lock washers – 20 for the lock down
bars and 12 for the upper brackets to
upper bracket offsets
- 2 upper brackets
- 1 open end ratchet wrench 10mm
- 1 socket wrench
- 2 extensions for the socket driver
- 4 flat washers for the shelf extension
- Bottom filler panel
•
- 1 nut Size M-8 for ground post
- 34 caged nuts 20 for the shelf and 14 for the
chassis faceplate and 6 for the filler panels
- 32 hex head bolts – 20 for the lock down
bars and 12 for the upper brackets to upper
bracket offsets
- 12 flat head screws for the upper bracket
offsets
-
1 socket nut driver 8mm
1 socket nut driver 10mm
1 socket nut driver 14mm
1 box wrench
6 two hole lock washers for lock down bars
Top filler panel
Parts included in the cable management installation kit:
- 1 cable management rack RH
- 16 caged nuts M6
- 9 cable management shelves
- 1 cable management rack LH
- 16 M6 bolts
Figure 6: Installation Kit Parts
Shelf
Lock-down bar
Flat head screws with
locktite
#6 hex head bolt
Shelf extension
Phillips pan head
screw
#8 hex head bolt
Upper bracket
washer
Caged nuts
Lock washers
Lock washers
Flat washers
Upper bracket
Flat washers
Upper bracket offset
2.7.3.3 Container Mishandling
The container has shock and tilt stickers applied. These will turn red if the container has
been mishandled or roughly handled. Upon receipt of the container look for and inspect
the shock and tilt stickers to confirm that they have not tripped. If one or more are red
Mellanox Technologies
27
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
notify the shipper and Mellanox. This on its own does not indicate damage to the contents. But, be sure to carefully inspect the contents if any of the shock and tilt stickers
have tripped.
Figure 7: Shock and Tilt Stickers
Stickers unaffected by
shipping
Stickers showing excessive
shock or tilt.
Mellanox Technologies
28
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
2.7.3.4 Opening the Container
1. Before starting the procedure, put the ESD strap on and connect it to a valid ground.
Figure 8: Container Screws
Container screws
It is highly recommended to have a screw gun or electric screwdriver for this step.
2. Remove the four sides of the container by unscrewing the phillips head screws holding the sides on.
3. Remove and put aside the box.
4. Visually inspect the chassis, make sure that:
• there is no visible damage
• 10 PSUs are installed for the chassis
• all 8 fans are installed
5. Remove all protective plastic film from all sides and top of the chassis.
The leafs, spines, and management modules are shipped separately.
Mellanox Technologies
29
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Do not remove any of the blocks or either of the lock-down bars at this time.
2.7.3.5 Installing the Shelf
The chassis is on ball bearings and can roll easily. Be aware that the chassis can roll off
of the pallet. Should the chassis start to fall, move out of the way. The chassis can
cause grave bodily harm should it fall on or near you.
1. Select the location in the rack. Try to keep the chassis as low as possible to keep the
center of gravity low.
It is recommended to set the top of the shelf at U5. Try and keep the chassis as low as
possible. Set the shelf from U3 to U5.
Placing the shelf too low may make it impossible to tighten the shelf brackets, in
step 11.
The maximum height that the chassis can be mounted, will be determined by the maximum height that the fork lift can raise the pallet.
2. Open the Installation kit and make sure that all of the parts are in the box. See
Figure 6,“Installation Kit Parts”.
The chassis should sit in the rack with the spine side as close as possible to the door. This
leaves maximum room for the cable management system.
The distance between the vertical supports must be between 65 cm(25.6”) and 80
cm(31.5”). If the distance in your rack is different, move the vertical supports so that
one pair is ~10 cm(4in.) away from the door.
The side of the chassis with the spine units will sit flush with the vertical supports of
the rack. The side of the chassis with the QSFP connectors will sit at the edge of the
shelf closer to the center of the rack.
Mellanox Technologies
30
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 9: Vertical Rack Supports Dimension
Vertical
supports
3. Decide which side of the rack you want the data connectors.
Figure 10: Placement of Chassis in Rack
You will most likely need extra room for cable bending on the connector side of the chassis
and should plan to keep the spine side as close to the rack door as possible, thus having more
room for the cables.
4. Measure the distance between the vertical supports and adjust the shelf brackets
according to this distance. This chassis can be installed in a rack with a distance
between the vertical supports of from 65cm(25.6in.) to 80cm(31.5in.).
Mellanox Technologies
31
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
5. The shelf comes with the four brackets pre-installed. Two of the brackets should be
loose. They may need to be removed and repositioned to meet the distance between
the vertical supports of the rack.
Figure 11: Adjustable Shelf Brackets
These two brackets
need to be adjusted.
They may even need
to be removed and
repositioned.
The holes in the bracket are
offset to one side.
The holes must be closer to
the top of the shelf.
6. Move the shelf brackets on the shelf. Place the shelf bracket so that it measures
slightly more than the measured distance between the vertical rack supports. Make
sure that there is enough play in the bracket so that it can move to the vertical support.
Do not tighten the hex head bolts.
You may need to remove the brackets and reinstall them.
Figure 12: Placing the Shelf Bracket
Adjusting slots
Mellanox Technologies
32
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 13: Caged Nut Locations for the Shelf Brackets
7. Insert five nuts into the rack for each of the four shelf brackets (the 2 brackets that
are adjustable and the 2 that are fixed). Make sure that the caged nuts are all at the
same height on the vertical supports. Do not use the top hole in the bracket.
8. Insert 4 caged nuts (two on right and 2 on the left of the spine side) for the bottom
filler panel.
9. Put the Shelf into the rack and twist the shelf into place. Make sure the spine side of
the shelf is closest to the rack doors. See Figure 14 to identify the spine side of the
shelf.
10. Install and tighten the 20 M6 bolts into the caged nuts.
Figure 14: Shelf Brackets
The spine
side of the
shelf has two
slots for the
extension
Adjustable
shelf brackets
11. Tighten the 16 hex head bolts on the adjustable brackets.
Mellanox Technologies
33
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 15: U Numbering Above Shelf
The first cage nut
on the spine side
goes here. The
rest of the caged
nuts go every 4 U
units up from
here.
12. Place 14 caged nuts into the vertical rack support at the locations corresponding to
the holes in the chassis faceplate. The holes in the faceplate start at 2U above the
shelf and are spaced every 4U centered as you go up the vertical rack support. There
are 7 holes on each side.
Mellanox Technologies
34
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
2.7.3.6 Inserting the Chassis
The chassis is on ball bearings and can roll easily. Be aware that the chassis can roll off
of the pallet. Should the chassis start to fall, move out of the way. The chassis can
cause grave bodily harm should it fall on or near you.
1. Put the container on the fork lift.
Figure 16: Putting the Chassis in the Rack Using a Fork Lift
The chassis is screwed down to the pallet on both the spine side and the leaf side.
Figure 17: Putting the Chassis in the Rack Using a Mechanical Lift
Mellanox Technologies
35
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 18: Place the Upper Bracket Offset
2. Screw on the two Upper Bracket offsets onto the chassis using six flat head screws
for each offset.
Figure 19: Attach the Shelf Extension
Mellanox Technologies
36
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
3. Screw on the shelf extension using four bolts with flat washers.
Figure 20: Place Caged Nuts
Place 8 caged nuts
between here and
here for the cable
holders
Top of shelf
4. If you are installing the cable management system, place 14 caged nuts on the other
side of the rack in the vertical supports.
Figure 21: Location for the Lock-Down Bar
Bottom of
the chassis
5. Unscrew both lock-down bars.
With both lock-down bars removed the chassis can roll! Be very careful that the chassis
does not roll off of the pallet.
6. Place the chassis in front of the rack and as close as possible to the rack.
Figure 22: Fork Lift
Container floor
Hinged extension
Mellanox Technologies
37
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 23: Mechanical Lift
7. Raise the chassis so that it is ~5cm above the shelf in the rack.
8. Raise the hinged extension on the container floor.
9. Lower the chassis until the hinged extension is sitting on the shelf extension.
10. Push the chassis from the container to the shelf.
Save the container pallet to remove this chassis. It will be necessary for the removal
and disposal procedures.
Mellanox Technologies
38
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 24: Face Plate Mounting Bolt Locations
Holes in the
faceplate for
mounting on
the rack.
The holes are
separated by
4U units.
11. Slide the chassis onto the shelf and determine the location of the upper brackets, on
the vertical supports on the connector side of the chassis.
Do not move the forklift away from the rack just yet.
12. Confirm that the caged nuts for the faceplate are in the correct location.
13. Slide the chassis out just far enough to install the upper brackets. See Figure 25.
Mellanox Technologies
39
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 25: Upper Bracket Installation
117cm from
the shelf to
this hole.
Use the
socket
wrench with
both
extensions to
tighten these
bolts.
Figure 26: Upper Brackets and Offset Location
14. Screw the upper brackets onto the vertical supports and tighten in place. See
Figure 26. You will need the socket wrench with both extensions to tighten these
bolts.
15. Slide the chassis onto the shelf until the face plate of the chassis touches the vertical
rack support.
16. Make sure the upper brackets are installed in their correct location.
17. Screw the 14 bolts through the faceplate into the caged nuts, DO NOT TIGHTEN.
Figure 27: Offset to Upper Bracket Bolts
Mellanox Technologies
40
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
18. For each offset and upper bracket, screw six bolts through the offset into the upper
bracket. See Figure 27. Use one flat washer and one lock washer for each of these
bolts. DO NOT TIGHTEN.
Figure 28: Location for the Lock-Down Bar
Bottom of
the chassis
Figure 29: Lock-Down Bar
These holes are
to screw the bar
into the Chassis
These holes are to screw
the bar into the shelf
19. Place the front lock-down bar at the edge of the chassis and align the holes in the
lock-down bar with the holes in the shelf. Screw down the lock-down bar. You will
need the 10 hex head screws and washers for each lock down bar. DO NOT
TIGHTEN
20. Screw down the second lock-down bar.
Figure 30: Lock-Down Bars Bolt and Washer Order
Mellanox Technologies
41
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
21. Remove the shelf extension and save for removal of the chassis.
22. Connect a valid ground, See Section 2.7.5, “Ground Connections,” on page 44, for
detailed instructions.
23. Tighten the faceplate screws. See Figure 24 on page 39.
24. Tighten the upper bracket to upper bracket offset screws. See Figure 27.
25. Tighten the lock down bars. See Figure 30.
26. Connect the bottom filler panel below the shelf, bend facing out.
27. Connect the top filler panel directly above the top of the chassis.
Figure 31: Spine Side with Filler Panels
28. Go to Chapter 4, “Chassis Power Up,” on page 76 to power up the switch system.
29. Insert 2 caged nuts for the filler panel.
Mellanox Technologies
42
InfiniBand FDR Switch Platform Hardware User Manual
2.7.4
Rev 1.7
Installing the Cable Holder
Now is the time to install the cable holder.
Figure 32: Cable Holder
Left side rack
Top side
16 X M6 caged nut
16 X M6 bolt for
caged nut
Cable support shelf
For each model of
chassis there is the
one support shelf for
every two leafs.
Mellanox Technologies
43
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
1. Place the cable holder next to the rack, on the connector side of the chassis, and identify the holes where the caged nuts were placed in step 4
The cable holders should go to the outside of the vertical supports.
2. Set the bottom of the cable holder at the level of the shelf.
If the cable holder is not set properly the upper bracket will not line up with the cable
holder.
3. Screw the cable holder onto the rack using the screws provided.
4. Repeat steps 1- 3 for the second cable holder.
5. Install the shelves. The cable support shelves just sit on the cable holders.
6. Use the holes in the shelves to tie down the cables individually or in bundles.
Use Velcro ties to tie down the cables. Electric cable ties are not recommended.
2.7.5
Ground Connections
Make sure to connect the ground post to a valid electrical ground. Use a grounding lug
and a ground wire of sufficient capacity to safely convey a potential discharge. The
grounding post is M-8 with 1.25mm pitch threads. A ground wire of AWG 6 or 4mm
diameter is recommended for grounding this device. The chassis is concurrently
grounded through each of the PSUs. Only connect the PSU cords to properly grounded
outlets. Do not rely on the PSU grounds. It is absolutely necessary to connect the grounding post. Make sure the connections are solid and permanent. If you choose to not use the
ground screw, make sure that the rack is properly grounded and that there is a valid
ground connection between the chassis of the switch and the rack. Test the ground using
an Ohm meter.
Figure 33: Ground Connection
Grounding post
2.8
Power Connections
The switch includes integrated hot-swap power supplies which support up to 10 loadsharing 1000W or 1600W supply units. The slots for the power supply units (PSUs) are
Mellanox Technologies
44
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
on the spine side. The left side has odd numbered PSUs and the right side has even numbered PSUs. Each PSU has a dedicated AC inlet. This design enables the optional use of
separate main and backup AC feeds. The input voltage is Autorange, 100-240 VAC,
50Hz or 60Hz. The output voltage for the PSUs is 48V. The power cords should be standard 3-wire AC power cords including a safety ground.
2.8.1
Powering Up the Switch Platform
Make sure that the power cords are compatible with your outlets. Power cords for different countries can be ordered from Mellanox.
The chassis in N+1 mode must be started with a full complement of PSUs, thereafter it
can run on one less than the total number of PSUs. This final PSU is redundant and
allows for hot swapping a PSU should one fail. Connecting the PSUs to different AC
lines provides AC failover protection.
When using the 1600W PSUs, the minimum complement of power supply units to start
the chassis is 5 and the chassis will continue to run at full capacity with only 5 PSUs.
The system should continue to run and allow a hot swap of a defective PSU. Should
there not be enough power to keep all of the leafs running, MLNX-OS® may power
down some leafs. If this happens it may be necessary to reboot the chassis once the
defective PSU has been replaced. Two simple ways to reboot is to use the reboot command in the CLI or reboot through the Web GUI.
The power system will divide the current consumption by the number of working PSUs.
Should one of the PSUs fail, the total current consumption will then be divided by the
remaining working PSUs. When the failed PSU is hot swapped the new PSU will ramp
up and pass its share of current, so that the total current is always divided by the number
of working PSUs.
1. Plug in the power cords to the PSUs.
2. Plug the other end of the power cords into grounded outlets.
Make sure that the outlets and circuits will not be overloaded. Spread out the load over
at least two or three circuits or use a 3 phase circuit.
Figure 34: Multiple Power Inlets – Electric Caution Notification
ACHTUNG
CAUTION
ATTENTION
Gafahr des elektrischen Schocks. Risque de choc et de danger
Risk of electric shock and
Entferrnen des Netzsteckers
energy hazard.
e’lectriques. Le de’branchment
elnes Netzteils spannungsfrei.
The PSUs are all independent.
d’une seule alimentation stabiUm alle Einhieten spannungsfrei lise’e ne de’branch uniquement
Disconnect all power supplies to zu machen sind die Netzstecker
qu’un module “Alimentation
aller Netzteile zu entfernen
ensure a powered down state
Stabilise’e”. Pour isoler cominside of the switch platform.
pletement le module en cause, Il
faut de’brancher toutes les alimentations stabilise’es.
Mellanox Technologies
45
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
3. Check the Status LEDs on all of the management modules and confirm that all of the
LEDs show status lights consistent with normal operation.
Any yellow or red status LEDs on any of the management modules is cause for concern and must be dealt with immediately.
4. Check that none of the LEDs on the spines are yellow.
It can take up to 5 minutes to boot up the system. Turn off the system if any LEDs
remain red for more than 5 minutes.
5. Check that the leaf status LEDs, fan status LED, and spine status LED in the spines
are all green.
The maximum number of connections from each leaf is 1. If the (number of leafs x the
maximum number of connections per leaf) is less than 36 then some of the leaf to spine
connection LEDs may be OFF.
Figure 35: Spine Module
Status, Fan, Bad Port and UID LEDs
2.9
Leaf connection LEDs
InfiniBand QSFP Cable Installation
The switch uses industry standard QSFP InfiniBand cables which are available from
Mellanox Technologies. The Mellanox proprietary QSFP cables support full 56+56Gb/s
(FDR), 40+40Gb/s (FDR10), 40+40Gb/s (QDR), 20+20Gb/s (DDR) and 10+10Gb/s
(SDR) bidirectional wire speed of the switch ports. All InfiniBand QSFP connections are
made to the leaf boards. Each leaf has 18 InfiniBand QSFP connectors in two rows,
which are numbered 1-18. See Section 3.1.6 for port numbering.
If maximum cable lengths are exceeded data transfer will be reduced and the bit error
rate will increase.
To raise link at FDR (56Gb/s) with 3rd party FDR cables, managed switch systems
must be programmed with management software MLNX-OS 3.3.4304 or higher, and
unmanaged switch systems need SwitchX firmware version 9.2.6000 or higher.
Mellanox Technologies
46
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
FDR and FDR10 are only guaranteed to work with approved Mellanox Cables.
All cables can be inserted or removed with the unit powered on. To insert a cable, press
the connector onto the port receptacle until the connector is firmly seated. The orange
LED indicator above the port will light when the physical connection is established
(when both ends of the cable are properly connected to working devices). Allow 15 seconds for link to get up. To remove, disengage the lock and slowly pull the connector
away from the port receptacle.
For a valid physical connection both ends of the cable must be connected to working
devices.
Take care to not impede the air flow through the ventilation holes next to the InfiniBand ports. Use cable lengths which allow routing horizontally around to the side of
the chassis before bending upward or downward in the rack.
2.9.1
Supported Approved Cables
For a list of approved cables for this switch see the Mellanox approved cable list.
http://www.mellanox.com/related-docs/user_manuals/Mellanox_approved_cables.pdf
2.9.2
Cable Power Classes
Chassis and switches need to be able to dissipate the heat generated by high power I/O
cables and modules. The Mellanox SX 65XX series chassis are rated for cables up to
class 2 as per the SFF committee classification (SFF-8436.PDF).
See http://www.mellanox.com/content/pages.php?pg=cables for the cable class rating of
Mellanox cables.
2.10
Hot Swap Insertion and Extraction
Before starting any procedure on the SX6536 switch system, put an ESD prevention
wrist strap on your wrist and connect to the SX6536 chassis.
Do NOT mix replacement parts based on different generations of chip.
Do not install InfiniScale IV based replacement parts within a SwitchX® based chassis and vice versa. All Replacement modules must be consistent with the Chassis family and switch chip generation.
Mellanox Technologies
47
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
This switch platform supports hot swap capabilities for the parts listed below.
•
Power supply units
•
Leaf boards
•
Spine boards
•
Leaf fan module
•
Spine fan module
•
Management modules
2.10.1 Power Supply Units
The 1000W power supplies deliver 1000W at 48V. The input to each of these power supplies requires 1176.5W in order to output 1000W.
The 1600W power supplies deliver 1600W at 48V. The input to each of these power supplies requires 1882.4W in order to output 1600W.
For N+2 configuration PSUs (Power Supply Unit) can be extracted without bringing
down the system.
For N+N configuration up to half of the PSUs can go down and the system will continue
to run.
The power required to run the switch system is equally divided between all of the working PSUs.
2.10.1.1 Extracting and Inserting the Power Supply Unit
With all of the 1000W power supplies installed, the system is in N+1 redundant configuration.
With all of the N+N 1600W power supplies installed, the system is in N +N redundant
configuration, half of the PSUs may be extracted without bringing down the system.
 To extract a PSU:
1. Determine which AC connector on the connector side of the chassis corresponds to
the defective PSU.
2. Remove the power cord from the power supply unit. Note which power cord it is
according to the AC numbering.
Figure 36: Power Cord Numbering
Mellanox Technologies
48
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 37: PSU and Outlet Locations
3. On the spine side of the chassis, remove the cover to the power supply unit for the
non-working PSU. Odd numbered PSUs are on the left side and even numbered PSUs
are on the right side facing the spines.There are four phillips head screws for the
cover plate.
Figure 38: Power Supply
Handle
Latch
4. Grasping the handle with one hand, push the black latch release while pulling the
handle outward. As the PSU unseats, the PSU status indicators will turn off.
5. Remove the PSU.
 To insert a PSU:
1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles.
2. Insert the PSU by sliding it into the opening until a slight resistance is felt.
3. Continue pressing the PSU until it seats completely. The latch will snap into place
confirming the proper installation.
Mellanox Technologies
49
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
4. Insert the power cord into the supply connector on the other side of the chassis.
5. Replace the cover over the PSUs.
The green indicators should light. If not, extract the PSU and re-insert it again.
2.10.2 Leaf Boards
Do NOT mix replacement parts based on different generations of chip.
Do not install InfiniScale IV based replacement parts within a SwitchX® based chassis and vice versa. All Replacement modules must be consistent with the Chassis family and switch chip generation.
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
The leaf boards are numbered from top to bottom, with corresponding numbers displayed to the outside of the leafs vertically along the side panel.
Mellanox Technologies
50
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 39: Leaf Board Numbering
2.10.2.1 Extracting a Leaf Board
Each leaf board has a ejector handle that locks the board in place and serves as a lever for
seating or extracting (see Figure 40).
1. Run the shut down command “no power enable <module>”. For example to shut
down leaf 16 run the command below.
switch [master] (config) # no power enable L16
2. Disconnect all cables connected to the leaf.
3. Push the ejector handle to unlock the ejector from the chassis.
4. Open the ejector until it is 45 degrees from the leaf.
Figure 40: Ejector Handle
Pull the leaf out of the chassis
Push the ejector handle
Ejector handle
Mellanox Technologies
51
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
5. Pull out the module half-way through the guiding rails using the ejector handle.
6. Lock the ejector handle.
7. Hold the body of the leaf on both sides and remove it from the chassis.
The board is short, therefore do not let go of it while sliding it out.
Figure 41: Leaf Release
Push here to release the ejector handle
Pull the ejector handle to remove the leaf
2.10.2.2 Inserting a Leaf Board
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
To insert the leaf board:
1. Check for foreign objects in or mechanical damage to the chassis leaf slots.
2. Check leaf mechanics for any noticeable damage.
3. Check back signal connectors’ integrity. Look for any broken signal dividers or any
deviations from the pass criterion shown in Figure 42.
Figure 42: Intact vs Defected Signal Connectors
Pass
Mellanox Technologies
Fail
52
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
4. Check power connector’s integrity. Look for any damage on the power connector
casing or blades damage, or any deviations from the pass criterion show in Figure 43.
Figure 43: Intact vs Defected Power Pin Holders
Pass
Fail
5. Start with the ejector handle fully open; that is, at 45 degrees to the front panel of the
leaf.
6. Holding the leaf by its sides, carefully set the leaf board into the chassis.
7. Applying equal pressure on both sides of the leaf board, slowly slide the board into
the chassis until the ejector handle reaches the vertical bar.
Do not apply excessive force to slide in the leaf board. If you feel resistance, remove
the leaf board and double check both the chassis and leaf for any damage.
8. Catch the hook onto the vertical bar of the chassis and push the ejector handle shut.
9. Lock the ejector handle onto the board.
Mellanox Technologies
53
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
2.10.3 Spine Boards
Do NOT mix replacement parts based on different generations of chip.
Do not install InfiniScale IV based replacement parts within a SwitchX® based chassis and vice versa. All Replacement modules must be consistent with the Chassis family and switch chip generation.
When hot swapping any of the units, it is necessary to wait 1 minute after removing the
defective part before inserting the new part. This is necessary so that the management
module will start a new cycle checking through the leafs and spines for the FW versions.
Each spine has a pair of ejectors that lock the board in place and serve as levers for seating or extracting (see Figure 45).
Management board #1 is connected to spine board #1, and management board #2 is connected to spine board #2. When a slave management board is not installed or not
working, the spine board connected to the master management board cannot be
hot-swapped. All of the spine boards can be hot-swapped when two management boards
are installed and working.
When more than one spine slot is empty always insert the lowest spine board first, then
work your way up.
If you need to replace the bottom spine and it does not go in, try removing one or two
spines above it and then insert the spines from the bottom up.
2.10.3.1 Extracting a Spine Board
When a slave management board is not installed or not working, hot-swapping the
spine board connected to the master management board will cause the chassis to crash.
Neither the CLI nor the GUI management tools will allow you to shut down spine #1
or spine #2, as the management modules are connected to the chassis components
through these spines.
Extracting Spine Board #1 or #2
Spine board #1 is connected to management board #1 and spine board #2 is connected to
management board #2.
Mellanox Technologies
54
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 44: Management Module Numbering
MNG1 management module #1
(top)
MNG2 management module #2
(bottom)
Removing spine #1 causes management module #1 to reset.
Removing spine #2 causes management module #2 to reset.
Warning: If the spine you want to hot swap is connected to the master management
module the management module will reboot when you take out the spine.
If you have only one management module the chassis will crash!
Figure 45: Spine Board Extraction
Pull the ejector handles out to remove the spine.
If you need to hot swap spine #1 or spine #2:
1. Check to see if the spine you need to remove is connected to the master management
module. See Figure 44.
If you have only one management module, the chassis will crash!
2. Follow the steps in Section below.
Extracting Spine Boards Except #1 or #2
1. Run the shut down command “no power enable <module>”. For example to shut
down spine 06 run the command below.
switch [master] (config) # no power enable S06
2. Push outward on the ejector handles to unlock the ejectors from the chassis.
Mellanox Technologies
55
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
3. Open the ejectors until they are at a 45 degree angle from the module.
Do not use the fan FRU handle to extract the spine board.
4. Pull out the module half-way through the guiding rails using both ejectors.
5. Lock the ejector handles.
6. Hold the body of the board on both sides and remove it from the chassis.
2.10.3.2 Inserting a Spine Board
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
To insert a spine board:
1. Check for foreign objects in or mechanical damage to the chassis spine slots.
2. Check spine mechanics for any noticeable damage or deviations from the pass criterion shown in Figure 46.
Figure 46: Intact vs Defected Mechanics
Pass
Mellanox Technologies
Fail
56
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
3. Check back signal connectors’ integrity. Look for any broken signal dividers or any
deviations from the pass criteria shown in Figure 47 and Figure 48.
Figure 47: Intact vs Defected Side Signal Connectors
Fail
Pass
Figure 48: Intact vs Defected Middle Signal Connectors
Pass
Fail
4. Check power connector’s integrity. Look for any damage on the power connector
casing or blades damage, or any deviations from the pass criterion shown in
Figure 49.
Figure 49: Intact vs Defected Power Pin Holders
Pass
Mellanox Technologies
Fail
57
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
5. Note the following sticker placed on the top of the spine board.
Figure 50: Spine Board Insertion Caution
6. Start with the ejector handles fully open; that is, at 45 degrees to the front panel of the
spine.
Do not use the fan FRU handle to insert the spine board.
7. Holding the spine by its sides, carefully set the spine board into the chassis.
8. Using only the ejector handles, slowly slide the board into the chassis until the hooks
reach the vertical bar.
Do not apply excessive force to slide in the spine board. If you feel resistance, remove
the spine and double check both the chassis and spine for any damage.
9. Catch the hooks onto the vertical bar of the chassis and push the ejector handle shut.
10. Lock the ejector handles onto the board.
2.10.4 Fan Modules
There are eight fan modules on the chassis for the leafs. They are located on both sides of
the chassis; four on the leaf side corners and four on the spine side corners. When a fan
module is not functioning the status LED on the fan will light up.
Each spine has an individual fan module that contains two individual fans. Should a single fan fail the Fan Status LED on the spine and the S. Fan LED on the management
module will light, indicating the necessity to replace the fan module. Air flow through
the spines is independent of the air flow through the leafs.
There are two different fan modules for the chassis. These fans have different model
numbers and are not interchangeable. The fans on the leaf side of the chassis are
MTF005001, whereas the fans on the spine side of the chassis are MTF005002.
Mellanox Technologies
58
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
2.10.4.1 Leaf Fan Module
There are eight Leaf fan modules. Four leaf fan modules are found on the leaf side and
four leaf fan modules are found on the spine side.
The leaf side fans are not interchangeable with the spine side fans. Air flow through the
leafs is independent of the air flow through the spines.
Figure 51: Leaf Fan Locations on the Chassis
Fans
Extracting the Leaf Fan Module
1. Push and hold the blue latch release. See Figure 52.
2. Slowly pull out the fan module using the handle.
Figure 52: Leaf Fan Module Extraction
Handle
Latch
Release
Mellanox Technologies
59
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Inserting the Leaf Fan Module
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
1. Make sure the fan module is oriented correctly top side up. Confirm that the location
of the connector in the chassis will line up with the connector in the fan module.
2. Slowly slide in the new leaf fan module.
If the fan module stops before it goes in all of the way it is inserted incorrectly or it
may be for the other side of the chassis!
3. Push the fan module until the latch engages.
4. Make sure that the green leaf LED on the module comes on (indicating that fan is
running).
2.10.4.2 Spine Fan Modules
Each spine module has a fan module with two individual fans built in. When a fan module is not functioning the Fan Status LED on the spine will light up.
Figure 53: Spine Fan Module
Fan module
When a fan module is removed the indicator light will reset.
Figure 54: Fan Status LED on the Spine Module
Fan status LED
Extracting the Spine Fan Module
1. Push the two blue latch buttons together while pulling the fan module out.
Mellanox Technologies
60
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Inserting the Spine Fan Module
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
1. Make sure the fan module is oriented correctly top side up. Confirm that the location
of the connector in the chassis will line up with the connector in the fan module.
2. Slowly slide in the new spine fan module.
3. Push the fan module as far as it will go, make sure the locking latches engage.
If the Fan LED continues to show red remove the fan module and check the pins on the
connector inside of the spine to make sure that none of them are bent.
2.10.5 Management Module
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
Extracting a Management Module
Management modules are located on the leaf side, above the leafs. There are two places
to install the management modules.
Only one management module is required to run the switch system.
Each management module has a pair of ejectors that lock the board in place and serve as
a lever for seating or extracting (see Figure 55).
1. Run the shut down command “no power enable <module>”. For example to shut
down management module 2 run the command below.
switch [master] (config) # no power enable MGMT2
2. Disconnect all cables connected to the management module.
3. Push outward on the ejector handles to unlock the ejectors from the chassis.
4. Open the ejectors until they are 45 degrees from the module.
5. Pull out the module half-way through the guiding rails using the ejector handle.
6. Lock the ejector handle.
Mellanox Technologies
61
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
7. Hold the body of the board on both sides and remove it from the chassis.
The board is short, therefore do not let go of it while sliding it out.
Figure 55: Management Module
Ejectors
2.10.5.1 Inserting a Management Module
When hot-swapping any of the units, it is necessary to wait 1 minute after removing
the defective part before inserting the new part. This is necessary so that the management module will start a new cycle checking through the leafs and spines for the FW
versions.
To insert a management board:
1. Check for foreign objects in or mechanical damage to the chassis management slots.
2. Check management mechanics for any noticeable damage.
3. Check back signal connectors’ integrity. Look for any broken signal dividers or any
deviations from the pass criterion shown in Figure 56.
Figure 56: Intact vs Defected Signal Connectors
Pass
Fail
4. Check power connector’s integrity. Look for any damage on the power connector
casing or blades damage, or any deviations from the pass criterion shown in
Mellanox Technologies
62
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 57.
Figure 57: Intact vs Defected Power Pin Holders
Pass
Fail
5. Start with the ejector handles fully open; that is, at 45 degrees to the front panel of the
management.
6. Holding the management by its sides, carefully set the management board into the
chassis.
7. Using only the management ejector handles, slowly slide the board into the chassis
until the hooks reach the vertical bar.
Do not apply excessive force to slide in the management board. If you feel resistance,
remove the management and double check both the chassis and management for any
damage.
8. Catch the hooks onto the vertical bar of the chassis and push the ejector handle shut.
9. Lock the ejector handles onto the board.
On switch systems with dual management systems, first connect the cable and configure
the master management module CPU and only then configure the slave. By default the
master CPU is the top management module. For further information on the master and
slave roles, see the MLNX-OS® Software UM section “High Availability”.
All management modules in the chassis must go through an initial configuration procedure. See the Installation Guide for the initial configuration procedure.
2.10.6 Switch Shut-Down Procedures
To shut down the chassis run the following command twice (once for each MM):
Reload halt [noconfirm]
Mellanox Technologies
63
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
The chassis cannot be restarted remotely!
To restart the chassis you must physically go to the switch and unplug all of the
power cords to the chassis and then replug in all of the power cords to the chassis.
The first time you run the command it shuts down the master management module and
the second time shuts down the slave management module.
To shut down a leaf run the following command:
no power enable <module>
To shut down a spine run the following command:
no power enable <module>
To shut down a management module run the following command:
no power enable <module>
Mellanox Technologies
64
InfiniBand FDR Switch Platform Hardware User Manual
3
Interfaces
3.1
LED Status Indicators
Rev 1.7
The LEDs are placed on the chassis for the convenience of the IT manager. All chassis
conditions and management options are available and controllable through the management SW, either CLI or Web GUI.
It is recommended that all of the chassis sub systems be maintained and managed
through the management software.
3.1.1
Power Supply Unit LEDs
Each Power Supply Unit has the following indicator LEDs.
Figure 58: Power Supply Unit Status Indications
AC – When lit this LED indicates input voltage between 100 and 240 Volts.
DC FAIL – When lit this LED indicates a fault in the power supply.
DC OK – When lit this LED indicates that the output from the power supply is +48
VDC.
The PSUs are on the spine side of the chassis behind two cover panels. The plugs for
these PSUs are on the leaf side of the chassis.
Mellanox Technologies
65
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 59: PSU Cover On and Off
PSUs covered
Cover off
ESD connection
3.1.2
Ground connection
Leaf Board LED Indicators
Figure 60: Leaf Board Led Indicators
3.1.2.1 Status LED
Each leaf board has a Status LED on the far left of the leaf. Table 4 shows the leaf status
according to the LED condition.
Mellanox Technologies
66
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
The Leaf Status indicator LED
has the following LED assignment:
Table 4 - Leaf Status LED
LED Condition
LED Description
Off
No power to the Leaf
Solid Green
Leaf is up and running
Flashing Green
Leaf is powering up
Solid Orange
Non fatal error – this leaf needs troubleshooting, but does not require
chassis shutdown
Solid Red
Fatal error
3.1.2.2 Bad Port LED
The Bad Port indicator is located on the left side of the leaf. The following Bad Port conditions are possible:
Table 5 - Bad Port LED Configurations
LED Configuration
Description
Off
OK – all ports are up and running.
Flashing Orange
Error – one or possibly more ports has just received a
symbol error
This LED shows symbol errors. Possible causes for this are:
•
bad cable
•
bad connection
•
bad connector
This LED lights up when one or more ports is receiving a symbol error. The LED immediately goes off until the next symbol error is received.
3.1.2.3 UID LED Switch Identifier
The UID LED is a debug feature that will become available to customers in the near
future. For details please contact Mellanox Technologies support.
3.1.2.4 Leaf Board Port Connector LED Assignment
Above the ports are two LEDs one for the upper port
and one for the lower port
.
Each port has a single 2 color LED. Table 6 shows the link status according to the LED
condition.
Table 6 - Connector Physical and Logical Link Indications
LED Condition
LED Description
Off
No power to the port
Solid Green
Logical link up
Mellanox Technologies
67
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Table 6 - Connector Physical and Logical Link Indications
LED Condition
LED Description
Flashing Green
Data activity – flashing speed is proportional to data transfer speed
Solid Orange
Physical link up
Flashing Orange
A problem with the physical link
The LED indicator, corresponding to each data port, will light orange when the physical
connection is established (that is, when the unit is powered on and a cable is plugged into
the port with the other end of the connector plugged into a functioning port). When a logical connection is made the LED will change to green. When data is being transferred the
light will blink green.
The switch does not provide a visual means to indicate the port speed configuration
(SDR, DDR, QDR, or FDR) and/or the link width (1X or 4X). The speed and link
width configurations can be retrieved using management software.
3.1.3
Spine Board LED Indicators
Each leaf board is connected by links to each spine module. Each spine has the following
LEDs.
•
One status LED for the spine health
•
One status LED for the spine fan modules
•
36 status LEDs showing the existence of leaf to spine connections
•
One Bad Port Led showing symbol errors in the data stream
•
One UID LED that can be lit to identify an individual spine
The 36 LEDs on each spine are divided by the number of leafs and the result (N) is the
number of connections from each leaf that are connected to the spine. 18 spines must be
installed and working to ensure that full BW exists between nodes. The maximum number of connections from each leaf is 1. If the (number of leafs) x (the maximum number
of connections per leaf) is less than 36 then some of the leaf to spine connection LEDs
may be OFF.
The status LEDs for the spine and their descriptions are shown in Table 7. The LEDs
indicate as follows.
Mellanox Technologies
68
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 61: Spine Status LEDs
Spine Status LED
Fan Status LED
Bad Port LED
UID LED
Spine leaf IB connection status
3.1.3.1 Status LED
Table 7 shows the spine status according to the LED condition.
Table 7 - Spine Status LED
LED Condition
LED Description
Off
No power to the spine
Solid Green
Spine is up and running
Flashing Green
Spine is powering up
Solid Orange
Non fatal error – this spine needs troubleshooting, but does not
require chassis shutdown
Solid Red
Fatal error
3.1.3.2 Fan LED
The spine fan indicator LED has the following LED assignment:
Table 8 - Spine Fan Status LED
LED Color
LED Description
Solid Green
Spine Fan is OK
Flashing Green
Spine Fan needs replacing
Solid Yellow
One or more of the fans in this spine is not working
Each spine has two fans in the fan module
Mellanox Technologies
69
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
3.1.3.3 Spine to Leaf IB Connection Status LEDs
The leaf connection status on each spine displays the condition of the connection
between the spine and each leaf. There is a minimum of one LED per leaf per spine and a
maximum of 1 LED per leaf. These LEDs indicate a valid connection between a leaf and
a spine.
Table 9 shows the leaf to spine status according to the LED condition.
Table 9 - Spine to Leaf IB Link Status
LED Condition
LED Description
Off
Link is down
Solid Green
Logical connection
Flashing Green
Data activity
Solid Orange
Physical connection
3.1.3.4 Bad Port LED
The Bad Port indicator is located on the left side of the spine. The following Bad Port
conditions are possible:
Table 10 - Bad Port LED Configurations
LED Condition
Description
Off
OK – No ports have received symbol errors recently
Flashing Orange
Error – One or possibly more ports has just received a
symbol error.
This LED shows symbol errors. Possible causes for this are:
•
bad cable
•
bad connection
•
bad connector
This LED lights up when one or more ports is receiving a symbol error. The LED immediately goes off until the next symbol error is received.
3.1.3.5 UID LED Switch Identifier
The UID LED is a debug feature that will become available to customers in the near
future. For details please contact Mellanox Technologies support.
3.1.4
Spine Side Panel Display LED Indicators
The spine side panel display has LEDs that show the chassis condition.
Figure 62: Spine Side Panel Display Status Indications
Mellanox Technologies
70
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Table 11 - LEDs Display for Normal Operation
LED Condition
Description
Normal
State
STATUS
Off – No Power
Green
Green – System is up and running
Yellow – System warning. Attention needed (such as overheating)
Red – System not operational (Diagnostics fail, CPU hang,
HW fail, Overheat-critical)
Blinking green – System booting / Restore factory defaults in progress
PSU STATUS
Off – No power
Green
Green –Normal operational
Red – PS fault detected. User should check individual power supplies
for fault indications.
SPINE FANS
STATUS
Off – No power to fan
Green – Nominal operational
Red – One or more of the spine fans is bad. User should check
individual spine fan LEDs for fault indications.
Green
LEAF FANS
STATUS
Off – No power to fan
Green – Nominal operational
Red – One or more of the leaf fans is bad. User should check
individual leaf fan LEDs for fault indications.
Green
MNG1
MASTER
STATUS
Off –
- no power
- this management module is not installed
- this management module is not the master
Green
Green – Management module is operating as a master
MNG2
MASTER
STATUS
Off –
- no power
- this management module is not installed
- this management module is not the master
Off
Green – Management module is operating as a master
3.1.5
Management Module LED Indicators
Figure 63: Management Module Status Indications
The management module LEDs display the switch system operating conditions.
Mellanox Technologies
71
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Table 12 - LEDs Display for Normal Operation
LED Condition
Description
Normal
State
STATUS
This LED
shows the status of the chassis.
Off – No Power
Green
Green – System is up and running.
Yellow – System warning. Attention needed (such as overheating).
Red – System not operational (Diagnostics fail, CPU hang,
HW fail, Overheat-critical)
Blinking green – System booting / Restore factory defaults in progress.
PSU STATUS
Off – No power
Green
Green – Normal operational
Red – PS fault detected. User should check individual power supplies
for fault indications.
SPINE FANS
STATUS
Off – No power to fan
Green – Nominal operational
Red – One or more of the spine fans is bad. User should check
individual spine fan LEDs for fault indications
Green
LEAF FANS
STATUS
Off – No power to fan
Green – Nominal operational
Red – One or more of the leaf fans is bad. User should check
individual leaf fan LEDs for fault indications
Green
MASTER
Off – this management module is not the master MM
Green – Management module is operating as a master (i.e., the other
management module is a slave)
Green
Figure 64: Management Module LEDs
3.1.5.1 Management Module PSU LED Indicator
The management module PSU indicator should be green.
Table 13 - Management Module PSU LED Configurations
LED Condition
Description
Green
OK – All PSUs are working at correct input and output voltages.
Red
Error – One or more of the PSUs for the chassis is bad. Check each
PSU for a red LED.
Mellanox Technologies
72
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
3.1.5.2 Management Module S. FANS LED Indicator
The management module S. FANS indicator should be green.
Table 14 - Management Module S.Fan LED Configurations
LED Condition
Description
Green
OK – All Spine fans are working at configured speed.
Red
Error – One or more of the spine fans within a spine fan module is bad.
Check the spines for a flashing green fan LED.
3.1.5.3 Management Module L. FANS LED Indicator
The management module L. FANS indicator should be green.
Table 15 - Management Module L.Fan LED Configurations
LED Condition
Description
Green
OK – All Chassis Leaf fans are working at configured speed.
Red
Error – One or more of the leaf fans for the chassis is bad. Check each
chassis fan for a red LED.
3.1.5.4 Management Module MASTER LED Indicator
Table 16 - Management Module MASTER LED Configurations
LED Condition
3.1.6
Description
Green
This management module is the master.
Off
This management module is the slave.
Port Connector Interfaces
The connector side of the switch has 36 leaf boards and each leaf board has 18 QSFP
ports. The ports on each leaf board are placed in two rows, 9 ports to a row. The ports are
labelled as shown in Figure 65. The bottom row ports are flipped from the top row. See
Figure 66.
Figure 65: Port Numbering
Figure 66: Top and Bottom Ports
Mellanox Technologies
73
InfiniBand FDR Switch Platform Hardware User Manual
3.2
Rev 1.7
Air Flow
These switches come with the air flow pattern of air entering through the spine side and
exiting through the connector side.
3.3
QSFP Cable Power Budget Classification
All SX6536 QSFP switches are designed for active cables with a max power per module
of 2.0W. This is power level 2 according to the QSFP Public Specification.
The SX6536 when used with 1.6kW power supplied in full N+N power redundancy
configuration only supports active cables with a max power per module of 1.7W
per port.
3.4
Management Module Interfaces
The switch system requires at least one management module. The management module
has five interfaces to connect to the SX6536. They are:
•
1 I2C port
•
1 CONSOLE port – this is an RS232 connector for connecting to a host
machine
•
1 MGT – this is an Ethernet connector
•
1 USB port
•
1 RST – reset button
Figure 67: Management Module Interfaces
3.4.1
I2C
This interface is for Debug and Troubleshooting only. This interface is for FAEs
only.
3.4.2
CONSOLE
The CONSOLE port is used during the installation process to configure the chassis for
remote management. Connect this port to a local host using the harness supplied with the
chassis. See the Installation Guide for the initial configuration procedure.
Mellanox Technologies
74
InfiniBand FDR Switch Platform Hardware User Manual
3.4.3
Rev 1.7
MGT– Management
The MGT port is an Ethernet port for remote management. Any remote terminal connected to the Ethernet port can then be used to manage the fabric and chassis.
Each Ethernet connector gets connected to Ethernet switches. These switches must be
configured to 100M/1G auto-negotiation.
Initial configuration must be done on all of the management modules. The first management module you configure will be the master.
3.4.4
USB
The USB port can be used to upload new SW using any storage device that has a USB
connector. This interface is USB 2.0.
3.4.5
Reset – RST
The Reset button resets the chassis management module when the button is pushed.
When the button is held down for 15 seconds the management module is reset and the
password deleted.
DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset
button. Sharp objects can cause damage, use a flat object such as a paper clip.
Figure 68: Reset Button
This button resets the CPU of the management module. A quick push of this button performs this reset. When the reset button is pushed on the master management module this
management module is reset becoming the slave and the other management module
becomes the master. If there is only one management module in the chassis all of the
leafs and ports are reset by bringing them down and powering them up when the reset
button is pushed. When the button is held down for 15 seconds the management module
is reset and the password is deleted. You will then be able to enter without a password
and make a new password for the user “admin”.
Mellanox Technologies
75
InfiniBand FDR Switch Platform Hardware User Manual
4
Rev 1.7
Chassis Power Up
Before starting any procedure on the SX6536 system put an ESD prevention wrist
strap on your wrist and connect to the SX6536 chassis.
With N+1 PSU redundancy the chassis must be started with a full complement of possible PSUs, thereafter it can run on one less than the total number of PSUs. This final PSU
is redundant and allows for hot swapping a PSU should one fail. Connecting the PSUs to
different AC lines provides AC failover protection.
The system should continue to run and allow a hot swap of a defective PSU. Should
there not be enough power to keep all of the leafs running, MLNX-OS® may power
down some leafs. If this happens it will be necessary to reboot the chassis once the defective PSU has been replaced.
With 1600W optional PSU supplies the chassis can run on as little as 1/2 of the full complement of PSUs. N+N allows the chassis to run on 5 PSUs supplied from one power
grid while 5 are connected to a second power grid.
1. Check all FRUs for proper insertion and seating before connecting the AC power
cords.
• Boards
• Power supplies
• Leaf fan modules
• Spine fan modules
2. Insert all leafs that you plan to use, in the chassis. Start at the bottom of the chassis
and work your way up.
3. Insert the first two spines in the top two slots.
4. Insert the rest of the spines from the bottom of the chassis up to slot #3.
5. Insert thermal blanks in unused leaf slots to maintain balanced air flow.
6. Tighten all leaf and spine mounting screws.
7. Connect the power cords to the PSUs.
8. Connect the power cords to grounded electrical outlets.
With N+1 PSU redundancy do not power up the chassis with less than all PSUs
installed.
A fully loaded SX6536 series switch system can draw 9.7 kW of power. Make sure
that the outlets and circuits will not be overloaded. Spread out the load over at least
two or three circuits, or a 3 phase supply.
Mellanox Technologies
76
InfiniBand FDR Switch Platform Hardware User Manual
4.1
Rev 1.7
Power Supply and Spine Board Indicator Status at Power ON
It can take up to 5 minutes to boot up the system. Turn off the system if any LEDs
remain red for more than 5 minutes.
As the power is turned on, you should observe the following conditions for normal operation:
1. Power Supply Unit(s) AC OK and DC OK indicators are ON and FAIL indicators are
OFF.
2. There is a green Status LED per spine board, per leaf board, and per management
module that indicates power supplies are good.
3. Spine Board indicators will display status of internal links to the installed leaf boards.
All PHY links to existing leaf Boards should be ON.
4. Check the Spine LEDs and make sure they coincide with Figure 69.
Figure 69: Spine Side Panel Display Status Indications
5. Check the Management Module LEDs and make sure they coincide with Figure 70.
Figure 70: Management Module Status Indications for Normal Operation
Mellanox Technologies
77
InfiniBand FDR Switch Platform Hardware User Manual
5
Rev 1.7
Switch Management Tools
This chapter describes the management module and tools available for Out-of-Band
management of the switch system via MLNX-OS®.
There are 2 Ethernet ports (1 for each management module) that get connected to
Ethernet switches. These switches must be configured to 10/100M auto-negotiation.
The SX6536 switch comes standard with a management software module for chassis
management called Mellanox Operating System (MLNX-OS). MLNX-OS is installed on
all SwitchX® based managed switch systems management modules. MLNX-OS
includes a CLI, WebUI, SNMP, and chassis management features for software and IB
management software (OpenSM).
You can get more information via the Mellanox MLNX-OS® SwitchX® Software
WebUI User’s Manual or the Mellanox MLNX-OS® SwitchX® Software User Manual.
The managed switch system includes the following software components:
•
Embedded Subnet Manager (SM)
•
Chassis manager and system BIST
•
SNMP agent, 3rd party tool integration
•
GUI
•
Remote logging
•
SSH/telnet
•
Secured access in-band and out-band
•
IPv4/IPv6 network stack
The chassis manager will give the user access to:
•
Switch temperatures
•
Power supply voltages
•
Fan unit information
•
Power unit information
•
Flash memory
•
Monitoring of:
• AC power to the PSUs
• DC power out from the PSUs
• chassis failures
•
querying for:
• switch serial numbers
• revisions
• software version
• SwitchX® FW version
• switch temperatures
Mellanox Technologies
78
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
The manager also has the ability to burn new firmware and upgrade software on the
switch.
5.1
InfiniBand Subnet Manager
The InfiniBand Subnet Manager (SM) is a centralized entity running in the switch. It discovers and configures all the InfiniBand fabric devices to enable traffic flow between
those devices. The SM applies network traffic related configurations such as QoS, routing, partitioning to the fabric devices.
You can view and configure the Subnet Parameters (SM) via the CLI/WebUI.
Each InfiniBand subnet needs one subnet manager to discover, activate and manage the
subnet. An InfiniBand® network requires a Subnet Manager to be running in either the
Infiniband switch itself (switch based) or on one of the nodes which is connected to the
Infiniband fabric (host based).
5.2
Fabric Inspector (Diagnostics)
Fabric Inspector is a plug & play software for fee within MLNX-OS displaying and filtering all identified systems and nodes within the fabric.
Fabric Inspector includes a complete set of tools for fabric wide diagnostics to check
node-node and node-switch connectivity and to verify routes within the fabric.
Advanced filtering allows creating filtering rules on a system wide basis, between nodes
or port connections based on traffic patterns and user assigned system names (GUIDs).
5.3
Accessing the CPU via the Ethernet Connector
Once the initial configuration is completed the management tools can be accessed
through:
5.4
•
SSH
•
Telnet
•
WEB
•
SNMP
•
XML
Upgrading Software
The new software and firmware updates are available to the user from the Mellanox Support website. Copy the update to a known location on a Remote server within your LAN.
Use the CLI or the GUI in order to perform the Software upgrade. For further information please refer to the MLNX-OS user manual.
If MLNX-OS is updated and the FW image in the leafs and spines of the chassis is an
earlier version than the minimum that the new version of the software can work with,
then the chassis management system may require up to ~45 minutes to update all of the
FW images in all of the leafs and spines.
Mellanox Technologies
79
InfiniBand FDR Switch Platform Hardware User Manual
6
Troubleshooting
6.1
Power Supply Unit
Rev 1.7
If the Power supplies cannot supply enough power, the management module may shut
down the some leafs.
As each PSU is plugged in, make sure that the green power LEDs on the PSU comes on.
Issue 1.
If the AC power LED is off:
1. Check that the power cable is the correct power cable for your country.
2. Check that the power cable is plugged into a working outlet.
3. Check that the power cable has a voltage within the range of 100 - 240 volts AC.
4. Remove and reinstall the power cable.
5. Check the circuit breakers to be sure that the breaker has not tripped.
6. Check that the power cable is good. Replace the power cable.
7. If the AC power LED is green but the OK power LED is off or the FAIL LED is on –
Replace the PSU.
6.2
Leaf Board
Issue 2. The power LED for the Leaf board is off:
1. Make sure that all of the PSUs are showing DC OK.
2. Uninstall and reinstall the Leaf board.
3. When the Yellow LED is on, this indicates a fault in the board, uninstall and reinstall
the Leaf board.
4. If uninstalling and reinstalling the Leaf board does not work, burn the latest FW on
the Leaf board and uninstall and reinstall the Leaf board.
5. Replace the Leaf board with a new one.
Should any of the boards shut down due to over temperature, wait 5 minutes and then
follow the procedure starting with step 2
Issue 3. The Physical link LED for the InfiniBand connector does not come on:
1. Check that both ends of the cable are connected.
2. Check that the locks on the ends are secured.
3. Make sure that the latest FW version is installed on both the HCA card and the
switch.
4. If media adapters are used check that the all connections are good, tight, and secure.
5. Replace the cable.
Issue 4. The Activity indication does not come on:
Check that the Subnet Manager has been started.
Mellanox Technologies
80
InfiniBand FDR Switch Platform Hardware User Manual
6.3
Rev 1.7
Management Module
Issue 1.
Yellow Status LED for the Chassis on the Management Module is Lit
1. Check the MLNX-OS management for confirmation and possible explanation of the
alert.
2. Reset the master management module by pushing the rest button. If you have two
management modules installed this will convert the master management module to
the slave and convert the slave to the master.
If there is only one management module in the chassis all of the leafs and ports
are reset by bringing them down and powering them up when the management
module is removed.
3. Make sure the S.Fans and L.Fans LEDs are green.
4. Make sure that the spine and the leafs both have the same version of FW.
5. Reburn the FW and remove and reinstall the management module.
6. If you are running the chassis with only one management module, remove and reinstall the management module. Make sure the mating connectors of the unit are free of
any dirt and/or obstacles. See Section 2.10.5 on page 61.
7. If you are running the chassis with only one management module, replace the management module.
Issue 2.
Yellow LED for the Leaf Fan on the Management Module is Lit
1. Check the MLNX-OS management for confirmation and possible explanation of the
alert.
2. Make sure that there is nothing blocking the front or rear of the chassis and that the
fan modules and ventilation holes are not blocked (especially dust over the holes).
3. If you find dust blocking the holes it is recommended to clean the fan unit and
remove the dust from the front and rear panels of the switch using a vacuum cleaner.
4. Determine which fan module is problematic by checking the status LED on each fan
module.
5. Remove and reinstall the problematic fan unit. Make sure the mating connector of the
new unit is free of any dirt and/or obstacles. See Section 2.10.4 on page 58.
6. Replace the Leaf fan module.
There are two non-interchangeable types of leaf fan modules. If the new leaf fan does
not go into the chassis confirm that it is the correct fan module.
Replace defective leaf fan modules as soon as they are identified.
Mellanox Technologies
81
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Should any of the boards shut down due to over temperature, follow the procedure
starting in step 2
Issue 3.
Yellow LED for the Spine Fan on the Management Module is Lit
1. Check the MLNX-OS management for confirmation and possible explanation of the
alert.
2. Determine which spine has a defective fan by checking the Fan LEDs on all of the
spines.
3. Make sure that there is nothing blocking the front or rear of the chassis and that the
fan modules and ventilation holes are not blocked (especially dust over the holes).
4. If you find dust blocking the holes it is recommended to clean the fan unit and
remove the dust from the front and rear panels of the switch using a vacuum cleaner.
5. Remove and reinstall the fan unit of the spine. Make sure the mating connector of the
new unit is free of any dirt and/or obstacles. See Section 2.10.4 on page 58.
6. Replace the spine fan module.
Replace defective spine fan modules as soon as they are identified.
6.4
Spine Board
Issue 1. The yellow LED on the Spine board is lit:
1. Check the MLNX-OS management for confirmation and possible explanation of the
alert.
2. Make sure that there is nothing blocking the front or rear of the chassis and that the
fan modules and ventilation holes are not blocked (especially dust over the holes).
3. If you find dust blocking the holes it is recommended to clean the fan unit and
remove the dust from the front and rear panels of the switch using a vacuum cleaner.
4. Remove and reinstall the spine board. Make sure the mating connectors of the unit is
free of any dirt and/or obstacles. See Section 2.10.3 on page 54.
5. Make sure that the spine and the Leafs both have the same version of FW.
6. Reburn the FW and remove and reinstall the spine.
7. Replace the spine board.
6.5
MLNX-OS® Software
Issue 1. The last software update did not succeed:
1. Connect the RS232 connector (CONSOLE) to a laptop.
2. Push the reset button on the switch or management module.
3. You will have ~ 5 seconds to stop the U-Boot by pressing Control-B.
4. Choose the image to upload. Only use image 1 or image 2.
Mellanox Technologies
82
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
U-Boot 2009.01-mlnx1.4 (May 12 2010 - 14:08:15)
CPU:
AMCC PowerPC 460EX Rev. A at 1000 MHz (PLB=200, OPB=100,
EBC=100 MHz)
Security/Kasumi support
Bootstrap Option H - Boot ROM Location I2C (Addr 0x52)
Internal PCI arbiter disabled
32 kB I-Cache 32 kB D-Cache
Board: Mellanox PPC460EX Board
FDEF:
No
I2C:
ready
DRAM:
2 GB (ECC enabled, 400 MHz, CL3)
FLASH: 16 MB
NAND:
1024 MiB
PCI:
Bus Dev VenId DevId Class Int
PCIE0: link is not up.
PCIE1: successfully set as root-complex
01
Net:
00
15b3
bd34
0c06
00
ppc_4xx_eth0, ppc_4xx_eth1
Hit Ctrl+B to stop autoboot:
0
Mellanox FabricIT
Boot Menu:
1. EFM_PPC_M460EX EFM_1.1.1000 2010-06-24 16:32:03 ppc
2. EFM_PPC_M460EX EFM_1.1.1200
2010-06-25
18 :00:03 ppc
3. U-Boot prompt
Choice:
5. Select the image to boot.
For more detailed instructions concerning MLNX-OS® software see the Mellanox
MLNX-OS® SwitchX® Software WebUI User’s Manual or the Mellanox MLNX-OS®
SwitchX® Software User Manual.
Mellanox Technologies
83
InfiniBand FDR Switch Platform Hardware User Manual
7
Disassembly and Disposal
7.1
Disassembling the Chassis
Rev 1.7
1. Power down the chassis.
2. Remove all power cables.
3. Remove all connector cables.
4. Disconnect the ground lug from the ground post.
5. Loosen all locking screws for the leafs, spines, and management modules in the chassis.
6. Remove all leafs.
7. Remove all spines.
8. Remove all management modules.
Use enough people to safely lift this product.
This product and all of its parts are NOT to be disposed of with household waste. This
product contains printed circuit boards cables and batteries. According to the WEEE
Directive 2002/96/EC, all waste electrical and electronic equipment (EEE) should be
collected separately and disposed of according to the directive.
9. Go to the Mellanox website for detailed instructions for disassembly of the FRUs and
chassis according to the WEEE Directive.
10. Using a socket wrench, remove the hex head screws holding down the lock-down bar
on the spine side of the chassis.
Mellanox Technologies
84
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 71: Lock-down Bar
These holes are to
screw the bar into the
Chassis
These holes are to screw the
bar into the shelf
11. Remove the lock-down bar.
12. Dispose of these pieces in a legal and environmentally friendly way.
Mellanox Technologies
85
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 72: Face Plate Mounting Bolt Locations
Holes in the faceplate for mounting on the rack.
The holes are separated by 4U
units
7.1.1
Removing the Chassis
1. Remove the screws connecting the upper brackets to the rack.
Mellanox Technologies
86
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
2. Remove the screws holding the chassis to the rack. These screws are located in the
faceplate on the spine side of the chassis.
3. Remove the upper brackets from the chassis.
4. Remove the lock-down bars.
Figure 73: Mechanical Lifting Device
5. Put the container base (saved from the installation) on the fork lift.
6. Raise the container base to 1 cm below the level of the shelf.
7. Move the chassis away from the rack and onto the container base.
8. Put wedges around the chassis to prevent the chassis from rolling off of the container
base.
9. Move the chassis away from the rack.
10. Dispose of the Chassis in a legal and environmental way.
11. Go to the Mellanox website for detailed instructions for disassembly of the chassis
according to the WEEE Directive.
7.1.2
Removing the Bottom Shelf
1. Remove all of the bolts that are holding the shelf to the rack.
2. Remove the filler panels.
3. Remove the shelf.
4. Remove all of the caged nuts.
Mellanox Technologies
87
InfiniBand FDR Switch Platform Hardware User Manual
7.2
Rev 1.7
Disposal
According to the WEEE Directive 2002/96/EC, all waste electrical and electronic
equipment (EEE) should be collected separately and not disposed of with regular
household waste.
Dispose of this product and all of its parts in a responsible and environmentally
friendly way.
Go to the Mellanox website for detailed instructions for disassembly according to the
WEEE Directive.
Mellanox Technologies
88
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Appendix A: Specification Data
Table 17 - Switch Specification SX6536[FT]-[10R, NR]
Physical
Size:
Mounting:
50.629” x 19” x 27” inches
1286mm x 482.6mm x 685mm
The shelf adds 100mm to the
height
Size / Mounting
# of spines/leafs Spines:
18
Leafs
128.97kg (284.33 lbs.) empty
weight (no leafs, spines, or management modules)
327.15kg (721.24 lbs.) full configuration
157.57kg (347.38 lbs.) shipped
configuration
Center of Gravity:
CoGh:
637mm (from bottom of chassis)
Measured from CoGw:
the bottom left 222mm (from left side surface)
corner as one
CoGd:
faces the switch 342.5mm (from port-end surface)
ports.
16.59M3/min. (585.9 CFM)
Max. Air Flow
Through spines: 9.48 M3/min. (334.8 CFM)
Weight:
Weight /
Center of
Gravity
Air Flow
SerDes Speeds /
Connector Types
Max. Air Flow
Through leafs:
19” Rack mount
SerDes Speeds:
10, 20, 40,Gb/s or 56,Gb/s per
port
Connector
Types:
36
QSFP
Power and Environmental
Input Voltage / Input Voltage:
Management
Mellanox Technologies
100 - 240 VAC 50-60Hz
Management
CPU:
PowerPC 460EX
89
InfiniBand FDR Switch Platform Hardware User Manual
Total Power
Consumption
FDR 14:
Typ
Max
Power numbers
Rev 1.7
Passive: 7399W
Active: 8878W
(includes QSFP at 1.5W)
Optical: 9075W
(includes QSFP at 1.7W)
Max heat output:
33,231 BTUs/hr
Power consumption for
optical cables
QSFP:
2.0W MAX Power level #2
Passive: 7768W
Active: 9444W
(includes QSFP at 1.7W)
Optical: 9739W
(includes QSFP at 2.0W)
Power Consumption Man- Typical: 15W
agement:
Max: 22W
Chassis fan:
Typical: 117W
Max: 135W
Power ConPower consumption Spine: Typical: 109.3W (includes 2 fans) sumption leaf:
Max:
Temperature
Cable power /
Humidity
114.9W (includes 2 fans)
Operating
Non-operating
0° to 45° Celsius
QSFP:
Mellanox Technologies
Typical: 93.1W
(including passive
QSFP power)
Max:
94.7W
(including passive
QSFP power)
MAX 2W
TYP: 1.7W
-40° to 70° Celsius
Humidity:
Operating
10% - 85% non-condensing
90
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Protocol Support
InfiniBand:
Management:
Auto-Negotiation of (56Gb/
s,40Gb/s, 20Gb/s, 10Gb/s)
Speed protocol /
Management
Data Rate:
Managed using MLNX-OS
Baseboard, Performance, and
Device management Agents for
full InfiniBand In-Band Management
QoS
56Gb/s per port
Data Rate / QoS
8 InfiniBand Virtual Lanes for all
ports
Regulatory Compliance
Safety:
US/Canada: cTUVus certificate
International: CB report and
certificate
Russia: GOST-R certificate
Argentina: S-mark certificate
DoC
Safety / EMC
(Emissions)
EMC
(Emissions):
BSMI certificate (for the power
supply only)
Environmental:
Acoustic /
Shock and
Vibration
Vibration:
EU: IEC 60068-2-64: Random
Environmental /
Vibration
Acoustic:
CE EMC & safety report and certificate
USA: FCC part 15 class A
Canada: ICES-003 class A
Australia / New Zealand:
AS/NZS CISPR 22 class A
Japan: VCCI, Class A
Australia C-Tick certificate
76.4 DbA
ISO 7779
ETS 300 753
EU: IEC 60068-2-29: Shocks,
Type I / II
EU: IEC 60068-2-32: Fall Test
Shock and
Vibration:
ETSI EN 300 019-2-2: 1999-09
Scalability and Performance
Leafs:
Power Supplies:
Up to 36 leafs; 18-ports each
Spines:
Switching
Performance /
Capacity
up to 18 spine boards.
All spines are needed for nonblocking configuration
Addressing:
10 Power Supplies standard
Management
Modules:
Leaf fans:
8
48K Unicast Addresses Max. per
Subnet
16K Multicast Addresses per
Subnet
Switching
Capacity:
Mellanox Technologies
2 available 1 required for operation
72.5 Tb/s
Switching
Performance:
Simultaneous wire-speed any port
to any port
91
InfiniBand FDR Switch Platform Hardware User Manual
A.1
Rev 1.7
EMI Certification
EMI certification on the fully populated chassis was performed with the chassis installed
in a closed two-door rack using the chassis installation kit supplied by Mellanox Technologies.
A.2
Approved Cables
For a list of all approved cables see:
http://www.mellanox.com/related-docs/user_manuals/Mellanox_approved_cables.pdf
A.3
EMC Certifications
The list of approved certifications per chassis in different regions of the world is located
on the Mellanox Website at:
http://www.mellanox.com/related-docs/user_manuals/
Regulatory_and_Compliance_Guide.pdf
EMC Statements are also in the Regulatory and Compliance Guide.
Mellanox Technologies
92
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Appendix B: Thermal Threshold Definitions
There are three thermal threshold definitions for the SwitchX® switch device which
impact the overall switch system operation state: Warning, Critical and Emergency.
1. Warning – 100ºC
On managed systems only: When the SwitchX® device crosses the 100oC threshold, a
Warning Threshold message will be issued by the MLNX-OS management SW, indicating to system administration that the switch has crossed the Warning threshold.
Note that this temperature threshold does not require nor lead to any action by hardware
(such as switch shutdown).
2. Critical – 120ºC
When the SwitchX® device crosses this temperature, the firmware will automatically
shut down the device.
3. Emergency – 130ºC
In case the firmware fails to shut down the SwitchX® device upon crossing the Critical
threshold, the SwitchX® device will auto-shutdown upon crossing the Emergency
(130ºC) threshold.
Mellanox Technologies
93
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Appendix C: Calculating the Weight of a Customized
Chassis
The weight of a customized chassis can be calculated for any possible customization as
follows.
Take the weight of a chassis with the following FRUs installed.
• All fans modules
• All power supplies
The weight of the SX6536 chassis configured above is 157.57kg for 6536-10R, 154.57
for 6536-NR.
To this add the weight of installed FRUs.
•
Spines
•
Leafs
•
Leaf blanks
•
Management modules
Fill in the table below to calculate the weight of your system.
Number of FRUs
FRU Type
Weight of 1 FRU
Total Weight / FRU Type
Chassis as shipped
# of Spines *
# of leafs *
# of leaf blanks *
# of management modules *
Total
3.77 =
2.76 =
0.764 =
3.15 =
=
This total is in kilograms. Multiply the total by 2.2 to get the total weight in pounds.
Mellanox Technologies
94
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Appendix D: Calculating the Power of a Chassis
To calculate the power consumption of a chassis add the power of the fans, spines, leafs,
and management modules.
Table 18 - Power Consumption of Chassis Parts
Part
Typ Power Passive Cables
Typ Power Optical Cables @ 1.7w
Per Port
IB FDR leaf
93.1W
132.7W
Spine
109.3W
Not applicable
Fan
117W
Not applicable
Management Module
15W
Not applicable
To calculate the chassis power at typical conditions fill in the table below.
Number of FRUs
FRU Type
# of spines *
Typ Power of 1
FRU
Total Power/FRU Type
109.3W
# of leafs (passive cables)* 93.1W
# of leafs (optical cables)* 132.7W
# of management modules 15W
*
for the PPC 460 management module
8
Chassis fan
117W
936W
Total DC power
Total AC power:
Total DC power / efficiency (85%)
N+N redundancy ONLY works with a supply voltage of 220V.
Mellanox Technologies
95
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Appendix E: QSFP Interface
Table 19 - InfiniBand QSFP Connector Pinout
Connector
Connector
Pin
Pin Name
Number
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
Mellanox Technologies
GND
Tx2n
Tx2p
GND
Tx4n
Tx4p
GND
ModSelL
ResetL
Vcc Rx
SCL
SDA
GND
Rx3p
Rx3n
GND
Rx1p
Rx1n
GND
GND
Rx2n
Rx2p
GND
Rx4n
Rx4p
GND
ModPrsL
IntL
Vcc Tx
Vcc 1
LPMode
GND
Tx3p
Tx3n
GND
Tx1p
Tx1n
GND
Signal Description
Ground
Transmitter Inverted Data Input
Transmitter Non-Inverted Data Input
Ground
Transmitter Inverted Data Input
Transmitter Non-Inverted Data Input
Ground
Module Select
Module Reset
+3.3 V Power supply receiver
2-wire serial interface clock
2-wire serial interface data
Ground
Receiver Non-Inverted Data Output
Receiver Inverted Data Output
Ground
Receiver Non-Inverted Data Output
Receiver Inverted Data Output
Ground
Ground
Receiver Inverted Data Output 3
Receiver Non-Inverted Data Output 3
Ground
Receiver Inverted Data Output 3
Receiver Non-Inverted Data Output 3
Ground
Module Present
Interrupt
+3.3 V Power supply transmitter
+3.3 V Power Supply
Low Power Mode
Ground
Transmitter Non-Inverted Data Input
Transmitter Inverted Data Input
Ground
Transmitter Non-Inverted Data Input
Transmitter Inverted Data Input
Ground
96
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Figure 74: InfiniBand QSFP Connector Symbol
Figure 75: QSFP Connector Male and Female Views
Mellanox Technologies
97
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Appendix F: Replacement Parts Ordering Numbers
Table 20 - Replacement Parts Ordering Numbers
Part Description
648 port FDR modular chassis, includes fans and
N+N power supplies, RoHS6
OPN
MSX6535-NR
648 port FDR modular chassis, includes fans and N+1 MSX6536-10R
power supplies, RoHS6
Power supply unit PSU 1000W for Modular Switch
Family
MTP005001
Power Supply unit PSU 1600W for Modular Switch
Family
MTP006002
Power supply blank
MTM005001
Leaf board unit 18 port FDR
MSX6001FR
Leaf board unit 18 port FDR-10
MSX6001TR
Modular Switch Family, Leaf - Blank
MTM005004
Spine board unit for FDR system
MSX6002FLR
Spine board unit for FDR10/QDR system
MSX6002TBR
Spine board blank
MTM005002
PPC460 Management Module
MSX6000MAR
x86 Management Module
MSX6000MBR
Modular Switch Family, Management - Blank
MTM005003
Rack Installation Kit for IS5600/SX6536 Series
MTR005600
Cable Management Device Set for IS5600/SX6536
MTR005601
Cables Set For IS5600/SX6536 Series
MTR005602
IS5600/SX6536, IS5300/SX6518 Series Modular
Switch, leaf cooling chassis fan unit located on Leaf
Side
MTF005001
IS5600/SX6536, IS5300/SX6518 Modular Switch,
leaf cooling chassis fan unit located on Spine Side
MTF005002
SX6536, SX6518, SX6512,MSX 6506 Modular Switch MTF005005
Series Spine Fan Unit
DB9 to RJ45 Harness
HAR000028
Power cord 250V 15A 2.0M C14 to C13
ACC000334
Power cord 125V 15A 2.0M C14 TO C13
ACC000242
Mellanox Technologies
98
InfiniBand FDR Switch Platform Hardware User Manual
Rev 1.7
Table 20 - Replacement Parts Ordering Numbers (Continued)
Part Description
OPN
Power cord Type B for USA, Canada, Mexico, Taiwan
ACC000204
Power cord Type H for Israel
ACC000205
Power cord Type E/F for Sweden, France, Germany,
Netherlands, Russia
ACC000207
Power cord Type G for UK
ACC000208
Power cord Type D for India
ACC000209
Power cord Type I for China
ACC000210
Power cord Type J for Switzerland
ACC000211
Power cord Type B for Japan
ACC000212
Power cord Type I for Australia
ACC000213
Mellanox Technologies
99
Appendix G: Installation Safety Warnings
G.1
Installation Safety Warnings (English)
1. Installation Instructions
Read all installation instructions before connecting the equipment to the power source.
2. Bodily Injury Due to Weight
Use enough people to safely lift this product.
3. Heavy Equipment
This equipment is very heavy and should be moved using a mechanical lift to avoid
injuries.
4. Installation in Restricted Access Location
This unit is intended for installation in a Restricted Access Location.
5. Risk of Electric Shock!
Risk of Electric Shock!
With the fan module removed power pins are accessible within the module cavity.
DO NOT insert tools or body parts into the fan module cavity.
6. Over-temperature
This equipment should not be operated in an area with an ambient temperature exceeding the maximum recommended: 45°C (113°F). Moreover, to guarantee proper air
flow, allow at least 8cm (3 inches) of clearance around the ventilation openings.
7. Stacking the Chassis
The chassis should not be stacked on any other equipment. If the chassis falls, it can
cause bodily injury and equipment damage.
Mellanox Technologies
100
8. Redundant Power Supply Connection - Electrical Hazard
This product includes a redundant power or a blank in its place. In case of a blank
power supply, do not operate the product with the blank cover removed or not securely
fastened.
9. Double Pole/Neutral Fusing
This system has double pole/neutral fusing. Remove all power cords before opening
the cover of this product or touching any internal parts.
10. Multiple Power Inlets
Risk of electric shock and energy hazard.
The PSUs are all independent.
Disconnect all power supplies to ensure a powered down state inside of the switch
platform.
11. During Lightning - Electrical Hazard
During periods of lightning activity, do not work on the equipment or connect or disconnect cables.
12. Copper InfiniBand Cable Connecting/Disconnecting
Copper InfiniBand cables are heavy and not flexible, as such they should be carefully
attached to or detached from the connectors. Refer to the cable manufacturer for special warnings/instructions.
13. Rack Mounting and Servicing
When this product is mounted or serviced in a rack, special precautions must be taken
to ensure that the system remains stable. In general you should fill the rack with equipment starting from the bottom to the top.
14. Equipment Installation
This equipment should be installed, replaced, and/or serviced only by trained and qualified personnel.
Mellanox Technologies
101
15. Equipment Disposal
Disposal of this equipment should be in accordance to all national laws and regulations.
16. Local and National Electrical Codes
This equipment should be installed in compliance with local and national electrical
codes.
17. Installation Codes
This device must be installed according to the latest version of the country
national electrical codes. For North America, equipment must be installed in
accordance to the applicable requirements in the US National Electrical Code
and the Canadian Electrical Code.
18. Battery Replacement
Warning: Replace only with UL Recognized battery, certified for maximum
abnormal charging current not less than 4mA
There is a risk of explosion should the battery be replaced with a battery of an
incorrect type.
Dispose of used batteries according to the instructions.
19. UL Listed and CSA Certified Power Supply Cord
For North American power connection, select a power supply cord that is UL Listed
and CSA Certified, 3 - conductor, [16 AWG], terminated with a molded plug rated at
125 V, [13 A], with a minimum length of 1.5m [six feet] but no longer than 4.5m.
For European connection, select a power supply cord that is internationally
harmonized and marked “<HAR>”, 3 - conductor, minimum 1.0 mm2 wire,
rated at 300 V, with a PVC insulated jacket. The cord must have a molded plug
rated at 250 V, 10 A.
20. High Leakage Current
Warning: High leakage current; Earth connection essential before connecting supply.
Mellanox Technologies
102
21. Add GND connection information
Before connecting this device to the power line, the protective earth terminal screws of
this device must be connected to the protective earth in the building installation.
(GND Connection Information):
The building installation shall provide a means for a connection to protective earth;
and the equipment shall be permanently connected to that by a service person.
A SERVICE PERSON shall check whether or not the socket - outlet from which the
equipment is to be powered provides a connection to the building protective earth. If
not, the SERVICE PERSON shall arrange for the installation of a PROTECTIVE
EARTHING CONDUCTOR from the separate protective earthing terminal to the protective earth wire in the building. The equipment shall be installed in area where equipotential bonding exists ((such as a telecommunication centre or a dedicated computer
room).
22. Installation codes
This device must be installed according to the latest version of the country national
electrical codes. For North America, equipment must be installed in accordance to the
applicable requirements in the US National Electrical Code and the Canadian Electrical Code.
23. Interconnection Of Units
Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL
certified type DP-1 or DP-2. (Note- when residing in non LPS circuit)
Overcurrent Protection: A readily accessible Listed branch circuit overcurrent
protective device rated 20 A must be incorporated in the building wiring.
24. Hazardous Radiation Exposure
Caution – Use of controls or adjustment or performance of procedures other
than those specified herein may result in hazardous radiation exposure.
CLASS 1 LASER PRODUCT and reference to the most recent laser standards
IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+
A2:2001
25. Proper Enclosure
A suitable electrical, mechanical and fire enclosure shall be provided by the end product manufacturer and or the end user.
Mellanox Technologies
103
26. Do Not Use the Switch as a Shelf or Work Space
Caution: Slide/rail mounted equipment is not to be used as a shelf or a work space. The
rails are not intended for sliding the unit away from the rack. It is for permanent installation at final resting place only, not used for service and maintenance
27. WEEE Directive
According to the WEEE Directive 2002/96/EC, all waste electrical and electronic
equipment (EEE) should be collected separately and not disposed of with regular
household waste.
Dispose of this product and all of its parts in a responsible and environmentally
friendly way.
4. Country of Norway Power Restrictions
This unit is intended for connection to a TN power system and an IT power system of
Norway only.
G.2
⸘孬⸘⏷㊶巵⛙ (Chinese)
1. ⸘孬㖖䯉
㦻岼⌨棓㦘⌨㚃榊䄟∪㑘⣷㒥⦷拸䠅⇜函揜㦘䴉䤌坚㨎ᇭ
2. ⥯摜摞⺝咃䤓ⅉ愺♦⍆
䍉ℕ⸘⏷怆尚᧨嵚⸘㘡恂⮯䤓ⅉ❰ⅴ⚗┪㔻怆㦻䞱❐ᇭ
Mellanox Technologies
104
3. 摜岼⌨
㦻岼⌨㰄摜᧨㑘∎䞷㳮㬿㆞怆摜㳮∕㚻䲊᧨ⅴ挎⏜ⅉ❰♦⍆ᇭ
4. ⸘孬㡋拁⒉丰Ⓟ●⩮
㦻岼⌨岼岗⸘孬㡋拁⒉丰Ⓟ●⩮ᇭ
5. 㦘岇榊䤓☀椹
㦘岇榊䤓☀椹᧝
㕕棳欷㓖㲰俓㈛᧨☂♾㘴岇Ⓙ㲰俓䴉口⏶䤓榊䄟摬吂ᇭ
嵚▎⺖ぴ␆㒥㳮愺榅ↅ㙡⏴Ⓙ欷㓖㲰俓䴉口⏶ᇭ
6. 䄺ㄵ拝浧
㦻岼⌨ₜ㑘⦷怔拝㓏ㆉ巿䤓㦏浧䜿⬒䄺ㄵ䤓●⩮₼拚⇫᧶r&r)ᇭ㷳⮥᧨
䍉ℕ≬巘㺲㿐䤓㿐抩㷲デ᧨嵚⦷抩欷♲㡐≬䟨咂⺠⏻⒕喀⚚ 䤓栢恬ᇭ
7. ⪕䠙㳮乀
㳮乀ₜ㑘⪕䠙⦷↊⇤␅Ⅵ岼⌨ₙᇭⰑ㨫㳮乀㘘囌᧨♾厌抯㒟ⅉ❰♦⍆咖岼⌨㚜
⭭ᇭ
8. 宖㆞榊䄟抲㘴㣑䤓榊㝙☀椹
㦻岼⌨棓㦘⌨㚃榊䄟∪㑘⣷㒥⦷拸䠅⇜函揜㦘䴉䤌坚㨎ᇭⰑ㨫㢾榊䄟∪㑘⣷䴉
䤌坚㨎᧨⦷䴉䤌坚㨎め♥ₚ㒥㦹䓱䓱⦉岑䤓㍔㽐ₚ᧨嵚▎㝜⇫㦻䞱❐ᇭ
9. 楨㰄 ₼㊶≬椹倁
㦻侊倀␆㦘楨㰄 ₼㊶≬椹倁ᇭ嵚㕣㘘㓏㦘榊䄟偩㈛᧨␜㓢栚㦻䞱❐䤓坚㨎㒥
䬿岇↊⇤⏶捷榅ↅᇭ
Mellanox Technologies
105
10. ⮩榊䄟懇⏴ㄶ
榊㝙咖厌䄟☀⹂䤓☀椹ᇭ
㓏㦘368⧖⚓呹䗷䵚ᇭ
⺖㓏㦘榊䄟∪㑘⣷㡆榊᧨䭉≬ℳ㙪⣷㄂♿⏶捷⦷榊䄟桫栘䕏㏚ᇭ
11. 栒榊㣑䤓榊㝙☀椹
⦷栒榊㦮栢᧨ₜ尐∎䞷㦻岼⌨㒥抲㘴㒥㕣ₚ儫偩ᇭ
12. InfiniBand 攔儫抲㘴 㕣ₚ
,QILQL%DQG 攔儫㈗摜₣㼡㦘㇗㊶᧨⥯㷳㉔檗⺞㉒孬⦷抲㘴⣷ₙ㒥呹抲㘴⣷ₙ㕣
ₚᇭⰑ榏䦇桫䤓䔈㸙巵⛙ 㖖䯉᧨嵚㿌峱儫偩完抯⟕ᇭ
13. 㳮㩅⸘孬咖值≽
㷳䞱❐め⸘孬⦷㳮㩅₼㒥⦷㳮㩅₼值≽㣑᧨㉔檗㘰♥䔈⸩檟棁㘹㡌ⅴ䭉≬侊倀
值㖐䳸⸩ᇭ₏咻㌷㑘崁⺖岼⌨㈭ㄤ捷Ⓙ檑䵾㟍䆎㳮㩅ᇭ
14. 岼⌨⸘孬
㦻岼⌨⍔棟䟀倢拝岢傃咖 㒥⚗㫋䤓ⅉ❰⸘孬ᇬ㦃㙪㒥值≽ᇭ
15. 岼⌨㭓函
㭓函㦻岼⌨㑘挄䏶㓏㦘⦚⏶㽤尞ᇭ
16. 䠅⦿咖⦚⹅榊㺲㽤尞
嵚挄䏶䠅⦿咖⦚⹅榊㺲㽤尞⸘孬㦻岼⌨ᇭ
Mellanox Technologies
106
17. ⸘孬㽤尞
嵚╨㉔挄㈹㦏㠿䓗䤓⦚⹅榊㺲㽤尞᧨⸘孬㦻岼⌨ᇭ⦷▦初⦿●᧨嵚╨㉔挄㈹初
⦚⦚⹅榊ぴ㽤尞✛┯㖎⮶榊ぴ㽤尞₼䤓拸䞷尞⸩᧨⸘孬㦻岼⌨ᇭ
18. 㦃㙪榊㻯
巵⛙᧶♹厌ⅴ8/崜♾榊㻯᧨₣♥㈦㦏⮶䟿デ⏔榊榊㿐⇝㡋P$崜巘䤓榊㻯拁
嫛㦃㙪ᇭ
啴㦃㙪斾崳櫭⨚䤓榊㻯᧨㦒㦘䒕䍇䤓☀椹ᇭ
嵚∬㝩㖖䯉㭓函ㅱ榊㻯ᇭ
19. UL⒦⚜✛CSA崜巘榊䄟偩
▦初⦿●⦷㘴ₙ榊䄟㣑᧨嵚指䞷䘁㈦8/⒦⚜✛&6$崜巘ᇬₘ⊚⺝浣ᇬ>
$:*@棓㒟⨚㙡檼᧨櫜⸩⋋䍉9ᇬ>$@᧨栆ㄵ咂⺠⏻⻉> ⏼喀⻉ @᧨⇕
ₜ怔拝⏻⻉䤓榊䄟偩ᇭ
㷟㿁⦿●⦷㘴ₙ榊䄟㣑᧨嵚指䞷⦚椪◣嵎㆞₣㲨䯉㦘+$5!ⷦ㲲ᇬₘ⊚⺝浣ᇬ
㲨䳀㒹槱咂⺠㄂㡈⏻☧᧨櫜⸩⋋䍉9᧨㘰䞷39&俤偲䤓榊䄟偩ᇭ榊䄟
偩榏㦘㒟⨚㙡檼᧨櫜⸩⋋䍉9$ᇭ
20. 浧䆞榊㿐
21. 㠿⬭GND 抲偩彖岙
檗抲㘴咂⮶㲢⸘孬₼䤓≬帆⦿偩ᇭ*1'抲偩彖岙 ᧶
⮶㲢⸘孬㑘㙟∪抲㘴≬帆⦿偩䤓㡈㆞᧷岼⌨₏㈚♹厌䟀值≽ⅉ❰抲㘴咂⦿偩ᇭ
值≽ⅉ❰㑘㴱㩴㙡ㄶ ∪榊俵岼⌨䤓㙡ㄶ 㢾⚵㙟∪抲㘴⮶㲢≬帆⦿偩䤓㡈㆞ᇭ
Ⱁ㨫㼡㦘᧨值≽ⅉ❰㑘⸘㘡㈭䗷䵚≬帆⦿偩䵾⷟᧨⺖≬帆㘴⦿⺝浣⸘孬咂⮶㲢
䤓≬帆⦿偩ᇭ岼⌨㑘⸘孬㡋㦘䷘榊⇜勾俟䤓●⩮ √Ⱁ᧨榊≰₼㉒㒥⺗䞷榊叵
⸳ ᇭ
22. ⸘孬㽤尞
嵚╨㉔挄㈹㦏㠿䓗䤓⦚⹅榊㺲㽤尞᧨⸘孬㦻岼⌨ᇭ⦷▦初⦿●᧨嵚╨㉔挄㈹初
⦚⦚⹅榊ぴ㽤尞✛┯㖎⮶榊ぴ㽤尞₼䤓拸䞷尞⸩᧨⸘孬㦻岼⌨ᇭ
23. ℡抲岼⌨
抲㘴咂56岼⌨✛⃨⮹偁恾⅚槱䤓儫偩㉔檗㢾8/崜巘櫭⨚'3㒥'3ᇭ
嵚㽷㎞⇜㡋槭/36榊恾㣑 拝榊㿐≬帆᧶䄥⌨Ⰼ∎䞷䤓⒦⚜⒕㞾榊恾拝榊㿐≬帆孬函㦏⮶櫜⸩⋋$㉔檗
㠃⚗⦷揜偩₼ᇭ
Mellanox Technologies
107
24. ☀椹䤓㟍⺓偩㥃槁
⺞㉒ದ∎䞷槭㦻㓚␙㖖⸩䤓㘶Ⓟᇬ嵎㠃㒥⪆嫛䲚ㄞ♾厌⺝咃㥬槁⦷☀椹䤓㟍⺓
偩ₚᇭ
揜⌨⏘儫抲㘴⩯䤓䞱❐
&/$66榆⺓䞱❐᧨₵♒䏶㦏㠿䤓榆⺓㲨䄥,(&$
$咖(1$$
揜⌨⏘儫抲㘴⩯䤓䞱❐
25. 拸䠅⮥㹋
俑䵾䞱❐ㅯ⟕㒥俑䵾∎䞷劔㑘㙟∪拸⚗䤓榊㺲ᇬ㳮㬿✛棁䋺⮥㹋ᇭ
26. ⒖㙪栚桫ₜ♾䞷⇫㳮㩅㒥ぴ⇫䴉栢
⺞㉒᧶䅠慛 ⺝慛⸘孬岼⌨ₜ♾䞷⇫㳮㩅㒥ぴ⇫䴉栢ᇭ⺝慛ₜ拸䞷㡋⺖岼⌨䅠
⒉㳮㩅∎䞷ᇭ⍔棟㻇⃔⸘孬⦷㦏㈛⸘函●⩮㣑∎䞷᧨ₜ♾䞷㡋值≽✛≬殙ᇭ
27. WEEE㖖ⅳ
㫈㝩:(((㖖ⅳ(&᧨㓏㦘ㅱ㭓䤓榊㺲咖榊⷟岼⌨(((᧨㑘⒕栚楕
₼᧨力₣ₜ㑘咖₏咻⹅ㄼㅱ㭓䓸₏怆㭓函ᇭ
嵚ⅴ弯弻✛䜿≬䤓㡈㆞㭓函㦻䞱❐♙␅㓏㦘榅ↅᇭ
28. 㖹Ⲑ⦚⹅榊䄟棟Ⓟ
㦻岼⌨⍔棟抲㘴咂㖹Ⲑ䤓71榊䄟侊倀✛,7榊䄟侊倀ᇭ
Mellanox Technologies
108
29. China CCC Warning Statement
Mellanox Technologies
109
G.3
Avertissements de sécurité pour l'installation (French)
1. Instructions d'installation
Veuillez lire la totalité des instructions d'installation avant de relier l'équipement au
secteur.
2. Blessures à cause du poids
Prévoyez assez de personnel pour soulever ce produit en toute sécurité.
3.
Équipement lourd
Cet équipement est très lourd et doit être déplacé avec un système de levage mécanique pour éviter les blessures.
4. Installation dans un emplacement à accès limité
Cette unité doit être installée dans un emplacement à accès limité.
5. Danger d'électrocution
Danger d'électrocution !
Lorsque le module de ventilation est retiré, les broches d'alimentation sont exposées
dans l'emplacement du module.
NE PAS insérer d'outils ou la main dans l'emplacement du module.
6.
Surchauffe
Cet équipement ne doit pas être en service dans un local dont la température dépasse le
maximum recommandé de 45°C (113°F). En outre et pour garantir une circulation
d'air correcte, laisser un espace d'au moins 8 cm (3") autour des orifices de ventilation.
Mellanox Technologies
110
7. Châssis empilé sur d'autres équipements
Le châssis ne doit pas être empilé sur d'autres équipements. S'il tombe, il peut endommager l'équipement ou entraîner des blessures.
8. Connexion de l'alimentation redondante : danger d'électrocution
Ce produit est équipé d'une alimentation redondante ou d'un cache si elle est absente.
Dans ce dernier cas, ne pas faire fonctionner le produit si le cache est retiré ou mal
fixé.
9. Fusibles phase/neutre
Ce système dispose de fusibles phase/neutre. Débranchez tous les cordons d'alimentation avant d'ouvrir le capot ou de toucher tout élément à l'intérieur.
10. Plusieurs prises d'alimentation
Risque et danger d'électrocution.
Les alimentations sont toutes indépendantes.
Pour s'assurer que le commutateur est bien hors tension, débranchez toutes les alimentations.
11. En cas d'orage, danger d'électrocution
Pendant un orage, ne pas travailler sur l'équipement ni brancher ou débrancher des
câbles.
12. Connexion et déconnexion du câble InfiniBand en cuivre
Les câbles InfiniBand en cuivre sont lourds et peu flexibles. Par conséquent, il faut
procéder avec soin pour les brancher ou les débrancher des connecteurs. Consulter le
fabricant du câble pour obtenir des instructions ou des avertissements spécifiques.
13. Montage en rack et maintenance
Lors du montage ou de la maintenance de ce produit dans un rack, il faut faire spécialement attention pour s'assurer que l'ensemble reste stable. En règle générale, le rack doit
être rempli en commençant par le bas.
Mellanox Technologies
111
14. Installation de l'équipement
Cet équipement ne doit être installé, remplacé et maintenu que par un personnel formé
et qualifié.
15. Mise au rebut de l'équipement
La mise au rebut de cet équipement doit se faire conformément à toutes les lois et
réglementations nationales.
16. Codes électriques locaux et nationaux
Cet équipement doit être installé conformément aux codes électriques locaux et nationaux.
17. Codes d'installation
Cet appareil doit être installé conformément à la version la plus récente des codes électrique nationaux. En Amérique du Nord, l'équipement doit être installé en respectant
les exigences de l'US National Electrical Code et du Code canadien de l'électricité.
18. Remplacement de la batterie
Avertissement : ne remplacer qu'avec une batterie UL, certifiée pour accepter un courant de charge anormal maximal supérieur ou égal à 4 mA.
Si la batterie n'est pas remplacée par un type correct, il y a un risque d'explosion.
Les batteries usagées doivent être mises au rebut conformément aux instructions.
19. Cordon d'alimentation UL Listed et certifié CSA
Pour le branchement électrique en Amérique du Nord, utiliser un cordon d'alimentation UL Listed et CSA Certified, à 3 conducteurs [calibre 16 AWG], avec une prise
moulée 125 V [13 A], faisant au moins 1,5 m de long [six pieds] et au plus 4,5 m.
Pour le branchement électrique en Europe, utiliser un cordon d'alimentation au format
international harmonisé (marqué <HAR>), à 3 conducteurs d'au moins 1 mm2 de section, 300 V, avec une gaine isolante en PVC. Le cordon doit avoir une prise moulée
250 V 10 A.
20. Courant de fuite élevé
Avertissement : courant de fuite élevé, une connexion à la terre est indispensable
avant de brancher l'alimentation.
Mellanox Technologies
112
21. Information d'ajout de branchement à la terre (GND)
Avant de relier cet appareil au secteur, ses vis des bornes de la terre de protection doivent être reliées à la terre de l'installation électrique de l'immeuble. (Informations de
branchement à la terre) :
L'installation électrique doit fournir une connexion à la terre, et un technicien de maintenance doit y relier l'équipement de façon permanente.
UN TECHNICIEN DE MAINTENANCE doit vérifier si la prise à laquelle sera branché l'équipement fournit une connexion à la terre. Si ce n'est pas le cas, le TECHNICIEN DE MAINTENANCE doit arranger l'installation d'un CONDUCTEUR DE
MISE A LA TERRE, allant de la borne de mise à la terre jusqu'au conducteur de terre
de l'immeuble. Cet équipement doit être installé dans une zone disposant de liaisons
équipotentielles (comme un centre de télécommunications ou une salle informatique
dédiée).
22. Codes d'installation
Cet appareil doit être installé conformément à la version la plus récente des codes électrique nationaux. En Amérique du Nord, l'équipement doit être installé en respectant
les exigences de l'US National Electrical Code et du Code canadien de l'électricité.
23. Interconnexion des unités
Les câbles de connexion aux interfaces RS232 et Ethernet de l'appareil doivent être
certifié UL de type DP-1 ou DP-2. (Note : en cas d'installation sur un circuit dont la
puissance n'est pas limitée)
Protection contre les surintensités : le câblage de l'immeuble doit intégrer un dispositif
certifié de protection contre les surintensités, calibré à 20 A et aisément accessible.
24. Exposition à des rayonnements dangereux
Attention : l'utilisation de commandes, l'ajustement ou la conduite de procédures
autres que celles indiquées ici pourraient conduire à une exposition dangereuse à des
rayonnements.
Pour les produits disposant de ports optiques
PRODUIT LASER DE CLASSE 1 et référence aux plus récentes normes relatives aux
lasers : IEC 60 825-1:1993 + A1:1997 + A2:2001 et EN 60825-1:1994+A1:1996+
A2:2001
Pour les produits disposant de ports optiques
25. Armoire de protection appropriée
Une enceinte appropriée aux niveaux électrique, mécanique et incendie doit être fournie par le constructeur du produit fini ou par l'utilisateur.
Mellanox Technologies
113
26. Ne pas utiliser comme étagère ou plan de travail
Attention : un équipement coulissant ou monté sur rail ne doit pas servir d'étagère ni de
plan de travail. Les rails ne sont pas destinés à faire coulisser l'unité hors du rack. Ils
sont destinés à une installation permanente à l'emplacement final, pas pour l'entretien
ni la maintenance.
27. Directive DEEE
Selon la Directive 2002/96/CE (DEEE), tous les déchets d'équipements électriques et
électroniques (EEE) doivent être collectés séparément et ne pas être mis au rebut avec
les déchets ménagers habituels.
Ce produit et toutes ses pièces doivent être mis au rebut d'une manière responsable,
respectant l'environnement.
28. Restrictions concernant l'alimentation pour la Norvège
G.4
Installation Sicherheitshinweise(German)
1. Installationsanleitungen
Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromversorgung
anschließen.
2. Verletzungsgefahr wegen des Gewichts
Um das Produkt sicher anzuheben, genügend Personen einsetzen.
3. Schweres Gerät
Dieses Gerät ist sehr schwer und muss mit einem mechanischen Hebegerät verschoben
werden, um Verletzungen zu vermeiden.
Mellanox Technologies
114
4. Installation an Bereich mit eingeschränktem Zugang
Diese Gerät ist für die Installation in einem Bereich mit beschränktem Zugang vorgesehen.
5. Stromschlagrisiko
Stromschlagrisiko!
Bei abgenommenem Ventilatormodul sind die Stromkontakte in der Modulvertiefung
zugänglich.
Es dürfen KEINE Werkzeuge oder Körperteile in die Vertiefung des Ventilatormoduls
gelangen.
6. Übertemperatur
Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der
maximal empfohlenen Temperatur von 45°C (113°F) betrieben werden. Es ist ein
Luftstrom von 200 LFM bei maximaler Umgebungstemperatur erforderlich. Außerdem sollten mindestens 8 cm (3 in.) Freiraum um die Belüftungsöffnungen sein, um
einen einwandfreien Luftstrom zu gewährleisten.
7. Stapeln des Chassis
Das Chassis sollte nicht auf andere Geräte gestapelt werden. Wenn das Chassis herunterfällt, kann es zu Verletzungen und Beschädigungen an Geräten führen.
5. Zweipolig/Neutrale Sicherung
Achtung:
Zweipolige bzw. Neutralleiter-Sicherung im Netzteil. Netzstecker ziehen, um sicherzustellen, daß keine Spannung am Gerät anliegt. Entfernen Sie alle Netzkabel vor dem
Öffnen der Abdeckung dieses Produkts oder dem Berühren der Innenteile.
8. Mehrere Stromeingänge
Risiko eines Stromschlags und Stomgefahr.
Alle Stromversorgungseinheiten sind unabhängig.
Trennen Sie alle Stomversorgungen, um einen abgeschalteten Zustand im Inneren der
Switch-Plattform sicherzustellen.
9. Bei Gewitter - Elektrische Gefahr
Arbeiten Sie während eines Gewitters und Blitzschlag nicht am Gerät, schließen Sie
keine Kabel an oder ab.
Mellanox Technologies
115
10. Anschließen/Trennen von InfiniBand-Kupferkabel
InfiniBand-Kupferkabel sind schwer und nicht flexible. Deshalb müssen sie vorsichtig
an die Anschlüsse angebracht bzw. davon getrennt werden. Lesen Sie die speziellen
Warnungen und Anleitungen des Kabelherstellers.
11. Rack-Montage und Wartung
Wenn dieses Produkt in einem Rack montiert oder gewartet wird, sind besondere Vorsichtsmaßnahmen zu ergreifen, um die Stabilität des Systems zu gewährleisten. Im
Allgemeinen sollten Sie das Gestell von unten nach oben mit Geräten füllen.
12. Geräteinstallation
Diese Gerät sollte nur von geschultem und qualifiziertem Personal installiert, ausgetauscht oder gewartet werden.
13. Geräteentsorgung
Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestimmungen erfolgen.
14. Regionale und nationale elektrische Bestimmungen
Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen
Bestimmungen installiert werden.
15. Installationscodes
Dieses Gerät muss entsprechend der aktuellsten Version des National Electrical Code
installiert weden. In Nodamerika muss das Gerät gemäß den geltenden Anforderungen
des US National Electrical Code und des Canadian Electrical Code installiert werden.
16. Akkuaustausch
Warnung: Nur durch von UL anerkannten Akkus ersetzen, die für maximalen anormalen Ladestrom von nicht weniger als 4mA zertifiziert sind.
Es besteht Explosiionsgefahr, wenn der Akku durch einen Akku eines falschen Typs
ersetzt wird.
Akkus gemäß den Anweisungen entsorgen.
Mellanox Technologies
116
17. UL- und CSA-zertifiziertes Netzkabel
Für Nordamerika Stromanschluss, wählen Sie ein Netzkabel, das UL-und CSA Certified
3 - Leiter, [18 AWG], mit einem angespritztem Stecker bewertet bei 125 V, [15], mit
einer Mindestlänge von 1,5 m [Six Feet] aber nicht mehr als 4,5 m.
Für die europäischen Zusammenhang, wählen Sie ein Netzkabel, das international
harmonisiert und der Aufschrift "<HAR>",
3 - Leiter, mindestens 0,75 mm2 Draht, bewertet mit 300 V, mit einem PVC-Mantel
isoliert. Das Kabel muss eine angespritztem Stecker bewertet bei 250 V, 10 A. "
18. Hoher Ableitstrom
WARNUNG: Hohe Ableitstrom; Earth Verbindung, bevor Sie die Verbindung von
wesentlicher Bedeutung werden.
19. Infomationen zum Erdungsanschluss
Bevor Sie dieses Gerät an das Stromnetz, die Schutzerde Terminal Schrauben dieses
Gerät muss an den Schutzleiter in der Gebäudeinstallation.
20. Installationscodes
Dieses Gerät muss installiert sein, entsprechend auf die neueste Version des Landes
National Electrical Code. Für Nordamerika, müssen in Übereinstimmung mit den geltenden Vorschriften in der US-amerikanischen National Electrical Code und dem
Canadian Electrical Code.
21. Verbindung der Geräte untereinander
Kabel für den Anschluss an das Gerät RS232-und Ethernet-Schnittstellen müssen UL
zertifiziert Typ DP-1 oder DP-2. (Hinweis-, wenn nicht mit Wohnsitz in LPS-Schaltung)
Überstromschutz: Eine leicht zugängliche Auflistung Abzweigleitung ÜberstromSchutzeinrichtung 20 A bewertet werden müssen in dem Gebäude Verkabelung.
22. Gefährliche Strahlung
Achtung – Nutzung von Steuerungen oder Einstellungen oder Ausführung von Prozeduren, die hier nicht spezifiziert sind, kann zu gefährlichem Strahlenkontakt führen..
Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards :
ICE 60 825-1:1993 + A1:1997 + A2:2001 und EN 60825-1:1994+A1:1996+ A2:2001
Mellanox Technologies
117
23. Geeignetes Gehäuse
Geeigneter elekrischer, mechanischer und Feuerschutz sind vom
Hersteller des Endprodukts oder dem Endbenutzer bereitzustellen.
24. Switch nicht als Regal oder Arbeitsplatz nutzen
Achtung: Auf Schieber/Schienen montiertes Gerät ist nicht als Regal oder Arbeitsbereich zu nutzen. Die Schienen sind nicht dafür bestimmt, die Einheit aus dem Gestell
weg zu ziehen. Sie sind nur für die permanente Installation an einem endgültigen Standort gedacht, nicht für Instandhaltung und Wartung.
25. WEEE-Direktive
Gemäß WEEE Directive 2002/96/EC müssen alle elektrischen und elektronischen
Abfallgeräte (EEE) separat gesammelt und nichit mit normalem Haushaltsmüll ensorgt
werden.
Dieses Produkt und alle seine Teile in verantwortungsvoller und umweltfreundlicher
Art und Weise entsorgen.
G.5
Advertencias de seguridad de instalación (Spanish)
1. Instrucciones de instalación
Antes de conectar el equipo a la fuente de alimentación, leer todas las instrucciones de
instalación.
2. Lesión corporal a causa de peso
.Recurra a suficientes personas para levantar este producto sin
Mellanox Technologies
118
3. Equipos pesados
Dado que el equipo es muy pesado, se debe mover únicamente mediante un elevador
mecánico, para evitar lesiones.
4. Instalación en lugares con acceso restringido
Esta unidad ha sido ideada para instalar en lugares de acceso restringido.
5. Riesgo de descarga eléctrica
¡Riesgo de descarga eléctrica!
Con el módulo del ventilador quitado, se obtiene acceso a las clavijas de alimentación
desde dentro de la cavidad del módulo.
NO introducir herramientas ni partes del cuerpo en la cavidad del módulo del ventilador.
6. Sobretemperatura
No se debe utilizar el equipo en un área con una temperatura ambiente superior a la
máxima recomendada: 45°C. Además, para garantizar una circulación de aire adecuada, se debe dejar como mínimo un espacio de 8 cm (3 pulgadas) alrededor de las
aberturas de ventilación.
7. Apilamiento del chasis
Los chasis no se deben apilar sobre otros equipos. La caída del chasis podría causar
lesiones corporales, así como daños al equipo.
8. Conexión redundante de fuente de alimentación: peligro de descarga
Este producto incluye una fuente de alimentación redundante o, en su lugar, una vacía.
Si se dispone de una fuente de alimentación vacía, no utilizar el producto si su tapa
está quitada o no está bien cerrada.
9. Fusible neutro o de polo doble
Dos fusibles, uno en el polo y otro en el neutro. Quitar los cables de corriente antes de
abrir la tapa de este producto o tocar cualquier componente interno.
Mellanox Technologies
119
10. Tomas de alimentación múltiples
Riesgo de descarga eléctrica y peligro de corriente.
Todas las fuentes de alimentación son independientes.
Desconecte todas las fuentes de alimentación, para asegurar que no haya corriente
alguna dentro de la plataforma de conmutación.
11. Al haber rayos: peligro de descarga
No utilizar el equipo ni conectar o desconectar cables durante períodos de actividad de
rayos.
12. Cable de conexión y desconexión InfiniBand de cobre
Dado que los cables de cobre InfiniBand son pesados y no son flexibles, su conexión a
los conectores y su desconexión se deben efectuar con mucho cuidado. Para ver advertencias o instrucciones especiales, consultar al fabricante del cable.
13. Montaje y mantenimiento del bastidor
Al instalar o realizar el mantenimiento de este aparato en un bastidor, es preciso adoptar precauciones especiales para garantizar que el sistema se mantenga estable. En general, en un bastidor, los equipos se deben instalar comenzando desde abajo hacia
arriba.
14. Instalación del equipo
La instalación, el reemplazo y el mantenimiento de este equipo estarán a cargo únicamente de personal capacitado y competente.
15. Eliminación del equipo
La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y
reglamentaciones nacionales.
16. Códigos eléctricos locales y nacionales
Este equipo se debe instalar conforme a los códigos eléctricos locales y nacionales.
Mellanox Technologies
120
17. Códigos de instalación
Este dispositivo se debe instalar conforme a la versión más reciente de los códigos
eléctricos nacionales del país en cuestión. En América del Norte, el equipo se debe
instalar de acuerdo con las disposiciones vigentes del Código Eléctrico Nacional de los
EE.UU. y del Código Eléctrico de Canadá.
18. Cambio de batería
II y a danger d’explosion s’il y a remplacement incorrect de la batterie. Remplacer
uniquement avec une batterie du même type ou d’un type équivalent recommandé par
le constructeur.
Mettre au rebut les batteries usagées conformément aux instructions du fabricant.
19. Cable de alimentación homologado por UL y con certificación CSA
En conexiones de América del Norte, seleccionar un cable de alimentación
homologado por UL y con certificación CSA de tres conductores, [16 AWG], terminado en un enchufe moldeado con capuchón de 125 voltios nominal, [13 A], con una
longitud mínima de 1,5 metros, pero no más de 4,5 metros.
En conexiones europeas, seleccionar un cable de alimentación armonizado
internacionalmente y marcado "<HAR>", de tres conductores, hilo de 1,0 mm2 como
mínimo, 300 voltios nominal, con cobertura protectora aislante de PVC. El cable debe
tener un enchufe moldeado con capuchón de 250 voltios nominal, 10 A.
20. Alta corriente de fuga
ADVERTENCIA: Alta corriente de fuga. Es esencial efectuar la conexión a tierra
antes de conectar la alimentación.
21. Agregar información de conexión a tierra (GND)
Antes de conectar el dispositivo a la línea de alimentación, los tornillos del terminal de
la puesta a tierra de protección del dispositivo se deben conectar a la puesta a tierra de
protección de la instalación del edificio.
(Información de conexión a tierra):
La instalación del edificio deberá prover un medio para la conexión con la puesta a
tierra de protección y un técnico de servicio deberá conectar permanentemente el
equipo a dicho medio de conexión.
Un TÉCNICO DE SERVICIO comprobará si la toma eléctrica de la que se suministrará corriente al equipo provee una conexión con la puesta a tierra de protección del
edificio. De no ser así, el TÉCNICO DE SERVICIO se encargará de instalar un CONDUCTOR DE CONEXIÓN A TIERRA DE PROTECCIÓN, del terminal de puesta a
tierra de protección separado al conductor de tierra de protección del edificio. El
equipo se instalará en un área donde haya conexión equipotencial, como por ejemplo,
un centro de telecomunicaciones o una sala de computadoras dedicada.
Mellanox Technologies
121
22. Códigos de instalación
Este dispositivo se debe instalar conforme a la versión más reciente de los códigos
eléctricos nacionales del país en cuestión. En América del Norte, el equipo se debe
instalar de acuerdo con las disposiciones vigentes del Código Eléctrico Nacional de los
EE.UU. y del Código Eléctrico de Canadá.
23. Interconexión de unidades
Los cables para la conexión con las interfaces RS232 y Ethernet de la unidad deben
estar homologados por UL tipo DP-1 o DP-2. (Nota: cuando residen en circuito no de
tipo LPS)
Protección contra sobrecargas: Al cableado del edificio se debe incorporar un dispositivo de protección contra sobrecargas de circuito derivado, de fácil acceso, con una
corriente nominal de 20 A.
24. Exposición a radiación peligrosa
Precaución: el uso de controles o ajustes o la realización de procedimientos distintos
de los que aquí se especifican podrían causar exposición a niveles de radiación peligrosos.
PRODUCTO LÁSER DE CLASE 1 y referencia a las normas de láser más recientes:
IEC 60825-1:2007/03 y EN 60825-1:2007
25. Recinto adecuado
El fabricante del producto final o el usuario final deberán suministrar
un confinamiento adecuado para componentes eléctricos y mecánicos y contra incendio.
26. No utilizar el conmutador como estante ni como espacio de trabajo
Cuidado: Equipos montados en deslizadores o rieles no se deben utilizar como estantes
ni como espacio de trabajo. La finalidad de los rieles no es deslizar la unidad hacia
afuera del bastidor. Sirven solo para la instalación permanente en el lugar de destino
final, no para fines de servicio o mantenimiento
27. Directiva WEEE
Conforme a la Directiva 2002/96/CE sobre RAEE, todos los residuos de equipos eléctricos y electrónicos (EEE) se deben recolectar por separado y no se deben eliminar
junto con residuos domésticos.
Al deshacerse de este producto y de todas sus partes, hágalo de una manera responsable y respetuosa con el medio ambiente.
Mellanox Technologies
122
G.6
Предупреждения по технике безопасности при установке (Russian)
1. Инструкция по установке
Перед подключением оборудования к источнику питания следует ознакомиться с
инструкцией по установке.
2. Травмы при переносе тяжелых предметов
Для поднятия этого изделия следует задействовать достаточное количество
людей.
3. Тяжелое оборудование
Это очень тяжелое оборудование, поэтому его следует перемещать с помощью
механического подъемника во избежание травм.
4. Опасность поражения электрическим током
Это устройство предназначено для установки в помещении с ограниченным
доступом.
5. Опасность поражения электрическим током
Опасность поражения электрическим током!
Когда снят вентиляторный модуль, существует возможность повреждения
контактов питания в его углублении.
НЕ вставлять инструменты или части тела в углубление вентиляторного модуля.
6. Перегрев
Не эксплуатировать это оборудование в помещении с температурой окружающей
среды, превышающей максимально рекомендуемое значение: 45 °C (113 °F).
Более того, для надлежащей вентиляции следует обеспечить зазор вокруг
вентиляционных отверстий не менее 8 см (3 дюйма).
Mellanox Technologies
123
7. Установка шасси поверх другого оборудования
Не устанавливать шасси поверх другого оборудования. Падение шасси может
привести к травмам и повреждению оборудования.
8. Опасность поражения электрическим током резервного источника питания
В этом изделии установлен резервный источник питания или модуль-заглушка.
Если установлен модуль-заглушка, не эксплуатировать изделие со снятой или
ненадежно закрепленной крышкой модуля-заглушки.
9.
Двухполюсный предохранитель на фазном и нейтральном проводах
В этой системе установлен двухполюсный предохранитель на фазном и
нейтральном проводах. Открывать кожух этого изделия или касаться внутренних
деталей можно только после отсоединения всех шнуров питания.
10. Несколько источников питания
Опасность поражения электрическим током и опасные энергетические
воздействия.
Блоки питания независимы друг от друга.
Чтобы обесточить все компоненты внутри платформы коммутации, следует
отсоединить все блоки питания.
11. Опасность поражения электрическим током во время грозы
Во время грозы запрещается использовать оборудование и подключать или
отключать кабели.
12. Подсоединение и отсоединение медных кабелей InfiniBand
Медные кабели InfiniBand тяжелые и негибкие, поэтому следует осторожно их
подсоединять и отсоединять. За особыми предупреждениями и указаниями
следует обратиться к производителю кабеля.
13. Установка или обслуживание в стойке
При установке или обслуживании этого изделия в стойке следует обеспечить
устойчивость системы. Как правило, стойка заполняется оборудованием снизу
вверх.
Mellanox Technologies
124
14. Установка оборудования
Устанавливать, заменять и/или обслуживать это оборудование должен только
подготовленный и квалифицированный персонал.
15. Утилизация оборудования
Это оборудование утилизируется в соответствии с национальными законами и
постановлениями.
16. Местные и национальные правила установки электрооборудования
Это оборудование устанавливается в соответствии с местными и национальными
правилами установки электрооборудования.
17. Правила установки электрооборудования
Это устройство устанавливается в соответствии с последним изданием
национальных правил установки электрооборудования. В Северной Америке
оборудование устанавливается в соответствии с действующими требованиями
Национальных правил эксплуатации и обслуживания электрических установок
США и Канады.
18. Замена аккумулятора
Осторожно! Заменять только аккумулятором, одобренным организацией UL и
рассчитанным на максимальный аномальный зарядный ток не менее 4 мА.
Существует риск взрыва при замене аккумулятора другим аккумулятором
неправильного типа.
Отработавшие аккумуляторы утилизируются в соответствии с указаниями.
19. Шнур питания, включенный в номенклатуру UL и сертифицированный Канадской
ассоциацией стандартизации (CSA)
Подключение к электропитанию в Северной Америке выполняется с помощью
шнура питания, включенного в номенклатуру UL и сертифицированного
Канадской ассоциацией стандартизации (CSA), 3-жильного, [16 AWG], длиной
от 1,5 м [6 футов] до 4,5 м, с литой вилкой, рассчитанной на 125 В [13 А].
Подключение к электропитанию в Европе выполняется с помощью
гармонизированного шнура питания с маркировкой <HAR>, 3-жильного, с
сечением жилы не менее 1,0 мм², рассчитанного на номинальное напряжение 300
В, с ПВХ оболочкой. Шнур должен иметь литую вилку, рассчитанную на 250 В,
10 А.
Mellanox Technologies
125
20. Высокий ток утечки
Осторожно! Высокий ток утечки. Заземлить перед подключением к
электропитанию.
21. Добавить информацию о подключении к заземлению
Перед подключением этого устройства к сети электропитания следует
подсоединить винты заземляющего зажима устройства к защитному заземлению
здания. (Информация о подключении к заземлению):
В здании должна быть предусмотрена возможность подключения к защитному
заземлению, к которому техник должен стационарно подключить оборудование.
ТЕХНИК должен убедиться, что розетка, от которой будет питаться
оборудование, подключена к защитному заземлению здания. Если розетка не
подключена к защитному заземлению, ТЕХНИК должен организовать прокладку
ПРОВОДА ЗАЩИТНОГО ЗАЗЕМЛЕНИЯ от отдельного зажима защитного
заземления до провода защитного заземления в здании. Оборудование
устанавливается в помещении с уравниванием потенциалов (например, в
телекоммуникационном центре или специальном помещении для компьютеров).
22. Правила установки электрооборудования
Это устройство устанавливается в соответствии с последним изданием
национальных правил установки электрооборудования. В Северной Америке
оборудование устанавливается в соответствии с действующими требованиями
Национальных правил эксплуатации и обслуживания электрических установок
США и Канады.
23. Подсоединение устройств
Для подключения к разъемам RS232 и Ethernet используются кабели типа DP-1
или DP-2, сертифицированные организацией UL. (Примечание. При
подключении к сети без ограниченного источника электропитания)
Максимальная токовая защита. В проводку здания в легкодоступном месте
следует включить устройство защиты от перегрузки по току номиналом 20 А.
24. Опасное радиационное воздействие
Внимание! Выполнение не изложенных здесь регулировок, настроек и процедур
может вызвать опасное радиационное воздействие.
ЛАЗЕРНОЕ ИЗДЕЛИЕ КЛАССА 1 и ссылка на последние стандарты по
безопасности лазерных изделий IEC 60 825-1:1993 + A1:1997 + A2:2001 и EN
60825-1:1994 + A1:1996 + A2:2001.
25. Соответствующий кожух
Производитель конечного изделия и/или конечный пользователь должны
обеспечить соответствующий электрический, механический и противопожарный
кожух.
Mellanox Technologies
126
26. Не использовать коммутатор как полку или рабочую
Внимание! Оборудование, установленное на направляющих, не должно
использоваться как полка или рабочая поверхность. Направляющие не
предназначены для удерживания устройства, выдвинутого из стойки. Они
предназначены для стационарной установки только в конечном положении и не
используются для обслуживания устройства.
27. Директива WEEE
В соответствии с Директивой 2002/96/EC (WEEE) отходы электрического и
электронного оборудования должны собираться и утилизироваться отдельно от
обычных бытовых отходов.
Следует утилизировать это изделие и все его части ответственным и
экологически безопасным способом.
G.7
Avertismente privind siguranţa la instalare (Romanian)
1. Instrucţiuni de instalare
Citiţi toate instrucţiunile de instalare înainte de a conecta
2. Accidentare cauzată de greutate
Apelaţi la un număr suficient de persoane pentru a ridica în siguranţă acest produs.
3.
Echipament greu
Acest echipament este foarte greu şi trebuie să fie mutat folosind un dispozitiv mecanic de ridicare pentru a evita producerea de leziuni.
Mellanox Technologies
127
4. Instalarea într-un loc cu acces limitat
Această unitate este destinată instalării într-un loc cu acces limitat.
5.
Risc de şoc electric
Risc de şoc electric!
Odată ce modulul ventilator este îndepărtat, pinii electrici sunt accesibili în cavitatea
modulului.
NU introduceţi instrumente sau părţi din corp în cavitatea modulului ventilator.
6.
Temperatură în exces
Acest echipament nu trebuie să fie acţionat într-o zonă unde temperatura ambiantă
depăşeşte valoarea maximă recomandată: 45°C (113°F). În plus, pentru a asigura un
flux de aer adecvat, lăsaţi un spaţiu liber de cel puţin 8 cm (3 inchi) în jurul fantelor de
ventilare.
7. Suprapunerea cadrului
Cadrul nu trebuie să fie suprapus peste niciun alt echipament. În cazul în care cadrul
cade, poate cauza leziuni corporale şi deteriorări ale echipamentului.
8. Conexiunea la o sursă de alimentare electrică suplimentară - pericol electric
Acest produs include o sursă de alimentare suplimentară sau un spaţiu gol în locul
acesteia. În cazul în care spaţiul pentru sursa de alimentare este gol, nu operaţi produsul când capacul orb este îndepărtat sau nu este fixat în mod sigur.
9.
Siguranţă fuzibilă bipolară/neutră
Acest sistem este prevăzut cu siguranţă fuzibilă bipolară/neutră. Îndepărtaţi toate cordoanele de alimentare înainte de a deschide capacul acestui produs sau înainte de a
atinge orice componente interne.
10. Multiple mufe electrice
Risc de şoc electric şi pericol electric.
Toate aparatele cu alimentare de la reţea sunt independente.
Deconectaţi toate sursele de alimentare cu energie pentru a asigura decuplarea în interiorul platformei de comutare.
Mellanox Technologies
128
11. În timpul descărcărilor electrice - pericol electric
În timpul perioadelor cu descărcări electrice luminoase, nu lucraţi cu echipamentul sau
nu conectaţi sau deconectaţi cablurile.
12. Conectarea/deconectarea cablului din cupru InfiniBand
Cablurile InfiniBand din cupru sunt grele şi inflexibile, de aceea trebuie să fie ataşate
sau detaşate de conectori cu grijă. Consultaţi producătorul de cabluri pentru avertismente/instrucţiuni speciale.
13. Montarea sau depanarea într-un rack
Când acest produs este montat sau depanat într-un rack, trebuie să fie luate măsuri de
precauţie speciale pentru a se asigura că sistemul rămâne stabil. În general, trebuie să
umpleţi rack-ul cu echipamente începând de jos în sus.
14. Instalarea echipamentului
Acest echipament trebuie să fie instalat, înlocuit şi/sau depanat numai de către personal
instruit şi calificat.
15. Eliminarea echipamentului
Eliminarea acestui echipament trebuie să se realizeze în conformitate cu toate legile şi
regulamentele naţionale.
16. Codurile electrice locale şi naţionale
Acest echipament trebuie să fie instalat conform codurilor electrice locale şi naţionale.
17. Codurile ed instalare
Acest dispozitiv trebuie să fie instalat în conformitate cu ultima versiune a codurilor
electrice naţionale ale ţării în cauză. Pentru America de Nord, echipamentul trebuie să
fie instalat conform cerințelor aplicabile din Codul electric naţional al SUA şi Codul
electric canadian.
Mellanox Technologies
129
18. Înlocuirea bateriei
Avertisment: Înlocuiţi numai cu o baterie recunoscută UL, certificată pentru curent de
încărcare anormal maxim de minimum 4 mA
Există risc de explozie în cazul în care bateria este înlocuită cu o baterie
necorespunzătoare.
Eliminaţi bateriile folosite în conformitate cu instrucţiunile.
19. Cordon de alimentare electrică înregistrat UL şi certificat CSA
Pentru conectarea la o sursă de alimentare pentru America de Nord, selectaţi un cordon
de alimentare care este înregistrat UL şi certificat CSA, cu 3 conductoare, [16 AWG],
terminat cu o fişă turnată, cu putere nominală egală cu 125 V, [13 A], cu o lungime de
minimum 1,5 m [şase picioare], dar nu mai lung de 4,5 m.
Pentru conectarea la o sursă de alimentare în Europa, selectaţi un cordon de alimentare
care este armonizat la nivel internaţional şi marcat „<HAR>”, cu 3 conductoare, cu
minimum 2 fire de 1,0 mm, cu putere nominală egală cu 300 V şi cu o manta izolantă
din PVC. Cordonul de alimentare trebuie să fie prevăzut cu o fişă turnată cu putere
nominală egală cu 250 V, 10 A.
20. Curent de scurgere de înaltă frecvenţă
Avertisment: Curent de scurgere de înaltă frecvenţă; Împământarea este esenţială
înainte de a conecta sursa de alimentare.
21. Adăugarea de informaţii privind legarea la pământ
Înainte de a conecta acest dispozitiv la o linie electrică de energie, şuruburile bornelor
de protecţie de legare la pământ ale acestui dispozitiv trebuie să fie conectate la priza
de pământ de protecţie din instalaţia clădirii. (Informaţii privind legarea la pământ):
Instalaţia clădirii va asigura un mijloc de conectare la priza de pământ, iar echipamentul va fi în mod permanent conectat la priza de pământ de un agent de întreţinere.
UN AGENT DE ÎNTREŢINERE va verifica dacă priza - borna de ieşire prin intermediul căreia va fi alimentat echipamentul cu energie electrică asigură o conexiune la
priza de pământ a clădirii. În caz contrar, AGENTUL DE ÎNTREŢINERE va dispune
instalarea unui CONDUCTOR DE PROTECŢIE DE LEGARE LA PĂMÂNT de la
borna separată de protecţie de legare la pământ la cablul de protecţie de legare la
pământ al clădirii. Echipamentul va fi instalat într-o zonă unde există legături
echipotenţiale (precum un centru de telecomunicaţii sau o cameră a computerelor
dedicată).
22. Codurile de instalare
Acest dispozitiv trebuie să fie instalat în conformitate cu ultima versiune a codurilor
electrice naţionale ale ţării în cauză. Pentru America de Nord, echipamentul trebuie să
fie instalat conform cerințelor aplicabile din Codul electric naţional al SUA şi Codul
electric canadian.
Mellanox Technologies
130
23. Interconectarea unităţilor
Cablurile pentru conectarea la unitatea RS232 şi la interfeţele Ethernet trebuie să fie de
tipul DP-1 sau DP-2 certificate UL. (Notă- când se regăsesc într-un circuit non-LPS)
Protecţie la supracurent: Un dispozitiv de protecţie la supracurent, înregistrat în circuitul de ramificare, uşor accesibil şi cu o putere nominală egală cu 20 A trebuie să fie
integrat în cablajul clădirii.
24. Expunerea la radiaţii periculoase
Atenţie – Utilizarea elementelor de comandă sau ajustarea sau executarea altor proceduri decât a celor indicate în acest document poate avea ca rezultat expunerea la
radiaţii periculoase.
PRODUS LASER CLASA 1 şi referire la cele mai recente standarde pentru laser IEC
60 825-1:1993 + A1:1997 + A2:2001 şi EN 60825-1:1994+A1:1996+ A2:2001
25. Carter adecvat
Un carter electric, mecanic şi ignifug adecvat va fi furnizat de fabricantul produsului
final şi/sau utilizatorul final.
26. Nu utilizaţi comutatorul ca raft sau spaţiu de lucru
Atenţie: Echipamentul montat pe o linie de alunecare/şină nu va fi utilizat ca raft sau
spaţiu de lucru. Scopul şinelor nu este de a glisa unitatea de pe rack. Acestea sunt destinate instalării permanente numai la punctul final de oprire şi nu vor fi folosite pentru
depanare şi întreţinere
27. Directiva DEEE
În conformitate cu Directiva DEEE 2002/96/CE, toate deşeurile de echipamente electrice şi electronice (EEE) trebuie colectate separat şi nu trebuie eliminate împreună cu
deşeurile menajere obişnuite.
Eliminaţi acest produs şi toate componentele sale în mod responsabil şi ecologic.
G.8
Sigurnosna upozorenja za instaliranje (Croatian)
1. Upute za instaliranje
Pažljivo pročitajte upute za instaliranje prije spajanja opreme na izvor električne energije.
Mellanox Technologies
131
2. Tjelesne ozljede uslijed težine
Kako biste sigurno podignuli ovaj proizvod, koristite dovoljan broj ljudi.
3.
Teška oprema
Ova oprema je vrlo teška i treba se premještati pomoću mehaničkog dizala kako bi se
izbjegle ozljede.
4. Instaliranje na lokaciji s ograničenim pristupom
Ovaj uređaj je namijenjen za instaliranje na lokaciju s ograničenim pristupom.
5. Rizik od strujnog udara!
Rizik od strujnog udara!
S uklonjenim modulom ventilatora, perima napajanja se može pristupiti u otvoru modula.
NEMOJTE umetati alat ili dijelove tijela u otvor modula ventilatora.
6. Pregrijavanje
Ovom se opremom ne bi trebalo rukovati u područjima s temperaturom okoline koja
premašuje najviše preporučene vrijednosti: 45°C (113°F). Osim toga, kako bi se osigurao odgovarajući protok zraka, omogućite najmanje 8 cm (3 inča) razmaka oko otvora
ventilatora.
7. Slaganje kućišta
Kućište se ne bi trebalo slagati na drugu opremu. Ako kućište padne, može izazvati
tjelesne ozljede i oštećenje opreme.
Mellanox Technologies
132
8. Redundantno napajanje - Opasnost od električne energije
Ovaj proizvod uključuje redundantno napajanje ili prazan prostor na njegovu mjestu.
U slučaju praznog prostora za napajanje, nemojte rukovati proizvodom ako je poklopac uklonjen ili ako nije dobro pričvršćen.
9. Dvopolni/neutralni osigurači
Ovaj sustav raspolaže dvopolnim/neutralnim osiguračima. Uklonite sve kabele napajanja prije otvaranja poklopca proizvoda ili dodirivanja unutarnjih dijelova.
10. Višestruki ulazi za napajanje
Rizik od strujnog udara i opasnost od električne energije.
PSU jedinice su neovisne.
Odspojite sva napajanja kako biste osigurali stanje bez napajanja unutar platforme
preklopnika.
11. Tijekom udara munje - Opasnost od električne energije
Tijekom djelovanja munja, nemojte raditi na opremi ili spajati ili odspajati kabele.
12. Spajanje/Odspajanje bakrenog kabela InfiniBand
Bakreni kabeli InfiniBand su teški i nesavitljivi i kao takvi se moraju pažljivo
priključiti na ili isključiti iz konektora. Obratite se proizvođaču kabela za posebna upozorenja/upute.
13. Montaža ormarića i servisiranje
Kad se proizvod montira ili se servisira u ormariću, moraju se poduzeti posebne mjere
opreza kako bi se osiguralo da sustav ostane stabilan. Općenito, trebali biste ispunjavati ormarić s opremom počevši od dna prema vrhu.
14. Instaliranje opreme
Ovu bi opremu trebalo instalirati, zamjenjivati i/ili servisirati samo obučeno i kvalificirano osoblje.
Mellanox Technologies
133
15. Odlaganje opreme
Odlaganje opreme trebalo bi se vršiti sukladno nacionalnim zakonima i propisima.
16. Lokalni i nacionalni električni kodovi
Ova oprema trebala bi se instalirati u skladu s lokalnim i nacionalnim električnim
kodovima.
17. Instalacijski kodovi
Ovaj se uređaj mora instalirati sukladno najnovijoj verziji nacionalnih
električnih kodova države. U Sjevernoj Americi oprema se mora instalirati
sukladno važećim zahtjevima navedenim u US National Electrical Code i
Canadian Electrical Code.
18. Zamjena baterije
Upozorenje: Bateriju zamijenite samo baterijom iz serije UL koja je certificirana za maksimalnu nepravilnu struju punjenja ne manju od 4 mA
Postoji rizik od eksplozije ako se baterija zamijeni neodgovarajućom vrstom.
Odložite prazne baterije sukladno uputama.
19. UL CSA kabel napajanja
Za sjevernoameričku mrežu odaberite kabel napajanja koji je na UL listi i sa
CSA certifikatom, 3 - žilni, [16 AWG] (16 AWG) koji završava lijevanim
utikačem nazivnog napona od 125 V, [13 A], minimalne duljine od 1,5 m [six
feet] (šest stopa), ali ne dulji od 4,5 m.
Za europsku mrežu odaberite kabel napajanja koji je međunarodno usklađen i
označen “<HAR>”, 3 - žilni, s najmanje 1,0 mm2 žice, nazivnog napona od
300 V, s PVC izolacijom. Kabel mora imati lijevani utikač nazivnog napona od
250 V, nazivne struje od 10 A.
20. Veliko curenje struje
Upozorenje: Veliko curenje struje; Prije spajanja napajanja nužno je spojiti uzemljenje.
Mellanox Technologies
134
21. Dodaj informaciju o GND spoju
Prije spajanja ovog uređaja na električni vod, vijci terminala zaštitnog uzemljenja
uređaja moraju se spojiti na zaštitno uzemljenje u instalacijama zgrade. (Informacija o
GND spajanju):
Instalacije u zgradi omogućit će sredstva za spajanje na zaštitno uzemljenje; a servisno
osoblje će trajno održavati spoj opreme s uzemljenjem.
SERVISNO OSOBLJE će provjeriti omogućuje li ili ne zidna utičnica napajanja za
opremu spoj na zaštitno uzemljenje zgrade. Ako ne, SERVISNO OSOBLJE će organizirati instaliranje VODIČA ZAŠTITNOG UZEMLJENJA iz posebnog terminala
zaštitnog uzemljenja na žicu zaštitnog uzemljenja u zgradi. Oprema će se instalirati u
područje gdje postoje ekvipotencijalni spojevi (poput telekomunikacijskog centra ili
namjenske računalne sobe).
22. Instalacijski kodovi
Ovaj se uređaj mora instalirati sukladno najnovijoj verziji nacionalnih električnih
kodova države. U Sjevernoj Americi oprema se mora instalirati sukladno važećim
zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code.
23. Interkonekcija uređaja
Kabeli za spajanje na jedinicu RS232 i Ethernet sučelja moraju biti s UL certifikatom vrste DP-1 ili DP-2. (Napomena - kad se nalazi u krugu bez LPS
vodiča)
Zaštita od strujnog preopterećenja: Uvijek dostupni odobreni zaštitni uređaji
od strujnog preopterećenja nazivne struje od 20 A moraju se ugraditi u
ožičenje zgrade.
24. Izloženost opasnom zračenju
Pozor – Korištenje kontrola, prilagodba ili izvođenje postupaka koji se razlikuju od onih koji su ovdje navedeni može izazvati izlaganje opasnom zračenju.
LASERSKI PROIZVOD KLASE 1 i referenca na najnovije laserske standarde
IEC 60 825-1:1993 + A1:1997 + A2:2001 i EN 60825-1:1994+A1:1996+
A2:2001
25. Odgovarajuća okolina
Odgovarajuće električno, mehaničko i protupožarno okruženje trebao bi omogućiti
proizvođač krajnjeg proizvoda i ili krajnji korisnik.
Mellanox Technologies
135
26. Nemojte koristiti preklopnik kao policu ili radnu površinu
Pozor: Oprema montirana na klizače/vodilice ne bi se trebala koristiti kao polica ili
radna površina. Vodilice nisu namijenjene za povlačenje uređaja iz ormarića. Služe
samo za trajnu instalaciju na konačnom položaju, a ne za servisiranje i održavanje.
27. WEEE direktiva
Sukladno WEEE direktivi 2002/96/EZ, sav električni i elektronički otpad (EEE) trebao
bi se prikupljati zasebno i ne bi se trebao odlagati kao običan kućanski otpad.
Odlaganje ovog proizvoda i svih njegovih dijelova vršite na odgovoran i ekološki
način.
28. Električna ograničenja države Norveške
Ovaj je uređaj namijenjen samo za spajanje na električni sustav s TN uzemljenjem i na
električni sustav s IT uzemljenjem države Norveške.
Mellanox Technologies
136
Download PDF
Similar pages
144 Port Modular InfiniBand Switch Platform
SX6710 - Mellanox Technologies
Installation Guide
IS5022
SX6005
48831-2 to 12 CD/DVD C-Tray Album (white) Specification
SX6005 Switch - Mellanox Technologies