Mellanox Technologies SwitchX-2 SX1012 User Manual

SwitchX®-2 60 Port Ethernet Switch System

Hardware User Manual

P/N: MSX1024B-1BFS, MSX1024B-1BRS, MSX1024B-2BFS, MSX1024B-2BRS

Rev 1.1

www.mellanox.com

Rev 1.0

NOTE:

THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED

DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY

KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE

THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT

HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE

PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND

DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST

QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED

WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT

ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES

FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND

(INCLUDING, BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;

LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY

THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE

OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED

DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Mellanox Technologies

350 Oakmead Parkway Suite 100

Sunnyvale, CA 94085

U.S.A.

www.mellanox.com

Tel: (408) 970-3400

Fax: (408) 970-3403

Mellanox Technologies, Ltd.

Beit Mellanox

PO Box 586 Yokneam 20692

Israel www.mellanox.com

Tel: +972 (0)74 723 7200

Fax: +972 (0)4 959 3245

2

© Copyright 2013. Mellanox Technologies. All Rights Reserved.

Mellanox®, Mellanox logo, BridgeX®, ConnectX®, CORE-Direct®, InfiniBridge®, InfiniHost®, InfiniScale®,

MLNX-OS®, PhyX®, SwitchX®, UFM®, Virtual Protocol Interconnect® and Voltaire® are registered trademarks of

Mellanox Technologies, Ltd.

Connect-IB™, FabricIT™, Mellanox Open Ethernet™, MetroX™, MetroDX™, ScalableHPC™, Unbreakable-Link™ are trademarks of Mellanox Technologies, Ltd.

All other trademarks are property of their respective owners.

Mellanox Technologies Document Number: 4083

SwitchX®-2 60 Port Ethernet Switch System Hardware User Manual

Table of Contents

Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

List of Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Chapter 1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

1.1 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

1.2 Serial Number and Product Version Information . . . . . . . . . . . . . . . . . . . . . . . . 11

Chapter 2 Ethernet Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

Chapter 3 Basic Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

3.1 Switch Platform Hardware Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

3.2 Status LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

3.2.1 System Status Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

3.2.2 Fan Status Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.2.3 Power Supply Status Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

3.3 Air Flow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

3.4 SFP+ Cable Power Budget Classification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

3.5 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

3.5.1 Port Connector Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

3.5.2 Port Speed Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

3.5.3 Management and Firmware Updating Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . 23

3.5.4 Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Chapter 4 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

4.1 Installation Safety Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

4.2 Installation Kits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

4.3 Package Contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

4.4 Mechanical Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

4.5 Grounding the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.6 Power Connections and Initial Power On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.7 Battery Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

4.8 Configuring the Switch the First Time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

4.9 Managed (Internally Managed) Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

4.10 Rerunning the Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

4.11 Connecting to the Switch Platform . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

4.11.1 Starting a Remote Connection to the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

4.12 Starting an SSH Connection to the Switch (CLI) . . . . . . . . . . . . . . . . . . . . . . . . 42

Chapter 5 Extracting and Inserting FRUs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43

5.1 Extracting and Inserting the Power Supply Unit . . . . . . . . . . . . . . . . . . . . . . . . . 43

5.2 Extracting and Inserting the Fan Units . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44

Rev 1.1

Mellanox Technologies 3

Rev 1.1

Chapter 6 Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

6.1 Splitting the Data Stream Using Breakout (Fanout) Cables . . . . . . . . . . . . . . . . 47

6.2 Cable Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

Chapter 7 Switch Shut Down Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

Chapter 8 Disassembly of the Switch from the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

8.1 Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

8.2 Upgrading Software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

Chapter 9 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Appendix A Specification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

A.1 Approved Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

A.2 EMC Certifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

A.3 China CCC Warning Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

Appendix B SFP+ Removal Tool Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Appendix C QSFP Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59

Appendix D SFP+ Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

Appendix E RJ-45 CONSOLE and I2C Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

Appendix F Accessory and Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

Appendix G Avertissements de sécurité d’installation (French) . . . . . . . . . . . . . . . . . . 65

Appendix H Installation - Sicherheitshinweise (German) . . . . . . . . . . . . . . . . . . . . . . . 69

Appendix I Advertencias de seguridad para la instalación (Spanish) . . . . . . . . . . . . 72

4 Mellanox Technologies


List of Figures

Figure 1: Connector Side View of the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

Figure 2: Pull Out Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

Figure 3: QSFP Switch System Power and Connector Side Panels . . . . . . . . . . . . . . . . . . . . . . . 14

Figure 4: System Status Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

Figure 5: Fan Status LED Connector Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Figure 6: Fan Status LED Power side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Figure 7: Power Status LED Connector Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Figure 8: Power Side Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Figure 9: PS Unit Status LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Figure 10: Bad Port LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Figure 11: Port LED to Port Location Assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Figure 12: Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Figure 13: Component Airflow Mismatch (Wrong) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Figure 14: Port Numbering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Figure 15: Top and Bottom QSFP Port Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Figure 16: Top and Bottom SFP+ Port Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Figure 17: Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Figure 18: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

Figure 19: Placement of Switch in Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

Figure 20: Mounting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

Figure 21: Screwing on the Rail . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

Figure 22: Inserting the Caged Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Figure 23: Slide the Rail into the Rail Slide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Figure 24: Status LEDs 5 Minutes After Power On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Figure 25: Two Power Inlets - Electric Caution Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Figure 26: Console Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

Figure 27: Fan and PS unit Air Flow Direction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43

Figure 28: Power Supply Unit Extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43

Figure 29: PS Unit Pulled Out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44

Figure 30: Air Flow Labels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45

Figure 31: Fan Module Latches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Figure 32: Breakout or Fanout Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Figure 33: Port Splitting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Figure 34: SFP+ Cable Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

Figure 35: QSFP Connector Male and Female Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

Rev 1.1


Rev 1.1

Figure 36: Rear View of Module With Pin Placement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61



List of Tables

Table 1: Revision History Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Table 2: Reference Documents and Web Sites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Table 3: System Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Table 4: Fan Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Table 5: PS Unit Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Table 6: Bad Port LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Table 7: Port Connector Physical and Logical Link Assignments for Ethernet . . . . . . . . . . . . . . . 20

Table 8: Air Flow Direction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

Table 9: Installation Kit According to Rack Size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

Table 10: Serial Terminal Program Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37

Table 11: Configuration Wizard Session - IP Configuration by DHCP . . . . . . . . . . . . . . . . . . . . . . 37

Table 12: Configuration Wizard Session - IP Zeroconf Configuration . . . . . . . . . . . . . . . . . . . . . . 39

Table 13: Configuration Wizard Session - Static IP Configuration . . . . . . . . . . . . . . . . . . . . . . . . . 40

Table 14: SX1024 Specification Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

Table 15: RJ-45 CONSOLE Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

Table 16: RJ-45 I2C Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

Table 17: OPNs for Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

Rev 1.1


Rev 1.1

Revision History

Table 1 - Revision History Table

Date

March 2013

January 2013

Revision

1.1

1.0

Description

Added SFP+ cable and module removal tool to contents.

Added figures to appendix.

Added note use only FCC compliant Ethernet cables.

Added note concerning USB insertion

Replaced wizard tables from MLNX-OS doc added section opening the CLI

Initial Release


SwitchX®-2 60 Port Ethernet Switch System Hardware User Manual Rev 1.1

About this Manual

This manual describes the installation and basic use of the Mellanox switch which is based on the

SwitchX®-2 switch device.

Intended Audience

This manual is intended for users and system administrators responsible for installing, running, and managing switch platforms.

The manual assumes familiarity with the Ethernet specification.

Related Documentation

Additional Documentation available from Mellanox:

Table 2 - Reference Documents and Web Sites

Document Name Description

SwitchX®-2 Switch Hardware Installation

Guide

The

Installation Guide

contains instructions for Installation in a rack and initialization of the switch platform. This document can be found on the product web page.

SwitchX®-2 Switch Product Hardware

Release Notes

For possible hardware issues see the switch support product page. This document can be found on the support web page for this product.

This requires a customer support login. Look up the relevant SwitchX®based switch system/series release note file.

Mellanox MLNX-OS® Software User

Manual

This document contains information regarding configuring and managing Mellanox Technologies Switch Platforms.

MLNX-OS® Software Command Reference Guide

Command Reference Guide for MLNX-OS® listing all of the commands available through MLNX-OS® with explanations and examples.

All of these documents can be found on the Mellanox Website at www.mellanox.com

. They are available either through the product pages www.mellanox.com

 Products  InfiniBand/VPI

Switch Systems or through the support page with a login and password.

Conventions

Throughout this manual, the name SX1024 and the term switch are used to describe the 60 port

SFP+/QSFP switch unless explicitly indicated otherwise.

The following icons are used throughout this document to indicate information that is important to the user.

This icon makes recommendations to the user.

This icon indicates information that is helpful to the user.


Rev 1.1

This icon indicates a situation that can potentially cause damage to hardware or software.

BEWARE! This icon indicates a situation that can potentially cause personal injury or damage to hardware or software.

Abbreviations

– Used to indicate a 4X port running at 56Gb/s

Mellanox Part Numbering Legend

Place

M

SX

P

Field

System Type

Data Transfer Protocol


SwitchX® switch Family

1 = Ethernet

Decoder

R Size of box

FF 40 Gb/s equivalent throughput

0 = 1U

1 = 1.5U

2 = 2U

16 = 640Gb/s

24 = 960Gb/s

35 = 2880 Gb/s Light version of the Management software

36 = 2880 Gb/s

X = 10Gb/s Ethernet B = 40Gb/s Ethernet C

-

P

M

Y

R

Data Rate

Separator

# Power Supplies

Depth of the Unit

Air Flow direction

Chip Generation

0=0, 1=1, 2=2....

S = standard depth, B = short depth

R= Connector side to Power side airflow 

F= Power Side side to Connector side airflow

R – SwitchX

S – SwitchX-2



1 Overview

The SX1024 Ethernet switch family provides the highest-performing fabric solution in a 1U form factor by delivering up to 1.152 Gb/s of non-blocking throughput to High-Performance Computing (HPC), high frequency trading and Enterprise Data Centers (EDC), with ultra-low latency. It has 48 10GbE ports that when connected to 10GbE based servers, provides a unique non-blocking solution for Ethernet Data-Centers.

Figure 1: Connector Side View of the Switch

Rev 1.1

SX1024

MGT

CONSOL

Mellanox

UID

RST

1.1

Features

• Based on Mellanox SwitchX-2

• Supports 48 SFP+ ports of 10 GbE

• Supports 12 QSFP ports of 40 GbE Upgradable with a license to 56 GbE

• 2x 10/100/1000BASE-T RJ-45 Ethernet port

• 1x RS232 RJ-45 Console connector

• 1x USB connector

• 1 + 1 redundant 300W AC/DC hot swappable Power supplies

• 3 + 1 redundant fans ordered in two fan units (Support Air in/out)

• On board Temperature monitoring

• Reset Push button on front panel

• Various status LEDs

• 19” rack mountable chassis, 1U with redundant power supplies and Fan units

1.2

Serial Number and Product Version Information

The serial number and the MAC for the switch are found on the pull out tab below the Mellanox logo on the right side of the Connector side panel. The MAC for the Management PC is also on this tab. This MAC is for the mgmt0 management interface (the top Ethernet port). The second interface mgmt1 has the next consecutive MAC. On this switch the mgmt1 interface is found on the power side on the left side.


Rev 1.1

59 60

Figure 2: Pull Out Tab

SX1024 mgmt0

Mellanox

Pull out tab

S/N: MT1244X03494

P/N: MSX1024B ‐ 1BFS

MAC: 0002C9020040

Rev:A1

Overview



2 Ethernet Ports

This Ethernet switch system supports 48 SFP+ ports, 12 QSFP ports and maintains a 4:1 ratio.

Each SFP+ port is capable of 10GbE/1GbE port speeds. Up to 24 SFP+ ports are capable of 1/2/

4/8G FC. Ports 1-12 are grouped as FC ports as well as ports 38-48.

All Ethernet ports can be manually configured through the CLI management interface.

Rev 1.1

40 GbE and 56 GbE are only guaranteed to work with approved cables and modules.

Each of the 12 QSFP ports is capable of up to 40GbE, upgradable to 56 GbE with a license, as well as 10GbE with a QSA QSFP to SFP+ adapter or QSFP to SFP+ Mellanox cables.

Each of the 48 SFP+ ports is capable of up to 10GbE.


Rev 1.1

Basic Operation

3 Basic Operation

3.1

Switch Platform Hardware Overview

Figure 3 shows the power side panel view of the switch. The figure shows the hot-swap power supply locations and the hot-swap fan modules, and an I2C banana connector.

The figure also shows the connector side panel views of the internally managed switch. The figure shows port configurations for the switch systems. Managed systems have 2 – Ethernet RJ-45 connectors for management, 1 – RJ-45 connector for connecting to a host PC, 1 – USB connector. All switches have various status LEDs for on site switch status information.

Figure 3: QSFP Switch System Power and Connector Side Panels

OK

!

OK

!

OK

!

OK

!

Mellanox

Power Side Panel

PS

UID

RST

49 50 51 52 53 54 55 56 57 58 59 60

SX1024

Mellanox

Connector Side Panel

3.2

Status LEDs

3.2.1

System Status Indicators

The System Status Indicators are located to the left of the connectors on the connector side panel, and on the power side at the far right. Both of these LEDs give identical information.

Figure 4: System Status Indicators

Green – OK

Yellow – a fault in the system

Red – Major Fault or

Fatal Error

Led Color shows the switch status

PS

UID

RST

Power side  status LED

Connector side  status LED



The system status indicators should display as follows:

• when the switch is plugged in, within five minutes the STATUS LED should light up green

• the FAN LED should light up green. If the FAN LED shows red, troubleshoot the fan module. See “Troubleshooting” on page 52.

As long as there is power to the switch (one PS unit is connected), and the switch is booted up and running, the status LED should be green.

Rev 1.1

If the STATUS LED shows red after five minutes, unplug the switch and call your

Mellanox representative for assistance.

If the switch shuts down due to over temperature, unplug the switch, wait 5 minutes and replug in the switch. For more information See “Troubleshooting” on page 52.

PS

UID

RST

Table 3 shows the system status LED assignment.

Table 3 - System Status LED Assignments

LED Configuration

Solid Green

Flashing Green

Solid Yellow

Solid Red

Off

STATUS/ System Health LED

OK – The system is up and running.

The system is booting up. This assignment is valid on managed systems only.

To be implemented in a future SW release.

Major Error – Possible damage can result to the switch. Turn off immediately.

e.g. bad firmware, can’t boot, overheated. If the system is booting up, it can take up to 5 minutes for the status led to change to green.

Off – The system has no power.


Rev 1.1

3.2.2

Fan Status Indicators

The indicator is located to the left of the connectors on the connector side panel.

Figure 5: Fan Status LED Connector Side

PS

UID

RST

The LED indicator on the Fan Module is on the right side of the module.

Figure 6: Fan Status LED Power side

Basic Operation

This is a two color LED

!

UID

RST

Table 4 shows the fan status LED assignment.

Table 4 - Fan Status LED Assignments

Fan air flow direction indicator


Solid Green

Solid Red

Off

FAN LED

OK – All fans are up and running.

Error – One or more fans is not operating properly. The system should be powered down and troubleshoot the fan module.

Off – The fan unit is not receiving any power. Check that the fan unit is properly and completely inserted.



All fans must be operating while the power supply is plugged in.

If the switch shuts down due to over temperature, unplug the switch, wait 5 minutes and replug in the switch. For more information See “Troubleshooting” on page 52.

3.2.3

Power Supply Status Indicators

The indicator is located to the left of the connectors on the connector side panel.

Figure 7: Power Status LED Connector Side

These are two color LEDs

Green — OK

Red — Major fault

Off — No power

PS

UID

RST

Figure 8: Power Side Panel

Fan status LEDs

OK

!

OK

!

OK

!

PS unit 1 status LED

OK

!

Mellanox

Fan Units

Primary Power Supply Unit

Each PS unit has a single 2 color LED on the right side of the PS unit, that indicates the internal status of the unit.

Rev 1.1


Rev 1.1

Basic Operation

Figure 9: PS Unit Status LEDs

This is a two color LED

Power supply fan air flow direction indicator

Table 5 shows the power supply unit status LED assignment.

Table 5 - PS Unit Status LED Assignments

LED Color

Solid Green

Solid Red

Off

Status

OK – The Power supply is delivering the correct voltage – 12VDC.

Error – The PS unit is not operational.

Off – There is no power to the system (neither PS unit is receiving power). If one

PS unit is showing green and the second PS unit is unplugged it will show a red indication.

3.2.3.1 Bad Port LED

Figure 10: Bad Port LED

PS

This is a one color LED

Flashing Orange — received symbol error

UID

RST

The Bad Port indicator is located on the left side of the connector side panel of the unit. Table 6 shows the fan status LED assignment.



Table 6 - Bad Port LED Assignments

LED Configuration Description

Off OK – No symbol errors have been received in last few seconds.

Flashing Orange Error – One or possibly more ports have just received a symbol error

Possible causes are:

• Bad cable

• Bad connection

• Bad connector

This LED lights up when one or more ports is receiving a symbol error. The LED immediately goes off until the next symbol error is received.

3.2.3.2 UID LED Switch Identifier

The UID LED is a debug feature that lights a blue LED on the switch connector side panel for ease in finding a particular switch.

3.2.3.3 Port Connector LED Indicators

The SFP+ ports come three rows to a column. The LEDs refer to the ports according to the color coding in Figure 11.

Figure 11: Port LED to Port Location Assignment

Rev 1.1

43 46

44 47

43 44 45 46 47 48

45 48

49

49

50

50


Rev 1.1

Figure 12: Port LEDs

Port LEDs

49 50 51 52 53

Basic Operation

Table 7 - Port Connector Physical and Logical Link Assignments for Ethernet


Off

Solid Green

Flashing Green

Flashing Orange

LED Description

Physical link is down / Default.

Physical link is up with no traffic.

Physical link is up with traffic.

Physical errors.

3.3

Air Flow

These switches can come with two air flow patterns. The two patterns are:

• Connector side inlet to power side outlet

• Power side inlet to connector side outlet

The air flow is specified in the product model number. See “Mellanox Part Numbering Legend” on page 10.On the PS unit and fan modules the air flow direction can be seen on the power side panel. All components need to have the same air flow. A mismatch in the air flow will affect the heat dissipation.

All PS units must have the same air flow as the fan modules.

Figure 13 shows a mismatch in component airflow.



OK

!

Figure 13: Component Airflow Mismatch (Wrong)

OK

!

OK

!

OK

!

Rev 1.1

OK

!

All air flow labels must be the same.



Any mismatch of these labels will affect the switch temperature.

OK

!

OK

!

OK

!

Table 8 shows the icons that indicate airflow using arrows and colors.


Rev 1.1

Table 8 - Air Flow Direction

Direction

Basic Operation

Label

OPN

Designation

Description

R

Connector side inlet to power side outlet

F

Power side inlet to connector side outlet

All components need the same colored airflow icons.

3.4

SFP+ Cable Power Budget Classification

All SwitchX®-2 SX10XX SFP+ switches are designed for active cables with a maximum power per module of 1.5W. Typical power per port is 1W.

3.5

Interfaces

3.5.1

Port Connector Interfaces

There are 48 SFP+ ports and 12 QSFP ports. They are arranged according to the figure below.



Figure 14: Port Numbering

1

2

3

4

5

6

7

8

9

10

11

12

13

14

16

17

15 18

19

20

22

23

21 24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

46

47

45 48

49 51 53 55 57 59

50 52 54 56 58 60

Figure 15: Top and Bottom QSFP Port Orientation

Rev 1.1

Figure 16: Top and Bottom SFP+ Port Orientation

3.5.2

Port Speed Configuration

These SFP+ ports can be manually configured to run at speeds ranging from 1GbE to 10 GbE.

These QSFP+ ports can be manually configured to run at speeds ranging from 10GbE to 56 GbE.

To change the port speed configuration use the GUI, or use the CLI and go to the interface configuration mode, then use the command “speed”.

3.5.3

Management and Firmware Updating Interfaces

There are six interfaces to connect to the SX1024:

• 2 X 100M/1Gb Ethernet connectors labeled

• 1 USB port that is labeled 

This interface can be used to update software or firmware.

• 1 connector that is labeled 

Use this connector to connect to the host PC.

• 1 reset button

• 1 I2C banana connector on the power supply side for FAE use only

I2C


Rev 1.1

Basic Operation

3.5.3.1 RJ-45 Connector

The port labeled is for a local host connection to the management module. This is used the first time the switch is connected. A harness is included in the package to connect to a DB9 connection on a host PC. Connecting to a local host PC and following the instructions in the

Installation Guide, “Configuring the Switch for the First Time”, must be done before any remote management is available. For the Socket pinout see “RJ-45 CONSOLE and I2C Interface” on page 63.

3.5.3.2 RJ-45 Ethernet Connector

The 2 Ethernet connections labeled provide access for remote management. The switch can be connected to any Ethernet port. The Ethernet port on the connector side of the switch is mgmt0. The Ethernet port on the power side of the switch is mgmt1.

Each Ethernet connector gets connected to Ethernet switches. These switches must be configured to 100M/1G auto-negotiation.

Use only FCC compliant Ethernet cables.

3.5.3.3 USB Connector

There is a single USB connector. This connector can be used to install software and or firmware upgrades using a memory device that has a USB connector. This connector is USB 2.0 compliant.

USB 1.0 is not supported.

Do NOT use excessive force when inserting or extracting the USB from the connector.

3.5.3.4 I2C Connector

There is an I2C connector on the far right of the power side of the switch.

This interface is for

Debug and Troubleshooting only.

This connector can be used to install firmware upgrades, should the firmware image be damaged and cannot be upgraded through a host PC or remotely. This interface is for support personnel and advanced users only.



3.5.4

Reset Button

On the connector side panel under the system LEDs is a reset button. This reset button requires a tool to be pressed.

Rev 1.1

DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button. Sharp objects can cause damage, use a flat object to push the reset button.

Figure 17: Reset Button

Press the reset button to reset the main and management CPUs and to delete the existing password.

PS

UID

RST

This button resets both the CPU of the switch device and the CPU of the management module. It thereby resets all of the ports by bringing them down and powering them up when the button is pushed. A quick push of this button performs this reset. When the button is held down for 15 seconds the switch is reset and the password is deleted. You will then be able to enter without a password and make a new password for the user

“admin”

.


Rev 1.1

4 Installation

Installation and initialization of the switch platform are straightforward processes, requiring attention to the normal mechanical, power, and thermal precautions for rack-mounted equipment.

4.1

Installation Safety Warnings

For Safety Warnings in French see “Avertissements de sécurité d’installation (French)” on page 65, for German see See “Installation - Sicherheitshinweise (German)” on page 69, and for

Spanish see “Advertencias de seguridad para la instalación (Spanish)” on page 72.

1. Installation Instructions

Installation

Read all installation instructions before connecting the equipment to the power source.

2. Over-temperature

This equipment should not be operated in an area with an ambient temperature exceeding the maximum recommended: 45°C (113°F). Moreover, to guarantee proper air flow, allow at least 8cm (3 inches) of clearance around the ventilation openings.

3. Restricted Access Location

This unit is intended for installation in a Restricted Access Location. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security.

4. Stacking the Chassis

The chassis should not be stacked on any other equipment. If the chassis falls, it can cause bodily injury and equipment damage.

5. Redundant Power Supply Connection - Electrical Hazard

This product includes a blank cover over the space for the redundant power supply. Do not operate the product if the blank cover is not securely fastened or if it is removed.

6. During Lightning - Electrical Hazard

During periods of lightning activity, do not work on the equipment or connect or disconnect cables.



7. Copper Cable Connecting/Disconnecting

Copper cables are heavy and not flexible, as such they should be carefully attached to or detached from the connectors. Refer to the cable manufacturer for special warnings and instructions.

8. Rack Mounting and Servicing

When this product is mounted or serviced in a rack, special precautions must be taken to ensure that the system remains stable. In general you should fill the rack with equipment starting from the bottom to the top.

9. Equipment Installation

This equipment should be installed, replaced, or serviced only by trained and qualified personnel.

10. Equipment Disposal

Disposal of this equipment should be in accordance to all national laws and regulations.

11. Local and National Electrical Codes

This equipment should be installed in compliance with local and national electrical codes.

12. Hazardous Radiation Exposure

Rev 1.1

Caution – Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure.

CLASS 1 LASER PRODUCT and reference to the most recent laser standards: 

IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:2001


Rev 1.1

13. UL Approved AC Power Cords

For North American power connection, select a power supply cord that is UL Listed and CSA Certified 

3 - conductor, [18 AWG], terminated in a molded on plug cap rated at 125 V, [15 A], with a minimum length of 1.5m [six feet] but no longer than 4.5m

For European connection, select a power supply cord that is internationally  harmonized and marked “<HAR>”, 

3 - conductor, minimum 0,75 mm2 wire, rated at 300 V, with a PVC insulated jacket.

The cord must have a molded on plug cap rated 250 V, 10 A.

14. Do Not Use the Switch as a Shelf or Work Space

Caution: Slide/rail mounted equipment is not to be used as a shelf or a work space.

15. WEEE Directive

According to the WEEE Directive 2002/96/EC, all waste electrical and electronic equipment (EEE) should be collected separately and not disposed of with regular household waste.

Dispose of this product and all of its parts in a responsible and environmentally friendly way.

The switch platform can be rack mounted and is designed for installation in a standard 19” rack.

The power side of the switch includes a hot-swap power supply module, a blank cover for an optional second PS unit for redundancy, and 2 hot-swap fan trays. There are two possible air flow directions. Be sure that the switch air flow direction is compatible with your system, rack, and PS units. The connector side of the switch has the ports, system LEDs, and management connection ports.

The switch platform contains auto-sensing 100 - 240 VAC connections for all possible PS units.

The installer should use a rack capable of supporting the mechanical and environmental characteristics of a fully populated platform.

The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take precautions to guarantee proper ventilation in order to maintain good airflow at ambient temperature. Cable routing in particular should not impede the air exhaust from the chassis.

Installation



4.2

Installation Kits

There are two Installation kit options. One long and one short. Both the standard and the short switches can be mounted using the long rail kit.

Table 9 - Installation Kit According to Rack Size

Kit OPN

MSX60-BKIT

MSX60-SKIT

Rack Size

40-60 cm deep

60-80 cm deep

Rev 1.1

4.3

Package Contents

Before you install your new switch, unpack the system and check to make sure that all the parts have been sent, check this against the parts list below. Check the parts for visible damage that may have occurred during shipping.

The switch comes packed with the following items:

• 1 X – switch

• 1 X – installation kit

• 1X – power cable one for each PS unit – Type C13-C14

• 1 X – Harness

• HAR000028 – Harness RS232 2M cable – DB9 to RJ-45

• 1 X – SFP+ cable and module removal tool

• 1 X – Quick Start Guide

• 1 X – China RoHS statement

If anything is damaged or missing, contact your customer representative immediately.

For customer support go to:  www.mellanox.com

=>Support => Customer Support Portal Login

4.4

Mechanical Installation

Tools and Customer Supplied Parts:

• Phillips Screwdrivers #1 and #2 • Grounding screw

• ESD strap • Grounding wire sufficient to reach a valid ground.

• ESD mat

For racks from 60cm to 80cm deep either use the standard depth switches with the long rail kit or the short switches with the long rail kit.

Parts included in the rail kit:

• 2 rails

• 2 rail slides

• 2 switch slides

• 16 recessed flat head screws You will have extras!

• 10 caged nuts

• 10 pan head screws M6


Rev 1.1

Figure 18: Rack Rail Kit Parts

Switch slide x2

Rail x2

Rail slide x2

Installation

1. Place the ESD mat on the floor where you will be working and put on the ESD strap. Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground.

2. Choose which side of the switch you want even with the rack vertical support. Either the side with the power supply units or the side with the QSFP connectors can be even with one of the vertical rack supports.



Figure 19: Placement of Switch in Rack

Doors

Connector side

Cable with recommended bending radius

19" (482.6mm)

Rev 1.1

This edge of the switch is even with the rack vertical support

Switch

Power / Spine side

Doors

Insufficient room for recommended bending radius

Consider the following when deciding where and how to mount the rails and rail slides:

The distance between the rack and the door can be as little as 1.57” (4 cm) on one side of the rack and as much as 7”(18 cm) on the other side of the rack. Keep in mind that there can be as many as

60 cables connected to the switch.

• Do you want the connector side recessed in the rack to allow for a larger cable bending radius? It is possible to recess the connector side by 2” (5cm) by optional placement of the switch rails. See Figure 20,“Mounting Options”.

• Will the connector side be recessed past other equipment in the rack and will this be problematic?

• The installation kit allows for a 2” (5cm) recess of the switch past the vertical support.


Rev 1.1

Figure 20: Mounting Options

Installation

3. Decide which mounting option you want to use.

4. Screw the switch slides onto the switch. Use 5 flat head screws for short switches and 7 screws for standard depth switches, to connect each switch slide.

Figure 21: Screwing on the Rail



Figure 22: Inserting the Caged Nuts

Side you will slide the switch into

Second side

5. Clip 6 caged nuts into the holes in the rack on the side of the rack you will be sliding the switch into. Check that both sides of the switch, power side and connector side, are at the same level in the rack.

6. Clip 4 more caged nuts into the holes on the opposite side of the rack. Check that both sides of the switch, left and right, are the same level in the rack.

7. Slide the rail into the rail slide.

8. Using two of the bolts for each corner install the rails and rail slides in the rack. Do not tighten the bolts yet.

Figure 23: Slide the Rail into the Rail Slide

Rev 1.1

This side of the rail kit goes on the side of the rack you will slide the switch into. This is the same side of the switch that will be next to the vertical support.


Rev 1.1

9. Slide the switch into the rails.

10. Tighten the bolts to 9.2 Nm or 81.5 pound inches.

11. Put the switch into place and screw the bolts into the nuts. Tighten the bolts to 9.2 Nm or 81.5 pound inches.

12. Ground the switch.

13. Plug in the power cables.

14. Check the Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation.

Figure 24: Status LEDs 5 Minutes After Power On

Installation

PS

UID

RST

Warning: Any yellow or red status LEDs are cause for concern and must be dealt with immediately.

It can take up to 5 minutes to boot up, during which time the status LED may indicate red.

15. You can start connecting all of the cables to the switch.

4.5

Grounding the Switch

Check to determine if your local or national electrical codes require an external ground to all IT components. If so, connect a ground wire to one of the casing screws and connect the other end to a valid ground. If you choose to not use the ground screw, make sure that the rack is properly grounded and that there is a valid ground connection between the chassis of the switch and the rack. Test the ground using an Ohm meter.

Some national and/or local codes may require IT components to be bonded and externally grounded (not including the power cord ground). You must follow all national and local codes when installing this equipment.

4.6

Power Connections and Initial Power On

The switch platform ships witone or twoh power supply units. For switches with only one unit installed, a second PS unit may be installed at a later time. Each supply has a separate AC recep-


SwitchX®-2 60 Port Ethernet Switch System Hardware User Manual tacle. The input voltage is auto-adjusting for 100 - 240VAC, 50-60Hz power connections. The power cords should be standard 3-wire AC power cords including a safety ground and rated for

15A or higher.

Caution: The switch platform will automatically power on when AC power is applied.

There is no power switch. Check all boards, power supplies, and fan tray modules for proper insertion before plugging in a power cable.

Rev 1.1


Caution: After inserting a power cable and confirming the green system status LED light is on; make sure that the Fan Status indicator shows green.

If the fan status indicator is not green then unplug the power connection and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and/or obstacles.

Caution: When turning off the switch, make sure ALL Connector LEDS are off to ensure a powered down status.

Do not hot swap the power supply if your switch has only one power supply. You must power down the system to replace the power supply unit when there is only one PS unit in the switch.

Figure 25: Two Power Inlets - Electric Caution Notifications

CAUTION

Risk of electric shock and energy hazard. The two PS units are independent.

Disconnect all power supplies to ensure a powered down state inside of the switch platform.

ACHTUNG

Gafahr des elektrischen

Schocks. Entferrnen des

Netzsteckers elnes Netzteils spannungsfrei. Um alle Einhieten spannungsfrei zu machen sind die

Netzstecker aller Netzteile zu entfernen

ATTENTION

Risque de choc et de danger  e’lectriques. Le de’branchment d’une seule alimentation stabilise’e ne de’branch uniquement qu’un module

“Alimentation Stabilise’e”.

Pour isoler completement le module en cause, Il faut de’brancher toutes les alimentations stabilise’es.

4.7

Battery Replacement

Mellanox Technologies does not support battery replacement. Customer removal of the switch cover will void the warrantee. Only Remove the cover to comply with WEEE directives or to disassemble for environmentally approved disposal.


Rev 1.1

Customer removal of the switch cover will void the warrantee.

4.8

Configuring the Switch the First Time

The procedures described in this chapter assume that you have already installed and powered-on your switch according to the instructions in this document.

4.9

Managed (Internally Managed) Switches

Internally managed switches, must be configured before they will work. Follow the procedures below to configure the switch.



To configure the switch:

Externally managed switches do not get configured. The CONSOLE, Ethernet, and

USB connectors are not found on externally managed switches. Instead there is an I2C connector.

1. Connect the host PC to the Console (RJ-45) port of the switch system using the supplied cable. The Console ports for systems are shown below as examples.

Figure 26: Console Port

SX1024

6 57 58 59 60

Connect the host PC to this

Mellanox

Installation

Make sure to connect to the Console RJ-45 port of the switch and not to the (Ethernet)

MGT port.

No remote IP connection is available at this stage.



2. Configure a serial terminal program (for example, HyperTerminal, minicom, or Tera Term) on your host PC with the settings described in Table 10 .

Table 10 - Serial Terminal Program Configuration

Parameter

Baud Rate

Data bits

Stop bits

Parity

Flow Control

9600

8

1

None

None

Setting

3. Login (from a serial terminal program) as admin and use admin as password. This starts the

Mellanox configuration wizard.

4. Go through the Mellanox configuration wizard. Table 11 shows an example of a wizard session.

Table 11 - Configuration Wizard Session - IP Configuration by DHCP (Sheet 1 of 2)

Wizard Session Display (Example) Comments

Mellanox configuration wizard

Do you want to use the wizard for initial configuration? yes

You must perform this configuration the first time you operate the switch or after resetting the switch. Type ‘y’ and then press

<Enter>.

Step1: Hostname? [switch-1]

Step 2: Use DHCP on mgmt0 interface? [no]

If you wish to accept the default hostname, then press <Enter>.

Otherwise, type a different hostname and press <Enter>.

Perform this step to obtain an IP address for the switch. (eth0 is the management port of the switch.)

If you wish the DHCP server to assign the IP address, type ‘yes’ and press <Enter>.

Step 3: Enable IPv6? [yes] yes

Step 4: Enable IPv6 autoconfig (SLAAC) on mgmt0 interface? [no] no

If you type ‘no’ (no DHCP), then you will be asked whether you wish to use the ‘zeroconf’ configuration or not. If you enter ‘yes’

(yes Zeroconf), the session will continue as shown in Table 12.

If you enter ‘no’ (no Zeroconf), then you need to enter a static IP, and the session will continue as shown in Table 13.

The management interface will be able to use IPv6 addresses.

This turns on autoconfiguration of the IPv6 addresses. This is unsuitable for DHCPv6.


Rev 1.1

Installation

Table 11 - Configuration Wizard Session - IP Configuration by DHCP (Sheet 2 of 2)

Wizard Session Display (Example) Comments

Step 5: Admin password (Press <Enter> to leave unchanged)? <new_password>

Step 6: Confirm admin password?

<new_password>

To avoid illegal access to the machine, please type a password and then press <Enter>. Then confirm the password by re-entering it.

Note that password characters are not printed.

You have entered the following information: The wizard displays a summary of your choices and then asks you to confirm the choices or to re-edit them.

1. Hostname: <switch name>

2. Use DHCP on mgmt0 interface: yes

3. Enable IPv6: yes

4. Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: no

5. Admin password (Enter to leave unchanged):

(CHANGED)

Either press <Enter> to save changes and exit, or enter the configuration step number that you wish to return to.

To change an answer, enter the step number to return to.

Otherwise hit <enter> to save changes and exit.

Note:

To run the command “configuration jump-start” you must be in

Config mode.

Choice: <Enter>

Configuration changes saved.

To return to the wizard from the CLI, enter the

“configuration jump-start” command from configuration mode. Launching CLI...

<switch name>



Table 12 - Configuration Wizard Session - IP Zeroconf Configuration

Wizard Session Display - IP Zeroconf Configuration (Example)


Do you want to use the wizard for initial configuration? y

Step 1: Hostname? [switch-112126]

Step 2: Use DHCP on mgmt0 interface? [no]

Step 3: Use zeroconf on mgmt0 interface? [no] yes

Step 4: Default gateway? [192.168.10.1]

Step 5: Primary DNS server?

Step 6: Domain name?



Step 9: Admin password (Enter to leave unchanged)?

You have entered the following information:

1. Hostname: switch-112126

2. Use DHCP on mgmt0 interface: no

3. Use zeroconf on mgmt0 interface: yes

4. Default gateway: 192.168.10.1

5. Primary DNS server:

6. Domain name:

7. Enable IPv6: yes

8. Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: yes

9. Admin password (Enter to leave unchanged): (unchanged)



Choice:


To return to the wizard from the CLI, enter the "configuration jump-start" command from configure mode. Launching CLI...

<switch name> [standalone: master] >

Rev 1.1


Rev 1.1

Table 13 - Configuration Wizard Session - Static IP Configuration

Wizard Session Display - Static IP Configuration (Example)


Do you want to use the wizard for initial configuration? y

Step 1: Hostname? [switch-112126]

Step 2: Use DHCP on mgmt0 interface? [yes] n

Step 3: Use zeroconf on mgmt0 interface? [no]

Step 4: Primary IP address? 192.168.10.4

Mask length may not be zero if address is not zero (interface mgmt0)

Step 5: Netmask? [0.0.0.0] 255.255.255.0

Step 6: Default gateway? 192.168.10.1

Step 7: Primary DNS server?

Step 8: Domain name?



Step 11: Admin password (Enter to leave unchanged)?

You have entered the following information:

1. Hostname: switch-112126

2. Use DHCP on mgmt0 interface: no

3. Use zeroconf on mgmt0 interface: no

4. Primary IP address: 192.168.10.4

5. Netmask: 255.255.255.0

6. Default gateway: 192.168.10.1

7. Primary DNS server:

8. Domain name:

9. Enable IPv6: yes

10. Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: no

11. Admin password (Enter to leave unchanged): (unchanged)



Choice:


To return to the wizard from the CLI, enter the "configuration jump-start" command from configure mode. Launching CLI...

<switch name>[standalone: master] >

5. Before attempting a remote (for example, SSH) connection to the switch, check the mgmt0 interface configuration. Specifically, verify the existence of an IP address. To check the current mgmt0 configuration, enter the following commands:

Installation


SwitchX®-2 60 Port Ethernet Switch System Hardware User Manual sx-43 [standalone: master] > enable sx-43 [standalone: master] # configure terminal sx-43 [standalone: master] (config) # show interfaces mgmt0

The following is an example of the output:

Interface mgmt0 state

Admin up: yes

Link up: yes

IP address: 192.168.10.43

Netmask: 255.255.255.0

Speed: 1000Mb/s (auto)

Duplex: full (auto)

Interface type: ethernet

Interface source: physical

MTU: 1500

HW address: 00:02:C9:11:2A:AE

Comment:

RX bytes: 1343502058 TX bytes: 313920869

RX packets: 17589211 TX packets: 992717

RX mcast packets: 0

RX discards: 0 TX errors: 0

TX discards:

RX errors: 0 TX overruns: 0

RX overruns: 0 TX carrier: 0

RX frame: 0 TX collisions: 0

TX queue len: 1000

0

For managed switches, confirm that the latest SW revision is installed on this device.

Use the CLI to get the currently installed revision and then go to Mellanox.com to check the revision of the latest version.

6. Run the command: show version

7. Compare the results of this command with the latest version for your switch posted on the support page for your switch . This page will need a support login and password.



Starting the Command Line (CLI)

1. Set up an Ethernet connection between the switch and a local network machine using a standard RJ-45 connector.

2. Start a remote secured shell (SSH) to the switch using the command “ssh -l <username>

<switch ip address>.” rem_mach1 > ssh -l <username> <ip address>

Rev 1.1


Rev 1.1

Mellanox MLNX-OS Switch Management

Last login: Thu Apr 28 11:24:13 2011 from 192.168.10.1

Mellanox Switch switch >

3. Login to the switch (default username is admin

, password admin

)

4. Once you get the prompt, you are ready to use the system. Refer to MLNX-OS Command Reference Guide

for additional information on the CLI commands.

4.10

Rerunning the Wizard

If you want to rerun the wizard run the following commands: sx-43 [standalone: master] > enable sx-43 [standalone: master]# configure terminal sx-43 [standalone: master] (config) # configuration jump-start

4.11

Connecting to the Switch Platform

4.11.1 Starting a Remote Connection to the Switch

There are two ways to access the management CPU:

• Via the Ethernet connector for remote access:

• SSH

• Telnet

• Web

• SNMP

• XML

• Via KVM connections locally

4.12

Starting an SSH Connection to the Switch (CLI)

1. Set up an Ethernet connection between the switch and a local network machine (“the remote machine” henceforth) using a standard RJ-45 connector.

2. Connect to the remote machine ( rem_mach1

is used as an example).

3. Start a remote shell to the switch using the following command using 

<switch_IP_address> is the IP address of the switch.

rem_mach1 > ssh -l <username> <switch ip address>

Mellanox MLNX-OS® Switch Management

Password:

Last login: March 13, 2013 from 192.168.10.1

Mellanox Switch sx-43 [standalone: master] >

4. You can enter any supported command now.

Installation



5 Extracting and Inserting FRUs

5.1

Extracting and Inserting the Power Supply Unit

With both power supplies installed in the redundant configuration, either PS unit may be extracted without bringing down the system.

Make sure that the PS unit that you are NOT replacing is showing all green, for both the PS unit and status indicators.

Rev 1.1

Figure 27: Fan and PS unit Air Flow Direction

OK

!

OK

!

OK

!

Mellanox

Power supply Power supply

2 Fan Units

See Section 3.3 on page 20 for more information on air flow direction.

Power supply units have directional air flows similar to the fan module. The Fan module airflow must coincide with the airflow of all of the PS units. If the PS unit airflow direction is different from the fan module airflow direction the switch internal temperature will be affected.

OK

!

Figure 28: Power Supply Unit Extraction

OK

!

OK

!

OK

!

Push Here Latch release

If you are not immediately installing a new PSU you must install a blank so that the air flow for cooling the switch is not compromised.


Rev 1.1

Figure 29: PS Unit Pulled Out

Extracting and Inserting FRUs

 To extract a PS unit:

1. Remove the power cord from the power supply unit.

2. Grasping the handle with your right hand, push the latch release with your thumb while pulling the handle outward. As the PS unit unseats, the PS unit status indicators will turn off.

3. Remove the PS unit.



To insert a PS unit:

1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles.

Do not attempt to insert a PS unit with a power cord connected to it.

2. Insert the PS unit by sliding it into the opening until a slight resistance is felt.

3. Continue pressing the PS unit until it seats completely. The latch will snap into place confirming the proper installation.

4. Insert the power cord into the supply connector.

5. Insert the other end of the power cord into an outlet of the correct voltage.

The green PS unit indicator should light. If not, repeat the whole procedure to extract the PS unit and re-insert it.

5.2

Extracting and Inserting the Fan Units

This switch can operate indefinitely with less than a full compliment of fans in the fan modules operating properly so long as the ambient temperature is below 45° Celsius. This switch has two fan modules. Each fan module has two integral fans.




Risk of Electric Shock!

With the fan module removed power pins are accessible within the module cavity. 

DO NOT insert tools or body parts into the fan module cavity.

Rev 1.1

Operation without a fan unit should not exceed two minutes.

During fan hot-swap, if the LED indicator is OFF then the fan unit is disconnected.

There are two possible air flows for the fan unit. The air flow depends on the switch model. See

“Air Flow” on page 20 for an explanation of the model numbers and labels.

Make sure that the fans have the air flow that matches the model number. An air flow opposite to the switch design will cause the switch to operate at a higher (less than optimal) temperature.

OK

!

OK

!

Figure 30: Air Flow Labels

OK

!

OK

!

These air flow labels must be the same.



Blue is power side inlet to connector side outlet

OK

!

OK

!

OK

!

OK

!

Red is connector side inlet to power side outlet



To extract a Fan Unit:

1. Grasping the handle with your right hand, push the latch release with your thumb while pulling the handle outward. As the fan unit unseats, the fan unit status indicators will turn off.

2. Remove the fan unit.


Rev 1.1

OK

!

Figure 31: Fan Module Latches

OK

!

OK

!

Extracting and Inserting FRUs

OK

!

Push Here Latch release

 To insert a FAN Unit:

1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles.

2. Insert the fan unit by sliding it into the opening until slight resistance is felt. Continue pressing the fan unit until it seats completely.

The green fan status indicator should light. If not, extract the fan unit and reinsert it.

After two unsuccessful attempts to install the fan unit, power off the switch before attempting any system debug.



6 Cabling

6.1

Splitting the Data Stream Using Breakout (Fanout) Cables

Specific ports can be split by using a QSFP 1X4 breakout cable to split one 40 GbE port into 4 lanes (4 SFP+ connectors 10GbE each). These 4 lanes then go, one lane to each of the 4 SFP+ connectors.

Figure 32: Breakout or Fanout Cable

Rev 1.1

Figure 33: Port Splitting Options

7

8

9

10

11

12

13

14

16

17

15 18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49 51

50 52

This port can be split into 4 10Gb/s SFP+

This port is unmapped according to the Port Splitting Table

The maximum 10 Gb/s Ethernet ports configurable with this switch is 64.

53

54

55 57 59

56 58 60

When using a port to split a data stream into 4-10Gb/s data streams (four lanes) one of the other ports on the switch will be disabled (unmapped). When using this feature you MUST go into the

MLNX-OS® chassis management system and reconfigure the individual ports to split -4. See the

MLNX-OS® Software Command Reference Guide for instructions on port configuration.


Rev 1.1

6.2

Cable Installation

56Gb/s and 40Gb/s are only guaranteed to work with approved Mellanox Cables.

All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated. The LED indicator, corresponding to each data port, will light when the physical connection is established (that is, when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port). After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When a logical connection is made the LED will change to green. When data is being transferred the light will blink green.

Do not force the cable into the cage with more than 

40 newtons / 9.0 pounds force / 4 kg force. Greater insertion force may cause damage to the cable or the cage.

Cables in the bottom row should be inserted up side down in relation to the how the cables are inserted in the top row.

Figure 34: SFP+ Cable Orientation

Cabling

48

To remove, disengage the locks and slowly pull the connector away from the port receptacle. The

LED indicator for that port will turn off when the cable is unseated.

Care should be taken not to impede the air flow through the ventilation holes next to the connector ports. Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack.



7 Switch Shut Down Procedure

To shut down the switch run the command:

Reload halt [noconfirm]

The switch cannot be restarted remotely!

To restart the switch you must physically go to the switch and unplug and plug in the power cord.

Rev 1.1


Rev 1.1

Disassembly of the Switch from the Rack

8 Disassembly of the Switch from the Rack



To disassemble the switch from the rack:

1. Unplug and remove all connectors.

2. Unplug all power cords.

3. Remove the ground wire.

4. Unscrew the 2 center bolts from the side of the switch with the bracket.

Support the weight of the switch when you remove the screws so that the switch does not fall.

5. Slide the switch from the rack.

6. Remove the rail slides from the rack.

7. Remove the ten caged nuts.

8.1

Disposal

According to the WEEE Directive 2002/96/EC, all waste electrical and electronic equipment (EEE) should be collected separately and not disposed of with regular household waste.

Dispose of this product and all of its parts in a responsible and environmentally friendly way.

Follow the instructions found in the Mellanox Web site at mellanox.com

for proper instructions to disassemble and dispose of the Switch according to the WEEE directive.

This button resets both the CPU of the switch device and the CPU of the management module. It

Press the reset button to reset the main CPU and the management CPU and to delete the existing password.

PS

50

UID

RST thereby resets all of the ports by bringing them down and powering them up when the button is pushed. A quick push of this button performs this reset. When the button is held down for 15 sec-


SwitchX®-2 60 Port Ethernet Switch System Hardware User Manual onds the switch is reset and the password is deleted. You will then be able to enter without a password and make a new password for the user “admin” .

You will need the MLNX-OS® package or Mellanox to update firmware for this switch. The

MLNX-OS® package can be downloaded from:  http://www.mellanox.com.

=> Products > Management Software > MLNX-OS.

The Mellanox UFM Management software is also an option to more closely manage your fabric, switches and nodes.

The switch can be managed either remotely, or Out-of-Band using MLNX-OS.

The SX10XX switches come standard with a management software module for chassis management called Mellanox Operating System (MLNX-OS). MLNX-OS® is installed on all based managed switch systems. MLNX-OS® includes a CLI, chassis management software

Rev 1.1

The Ethernet ports for remote management connect to Ethernet switches. These switches must be configured to 100M/1G auto-negotiation.

8.2

Upgrading Software

Software and firmware updates are available from the Mellanox Support website. Copy the update to a known location on a Remote server within the user’s LAN.

Use the CLI in order to perform software upgrades. For further information please refer to the the

MLNX-OS Software User Manual section Upgrading MLNX-OS® Software.

Be sure to read and follow all of the instructions regarding the updating of the software on your switch system.


Rev 1.1

Troubleshooting

9 Troubleshooting

As soon as a switch is plugged in make sure that the green power LEDs on the PS units are on.

Issue 1.

Status LED and or Status Health LED:

If either of these two LEDs is red

unplug the switch and call your Mellanox representative.

Issue 2.

Power supply unit:

If the LED on the PS unit is not lit or is red, check that the power cable is plugged into a working outlet.

1.

Check that the power cable has a voltage within the range of 100 - 240 volts AC.

2.

Check that the air flow direction of the PS units are consistent with the Fan module air flow.

3.

Remove and reinstall the power cable.

4.

Remove and reinstall the PS unit.

Issue 3.

The power LED for the switch shuts off:

1.

Check that the there is adequate ventilation. Are the fan LEDs showing that the fans are all up and running?

2.

Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes are not blocked (especially dust over the holes).

3.

If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the switch using a vacuum cleaner.

Issue 4.

The green power LED for the fans does not come on:

1.

Check that the Power LEDs are on.

2.

Remove and reinstall the fan unit. Make sure the mating connector of the new unit is free of any dirt and/or obstacles. See Section 7, “Switch Shut Down Procedure,” on page 49.

3.

Check that the mating connector pins are not bent.

Do not run the switch if the System Status LED for the Fans is Red!

52

Issue 5.

Issue 6.

Issue 7.

The link LED for the connector does not come on:

1.

Check that both ends of the cable are connected.

2.

Check that the locks on the ends are secured.

3.

Make sure that the latest firmware version is installed on all of the HCA cards and the switch.

4.

If media adapters are used, check that the all connections are good, tight, and secure.

The acti

vity

LED does not come on:

When running IB check that the Subnet Manager has been started.

The switch is off:

1.

Unplug the switch.

2.

Wait 5 minutes.

3.

Plug in the switch.

4.

If the switch does not come on, check the power supplies.



Issue 8.

Issue 9.

5.

If the switch comes on, Use the MLNX-OS® management CLI to determine the cause of the Shutdown.

6.

Check the temperature.

7.

Check the Fan status.

The switch is not working and unresponsive:

1.

Reset the switch.

If resetting the switch does not work:

1.

Unplug the switch.

2.

Wait 5 minutes.

3.

Plug in the switch.

4.

If the switch does not come on, check the power supplies.

5.

If the switch comes on, use the MLNX-OS® management CLI to determine the cause of the shutdown.

The last software update did not succeed:

1.

Connect the RS232 connector (CONSOLE) to a laptop.

2.

Push the reset button on the switch or management module.

3.

You will have ~ 5 seconds to stop the U-Boot by pressing Control-B.

4.

Choose the image to upload. Only use image 1 or image 2.

Rev 1.1

U-Boot 2009.01-mlnx1.4 (<date>)

CPU: AMCC PowerPC 460EX Rev. A at 1000 MHz (PLB=200, OPB=100, EBC=100 MHz)

Security/Kasumi support

Bootstrap Option H - Boot ROM Location I2C (Addr 0x52)

Internal PCI arbiter disabled

32 kB I-Cache 32 kB D-Cache

Board: Mellanox PPC460EX Board

FDEF: No

I2C: ready

DRAM: 2 GB (ECC enabled, 400 MHz, CL3)

FLASH: 16 MB

NAND: 1024 MiB

PCI: Bus Dev VenId DevId Class Int

PCIE0: link is not up.

PCIE1: successfully set as root-complex

01 00 15b3 bd34 0c06 00

Net: ppc_4xx_eth0, ppc_4xx_eth1

Hit Ctrl+B to stop autoboot: 0

Mellanox MLNX-OS

Boot Menu:

1. SX_PPC_M460EX 3.2.0000-dev-HA 2013-04-10 12:02:49 ppc


Rev 1.1

2. SX_PPC_M460EX 3.2.0000-dev-HA 2013-04-11 14:05:39 ppc

3. U-Boot prompt

Choice:

5.

Select the image to boot.

Troubleshooting


7.01 kg 1 PS unit

7.75 kg 2 PS units

Rev 1.1


Appendix A: Specification

Table 14 - SX1024 Specification Data

Size /Weight

Size:

SX1024B

(short)

Physical

1U

1.716” H x 16.85” W x 15.9” D

43.6 mm X 428 mm X 403.4 mm

IdataPLX

Weight:

Short:

Mounting

SerDes Speeds /

Connector Types

Mounting:

SerDes Speeds:

19” Rack mount

10 or 1Gb/s per port

Connector

Types: QSFP

Can use QSFP to SFP+ adapter modules

Air Flow/

Heat dissipation

Air Flow:

34.62 CFM

Heat dissipation:

Maximum

912.24 BTUs/hr

Input Voltage /

Management

CPU

Input Voltage:

Power and Environmental

100 - 240 VAC 50-60 Hz

Power 

Consumption: PS unit fan is always at 70%

Management

CPU: PowerPC 460EX CPU

Typ:

40 GbE

Passive cables:

Active Cables:

Optical cables:

SFP+

152W

218W

221W

MAX 1.5 W

TYP: 1.0 W

Power numbers

Max:

40GbE

Passive cables:

Active Cables:

Optical cables:

QSFP

Cable power /

Temperature

175 W

263 W

267 W

MAX 2.0 W

TYP: 1.5 W

Shock and

Vibration/

Humidity

Shock and 

Vibration: ETSI EN 300 019-2-2: 1999-09

Temperature:

Operating

Humidity:

Operating





Non-operating

0° to 45° Celsius

-40° to 70° Celsius

5% - 95% non-condensing


Rev 1.1

Table 14 - SX1024 Specification Data

Speed protocol \

QoS /

Management

Ethernet:

Protocol Support

Default 10Gb/s, must be manually configured to 1Gb/s through the GUI or the CLI.

Management:

Managed using MLNX-OS

Data Rate:

Data Rate

Safety \

EMC

(Emissions)

Safety:

10Gb/s

US/Canada: cTUVus

EU: IEC60950

Regulatory Compliance

EMC 

(Emissions):

International: CB

USA: FCC, Class A

Canada: ICES, Class A

EU: EN55022, Class A

EU: EN55024, Class A

EU: EN61000-3-2, Class A

EU: EN61000-3-3, Class A

Japan: VCCI, Class A

Environmental /

Acoustic

Environmental:

EU: IEC 60068-2-64: Random 

Vibration

EU: IEC 60068-2-29: Shocks, 

Type I /

II

EU: IEC 60068-2-32: Fall Test

Acoustic:

Scalability and Performance

Switching

Performance /

Capacity

Switching 

Performance: Simultaneous wire-speed any port to any port

Switching 

Capacity:

Reliability, Availability and Serviceability Features

Hot-Swappable:

Hot swapability /

Redundancy

1+1 Redundant:

Fan Module

Power Supplies

ISO 7779

ETS 300 753

2.30Tb/s

A.1

Approved Cables

For a list of all approved cables see: http://www.mellanox.com/related-docs/user_manuals/Mellanox_approved_cables.pdf

A.2

EMC Certifications

The list of approved certifications per switch in different regions of the world is located on the

Mellanox Website at: http://www.mellanox.com/related-docs/user_manuals/Regulatory_and_Compliance_Guide.pdf

EMC statements are also in the Regulatory and Compliance Guide.



A.3

China CCC Warning Statement

Rev 1.1


Rev 1.1

Appendix B: SFP+ Removal Tool Instructions

1

2

3

4

5

3

4

1

2


J3 and J6

GND

Rx2n

Rx2p

GND

Rx4n

Rx4p

GND

ModPrsL

IntL

VccTx

Vcc1

LPMode

GND

Tx3p

Tx3n

GND

Tx1p

Tx1n

GND

25

26

27

28

29

30

20

21

22

23

24

31

32

33

34

35

36

37

38

GND

Rx1n

Rx1p

GND

Rx3n

Rx3p

GND

SDA

SCL

Vcc Rx

ResetL

ModSelL

GND

Tx4p

Tx4n

GND

Tx2p

Tx2n

GND

8

7

3

2

1

6

5

4

12

11

10

9

19

18

17

16

15

14

13

Rev 1.1


Appendix C: QSFP Interface

Connector

Pin Number

29

30

31

32

25

26

27

28

21

22

23

24

17

18

19

20

33

34

35

36

37

38

13

14

15

16

9

10

11

12

7

8

5

6

3

4

1

2

Connector

Pin Name

Signal Description

GND

Tx2n

Tx2p

GND

Ground

Transmitter Inverted Data Input

Transmitter Non-Inverted Data Input

Ground

Tx4n

Tx4p



GND Ground

ModSelL Module Select

ResetL Module Reset

Vcc Rx +3.3 V Power supply receiver

SCL

SDA

2-wire serial interface clock

2-wire serial interface data

GND

Rx3p

Rx3n

GND

Ground

Receiver Non-Inverted Data Output

Receiver Inverted Data Output

Ground

Rx1p

Rx1n

GND

GND

Rx2n

Rx2p

GND

Rx4n

Receiver Non-Inverted Data Output

Receiver Inverted Data Output

Ground

Ground

Receiver Inverted Data Output 3

Receiver Non-Inverted Data Output 3

Ground

Receiver Inverted Data Output 3

Rx4p

GND

Receiver Non-Inverted Data Output 3

Ground

ModPrsL Module Present

IntL Interrupt

Vcc Tx +3.3 V Power supply transmitter

Vcc 1 +3.3 V Power Supply

LPMode Low Power Mode

GND Ground

Tx3p

Tx3n

GND

Tx1p

Tx1n

GND



Ground



Ground


Rev 1.1

Figure 35: QSFP Connector Male and Female Views

View into Rear of

Connector

Top

18.35

8.50

View into Front of Cage

8.50

Top

18.35



Appendix D: SFP+ Interface

56.50


MTSFPP-SR Module

14.80

13.60

1.55

0.50

8.50

1.80

2.55

0.60

44.95

13.70

Figure 36: Rear View of Module With Pin Placement

Top

13.70

8.50

11.85

13.90

Rev 1.1

1

2

3

Pin Symbol Name

VeeT

TX_Fault

TX_Disable

Description

Transmitter Ground (Common with Receiver Ground) a

Transmitter Fault.

b

Transmitter Disable. Laser output disabled on high or open. c


Rev 1.1

Pin Symbol Name Description

4

5

6

7

8

9

10

11

SDA

SCL

MOD_ABS

RS0

RX_LOS

RS1

VeeR

VeeR

2-wire Serial Interface Data Line d

2-wire Serial Interface Clock Line d

Module Absent. Grounded within the module d

No connection required

Loss of Signal indication. Logic 0 indicates normal operation. e

No connection required

Receiver Ground (Common with Transmitter Ground) a


15

16

17

12

13

14

RD-

RD+

VeeR

VccR

VccT

VeeT

Receiver Inverted DATA out. AC Coupled

Receiver Non-inverted DATA out. AC Coupled


Receiver Power Supply

Transmitter Power Supply

Transmitter Ground (Common with Receiver Ground) a

18

19

TD+

TD-

Transmitter Non-Inverted DATA in. AC Coupled.

Transmitter Inverted DATA in. AC Coupled.

20 VeeT

Transmitter Ground (Common with Receiver Ground) a a. Circuit ground is internally isolated from chassis ground.

b. T

FAULT

is an open collector/drain output, which should be pulled up with a 4.7k – 10k

Ohms resistor on the host board if intended for use. Pull up voltage should be between 2.0V to Vcc + 0.3V. A high output indicates a transmitter fault caused by either the TX bias current or the TX output power exceeding the preset alarm thresholds. A low output indicates normal operation. In the low state, the output is pulled to <0.8V.

c. Laser output disabled on TDIS >2.0V or open, enabled on TDIS <0.8V

d. Should be pulled up with 4.7k

Ω – 10k Ω on host board to a voltage between 2.0V and 3.6V.

MOD_ABS pulls line low to indicate module is plugged in.

e. LOS is open collector output. Should be pulled up with 4.7k

Ω – 10k Ω on host board to a voltage between 2.0V and 3.6V. Logic 0 indicates normal operation; logic 1 indicates loss of signal.



Appendix E: RJ-45 CONSOLE and I2C Interface

The RJ-45 CONSOLE and I2C interface uses the EIA 568A standard wiring color coding.

J34

CONSOLE

TXD+

TXD-

RXD+

GND

GND

RXD-

GND

GND

RJ45_RTS#

RJ45_DTR#

RJ45_TXD

GND

GND

RJ45_RXD

GND

GND

Pin 1

Pin 8

Looking into the Socket

Table 15 - RJ-45 CONSOLE Pinout

Connection

TXD+

TXD-

RXD+

GND

GND

RXD-

GND

GND

Signal Pin#

RJ-45_RTS# 1

RJ-45_DTR# 2

RJ-45_TXD 3

GND 4

GND 5

RJ-45_RXD 6

GND

GND

7

8

Color

G/W

G

O/W

Bl

Bl/W

O

Br/W

Br

Rev 1.1

J34

TXD+

TXD-

RXD+

GND

GND

RXD-

GND

GND

I2C

RJ45_SDA

GND

GND

GND

GND

RJ45_SCL

GND

GND

Pin 1

Pin 8

Looking into the Socket

Table 16 - RJ-45 I2C Pinout

Connection

TXD+

TXD-

RXD+

GND

GND

RXD-

GND

GND

Signal Pin#

RJ-45_SDA 1

GND 2

GND

GND

3

4

GND 5

RJ-45_SCL 6

GND

GND

7

8

Color

G/W

G

O/W

Bl

Bl/W

O

Br/W

Br


Rev 1.1

Appendix F: Accessory and Replacement Parts

Table 17 - OPNs for Replacement Parts

Part Description

I2C DB9 or RJ-45 to USB Adapter

Fan module with power supply side to connector side air flow

Fan module with connector side to power supply side air flow

300W Power Supply w/ Power Supply Side to Connector side air flow

300W Power Supply w/ Connector side to Power Supply side air flow

Power cord Type C13-C14

Installation Kit for short switches in racks 40-60 cm deep

Installation Kit for short or standard switches in racks 60-80 cm deep

OPN

MTUSB-1

MSX62-FF

MSX62-FR

MSX60-PF

MSX60-PR

ACC000500

MSX60-BKIT

MSX60-SKIT



Appendix G: Avertissements de sécurité d’installation

(French)

1. Instructions d’installation

Lisez toutes les instructions d’installation avant de brancher le matériel à la source d’alimentation électrique.

Rev 1.1

2. Température excessive

Ce matériel ne doit pas fonctionner dans une zone avec une température ambiante dépassant le maximum recommandé de 45°C (113°F). Un flux d’air de 200LFM à cette température ambiante maximale est nécessaire. En outre, pour garantir un bon

écoulement de l’air, laissez au moins 8 cm (3 pouces) d’espace libre autour des ouvertures de ventilation.

3. Empilage du châssis

Le châssis ne doit pas être empilé sur un autre matériel. Si le châssis tombe, il peut provoquer des blessures corporelles et des dégradations de biens.

4. Connection d'Alimentation electrique excedentaire -dangers électriques

Ce produit comporte un couvercle transparent sur l’espace pour l’alimentation électrique redondante. 

Ne pas faire fonctionner le produit si le couvercle transparent n’est pas solidement fixé ou s’il est enlevé.

5. Système de fusible neutre/à double pôle

Avertissement: Système de fusible neutre/à double pôle. Veuillez debrancher tous les cordons d'alimentation avant d'ouvrir le boitier de ce produit ou de toucher un de ses composants internes.

6. Orages – dangers électriques

Pendant un orage, il ne faut pas utiliser le matériel et il ne faut pas brancher ou débrancher les câbles.

7. Branchement/débranchement des câbles en cuivre

Les câbles InfiniBand en cuivre sont lourds et ne sont pas flexibles, il faut donc faire très attention en les branchant et en les débranchant des connecteurs. Consultez le fabricant des câbles pour connaître les mises en garde et les instructions spéciales.


Rev 1.1

8. Risque de choc et de danger

Risque de choc et de danger  e’lectriques. Le de’branchment d’une seule alimentation stabilise’e ne de’branch uniquement qu’un module “Alimentation Stabilise’e”. Pour isoler completement le module en cause, Il faut de’brancher toutes les alimentations stabilise’es

Risk of electric shock and energy hazard.

The PSUs are all independent.


9. Montage et entretien sur baie

Lorsque ce produit est monté ou entretenu sur baie, il faut prendre des précautions spéciales pour s’assurer que le système reste stable. En général, il faut remplir la baie avec du matériel de bas en haut.

10. Fuite>3.5mA Leakage >3.5mA

« ATTENTION – La connexion à la terre des forts courants de fuite est essentielle avant le branchement de l’alimentation. »

Avant de brancher l’appareil à la conduite d’alimentation, les vis de protection à la terre du terminal de l’appareil doivent être appliquées à l’installation de protection à la

Terre du bâtiment.

11. Danger d’explosion de la Batterie

II y a danger d’explosion s’il y a remplacement incorrect de la batterie. Remplacer uniquement avec une batterie du même type ou d’un type équivalent recommandé par le constructeur.

Mettre au rebut les batteries usagées conformément aux instructions du fabricant.

12. Forts Courants de Fuite High Leakage Current

Attention: Forts courants de fuite. Il est essentiel de relier a la terre avant de brancher l'alimentation.

13. Ajouter une information de connexion à la masse Connect a Valid Ground to this Device

Avant de brancher l’appareil à la conduite d’alimentation, les vis de protection à la terre du terminal de l’appareil doivent être appliquées à l’installation de protection à la

Terre du bâtiment.

14. Installation du matériel

Ce matériel ne doit être installé, remplacé ou entretenu que par du personnel formé et qualifié.



15. Elimination du matériel

L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur.

16. Codes électriques locaux et nationaux

Rev 1.1

Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux.

17. Codes d’installation

L’appareil doit être installé selon l’ancienne version des codes électriques nationaux du pays. Pour l’Amérique du Nord, l’équipement doit être installé conformément aux spécifications du Code Electrique National Américain et du Code Electrique Canadien.

18. Interconnexion des unites

Les câbles de branchement à l’unité RS232 et les interfaces Ethernet doivent être certifiés UL de type DP-1 ou DP-2. (Note - lorsqu’il existe dans un circuit non LPS)

Protection contre la surintensité : Un appareil de protection répertorié facilement accessible contre la surintensité du circuit de branchement et calibré à 20A doit être incorporé dans le câblage électrique du bâtiment.

19. Exposition au rayonnement grave

Mise en garde – l'utilisation de commandes ou de réglages ou l'exécution de procédures autres que ce qui est spécifié dans les présentes peut engendrer une exposition au rayonnement grave.

PRODUIT LASER DE CLASSE 1 » et références aux normes laser les plus récentes

CEI 60 825-1:1993 + A1:1997 + A2:2001 et NE 60825-1:1994+A1:1996+ A2:2001

20. S’assurer que les enceintes sont appropriées

Des enceintes électriques, mécaniques et incendie adaptées doivent être fournies par le  fabricant du produit final ou par l’utilisateur final.


Rev 1.1

21. Cordons électriques CA homologués UL

Pour les prises électriques en Amérique du Nord, choisissez un cordon électrique homologué UL et certifié CSA

à 3 conducteurs, [18 AWG], terminé par une fiche moulée, d’une tension nominale de

125 V, [15 A], avec une longueur minimale de 1,5 m [6 pieds] et d’une longueur maximale de 4,5 m [18 pieds]

Pour les prises électriques en Europe, choisissez un cordon électrique harmonisé internationalement et marqué "<HAR>",

à 3 conducteurs, d’un diamètre de fil minimum de 0,75 mm2, d’une tension nominale de 300 V, avec une gaine isolée en PVC. Le cordon doit avoir une fiche moulée d’une tension nominale de 250 V et d’une intensité nominale de 10 A.

22.

<40 lbs

<18 kgs

40 - 70 lbs

18 - 32 kgs

23. Conformément à la Directive WEEE

70 - 121 lbs

32 - 55 kgs

>121 lbs

>55 kgs

Conformément à la Directive WEEE 2002/96/EC, les déchets d'équipements électriques et électroniques (EEE) doivent être triés et ne peuvent être éliminés avec les déchets ménagers.

Veuillez disposer de ce produit et de tous ses composants de manière responsable et respectueuse de l’environnement.



Appendix H: Installation - Sicherheitshinweise (German)

1. Installationsanleitungen

Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromversorgung anschließen.

2. Übertemperatur

Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der maximal empfohlenen Temperatur von 45°C (113°F) betrieben werden. Es ist ein Luftstrom von 200 LFM bei maximaler Umgebungstemperatur erforderlich. Außerdem sollten mindestens 8 cm (3 in.) Freiraum um die Belüftungsöffnungen sein, um einen einwandfreien Luftstrom zu gewährleisten.

3. Stapeln des Chassis

Das Chassis sollte nicht auf andere Geräte gestapelt werden. Wenn das Chassis herunterfällt, kann es zu Verletzungen und Beschädigungen an Geräten führen.

4. Redundanter Stromversorgungsanschluss - Elektrische Gefahr

Dieses Produkt verfügt über eine Abdeckung über dem Bereich für die redundante

Stromversorgung. Betreiben Sie das Produkt nicht, wenn diese Abdeckung nicht sicher festsitzt oder entfernt wurde.

5. Bei Gewitter - Elektrische Gefahr

Arbeiten Sie während eines Gewitters und Blitzschlag nicht am Gerät, schließen Sie keine Kabel an oder ab.

6. Anschließen/Trennen von Kupferkabel

Kupferkabel sind schwer und nicht flexible. Deshalb müssen sie vorsichtig an die

Anschlüsse angebracht bzw. davon getrennt werden. Lesen Sie die speziellen Warnungen und Anleitungen des Kabelherstellers.

7. Gafahr des elektrischen Schocks.

Gafahr des elektrischen Schocks. Entferrnen des Netzsteckers elnes Netzteils spannungsfrei. Um alle Einhieten spannungsfrei zu machen sind die Netzstecker aller Netzteile zu entfernen

Risk of electric shock and energy hazard.

The PSUs are all independent.



Rev 1.1

70

8. Rack-Montage und Wartung

Wenn dieses Produkt in einem Rack montiert oder gewartet wird, sind besondere Vorsichtsmaßnahmen zu ergreifen, um die Stabilität des Systems zu gewährleisten. Im

Allgemeinen sollten Sie das Gestell von unten nach oben mit Geräten füllen.

9. Geräteinstallation

Diese Gerät sollte nur von geschultem und qualifiziertem Personal installiert, ausgetauscht oder gewartet werden.

10. Geräteentsorgung

Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestimmungen erfolgen.

11. Regionale und nationale elektrische Bestimmungen

Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen

Bestimmungen installiert werden.

12. Richtigen Schutz sicherstellen

Geeigneter elekrischer, mechanischer und Feuerschutz sind vom 

Hersteller des Endprodukts oder dem Endbenutzer bereitzustellen.

13. Strahlenkontakt

Achtung – Nutzung von Steuerungen oder Einstellungen oder Ausführung von Prozeduren, die hier nicht spezifiziert sind, kann zu gefährlichem Strahlenkontakt führen..

Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards : 

ICE 60 825-1:1993 + A1:1997 + A2:2001 und EN 60825-1:1994+A1:1996+ A2:2001

14. UL-und CSA Certified Netzkabel

Für Nordamerika Stromanschluss, wählen Sie ein Netzkabel, das UL-und CSA Certified

3 - Leiter, [18 AWG], mit einem angespritztem Stecker bewertet bei 125 V, [15], mit einer Mindestlänge von 1,5 m [Six Feet] aber nicht mehr als 4,5 m.

Für die europäischen Zusammenhang, wählen Sie ein Netzkabel, das international harmonisiert und der Aufschrift "<HAR>",

3 - Leiter, mindestens 0,75 mm2 Draht, bewertet mit 300 V, mit einem PVC-Mantel isoliert. Das Kabel muss eine angespritztem Stecker bewertet bei 250 V, 10 A. "



15. Ableitstrom> 3.5mA LEAKAGE >3.5mA

WARNUNG: Hohe Ableitstrom; Earth Verbindung, bevor Sie die Verbindung von wesentlicher Bedeutung werden.

16. Add GND Verbindung Informationen

Bevor Sie dieses Gerät an das Stromnetz, die Schutzerde Terminal Schrauben dieses

Gerät muss an den Schutzleiter in der Gebäudeinstallation.

17. Installation Codes

Dieses Gerät muss installiert sein, entsprechend auf die neueste Version des Landes

National Electrical Code. Für Nordamerika, müssen in Übereinstimmung mit den geltenden Vorschriften in der US-amerikanischen National Electrical Code und dem

Canadian Electrical Code.

18. Zusammenschaltung von EINHEITEN

Kabel für den Anschluss an das Gerät RS232-und Ethernet-Schnittstellen müssen UL zertifiziert Typ DP-1 oder DP-2. (Hinweis-, wenn nicht mit Wohnsitz in LPS-Schaltung)

Überstromschutz: Eine leicht zugängliche Auflistung Abzweigleitung Überstrom-

Schutzeinrichtung 20 A bewertet werden müssen in dem Gebäude Verkabelung.

19. Zweipolige bzw. Neutralleiter-Sicherung im Netzteil

Achtung:

Zweipolige bzw. Neutralleiter-Sicherung im Netzteil. Netzstecker ziehen, um sicherzustellen, daß keine Spannung am Gerät anliegt. Entfernen Sie alle Netzkabel vor dem

Öffnen der Abdeckung dieses Produkts oder dem Berühren der Innenteile.

20. Bodily Injury Due to Weight

Use enough people to safely lift this product.

Rev 1.1

<40 lbs

<18 kgs

40 - 70 lbs

18 - 32 kgs

70 - 121 lbs

32 - 55 kgs

>121 lbs

>55 kgs


Rev 1.1

Appendix I: Advertencias de seguridad para la instalación (Spanish)

1. Instrucciones de instalación

Antes de conectar el equipo a la fuente de alimentación, leer todas las instrucciones de instalación.

2. Lesión corporal por peso

<40 lbs

<18 kgs

3. Lesión corporal por peso

40 - 70 lbs

18 - 32 kgs

70 - 121 lbs

32 - 55 kgs

>121 lbs

>55 kgs

This equipment is very heavy and should be moved using a mechanical lift to avoid injuries.

4. Sobrecalentamiento

No se debe utilizar el equipo en un área con una temperatura ambiente superior a la máxima recomendada: 45°C. Además, para garantizar una circulación de aire adecuada, se debe dejar como mínimo un espacio de 8 cm (3 pulgadas) alrededor de las aberturas de ventilación.

5. Apilamiento del chasis

Los chasis no se deben apilar sobre otros equipos. La caída del chasis podría causar lesiones corporales, así como daños al equipo.

6. Dos fusibles, uno en el polo y otro en el neutro

Dos fusibles, uno en el polo y otro en el neutro. Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno.



7. Cuando hay rayos: peligro de descarga eléctrica

No utilizar el equipo ni conectar o desconectar cables durante períodos de actividad de rayos.

8. Conexión y desconexión del cable Copper

Dado que los cables de cobre son pesados y no son flexibles, su conexión a los conectores y su desconexión se deben efectuar con mucho cuidado. Para ver advertencias o instrucciones especiales, consultar al fabricante del cable.

Rev 1.1

9. Montaje y mantenimiento de bastidores

Al instalar o realizar el mantenimiento de este aparato en un bastidor, es preciso adoptar precauciones especiales para garantizar que el sistema se mantenga estable. En general, en un bastidor, los equipos se deben instalar comenzando desde abajo hacia arriba.

10. Instalación de equipos

La instalación, el reemplazo y el mantenimiento de este equipo estarán a cargo únicamente de personal capacitado y competente.

11. Asegurar confinamientos adecuados

El fabricante del producto final o el usuario final deberán suministrar  un confinamiento adecuado para componentes eléctricos y mecánicos y contra incendio.

12. Eliminación de equipos

La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales.

13. Códigos eléctricos locales y nacionales

Este equipo se debe instalar conforme a los códigos eléctricos locales y nacionales.


Rev 1.1

14.

Cable de alimentación homologado por UL y con certificación CSA

En conexiones de América del Norte, seleccionar un cable de alimentación homologado por UL y con certificación CSA de tres conductores, [16 AWG], terminado en un enchufe moldeado con capuchón de 125 voltios nominal, [13 A], con una longitud mínima de 1,5 metros, pero no más de 4,5 metros.

En conexiones europeas, seleccionar un cable de alimentación armonizado  internacionalmente y marcado "<HAR>", de tres conductores, hilo de 1,0 mm2 como mínimo, 300 voltios nominal, con cobertura protectora aislante de PVC. El cable debe tener un enchufe moldeado con capuchón de 250 voltios nominal, 10 A.

15. Añadir conexión a tierra

Antes de conectar el dispositivo a la línea de alimentación, los tornillos del terminal de la puesta a tierra de protección del dispositivo se deben conectar a la puesta a tierra de protección de la instalación del edificio.

(Información de conexión a tierra):

La instalación del edificio deberá prover un medio para la conexión con la puesta a tierra de protección y un técnico de servicio deberá conectar permanentemente el equipo a dicho medio de conexión.

Un TÉCNICO DE SERVICIO comprobará si la toma eléctrica de la que se suministrará corriente al equipo provee una conexión con la puesta a tierra de protección del edificio. De no ser así, el TÉCNICO DE SERVICIO se encargará de instalar un CON-

DUCTOR DE CONEXIÓN A TIERRA DE PROTECCIÓN, del terminal de puesta a tierra de protección separado al conductor de tierra de protección del edificio. El equipo se instalará en un área donde haya conexión equipotencial, como por ejemplo, un centro de telecomunicaciones o una sala de computadoras dedicada.

16. Códigos de instalación

Este dispositivo se debe instalar conforme a la versión más reciente de los códigos eléctricos nacionales del país en cuestión. En América del Norte, el equipo se debe instalar de acuerdo con las disposiciones vigentes del Código Eléctrico Nacional de los

EE.UU. y del Código Eléctrico de Canadá.

17. Directiva sobre RAEE

Conforme a la Directiva 2002/96/CE sobre RAEE, todos los residuos de equipos eléctricos y electrónicos (EEE) se deben recolectar por separado y no se deben eliminar junto con residuos domésticos.

Al deshacerse de este producto y de todas sus partes, hágalo de una manera responsable y respetuosa con el medio ambiente.


No results