Using Navisphere Manager Software. EMC FC4500, FC5300, FC5700

5

Storage System Hardware

Server component

Unshared Direct

(one server)

Server

The storage systems attach to the server and the interconnect components described in Chapter 1.

Shared-or-Clustered Direct

(two servers)

Server Server

Shared Switched

(multiple servers)

Server Server

Server

Interconnect component

Storage component

FC loop 1

FC loop 2

Disk-array storage systems

Figure 5-1 Shared and Unshared Storage

Switch fabric Switch fabric

5-2

EMC Fibre Channel Storage Systems Configuration Planning Guide


5

Hardware for Shared Storage

The primary hardware component for shared storage is a ten-slot

Disk-array Processor Enclosure (DPE) with two storage processors

(SP). The DPE can support up to nine separate 10-slot enclosures called Disk Array Enclosures (DAEs) for a total of 100 disks. Shared storage requires two SPs and the Access Logix software option.

A DPE with a DAE is available as a deskside system, but with a capacity of 20 disks this cannot provide the expandability and total storage capacity needed for a SAN (storage area network). So this section does not cover the deskside version.

Storage Hardware — Rackmount DPE-Based Storage Systems

The DPE rackmount enclosure is a sheet-metal housing with a front door, a midplane, and slots for the storage processors (SPs), link control cards (LCCs), disk modules, power supplies, and fan packs.

All components can be replaced under power. The DPE rackmount model looks like the following figure.

Front Back

Power supplies

LCC

Link control card (LCC)

Disk modules (front door removed for clarity)

Storage processors (SPs)

FC ports with GBICs

Drive fan module

(detached for clarity)

Figure 5-2 DPE Storage-System Components – Rackmount Model

A separate standby power supply (SPS) is required to support write caching. All the shared storage components — rackmount DPE,

DAEs, SPSs, and cabinet — are shown in the following figure.

Hardware for Shared Storage 5-3

5


DAE

DAE

DPE

DAE

DAE

DPE

Disks

SPs

Standby power supplies (SPSs)

Front

Figure 5-3 Rackmount System with DPE and DAEs

Rear

EMC1744

The disks — available in differing capacities — fit into slots in the enclosure. Each module has a unique ID that you use when binding or monitoring its operation. The ID is derived from the enclosure address (always 0 for the DPE, settable on a DAE) and the disk module slot numbers.

5-4



5

Disk Modules and Module IDs — Rackmount DPE-Based System

10 11 12 13 14 15 16 17 18 19

0 1 2 3 4 5 6 7 8 9

Storage Processor (SP)

The SP provides the intelligence of the storage system. Using its own operating system (called Core Software), the SP processes the data written to or read from the disk modules, and monitors the modules themselves. An SP consists of a printed-circuit board with memory modules (DIMMs), and status lights.

For high availability, a storage system can support a second SP. The second SP provides a second route to a storage system and also lets the storage system use write caching for enhanced write performance. Two SPs are required for shared storage.

Server Server Server

Switch fabric

SP A SP B

Storage systems

Switch fabric

SP A SP B

Path 1

Path 2

Figure 5-4 Shared Storage Systems

See Chapter 3 for more examples of shared storage.

Hardware for Shared Storage 5-5

5


Hardware for Unshared Storage

Unshared storage systems are less costly and less complex than shared storage systems. They offer many shared storage system features; for example, you can use multiple unshared storage systems with multiple servers. However, with multiple servers, unshared storage offers less flexibility and security than shared storage, since any user with write access to privileged server files can enable access to any storage system.

Types of Storage System for Unshared Storage

For unshared storage, there are four types of storage system, each using the FC-AL protocol. Each type is available in a rackmount or deskside (office) version.

• Disk-array Processor Enclosure (DPE) storage systems. A DPE is a 10-slot enclosure with hardware RAID features provided by one or two storage processors (SPs). In addition to its own disks, a

DPE can support up to 110 additional disks in 10-slot Disk Array

Enclosures (DAEs) for a total of 120 disks. This is the same kind of storage system used for shared storage, but it uses a different storage processor (SP).

• Intelligent Disk Array Enclosure (iDAE). An iDAE, like a DPE, has SPs and thus all the features of a DPE, but is thinner and has a limit of 30 disks.

• Disk Array Enclosure (DAE). A DAE does not have SPs. A DAE can connect to a DPE or an iDAE, or you can use it without SPs. A

DAE used without an SP does not inherently include RAID, but can operate as a RAID device using software running on the server system. Such a DAE is also known as Just a Box of Disks, or

JBOD.

5-6



5

Disk-array processor enclosure (DPE)

Deskside DPE with DAE

Rackmount DPE, one enclosure, supports up to 9 DAEs

30-slot deskside

Intelligent disk-array enclosure (iDAE)

10-slot deskside Rackmount

Figure 5-5 Storage System Types for Unshared Storage

Hardware for Unshared Storage 5-7

5


Front

The following figure shows some components of a deskside DPE.

Components for rackmount types are similar.

Back (fans and cables omitted for clarity)

Storage processors

(SPs)

DAE link control

card (LCC)

DPE LCC

DAE power supplies

DPE power supplies

DPE

SP fan cover

(covers SP fan pack)

DAE

Front doors

(cover disk modules)

Power distribution

units

FC ports

DPE LCC

SPS units

DAE LCC

Figure 5-6 DPE Components - Deskside Model

Disks

enclosure. Each disk has a unique ID that you use when binding it or monitoring its operation. The ID is the enclosure address (always 0 for the DPE, settable on a DAE) and the disk slot number.

5-8



5

0

1

2

3

4

5

6

7

8

9

14

15

16

17

18

19

10

11

12

13

Figure 5-7 Disks and Disk IDs

0 1 2 3 4 5 6 7 8 9

Storage Processor (SP)

The SP provides the intelligence of the storage system. Using its own operating system (called Core Software), the SP processes the data written to or read from the disk modules, and monitors the modules themselves. An SP consists of a printed-circuit board with memory modules (DIMMs), status lights, and switches for setting FC-AL addresses.

For high availability, a storage system can support a second SP. A second SP provides a second route to a storage system, so both SPs can connect to the same server or two different servers, as follows.

Hardware for Unshared Storage 5-9

5


Server

Storage system

DAE(s)

SP A

DPE

SP B

Cables

FC loop 1

FC loop 2

Figure 5-8 Storage System with Two SPs Connected to the Same Server

Highly available cluster

Server 1 Server 2

Storage system

DAE(s)

SP A

DPE

SP B

FC loop 1

FC loop 2

Figure 5-9 Storage System with Two SPs Connected to Different Servers

Either SP can control any LUN in the storage system, but only one SP at a time can control a LUN. If one SP cannot access a LUN it controlled (because of a failure), you can transfer control of the LUN to the other SP, manually or via software.

5-10



5

Storage-system caching provides significant performance enhancement. Read caching is available with one or two SPs.

Mirrored write caching, particularly helpful with RAID 5 I/O, requires two SPs (to mirror one another, for cache integrity) and a

Standby Power Supply (SPS) to enable the SPs to write their cached data to disk if power fails.

Planning Your Hardware Components

This section helps you plan the hardware components — adapters, switches or hubs, cables, storage systems, and site requirements — for each server in your installation.

For shared storage, you must use a DPE rackmount system with two

SPs and high-availability options. We assume you have some idea of how many servers, adapters, switches or hubs, storage systems, and

SPs you want. Skip to the component data sheets following.

For unshared storage, you can use one or two SPs and you can choose among storage system configurations. This section assumes you have

examined the configurations shown starting on page 4-2 and have

some idea of how many servers, adapters, switches or hubs, storage systems, and SPs you want. It ends with blank worksheets and sample worksheets.

Configuration Tradeoffs - Shared Storage

The hardware configuration required for shared storage is very specific: two host-bus adapters in each attached server, two Fibre

Channel switches, and two SPs per storage system. Choices you can make with shared storage systems include the number of storage systems (up to 15 are allowed), and for each storage system the cache configuration (maximum or minimum), and one or two standby power supplies (SPS units).

The number of storage systems in the SAN depends on the servers’ processing demands. For each system, the larger cache improves write performance for very large processing loads; the redundant SPS lets write caching continue if one SPS fails.

Planning Your Hardware Components 5-11

5


Configuration Tradeoffs - Unshared Storage

For each storage-system enclosure, you have two important areas of choice: rackmount or deskside model, and high-availability options.

Generally, rackmount systems are more versatile; you can add capacity in a cabinet without consuming more floor space. However, rackmount systems require additional hardware, such as cabinets and mounting rails, and someone must connect power cords and cables within them. For large storage requirements, rackmount systems may be more economical than deskside systems. Deskside systems are more convenient; they ship with all internal cabling in place and require only ac power and connection to the servers.

For high availability, there are many variations. The most important high-availability features are a second SP/LCC pair, second power supply, and standby power supply (SPS). The second SP/LCC and

SPS let you use write caching to enhance performance; the second SP provides continuous access to storage-system disks if one SP or LCC fails. Another high-availability option is a redundant SPS.

Yet another option, for a deskside system, is a second power distribution unit (PDU), which lets you route ac power from an independent source. Used this way, the second PDU protects against failure in one of the two ac power sources. With a rackmount system, you can acquire a cabinet with one or two ac inlet cords. The second inlet cord, connected to a second ac power source, provides the same advantage for all storage systems in the cabinet as the second PDU in the deskside storage system.

For deskside systems, the optional high-availability hardware fits into the deskside cabinet. Deskside high-availability options are as follows.

5-12



5

Deskside

DPE

Table 5-1

Minimum

High-Availability Options, Deskside Unshared Storage

System Type HA Level PDUs SPs

1

LCCs

1 DAE

Power

Supplies

1 DPE

1 DAE

Disks

5 (without write cache) iDAE

DAE only

Maximum

Minimum

2 2 4 (2 DPE

2 DAE)

1 1 n/a

2 (30-slot)

Maximum 2 2 n/a

Minimum 1

Maximum 2 n/a n/a

4 (30-slot)

1

2

4

(2 DPE

2 DAE)

1

2 (10-slot)

6 (30-slot)

1

2

10 (write cache or RAID 3)

3 (without write cache)



No minimum

No minimum

SPS Units


1 (write cache)

2


1 (write cache

2 n/a n/a

Table 5-2

For rackmount systems, the standby power supply or supplies (SPS or BBU) must be placed in a tray directly beneath the storage system.

Typically, any hubs in the cabinet mount at the top or bottom of the cabinet. Rackmount options are as follows.

High-Availability Options, Rackmount Unshared Storage

Rackmount

System Type HA Level SPs

DPE Minimum 1

LCCs

1

Maximum 2 2 (DPE)

18 (with 9

DAEs) iDAE Minimum 1 (10-slot)

4 (with two

DAEs)

DAE only

Maximum 2

Minimum n/a

Maximum n/a n/a

1

2

2

1

2

Power

Supplies

1

2 (DPE)

11 (with 9

DAEs)

1

Disks


10 (write cache or

RAID 3)


5 (write cache or

RAID 3)

5 (write cache or

RAID 3)

No minimum

No minimum

SPS Units


1 (write cache)

2


1 (write cache

2 n/a n/a

Planning Your Hardware Components 5-13

5


Hardware Data Sheets

The hardware data sheets shown in this section provide the plant requirements, including dimensions (footprint), weight, power requirements, and cooling needs, for DPE, iDAE, DAE, and 30-slot

SCSI disk systems. Sections on cabinets and cables follow the data sheets.

DPE Data Sheet

Depth

74.7 cm

(30 in)

Deskside model

Width

52.1 cm

(20.6 in)

For shared storage, a rackmount DPE and one or more rackmount

DAEs are required. For unshared storage, you can use a rackmount or deskside DPE and DAE(s). The DPE dimensions and requirements are shown in the following figure.

DPE Dimensions and Requirements

Rackmount model

Depth

70 cm

(27.6 in)

Width

44.5 cm

(17.5 in)

Height

68 cm

(26.8 in)

Height

28.6 cm

(11.3 in)

6.5 U

Weight (without packaging)

Maximum (max disks, SPs,

LCCs, PSs): with 2 SPSs

SPS mounting tray height 4.44 cm

(1.75 in), 1 U; depth 54.1 cm

(21.3 in)

Deskside Rackmount

144 kg (316 lb) 52 kg (115 lb)

165 kg (364 lb) 74 kg (163 lb)

5-14



5

Power requirements

Voltage rating:

Current draw:

Power consumption:

100 V ac to 240 V ac –10%/+15%, single-phase, 47 Hz to 63 Hz; power supplies are auto-ranging

At 100 v ac input – Deskside

DPE/DAE: 12.0 A; Rackmount

DPE: 8.0 A max; SPS: 1.0 A max per unit during charge

Deskside DPE/DAE: 1200 VA;

Rackmount DPE: 800 VA max SPS:

1.0 A per unit during charge

Power cables (single or dual) ac inlet connector: IEC 320-C14 power inlet

Deskside power cord: USA: 1.8 m (6.0 ft):

NEMA 6-15P plug

Outside USA Specific to country

Operating environment

Temperature: 10 o

C to 40 o

C (50 o

F to 104 o

F)

Relative humidity:

Altitude:

Noncondensing, 20% to 80%

40 o

C to 2,438 m (8,000 ft); 37 o

C to 3,050 m

(10,000 ft)

Heat dissipation (max): Deskside DPE/DAE: 3931x10

3

J/hr (2730

BTU/hr) max estimated;

Rackmount DPE: 2520x10

3

J/hr (2390

BTU/hr) max estimated

Air flow: Front to back

Service clearances

Front:

Back:

30.3 cm (1 ft)

60.6 cm (2 ft)

Hardware Data Sheets 5-15

5


iDAE Data Sheet

Deskside 30-slot model

Depth

74.7 cm

(30 in)

Width

52.1 cm

(20.6 in)

You can use a rackmount or deskside DPE and DAE(s) for unshared storage. The iDAE dimensions and requirements are shown in the following figure.

Dimensions and Requirements, iDAE


Depth

74.7 cm

(30 in)

Width

25 cm

(9.8 in)

Rackmount model

Depth

63.3 cm

(24.9 in)

Width

44.5 cm

(17.5 in)

Height

68 cm

(26.8 in)

SPS mounting tray, height 4.44 cm

(1.75 in), 1 U; depth 69.9 cm

(27.5 in)

Height

15.4 cm

(6.1 in)

3.5 U


Maximum (max disks, SPs):

Deskside 30 Deskside 10 Rackmount

144 kg (316 lb) 60 kg (132 lb) 35.4 kg (78 lb)


Voltage rating:

Current draw:

Power consumption:

100 V ac to 240 V ac +/- 10%, single-phase,

47 Hz to 63 Hz; power supplies are auto-ranging

At 100 v ac input – 30-slot 12.0 A; 10-slot: 4.0

A; SPS: 1.0 A max per unit during charge

30-slot: 1200;10-slot: 400 VA; SPS: 100 VA per unit during charge

5-16



5


Deskside power cord: USA: 1.8 m (6.0 ft): NEMA

6-15P plug

Outside USA: Specific to country


Temperature:

Relative humidity:

Altitude:

10 o C to 40 o C (50 o F to 104 o F)


40 o C to 2,438 m (8,000 ft); 37 o C to 3,050 m

(10,000 ft)

Heat dissipation (max): 30-slot: 4,233 KJ/hr (4,020 BTU/hr)

10-slot: 1,411 KJ/hr (1,340 BTU/hr)


Service clearances

Front:

Back:

30.3 cm (1 ft)

60.6 cm (2 ft)


5


DAE Data Sheet


Depth

74.7 cm

(30 in)

Width

52.1 cm

(20.6 in)

The DAE storage-system dimensions and requirements are shown in the following figure.

Dimensions and Requirements, DAE


Width

25 cm

(9.8 in) Depth

74.7 cm

(30 in)

Rackmount model

Depth

63.3 cm

(24.9 in)

Width

44.5 cm

(17.5 in)

Height

68 cm

(26.8 in)

Height

15.4 cm

(6.1 in)

3.5 U


Maximum (max disks, SPs)

Deskside 30 Deskside 10 Rackmount

144 kg (316 lb) 60 kg (132 lb) 35.4 kg (78 lb)


Voltage rating:

Current draw:

Power consumption:

100 V ac to 240 V ac +/- 10%, single-phase,

47 Hz to 63 Hz; power supplies are auto-ranging

At 100 v ac input – 30-slot 12.0 A; 10-slot: 4.0

A; SPS: 1.0 A max per unit during charge*

30-slot: 1200;10-slot: 400 VA; SPS: 1.0 VA per unit during charge

5-18



5


Deskside power cord: USA: 1.8 m (6.0 ft): NEMA

6-15P plug

Outside USA: Specific to country


Temperature:

Relative humidity:

Altitude:

10 o C to 40 o C (50 o F to 104 o F)


40 o C to 2,438 m (8,000 ft); 37 o C to 3,050 m

(10,000 ft)

Heat dissipation (max): 30-slot: 4,233 KJ/hr (4,020 BTU/hr)

10-slot: 1,411 KJ/hr (1,340 BTU/hr)


Service clearances

Front:

Back:

30.3 cm (1 ft)

60.6 cm (2 ft)


5


Cabinets for Rackmount Enclosures

Prewired 19-inch-wide cabinets, ready for installation, are available in the following dimensions to accept rackmount storage systems.

Vertical Space Exterior Dimensions Comments

173 cm or 68.25 in

(39 NEMA units or

U; one U is 1.75 in)

Height: 192 cm (75.3 in)

Width: 65 cm (25.5 in)

Depth: 87 cm (34.25 in) plus service clearances, which are 90 cm (3 ft),

30 cm front and 60 cm back

Accepts combinations of:

DPEs at 6.5 U, iDAEs at 3.5 U,

SPS units at 1 U,

DAEs at 3.5 U each,

Switches or hubs at 1 U

Weight (empty): 134 kg (296 lb)

Requires 200–240 volts ac. Plug options include L6–30 or L7–30 (domestic) and

IEC 309 30 A (international).

Each power strip has 12 IEC-320 CIS outlets.

Filler panels of various sizes are available.

As an example, a rackmount storage system that supports 100 disk modules has the following requirements.

Category

Vertical cabinet space in

NEMA units (U, one U is

1.75 in)

Weight

Power

Cooling

Requirement

Bottom to top: One SPS (1 U), one DPE (6.5 U), and nine DAEs (9*3.5 U equals 31.5 U) for a total of 39 U.

516 kg (1,137 lb) including the cabinet (134 kg), DPE (52 kg), SPS (11 kg), and nine DAEs (9 * 35.4 kg equals 319 kg).

4,500 VA max, including the DPE (800 VA), SPS (100 VA), and nine DAEs

(9 * 400 VA equals 3600 VA).

15,484 KJ/hour (14,700 BTU/hr), including the DPE (2,520

KJ/hr), SPS (265 KJ/hour, estimated), and nine DAEs (9*1,411 KJ/hr equals

12,699 KJ/hr).

5-20



5

Cable and Configuration Guidelines

We recommend that all copper-interconnected nodes be connected to a common ground grid. The common grid is not needed for optical interconnections.

Copper cable allows up to 30 meters (99 feet) between nodes or switches and hubs. Optical cable allows significantly longer distances. This is a major advantage of optical cable. However, you can use optical cable from a server only if the server’s adapter supports optical cable; otherwise you must use copper. Not all adapters support optical cable.

To connect a DPE to a DAE, you must use copper cable, whose maximum length is 10 meters (33 ft). So, the distance between a DPE and the DAEs it controls cannot exceed 10 meters (33 ft).

The host-bus adapters and SPs used with shared storage systems require optical cable, as does the switch between adapters and SPs.

The SPs used with unshared storage systems support copper cables and — with MIAs — optical cables. A hub itself supports copper, or with a MIA, optical. So you can use a copper cable or — with two

MIAs per cable — optical cable between any hub and SP. For optical cable to work between an adapter and hub or SP, then the adapter must support optical cable.

Server Server

Maximum distance:

Copper cable: 30 m

Optical cable:500 m or more

Switch or hub

Maximum distance:

Copper cable: 30 m

Storage system Storage system

Figure 5-10 Comparison Between Optical and Copper Cabling

Cable and Configuration Guidelines 5-21

5


Table 5-3

You can use any existing FDDI, multimode, 62.5 micron cable with good connections to attach servers, switches or hubs, and storage systems. These cables must be dedicated to storage-system I/O.

Cable Sizes — Optical

Length

5 m (16.5 ft) or

10 m (33 ft)

Typical Use

Within one room, connecting servers to storage systems (adapter must support optical cable) or connecting switches or hubs to storage systems

50 m (164 ft)

100 m (328 ft)

250 m (821 ft,.15 mi)

500 m (1642 ft,.31 mi)

Within one building, connecting servers to storage systems (adapter must support optical cable) or connecting switches or hubs to storage systems

Within one complex, connecting servers to storage systems (adapter must support optical cable) or connecting switches or hubs to storage systems

Optical cabling is 50 micron (maximum length is 500 m —1,650 ft —, or

62.5 micron (maximum length is 300 m — 985 ft. Both types are multimode, dual SC, and require a MIA on a DB-9 or hub connector. The minimum length is 2 m (6.8 ft). The minimum bend radius is 3 cm (1.2 in).

5-22



5

Table 5-4 Cable Sizes — Copper

Length

0.3 m (1 ft), non-equalized

1.0 m (3.3 ft), non-equalized

3 m (10 ft), non-equalized

Typical Use

Connecting DPE/DAE and DAE LCCs

Connecting a hub to an adjacent storage system

Connecting a hub to a storage system in the same cabinet, or daisy chaining from one cabinet to an adjacent cabinet

5 m (16.5 ft), non-equalized

10 (33 ft), non-equalized

Connecting a hub in one rack to a storage system in another cabinet

Connecting servers to hubs and/or storage systems — maximum length for non-equalized copper cable, maximum length between LCCs

30 m (98.5 ft), equalized Connecting servers to hubs and/or storage systems – maximum length for copper cable

Copper cabling is shielded, 75-ohm twin-axial, shield bonded to DB-9 plug connector shell (360 o ) FC-AL

Standard, Revision 4.4 or higher.

Component planning diagrams and worksheets follow.

Cable and Configuration Guidelines 5-23

5


Hardware Planning Worksheets

Following are worksheets to note the hardware components you want. There are two types of configuration:

• Shared storage

• Unshared storage

Hardware for Shared Storage

A1

Server 1

A1

Server n

. . .

An An

Path 1

Path 2

Switch 1

D1

E2

E1

Dm

E2

E1

DAE

DAE

DPE

SP B SP A

Storage system 1

DAE

DAE

DPE

SP B SP A

Storage system m

E2

E1

D1

E2

E1

Dm

Switch 2

Figure 5-11 Cable Identifier — DPE-Based System for Shared Storage

The cable identifiers used above apply to shared and unshared storage systems. The worksheet applies to shared storage only.

5-24



5

Hardware Component Worksheet for Shared Storage

Number of servers:____ Adapters in servers:____ Switches: 16-port:____8-port:____

Rackmount DPEs:_____SP/LCC pairs:_____PSs:_____SPSs:____ Rackmount cabinets:___

Rackmount DAEs:_____ LCCs:_____PSs:_____

Cables between server and switch - Cable A, optical only

Cable A

1,

Cable A

2,

Optical: Number:____ ....................................................... ..............Length________m or ft

Optical: Number:____ ....................................................... ..............Length________m or ft

Cable A n

, Optical: Number:____ ...................................................... ..............Length________m or ft

Cables between switches and storage systems - Cable D, copper or optical

Cable D

1,

Optical:Number:_____ ...................................................... ..............Length________m or ft

Cable D

2,

Optical:Number:_____ ...................................................... ..............Length________m or ft

Cable D m,

Optical:Number:_____ ..................................................... ..............Length________m or ft

Cables between enclosures - Cable E, which connects LCCs; between a DPE LCC and a DAE LCC, Cable

E must be copper; between DAE LCCs, it can be copper or optical.

Cable E

1

Cable E

2

:Number:_____

V

Copper

V

Optical(for DAE to DAE only). ..............Length________m or ft

:Number:_____ V Copper V Optical(for DAE to DAE only) ..............Length________m or ft

Hardware Planning Worksheets 5-25

5


Highly available cluster

File Server Mail Server Database Server

Switch 1 Switch 2

A2 Cable between server and switch

D1

Cable between switch and storage system

Path 1

Path 2

DAE

DAE

DAE

DAE

DAE

DAE

DPE

SP B SP A

Storage system

Figure 5-12 Sample Shared Storage Installation

E1

Cable between storage systems or enclosures

5-26



5

Hardware Component Worksheet for Shared Storage

Number of servers:__ 3 _ Adapters in servers:__ 6 _ Switches: 16-port:____8-port:__ 2

Rackmount DPEs:__ 1 ___SP/LCC pairs:__ 2 ___PSs:___ 2 __SPSs:__ 2 __ Rackmount cabinets:_ 1 __

Rackmount DAEs:__ 6 ___ LCCs:___ 12 __PSs:___ 12 __

Cables between server and switch - Cable A, optical only

Cable A

1,

Optical: Number:_____ ...................................................... ............. Length______m or ft

Cable A

2,

Optical: Number:__ 4 __ ..................................................... ............. Length__ 33 _m or ft

Cable A n

, Optical: Number:____ ....................................................... ............. Length______m or ft

Cables between switches and storage systems - Cable D, copper or optical

Cable D

1,

Optical:Number:__ 2 ___ .................................................... ............. Length___ 33 __m or ft

Cable D

2,

Cable D m,

Optical:Number:_____ ...................................................... ............. Length________m or ft

Optical:Number:_____ ...................................................... ............. Length________m or ft

Cables between enclosures - Cable E, which connects LCCs; between a DPE LCC and a DAE LCC, Cable

E must be copper; between DAE LCCs, it can be copper or optical.

Cable E

1

Cable E

2

:Number:__ 12 ___ V Copper V Optical(for DAE to DAE only) ......... Length____ 1 ___m or ft

:Number:_____ V Copper V Optical(for DAE to DAE only). ............. Length________m or ft

Hardware for Unshared Storage

The cable identifiers used in the following figure and on the following worksheets apply to all types of unshared storage systems.

So, if you want to plan a site with different types of systems, you can consolidate all your unshared storage component entries (from the different system types on a single worksheet).


5


A1

Server 1

A1

Server 2

A2 A2

DAE

FC Loop 1

FC Loop 2

E2

E1

DAE iDAE/DPE

SP B SP A

Storage system

E2

E1

Figure 5-13 Cable Identifier — Unshared System without Hubs

5-28



5

A1

Server 1

A1

Server n

. . .

An

Hub 1 Hub 2

DAE

D1

E2

E1

Dm

DAE iDAE/DPE

SP B SP A


DAE

E2

E1

D1

Dm

FC Loop 1

FC Loop 2

E2

E1

DAE iDAE/DPE

SP B SP A

Storage system m

E2

E1

Figure 5-14 Cable Identifier — Unshared Full-Fibre System with Hubs

An


5


Hardware Component Worksheet for Unshared Storage

Number of servers: Adapters in servers:______ Hubs (copper):_____ MIAs (copper to optical):______

DPE-based and DAE-only storage systems:

Rackmount DPEs:_____SP/LCC pairs:_____

Rackmount iDAEs:_____SPs:_____

PSs:_____SPSs:____ Rackmount cabinets:___


Rackmount DAEs:_____ LCCs:_____PSs:_____

Deskside DPEs:_____SP/ LCC pairs:_____DAE LCCs:____ DPE PSs:____ DAE PSs:____ SPSs:__

Deskside iDAEs:_____SPs:_____ DAE LCCs:____ PSs:____ SPSs:___

Deskside DAEs: 30-slot_____ 10-slot______ LCCs:_____ PSs:_____

Cables between server and storage system or between server and hub - Cable A, copper or optical

Cable A

1

:Number:____ V Copper V Optical ...................................... ............. Length________m or ft

Cable A

2

Cable A n

:Number:____ V Copper V Optical..................................... ............. Length________m or ft

:Number:____ V Copper V Optical..................................... ............. Length________m or ft

Cables between hubs and storage systems - Cable D, copper or optical

Cable D

1

Cable D

2

Cable D m

:Number:_____ V Copper V Optical ..................................... ............. Length________m or ft

:Number:_____ V Copper V Optical ..................................... ............. Length________m or ft

:Number:_____ V Copper V Optical..................................... ............. Length________m or ft

Cables between storage systems or enclosures - Cable E, which connects LCCs or SP-LCC; between a

DPE LCC or iDAE SP and a DAE LCC, Cable E must be copper; between DAE LCCs, it can be copper or optical.

Cable E

1

Cable E

2

:Number:_____ V Copper V Optical(DAE to DAE only)........ ............. Length________m or ft

:Number:_____ V Copper V Optical(DAE to DAE only)........ ............. Length________m or ft

*Please specify all storage-system components you need, even though you will not need to order them separately, since most or all components will be included with the model of each system you order.

5-30



5

Server

A1 Cable between server

and storage system

A1

E1

DAE

E1 Cable between storage

systems or enclosures

Included with deskside

DPE iDAE/DPE

SP A

Figure 5-15 Sample Unshared Deskside System — Basic Configuration

Sample Component Worksheet


Number of servers: 1 Adapters in servers:___ 1 ___ Hubs (copper):______ MIAs (copper to optical):_____



Rackmount iDAEs:__ 1 ___SPs:__ 1 ___


PSs:___ 1 __SPSs:____ Rackmount cabinets:__ 1 _

Rackmount DAEs:___ 1 __ LCCs:__ 1 ___PSs:__ 1 ___





Cable A

1

:Number:__ 1 __ V Copper V Optical ................................... ..............Length__

1 0 __ _m or ft

Cable A

2

Cable A n

:Number:____ V Copper V Optical .................................... ..............Length________m or ft

:Number:____ V Copper V Optical .................................... ..............Length________m or ft


Cable D

1

Cable D

2

Cable D m

:Number:_____ V Copper V Optical..................................... ..............Length________m or ft

:Number:_____ V Copper V Optical..................................... ..............Length________m or ft

:Number:_____ V Copper V Optical .................................... ..............Length________m or ft



Cable E

1

Cable E

2

:Number:__ 1 __ V Copper V Optical(DAE to DAE only)....... ..............Length__

1 _____m or ft

:Number:_____ V Copper V Optical(DAE to DAE only) ..... Length________m or ft


5


Server

E1

A1 Cable between

server and storage

system



included with deskside DPE



A1

DAE

DAE

DAE

E2

DAE

DPE

SP B SP A

Storage system

FC Loop 1

FC Loop 2

Figure 5-16 Sample Unshared Deskside System — Dual-Adapter/Dual-SP

Configuration

5-32



5

Sample Component Worksheet


Number of servers: 1 Adapters in servers:__ 2 __ Hubs (copper):______ MIAs (copper to optical):_______



Rackmount iDAEs:_____SPs:_____

Rackmount DAEs:_____



LCCs:_____PSs:_____

Deskside DPEs:__ 1 _SP/ LCC pairs:__ 2 __DAE LCCs:__ 2 __ DPE PSs:_ 2 _ DAE PSs:_ 2 _ SPSs:_ 1 _


Deskside DAEs: 30-slot__ 1 ___ 10-slot______ LCCs:__ 6 ___ PSs:__ 6 __


Cable A

1

:Number:_ 2 _ V Copper V Optical ...................................... ............. Length___ 10 ___m or ft

Cable A

2

Cable A n

:Number:____ V Copper V Optical .................................... ............. Length________m or ft

:Number:____ V Copper V Optical .................................... ............. Length________m or ft


Cable D

1

Cable D

2

Cable D m

:Number:_____

V

Copper

V

Optical..................................... ............. Length________m or ft

:Number:_____ V Copper V Optical..................................... ............. Length________m or ft

:Number:_____ V Copper V Optical .................................... ............. Length________m or ft



Cable E

1

:Number:__ 6 ___ V Copper V Optical(DAE to DAE only)...... ............. Length___ 1 ____m or ft

Cable E

2

:Number:__ 2 ___ V Copper V Optical(DAE to DAE only)...... ............. Length___ 5 ____m or ft


5


Server 1 Server 2

Cable between server and hub

A1

A2 Cable between server and hub

A2

Hub 1 Hub 2

Cable between hub and storage system

D2

FC Loop 1

FC Loop 2

D1

DAE

DAE

DAE

DAE

DPE

SP B SP A


DAE

DAE

DAE

DAE

DPE

SP B SP A


E1

Cable between storage systems or enclosures

D2

D1

Cable between hub and storage system

Figure 5-17 Sample Component Worksheet for DPE-Based System with Hubs — Two

Loops

5-34



5


Number of servers: 2 Adapters in servers:___ 4 ____ Hubs:___ 2 ____ MIAs (optical to copper):_______


Rackmount DPEs:_____SP/LCC pairs:__ 4 ___ PSs:___ 4 __SPSs:_ 2 __ Rackmount cabinets:_ 2 __

Rackmount iDAEs:_____SPs:_____ PSs:_____SPSs:____ Rackmount cabinets:___

Rackmount DAEs:__ 8 ___ LCCs:__ 16 _PSs:__ 16 ___





Cable A

1

:Number:__ 2 _

V

Copper

V

Optical ..................................... ..............Length_

20 _____m or ft

Cable A

2

Cable A n

:Number:__ 2 __ V Copper V Optical ................................. ..............Length_

1 0 _____m or ft

:Number:____ V Copper V Optical.................................... ..............Length________m or ft


Cable D

1

:Number:__ 2 __ V Copper V Optical .................................... ..............Length__

20 __ _m or ft

Cable D

2

:Number:__ 2 __ V Copper V Optical .................................... ..............Length___

20 ___m or ft

Cable D m

:Number:_____ V Copper V Optical.................................... ..............Length________m or ft



Cable E

1

Cable E

2

:Number:_ 16 __ V Copper V Optical(DAE to DAE only)....... ..............Length___

1 ____m or ft

:Number:_____ V Copper V Optical(DAE to DAE only)....... ..............Length________m or ft

Please specify all storage-system components you need, even though you will not need to order them separately, since most or all components will be included with the model of each system you order.

What Next?

This chapter explained hardware components of shared and unshared storage systems. If you have completed the worksheets to your satisfaction, you are ready to consider ordering some of this equipment. Or you may want to read about storage management in the next chapter.


5


5-36


6

Storage-System

Management

This chapter explains the management applications you can use to manage storage systems from servers. Topics are

• Using Navisphere Manager Software .............................................6-3

• Storage Management Worksheets ...................................................6-5

Storage-System Management 6-1

6

Storage-System Management

Navisphere software lets you bind and unbind disks, manipulate caches, examine storage-system status and logged events, transfer control from one SP to another, and examine events recorded in storage system event logs.

Navisphere products have two parts: a graphical user interface (GUI) and an Agent application. The GUIs run on a management station, accessible from a common framework, and communicate with storage systems through the Agent that runs on each server. The

Navisphere products are

• Navisphere Manager, which lets you manage multiple storage systems on multiple servers simultaneously;

• Navisphere Analyzer, which lets you measure, compare, and chart the performance of SPs, LUNs, and disks.

• Navisphere Integrator, which provides an interface between

Navisphere products and HP OpenView, CA Unicenter, and

Tivoli.

• Navisphere Event Monitor, which checks storage systems for fault conditions and can notify you and/or customer service if any fault condition occurs.

• Navisphere failover software. Application-Transparent Failover

(ATF) is an optional software package for high-availability installations. ATF software lets applications continue running after the failure anywhere in the path to a LUN: a host-bus adapter, cable, switch, or SP. ATF is required for any server that has two host-bus adapters connected to the same storage system.

Another failover product is CDE (Driver Extensions) software, which has limited failover features. CDE is included with each host-bus adapter driver package.

• Navisphere Agent, which is included with each storage system, and Navisphere CLI (Command Line Interface), which lets you bypass the GUI and type commands directly to storage systems.

The Agent runs on any of several different platforms, including

Windows and popular UNIX® platforms; the other products run on

Windows platforms only.

6-2 EMC Fibre Channel Storage-System Configuration Planning


6

Using Navisphere Manager Software

Navisphere Manager software (Manager) lets you manage multiple storage systems connected to servers on a TCP/IP network. Manager offers extensive management features and includes comprehensive on-line help. Manager is required for shared storage and optional for unshared storage.

Manager runs on a management station which is a Windows NT

®

or

Windows

®

2000 host. The servers connected to a storage system can run Windows or one of several UNIX® operating systems. With shared storage, servers connected to the SAN can run different operating systems; with direct (unshared direct or shared-or-clustered) storage, servers connected to the same storage system must run the same operating system.

The following figures show Navisphere Manager in shared and unshared environments.

Using Navisphere Manager Software 6-3

6


File Server

Management station and server

Operating system A

Navisphere

Manager

Navisphere

Agent

Failover

software

Mail Server


Operating system A

Navisphere

Manager

Navisphere

Agent

Failover

software

Switch fabric

Database Server

Operating system B

Navisphere

Agent

Failover

software

Switch fabric

Production Server

Operating system C

Navisphere

Agent

Failover

software

LAN

Path 1

Path 2

Figure 6-1 Sample Shared Switched Environment with Navisphere Manager

Accts Server


Operating system A

Navisphere

Supervisor

Navisphere

Agent

Database Server

Operating system B

Navisphere

Agent

Development Server


Operating system C

Navisphere

Supervisor

Navisphere

Agent

LAN

6-4

Figure 6-2 Sample Unshared Environment with Navisphere Manager

EMC Fibre Channel Storage-System Configuration Planning


6

Storage Management Worksheets

This section includes two worksheets: one for shared storage and one for unshared storage. The following worksheet will help you plan your storage system management environment. For each host, complete a section.

For the shared storage worksheet, complete the management station hostname and operating system; then decide whether you want the

Navisphere Analyzer and/or Event Monitor and, if so, mark the appropriate boxes. Then write the name of each managed server, with operating system, Storage Group, and configuration access specification. You can copy much of the needed information from the

LUN and Storage Group planning worksheet in Chapter 3 or 4.

Management Utility Worksheet – Shared Storage

Management station hostname:___________________Operating system:_______________

Software: V Navisphere Manager/Agent V Navisphere Analyzer V Navisphere Event Monitor

List all the servers this host will manage. Each managed server must run an Agent and ATF software of the same type as its operating system.

Server: Op sys: Storage Group number or name:

Server:

Server:

Op sys:

Op sys:

Storage Group number or name:


Server:

Server:

Server:

Server:

Server:

Op sys:

Op sys:

Op sys:

Op sys:

Op sys:






V

V

V

Config Access

Config Access

Config Access

V Config Access

V Config Access

V Config Access

V Config Access

V Config Access

Management station hostname:___________________Operating system:_______________


List all the servers this host will manage. Each managed server must run an Agent and ATF software of the same type as its operating system.

Server: Op sys: Storage Group number or name:

Server:

Server:

Op sys:

Op sys:



Server:

Server:

Server:

Server:

Server:

Op sys:

Op sys:

Op sys:

Op sys:

Op sys:






V

V

V

Config Access

Config Access

Config Access

V Config Access

V Config Access

V Config Access

V Config Access

V Config Access

Storage Management Worksheets 6-5

6


For unshared storage (unshared direct or shared-or-clustered direct), for each host, choose a Navisphere product. The host may be a management station that is not a server (complete only the Manager section); it may be a management station that is a server (complete the Manager section and mark the Agent box), or it may be a server

(mark the Agent box).



6

Management Utility Worksheet – Unshared Storage

Hostname:

Storage system type: V DPE-based

Operating system:

V iDAE-based


List all the servers this host will manage. Each managed server must run an Agent of the same type as its operating system.

Server: Oper sys: Server: Oper sys:

Server:

Server:

Server:

Oper sys:

Oper sys:

Oper sys:

Server:

Server:

Server:

Oper sys:

Oper sys:

Oper sys:

Hostname: Operating system:

Storage system type: V DPE-based V iDAE-based

Software: V Navisphere Manager and Navisphere Agent V Navisphere Agent and CLI



Server:

Server:

Server:

Oper sys:

Oper sys:

Oper sys:

Server:

Server:

Server:

Oper sys:

Oper sys:

Oper sys:

Hostname: Operating system:

Storage system type: V DPE-based V iDAE-based

Software: V Navisphere Manager and Navisphere Agent V Navisphere Agent and CLI



Server:

Server:

Oper sys:

Oper sys:

Server:

Server:

Oper sys:

Oper sys:


Storage Management Worksheets 6-7

6



Index

A ac power requirements

DAE-only storage system 5-18

DPE storage system 5-14

iDAE storage system 5-16

application planning

shared storage 3-6

unshared storage 4-4

application worksheet, completing

shared 3-6, 4-4 unshared or clustered direct 4-4

applications

for RAID Groups, sample 2-19

LUN and file system

planning 3-6

application-transparent failover (ATF) software

6-2

array, see disk-array storage system attach kit, see host-bus adapter driver package

audience for manual xi

C

cabinets for rackmount storage systems 5-20

cabling

guidelines 5-21

introduced 1-4

types and sizes 5-22

cache

about 5-11

page size 4-13

cascading switches 1-6

CDE driver extensions software 6-2

CLI (Command Line Interface) 6-2

clustered installation, disk structure example 4-3

communication with storage system, see Chapter

6

configurations

RAID

compared 2-12

examples 4-2

planning 3-6

RAID types

guidelines 2-17

shared storage

examples 3-3

tradeoffs 5-12

unshared storage

examples 4-2 installation 4-2

cooling requirements

cabinet 5-20

DAE 5-19

DPE 5-15

iDAE 5-17

copper cable, types and sizes 5-23

CRUs (customer-replaceable units)


locating 5-8

SP 5-5, 5-9

D

DAE, see also Disk Array Enclosure (DAE)

DAE-only storage systems

dimensions 5-18

introduced 1-16, 5-6


i-1

Index i-2

site requirements 5-18 weight 5-18

data sheets, hardware 5-14

device name, operating system 3-16, 4-15

disk capacity

defined 4-14

capacity, defined 4-13

configuration types

compared 2-12

configuration, see also RAID Group

IDs 3-4, 4-2

LUN types

planning 3-6

mirror, defined 2-2

number on worksheet 4-14

RAID types

guidelines 2-17

sample applications 2-19

shared storage

examples 3-3

striping, defined 2-2

unit number on worksheet 3-8, 4-13

unshared storage

example 4-2 examples 4-2

Disk Array Enclosure (DAE)

introduced 5-6

site requirements 5-18

Disk Array Processor Enclosure (DPE)

introduced 5-6

Disk Array Processor Enclosure (DPE), see DPE storage system

disk-array storage system

communicating with, see Chapter 6

hardware

shared storage 1-15


installation types 1-10

managing, see Chapter 6

DPE storage systems

components 5-3

dimensions 5-14 site requirements 5-14 weight 5-14

driver extensions software (CDE) 6-2

dual paths to LUNs 3-2, 4-2


E enclosure address (EA)

DPE 5-4, 5-8

F fabric, switch

introduced 1-3

Fibre Channel

adapter 1-4 components 1-4

defined 1-3

hub, description 1-8

switch, description 1-5 switch, see switch

file system

name 3-17, 4-15

worksheet

completing 3-13, 4-12

footprint


DPE storage systems 5-14

iDAE storage systems 5-16

rackmount cabinet 5-20

G

GBIC (Gigabit Interface Converter), about 1-5

global spare, see hot spare

grounding requirements 5-21

GUI (in storage-system management utilities) 6-3

H hardware

data sheets 5-14

mirroring 2-2

planning worksheets

shared storage 5-24

shared storage 1-15, 5-3


heat dissipation




height

DAE-only storage systems 5-18


iDAEstorage system 5-16

high availability

options for unshared storage 5-13

shared switched instllation 1-10

host, see also server

host-bus adapter (HBA), introduced 1-4 host-bus adapter driver package 1-4

hot spare

defined 2-9


when to use 2-18

hub

description 1-8

planning system with 5-29

sample hardware worksheet 5-34

I iDAE storage systems

dimensions 5-16 site requirements 5-16 weight 5-16

image, disk, defined 2-2

individual access array, see RAID 5 Group

individual disk unit

defined 2-9

disk space usage 2-16

performance 2-14


when to use 2-18


tradeoffs 5-11

intelligent Disk Array Enclosure (iDAE), see iDAE storage systems

interconnect components 5-1

cables, hubs, switches 1-4

interface kit, see host-bus adapter driver package

L

LCC (link control card) 5-8

logical volume, see file system

LUN (logical unit) configurations

individual disk, defined 2-9

RAID 0, defined 2-8

RAID 1 mirrored pair 2-7

RAID 1/0 Group

defined 2-8

RAID 3 Group, defined 2-5

RAID 5 Group, defined 2-4

shared storage, examples 3-3

disk mirror, defined 2-2

in RAID Group 2-3

number on worksheet 3-8, 3-15, 4-13, 4-14

paths to 3-2, 4-2

planning 3-6

RAID types

compared 2-12

guidelines 2-17


SP control of 5-10

unshared storage

examples 4-2 unshared, examples 4-2

worksheets 3-13, 4-10, 4-12

M

Manager utility 6-2

manual, about 1-xi

MIA (media interface adapter), about 1-5

mirrored pair, see RAID 1 mirrored pair mirrored RAID 0 Group, see RAID 1/0 Group

mirroring, defined 2-2

N

Navisphere Manager utility 6-2

node, defined 1-3

nonredundant array, see also RAID 0 Group

O operating system

device name for disk unit 4-15

device name for LUN 3-16

software mirroring 2-2

optical cable, types and sizes 5-22

organization of manual xii

Index


i-3

Index i-4

P

page size, cache 3-14, 4-13

parallel access array, see RAID 3 Group

paths to LUNs 3-2, 4-2

performance, RAID Group 2-13

physical disk unit, see LUN (logical unit) physical volume, see LUN (logical unit)

planning LUNs and file systems 3-6

plant requirements

DAE 5-18

iDAE 5-16

plug types 5-20

power requirements


DPEstorage system 5-14


power supplies (PSs), DPE storage system 5-8

R rackmount model DPE storage system

DPE storage system

rackmount model 5-3

RAID Group configurations

compared 2-12

performance 2-13

planning 3-6

RAID types

guidelines 2-17


RAID 3 versus RAID 5 2-6

shared storage

examples 3-3

types and tradeoffs, see Chapter 2

unshared storage

examples 4-2

RAID Groups and LUNs 2-3

RAID types

guidelines 2-17


RAID 0 Group

defined 2-8


when to use 2-18

RAID 1 mirrored pair

defined 2-7



when to use 2-17

RAID 1/0 Group

defined 2-8


when to use 2-17

RAID 3 Group

defined 2-5


when to use 2-17

RAID 5 Group

defined 2-4


when to use 2-17

redundant array of independent disks (RAID), see

RAID Group

S server

cabling guidelines 5-21

component 5-1

connection to storage system, see cabling

planning worksheet


unshared storage example 4-2

service clearance


iDAEstorage system 5-17

shared storage

components 5-3

disk structure example 3-3

hardware 1-15

switched, defined 1-10

shared storage systems

cabinets 5-20

hardware planning worksheets 5-24

shared-or-clustered direct installation

defined 1-10

disk structure example 4-2, 4-3

site requirements

DAE 5-18


DPE storage systems 5-14

iDAE storage systems 5-16

size, cache 3-14, 4-13

software mirroring, defined 2-2

SP (storage processor)

description 5-5, 5-9

FC-AL address ID 3-14, 4-12

SPS (standby power supply)


storage components

shared storage 5-3

storage managment worksheets 6-5

storage system caching

on worksheet 4-14

storage-system caching

as feature 5-11

stripe

with RAID 1/0, RAID 0 2-8

with RAID 5, RAID 3 2-4

stripe, defined 2-2

switch

description 1-5

in sample shared storage configuration 3-3

introduced 1-3

switch fabric

introduced 1-3

T temperature requirements




terms, RAID 2-2

tradeoffs


RAID types 2-12

U unshared direct installation

defined 1-10


unshared storage


hardware 1-16

hardware planning worksheets 5-27


V

vault disks 2-10

volume, name 3-17

W weight




storage system installation 5-20

worksheet

application 3-6 completing 3-6

component planning


LUN 3-13, 4-10, 4-11, 4-12

worksheets component planning

shared storage 5-24


storage management 6-5

Index


i-5

Index i-6


Using Navisphere Manager Software. EMC FC4500, FC5300, FC5700

Hardware for Shared Storage

Storage Hardware — Rackmount DPE-Based Storage Systems

Disks

Storage Processor (SP)

Hardware for Unshared Storage

Types of Storage System for Unshared Storage

Disks

Storage Processor (SP)

Planning Your Hardware Components

Configuration Tradeoffs - Shared Storage

Configuration Tradeoffs - Unshared Storage

Hardware Data Sheets

DPE Data Sheet

iDAE Data Sheet

DAE Data Sheet

Cabinets for Rackmount Enclosures

Cable and Configuration Guidelines

Hardware Planning Worksheets

Hardware for Shared Storage

Hardware Component Worksheet for Shared Storage

Hardware Component Worksheet for Shared Storage

Hardware for Unshared Storage

Hardware Component Worksheet for Unshared Storage

Hardware Component Worksheet for Unshared Storage

Hardware Component Worksheet for Unshared Storage

Hardware Component Worksheet for Unshared Storage

Storage-System

Management