Foreword
Don Harbert
\lice
President.
UNIX
IJusiness
Digital not only invented dusters bur continues to set rhe standard by which all other cluster systems are measured. The VAXcluster success and that of Digital's latest UNIX clus ter systems derive ri·om superb engi neering that builds on the system definition put forth in the early 1980s by the VAX engineering team: an available, extensible, h.igh-pertormanu: multicomputer system built fi-om standard processors and a general purpose operating system, with char acteristics of borh loosely and tightly coupled systems.'
We in the UNIX community arc proud of our VAXcluster heritage and have engineered our products ro provide the same kinds of benefits to customers that V AXcluster systems provide.1 In the opening paper for this issue of the
journal,
members oftbe Digital UNIX engineering ream describe the multicomputer system for the Digital UNIX environ ment, called TruCiuster, wh.ich, like the VAXcluster system, is designed for high availability, scalability, and pertormance.
The technology, of course, is dif ferent, and the environment is open.
The fundamental concepts are never theless the same. The TruCiuster system is a loosely coupled, general purpose system connected by a high-performance interco!Ulect. It maintains a single security domain and is managed as a single system.
•
Nancv
P.
Kronenberg,
Hcmv lVI. Lew, and William
D.
Strecker, "VAXclusn:rs:
A Closely-Coupled Distributed
System,"
11011
Trausactions ou Oimputer.\)·ste/1/s, vol.4,.no.
2
(l'vby 1986): 130-146. t Digital has renamed VAXclustcr svstcms to
OpcnV,viS
Clustn svsrems.
Cluster services remain available even when other members are unavaiL!ble.
Like VAXcluster systems, TruCiuster systems implement a distributed lock manager, which provides synchro nization tor a highly parallelized distributed database system. The teclmology for the lock manager, however, is newly implemented tor the UNIX environment. Also com pletely new is the interconnect tech nology tor TruCiuster systems.
MEMORY
CHANNEL is a reliable, high-speed interconnect based on a design by Digital partner Encore
Computer Corporation. MEMOR.Y
CHAN EL addresses the unique needs of clusters by implementing clusterwide virrual shared memory; the interconnect reduces overhead and latency by two to three orders of magnitude.1 Because MEMORY
CHANNEL uses the industry standard PCI, designers can imple ment the network at very low cost.
We believe this interconnect tech nology puts Digital years ahead of the competition.
The TruCiuster system is rhe latest example of Digital's intent to remain a technology leader in the UNIX market.
We began by developing the first high-perf()rmance, 64-bit general-purpose operating system,
DEC
OSF
/l,
shipping in March
1993. The first Digital UNIX cluster release, DEC:sak Available Server
Environment, followed soon there after in April 1994. The announce ment in April 1996 ofTruCiustcr systems with MEMORY CHA
1 EL
:j: Richal'cl
B.
Gilkrr, "Memory
ChJtlllcl
Network f(>r PC: I," 1/:l:F :llicro
(february l':I<J6): 12-IR.
Digital Technical )ound
Vol. R
No. I 19':16
3
ag:tin places Digit:�! E1r ahead of the competition technologicallv. The pcrti:m11:tnce of these :waibble cluster systems now approaches that of very expensive supercomputers. System pcrti:m1unce has b..:en me:tsured at the record-breaking: rare of 30,390 tpmC 011 tour Alph:tScrver 8400 systems running Digital UNIX and th<.: Oracle Univns:tl Snver with
Or�Kie Parallel Server. The previous perti:>rmance record, 20,918 rpmC, was held by the proprietary Tandem
Him:tbya K10000-!12; Digital's open system cluster pertormance
1·ecord is 1.5 rimes the Tandem perfi:mnance record at one third the svsrem cost. ror Digital, clusters of high perti:mnance 64-bir systems are to
;1 great extent at the heart of irs commercial and technic:tl server smtet,'V. Digital UNIX has been de tined and engineered tor the ser ver business, specitically, tor the high perti:mll:tnce commerci:tl and large probkm/scientitic e11\'ironmcnr. To be successful in the open svstem m:tr ker, however, a company must reach outside itself to jointly engineer prod ucts with leading sortw;ll"C suppliers th:tt have rhe sofuv:tre customers need ro be comperiti\·c. Therefore, the tirst TruCiusrer implementation is designed with Digit:�l's partners m:ljor sottware comp<mics-to meet the requirements ti:>r high pcrtormance and tl111ctionalirv in the commerci:�l chrab:1se server marker.
The competitive challenge now is ro m:�inrain Digital's signitic:�nt lead in pro\·iding outstanding cluster per ti:mlwKe, a\·ail:�bilirv, and ;lft(xcbbil iry. hom :1 rechnologiul perspective, the imm<.:diate and achicv:�ble goal is to increase the number of cluster nodes J-i-om 4 to 10 or 20 nodes.
Within this r:�ng<.:, Digital maintains a simple cluster system model that otters the perf(mnance advJ!lt;lges of c.lustcring and :�voids the disadvan t:�ges, such :ts the ma.nagcmellt l�rob lems and qualiticarion healbches, of more compkx topologies. Further, the Digital UNIX organization will fOCllS Oil a new cJ LISter ti Je S\'Stem, configuration tloibilirv, man:1gement tools, and J cluster :�lias that :�I lows a single-system view tor clients and peers. The overall goal of this work is to e\·olvc row:�rd J more general computing ell\·ironment.
The kinds of tools rh:n both sim pli�' and enha1Ke pertormance arc exemplitied by the program ;l!Jalysis and optimization tools prcscmcd in this issue. Built on Digit:� I UNIX l'ersion 4.0 :tnd announced in April, these tools help software developers cxtr:tct maximum perti:.mnancc ti·om the system. The story of the tools dcvelopmcm is <lll excellent c:omple ofrhe direct application of research to products. The power ofrhc OM object moditicttion tool <lnd the analy sis tool with object modification
(Atom) \\\lS recognized bv d..:velopcrs e\·en :�s resc:trch progressed; in t:Kr, semiconductor designers developed
Atom tools to evaluate new Alpha chip implementations. The result of this close cooperation between research and dewlopmenr is ,llkmced programming tools tor customers.
These efti:>rts in the
UNIX org:�ni z:�tion arc manitestarions of Digital's commitment to open system�. Other areas of engineering where this com mirmem is app:trenr are also repre sented in this issue. For example, eXcursion sottware is kcv ro integra tion between Microsoft's Windows t:11nilv of products :�nd Digit:�l's
UNIX <llld OpcnViVIS products.
This whollv revised version both adds new fimction;llirv and conserves system resources. Another major area of strength tor Digital is irs networks products. Networks engineers describe two cxampks of network services that incre:�sc users' choices and extend system tl1ncrionaJirl', i.e., the Imegratcd Directory Scn·iccs
(IDS) and the Common Directory
Interbce.
DigitJI's srr:�regv is to continue to engineer products th:tr pro\·ide out stJnding performance and pric..:/ pcrti:mlla!Ke in open environments.
In all areas of engineering-systems, services, networking-our goal i� to set the standard lw which all others
:�rc measured.
4
Dig;iral Tcchnictl )ound
V"l. 8 No. I
1996