SUMMARY: TruCluster 5.1a : Memory Channel VS Ethernet

From: Jean-François Blanchet <Jfblanchet_at_dgeq.qc.ca>
Date: Mon, 17 Sep 2001 09:08:20 -0400

My message :

>Hi managers,
>
>I planing to buy two alpha DS20e and two DS10 all in the same cluster.
>
>New, with TruCluster 5.1a is the choice between the memory chanel and >ethernet at 100mb.
>
>The memory chanel is an expansive solution, I ask the vendor for the >ethernet solution and he told me that this is not a good choice for >performance .
>
>The question :
>
>Can you comfirm me the impact of this choice on the performance of my >system. Is it (Memory Chanel) a vendor choice for making more money??
>
>Thank's
>Jeff

Thank's to all.

Lot of responses but there is no concensus, in the fact it depend of the application, In my case I have the money , I will take no chance .I join the message of "Dr. Thomas.Blinn" .

He wrote :

I'm sure you realize that no one on the tru64-unix-managers mailing list
is going to be able to give you an informed answer to your question.

You are correct, Memory Channel hardware is quite expensive. Since your
DS10 systems come with 100Mbit Ethernet on the motherboard, and there
are relatively inexpensive dual- and quad- channel 100Mbit Ethernet
cards available for the DS20E, you would have a much more cost effective
solution using Ethernet as the cluster interconnect (CI).

Since I know NOTHING about your workload, I can't tell you what impact
that choice would have on performance. The Memory Channel hardware is
capable of doing certain kinds of operations with very low overhead; it
has higher data transfer throughput than 100Mbit Ethernet and better
supports distributed disk and tape I/O. I don't personally know if it
would actually work in your configuration on all the system, and you'd
need to figure that out. But if you need the maximum performance for a
four node cluster, it is probably the way to go.

Of course, you've said NOTHING about the I/O connectivity that you plan
to have, that is, what systems connect directly to what disks. If you
plan to use local storage on ALL of the systems (it is possible to do
it that way), then ALL of the "off node" disk traffic is going to go
through the 100Mbit Ethernet, and the cluster file system protocols are
more reliable than NFS but not much different in terms of throughput
for the data. Plus, there is other traffic that will share the wire,
and some of that traffic is cluster bookkeeping operations that use
less system resources when done with Memory Channel hardware.

To summarize, without knowing A LOT MORE about your real workload and
how you propose to configure the systems, it's impossible to tell you
whether the Memory Channel hardware is worth the cost. If it were me,
I'd probably go with the 100Mbit Ethernet but budget for moving to the
Memory Channel hardware if I felt the performance wasn't meeting the
needs. I'd also take into account that TruCluster Server is already
being tested with gigabit Ethernet, and that newer less expensive GB
Ethernet adapters are not real far away from release, and that once
GB Ethernet is verified as working correctly, I might be able to move
to GB Ethernet to address bandwidth concerns. I'd also consider using
shared storage, either parallel SCSI or a FC SAN approach, to get the
I/O bandwidth bottlenecks removed, if I could get storage adapters to
implement the shared storage farm that would work in both system types,
the DS20E and the DS10.

Tom


_____________________________
Jean-Francois Blanchet
jfblanchet_at_dgeq.qc.ca

Direction de l'informatique
Service de la Technologie.

Le Directeur général des élections
du Québec
3460, rue de La Pérade
Sainte-Foy (Québec) CANADA
G1X 3Y5

Téléphone : (418) 644-9339
Fax : (418) 643-8089
_____________________________
-----BEGIN PGP PUBLIC KEY BLOCK-----
Version: PGP 7.0

mQGiBDtMVjURBADDgJDN29AiRCAiNmw2tgFqyC+h/aPs3LBWJtSn4JZ2RTfNRm44
sMp8k0iI0qCXYnSWJA9yXxcemsv/tNvLRuAmNrId3Q5kiCJ2k0Xd7KtVmJe9ARSA
TuvwxdJwBHYV7fjyiTrFf4Zwa3cMFEyO2Cx5ZLgEO4tBaem1AnbKPluCqwCg//gw
pCj0QxN3dle4DmC2/6FxfnsEAKA9BgkkrYMAbXu5jfrYqdgxPVPmr+WJXLev05N1
/ptVycEvhnfhy1iEpGLqedSSPET3WyffzawZbRYV/f/6ThRkCkxT9nN6Wt4CYglU
7LOkaehqjsjh4Ke1UQLXXzK+I+2V8T9vPUpbLU8S2kyG/cLF6WUWUlxv4Lkq19ow
AkNnBACueZlLekz4aFSGeUbtvmYvJuqsNCKFJVmEM4KzAM4PTjs0c2EflFktAKg8
pRYI+SK8nSxNnByFgXjsIWwXNuckT73RyqnAXGJEsKTmhe6zqL5y9llu+ktXFEct
zMsHfcDpyawuaNsQ2N3n1DX4Wu8J69qo1b6XNT3glmk/lZ5BtbQuSmVhbi1GcmFu
529pcyBCbGFuY2hldCA8amZibGFuY2hldEBkZ2VxLnFjLmNhPohVBBARAgAVBQI7
TFY1BQsDAgEKAhkBBRsDAAAAAAoJEP2v9TwhjJIGmaAAnRAQSoJIg9JWCeeGo6cx
8X1fWKpjAJ95vUdnE4T0hjhF5B2CHO9EfK4X6LkCDQQ7TFY2EAgA9kJXtwh/CBdy
orrWqULzBej5UxE5T7bxbrlLOCDaAadWoxTpj0BV89AHxstDqZSt90xkhkn4DIO9
ZekX1KHTUPj1WV/cdlJPPT2N286Z4VeSWc39uK50T8X8dryDxUcwYc58yWb/Ffm7
/ZFexwGq01uejaClcjrUGvC/RgBYK+X0iP1YTknbzSC0neSRBzZrM2w4DUUdD3yI
sxx8Wy2O9vPJI8BD8KVbGI2Ou1WMuF040zT9fBdXQ6MdGGzeMyEstSr/POGxKUAY
EY18hKcKctaGxAMZyAcpesqVDNmWn6vQClCbAkbTCD1mpF1Bn5x8vYlLIhkmuqui
XsNV6TILOwACAgf+NidcBRLw732GfQH2bHrFI6t5P56gE1plpUlxabrWC8kYFtNT
kvoC/VDaU+6Yr+SPCl36Ve/k82cqdZPmHv56YyziKYbZtQpbOlrBUj8NCs6x6NjA
+4SILzdDUs0BwaRG+9fqfTS5nS+if+3GopmlkKrJ9tfinigj9hX7rjsv31z3HrTS
Uq4NfNPPqYvQQaqvd3dbBKAE8aX1Pjf160iB7W40vmw4FVssKGrhcivfm3CFVH2x
o7N3/KI2EUVFy+/QaYyP42L8Ewb85EbxMKpbkaB4G2JAFWNuacFXmmH8boxGlccH
7I8ZuQyUQPbUncLR2MbdiYhqcQeBot95iZcGDIhMBBgRAgAMBQI7TFY2BRsMAAAA
AAoJEP2v9TwhjJIG7JMAoJLoffpwWLsnX5nuL9/tULQFZnDwAJ9U7rFprdVD6omg
FMXx/hbZIAUEEA==
=xrRr
-----END PGP PUBLIC KEY BLOCK-----
Received on Mon Sep 17 2001 - 13:09:02 NZST

This archive was generated by hypermail 2.4.0 : Wed Nov 08 2023 - 11:53:42 NZDT