SUMMARY: Fun with fibre-channel HBAs

From: John P Speno <speno_at_isc.upenn.edu>
Date: Wed, 10 Jan 2001 10:54:27 -0500

My original issue:

> System is an ES40 with dual KGPSA-CA fibre-channel HBAs attached to dual
> SanSwitch 16 (compaq's rebranded brocade fibre switches, I think). OS is
> Tru64 UNIX 5.1 with patch kit 2 installed, firmware is 5.8-43. HBA
> firmware is 3.03X2(1.11). The back-end storage is HSG80 stuff running in
> DRM mode.
>
> I've been experimenting with unplugging the HBAs while the system is up
> and running. :-)
>
> The problem is that once I unplug an HBA, plugging it back in doesn't
> work, i.e. it won't re-sync and no longer becomes a path to the storage
> units. (The blinking amber light on the HBA don't blink no more)

The non-solution:

After a few reboots, I can no longer recreate this situation. Now when an
HBA is disconnected and reconnected, it comes back to life just fine. The
sync light goes off when disconnected and goes back on when reconnected
just like I expected.

I can't explain why it wasn't working before, but it definitely wasn't,
even after rebooting the host a few times.

When there is I/O going to the HSG80, all of that I/O appears to go
through one HBA. If you unplug that HBA, it takes about 40 seconds before
I/O resumes through the other HBA. At that point, you can plug the first
HBA back in and connectivity for the units behind it will increase, again
after about 40 seconds. (Look for EVM events of type
sys.unix.hw.connections_reduced and sys.unix.hw.connections_increased.
These events are priority 400 and 300 respectively so the default
/etc/evmlogger.conf won't mail them to you or show them on the console.)

And I didn't find out from anyone if there is a way to cause an HBA to
re-sync from the OS. I guess we just have to rely on the HBA/firmware/OS
to just do it.
Received on Wed Jan 10 2001 - 15:55:29 NZDT

This archive was generated by hypermail 2.4.0 : Wed Nov 08 2023 - 11:53:41 NZDT