HP OpenVMS Cluster Systems


Previous Contents Index

8.2.3.1 Creating and Configuring a Two-Node Disaster Tolerant Cluster Using IP

Cluster over IP can be used to create and configure a two-node disaster tolerant cluster. Node ORCHID is a standalone node at SITE A and node TULIP at SITE B, is already a member (the only member) of the cluster. In this scenario, Cluster over IP is not configured in TULIP. SITE A and SITE B can be in the same or different LAN, building or any other geographical location. It is required to have IP connectivity between SITE A and SITE B and should be within the supported inter site distance.

Step 1. Configuring Node TULIP to Enable Cluster over IP

To configure the node TULIP (OpenVMS Alpha node) for enabling the Cluster over IP feature, execute the CLUSTER_CONFIG_LAN.COM procedure on node TULIP and select the appropriate option as illustrated:

Example 8-4 Configuring Node TULIP to Enable Cluster over IP

TULIP$@SYS$MANAGER:CLUSTER_CONFIG_LAN
                 Cluster/IPCI Configuration Procedure 
                   CLUSTER_CONFIG_LAN Version V2.84 
                     Executing on an Alpha System 
 
DECnet-Plus is installed on this node. 
Alpha satellites will use LANCP, not DECnet, for MOP downline loading. 
 
Enter a "?" for help at any prompt. If you are familiar with the execution of 
this procedure, you may want to mute extra notes and 
explanations by invoking it with "@CLUSTER_CONFIG_LAN BRIEF". 
 
TULIP is an Alpha system and currently a member of a cluster so the following 
functions can be performed: 
 
MAIN Menu 
 
   1. ADD an Alpha node to the cluster. 
   2. REMOVE a node from the cluster. 
   3. CHANGE a cluster member's characteristics. 
   4. CREATE a duplicate system disk for TULIP. 
   5. MAKE a directory structure for a new root on a system disk. 
   6. DELETE a root from a system disk. 
   7. EXIT from this procedure. 
 
Enter choice [7]: 3 (1) 
 
CHANGE Menu 
 
   1. Enable TULIP as a boot server. 
   2. Disable TULIP as a boot server. 
   3. Enable a quorum disk for TULIP 
   4. Disable a quorum disk for TULIP. 
   5. Enable TULIP as a disk server. 
   6. Disable TULIP as a disk server. 
   7. Change TULIP's ALLOCLASS value. 
   8. Enable TULIP as a tape server. 
   9. Disable TULIP as a tape server. 
  10. Change TULIP's TAPE_ALLOCLASS value. 
  11. Change an Alpha satellite node's LAN adapter hardware address. 
  12. Enable Cluster Communication using IP on TULIP. 
  13. Disable Cluster Communication using IP on TULIP. 
  14. Enable the LAN for cluster communications on TULIP. 
  15. Disable the LAN for cluster communications on TULIP. 
  16. Enable Memory Channel for cluster communications on TULIP. 
  17. Disable Memory Channel for cluster communications on TULIP. 
  18. Change TULIP's shared SCSI port allocation class value. 
  19. Return to MAIN menu. 
 
Enter choice [19]: 12 (2)
ENABLE IP for cluster communications (Y/N)? Y (3)
UDP port number to be used for Cluster Communication over IP[49152]?Y (4)
Enable IP multicast for cluster communication(Y/N)[Y]? Y (5)
What is the IP multicast address[239.242.7.193]? [Return] (6)
What is the TTL (time to live) value for IP multicast packets [32]?  [Return] (7)
Do you want to enter unicast address(es)(Y/N)[Y]?  [Return] (8)
What is the unicast address [Press Enter to end the list]? 10.0.1.2 (9)
What is the unicast address[Press Enter to end the list]?  [Return] (10)
 
   ***************************************************************** 
        Cluster Communications  over IP  has  been  enabled.  Now 
        CLUSTER_CONFIG_LAN will run the  SYS$MANAGER:TCPIP$CONFIG 
        procedure. Please select the IP interfaces to be used for 
        Cluster Communications  over IP  (IPCI). This can be done 
        selecting "Core Environment"  option from the main menu 
        followed by the "Interfaces"  option.  You may also use 
        this opportunity to configure other aspects. 
   **************************************************************** 
 
Press Enter to continue. 
 
       Checking TCP/IP Services for OpenVMS configuration database files. 
 
        HP TCP/IP Services for OpenVMS Configuration Menu 
        
Configuration options: 
 
                 1  -  Core environment 
                 2  -  Client components 
                 3  -  Server components 
                 4  -  Optional components 
                 5  -  Shutdown HP TCP/IP Services for OpenVMS 
                 6  -  Startup HP TCP/IP Services for OpenVMS 
                 7  -  Run tests 
                 A  -  Configure options 1 - 4 
                [E] -  Exit configuration procedure 
 
Enter configuration option: 1 (11)
 
       HP TCP/IP Services for OpenVMS Core Environment Configuration Menu 
 
        Configuration options: 
 
                 1  -  Domain 
                 2  -  Interfaces 
                 3  -  Routing 
                 4  -  BIND Resolver 
                 5  -  Time Zone 
                 A  -  Configure options 1 - 5 
                [E] -  Exit menu 
 
Enter configuration option: 2 (12)
 
HP TCP/IP Services for OpenVMS Interface & Address Configuration Menu 
 
 Hostname Details: Configured=TULIP, Active=TULIP 
 
 Configuration options: 
 
                 0  -  Set The Target Node (Current Node: TULIP) 
                 1  -  IE0 Menu (EIA0: TwistedPair 100mbps) 
                 2  -  10.0.2.2/23    TULIP                  Configured,Active 
                 3  -  IE1 Menu (EIB0: TwistedPair 100mbps) 
                 4  -  10.0.2.224/23   *noname*              Configured,Active 
                 I  -  Information about your configuration 
                [E] -  Exit menu 
 
Enter configuration option: 2 (13)
 
 
  HP TCP/IP Services for OpenVMS Address Configuration Menu (Node: TULIP) 
 
      IE0 10.0.2.2/23 TULIP Configured, Active IE0 
 
 Configuration options 
 
                 1  - Change address 
                 2  - Set "TULIP" as the default hostname 
                 3  - Delete from configuration database 
                 4  - Add to IPCI database 
                 5  - Deactivate from live system 
                 6  - Add standby aliases to configuration database (for failSAFE IP) 
                [E] - Exit menu 
 
Enter configuration option: 4 (14)
Updated Interface in IPCI configuration file: SYS$SYSROOT:[SYSEXE]TCPIP$CLUSTER.DAT; 
 
Updated Default Route in IPCI configuration file: SYS$SYSROOT:[SYSEXE]TCPIP$CLUSTER.DAT; 
Added address IE1:10.0.2.2 to IPCI database 
 
   HP TCP/IP Services for OpenVMS Interface & Address Configuration Menu 
 
 Hostname Details: Configured=TULIP, Active=TULIP 
 
 Configuration options: 
 
                 0  -  Set The Target Node (Current Node:tulip) 
                 1  -  IE0 Menu (EIA0: TwistedPair 100mbps) 
                 2  -  10.0.2.2/23    TULIP                  Configured,IPCI,Active 
                 3  -  IE1 Menu (EIB0: TwistedPair 100mbps) 
                 4  -  10.0.2.224/23   *noname*              Configured,Active 
                 I  -  Information about your configuration 
                [E]-  Exit menu 
 
Enter configuration option: E (15)
 
      HP TCP/IP Services for OpenVMS Core Environment Configuration Menu 
 
        Configuration options: 
 
                 1  -  Domain 
                 2  -  Interfaces 
                 3  -  Routing 
                 4  -  BIND Resolver 
                 5  -  Time Zone 
                 A  -  Configure options 1 - 5 
                [E] -  Exit menu 
 
Enter configuration option: E 
                                                                               
        HP TCP/IP Services for OpenVMS Configuration Menu 
 
        Configuration options:                                                 
 
                 2  -  Client components 
                 3  -  Server components 
                 4  -  Optional components 
                 5  -  Shutdown HP TCP/IP Services for OpenVMS 
                 6  -  Startup HP TCP/IP Services for OpenVMS 
                 7  -  Run tests 
                 A  -  Configure options 1 - 4 
                [E] -  Exit configuration procedure 
 
Enter configuration option: E 
    The configuration procedure has completed successfully. 
 
    Tulip has been enabled for IP communications  (16)
    Please run AUTOGEN to reboot TULIP:           
  
TULIP$ @SYS$UPDATE:AUTOGEN GETDATA REBOOT (17)
Field Description
(1) TULIP is a single-member cluster without Cluster over IP enabled. The cluster member characteristics can be changed to enable Cluster over IP for this node by selecting option 3.
(2) Select option 12 to enable cluster over IP. By selecting this option, the SYSGEN parameter, NISCS_USE_UDP is set to 1, which enables the PEDRIVER to use IP for cluster communication. This requires reboot of the node. If LAN is not already selected as the cluster interconnect, this option sets NISCS_LOAD_PEA0 to 1 to load PEDRIVER during the next reboot.
(3) Enable IP for cluster communication.
(4) The UDP port number used for cluster communication. The UDP port number must be same on all members of the cluster. Also, ensure that there is no other cluster in your environment using the same UDP port number and this port number must not be used by any other application.
(5) You can enable IP multicast for cluster communication if your environment allows IP multicast traffic between cluster nodes. Check with your network administrator, if IP multicasting is enabled in your environment.
(6) Enter the IP multicast address for the cluster, if IP multicasting is enabled. By default, the IP multicast address is selected from the administratively scoped IP multicast address ranging from 239.242.x.y. The last two octets x and y are generated based on the cluster group number. In the above example cluster group number is 1985 and can be calculated as follows:
X= 1985/256

Y= 1985 - (256 *x)

The system administrator can override the default multicast address by a unique address for their environment.
(7) TTL is the time to live for IP multicast packets. It specifies the number of hops allowed for IP multicast packets.
(8) Enter "Yes" to enter the IP unicast addresses for the remote nodes of the cluster, which are not reachable using IP multicast address.
(9) In this example, 10.0.1.2 is the IP unicast address for the node ORCHID. Although, the IP multicast is selected, ORCHID's IP address is entered because the IP multicast connectivity between SITE A and SITE B is presumed to be not existing in this example.
Note: Enter the list of IP address of the cluster. All the information entered in [4],[6],[7] and [9] are entered into the SYS$SYSTEM:PE$IP_CONFIG.DAT file. The PE$IP_CONFIG.DAT file is generated as shown in the following example. Also, to allow the remote node to join the cluster, the Unicast list in the PE$IP_CONFIG.DAT on the local node must contain the IP address of the remote node.
In this example, TULIP must have ORCHID's IP address and ORCHID must have TULIP's IP address.
! CLUSTER_CONFIG_LAN creating for CHANGE operation on 10-JUL-2008 
14:14:06.57

multicast_address=239.242.7.193
ttl=32
udp_port=49152
unicast=10.0.1.2
(10) Press [Return] after entering the Unicast list.
(11) CLUSTER_CONFIG_LAN.COM invokes TCPIP$CONFIG.COM to configure the IP interfaces used for cluster communication. Select the core environment option.
Assuming that TCP/IP is already configured, the node can be pinged from outside the subnet.
(12) Select the interface option from the core environment menu.
(13) Select the appropriate interface for cluster communication. In this example, option 2 is selected.
(14) In the configuration option for the selected address, select option 4 to add to IPCI database. The interface information along with the default route is entered in the TCPIP$CLUSTER.DAT as shown:
interface=IE0,EIA0,10.0.2.2,255.255.254.0

default_route=10.0.2.1
(15) Exit from the TCP/IP configuration procedure, which returns to CLUSTER_CONFIG_LAN.COM.
(16) Proceed with cluster configuration.
(17) After rebooting the system, run AUTOGEN. PEDRIVER in ORCHID will start using IP in addition to LAN for cluster communication and must be able to join TULIP.

Step 2. Configuring Node ORCHID as a Cluster Member

To configure ORCHID with Cluster over IP enabled, execute CLUSTER_CONFIG_LAN.COM on node ORCHID and select the appropriate option as shown in the following example:

Example 8-5 Configuring Node ORCHID to Enable Cluster over IP

ORCHID$ @SYS$MANAGER:CLUSTER_CONFIG_LAN.COM
                 Cluster/IPCI Configuration Procedure 
                   CLUSTER_CONFIG_LAN Version V2.84 
                     Executing on an IA64 System 
    DECnet-Plus is installed on this node. 
    IA64 satellites will use TCP/IP BOOTP and TFTP services for downline 
    loading. 
     TCP/IP is installed and running on this node. 
 
Enter a "?" for help at any prompt.  If you are familiar with the execution of this 
procedure, you may want to mute extra notes and 
explanations by invoking it with "@CLUSTER_CONFIG_LAN BRIEF". 
 
This IA64 node is not currently a cluster member. 
 
MAIN Menu 
 
   1. ADD ORCHID to existing cluster, or form a new cluster. 
   2. MAKE a directory structure for a new root on a system disk. 
   3. DELETE a root from a system disk. 
   4. EXIT from this procedure. 
 
Enter choice [4]: 1 (1)
Is the node to be a clustered node with a shared SCSI/FIBRE-CHANNEL bus (Y/N)? N 
What is the node's SCS node name? ORCHID 
    IA64 node, using LAN/IP for cluster communications.  PEDRIVER will be loaded. 
   No other cluster interconnects are supported for IA64 nodes. 
Enter this cluster's group number: 1985 
Enter this cluster's password: 
Re-enter this cluster's password for verification: 
 
ENABLE IP for cluster communications (Y/N)? Y (2)
UDP port number to be used for Cluster Communication over IP[49152]?[Return] (3)
Enable IP multicast for cluster communication(Y/N)[Y]? Y [Return] (4)
What is IP the multicast address[239.242.7.193]? [Return] (5)
What is the TTL (time to live) value for IP multicast packets [32]? [Return] (6)
Do you want to enter unicast address(es)(Y/N)[Y]?[Return] (7)
What is the unicast address[Press [RETURN] to end the list]? 10.0.2.2 (8)
What is the unicast address[Press [RETURN] to end the list]?[Return] (9)
  
 
                 ******************************************************************** 
                 Cluster Communications over IP has been enabled.  Now 
                 CLUSTER_CONFIG_LAN will run the SYS$MANAGER:TCPIP$CONFIG procedure. 
                 Pleas select the IP interfaces to be used for Cluster Communications 
                 over IP (IPCI). This can be done selecting "Core Environment" option 
                 from the main menu followed by the "Interfaces" option. You may 
                 also use this opportunity to configure other aspects. 
                 ********************************************************************* 
 
Press Return to continue ... 
 
TCP/IP Network Configuration Procedure 
 
        This procedure helps you define the parameters required 
        to run HP TCP/IP Services for OpenVMS on this system. 
 
%TCPIP-I-IPCI, TCP/IP Configuration is limited to IPCI. 
-TCPIP-I-IPCI, Rerun TCPIP$CONFIG after joining the cluster. 
 
 
    HP TCP/IP Services for OpenVMS Interface & Address Configuration Menu 
 
 Hostname Details: Configured=Not Configured, Active=nodeg 
 
 Configuration options: 
 
   0  -  Set The Target Node (Current Node: ORCHID) 
   1  -  IE0 Menu (EIA0: TwistedPair 100mbps) 
   2  -  IE1 Menu (EIB0: TwistedPair 100mbps) 
  [E] -  Exit menu 
 
Enter configuration option: 1 (10)
 
                    * IPCI Address Configuration * 
 
Only IPCI addresses can be configured in the current environment. 
After configuring your IPCI address(es) it will be necessary to 
run TCPIP$CONFIG once your node has joined the cluster. 
 
 
    IPv4 Address may be entered with CIDR bits suffix. 
    E.g. For a 16-bit netmask enter 10.0.1.1/16 
 
Enter IPv4 Address []:10.0.1.2/24 (11)
Default netmask calculated from class of IP address: 255.0.0.0 
 
    IPv4 Netmask may be entered in dotted decimal notation, 
    (e.g. 255.255.0.0), or as number of CIDR bits (e.g. 16) 
 
Enter Netmask or CIDR bits [255.0.0.0]: 255.255.254.0 (12)
 
Requested configuration: 
 
      Node     : ORCHID 
      Interface: IE0 
      IPCI     : Yes 
      Address  : 10.0.1.2/23 
      Netmask  : 255.255.254.0 (CIDR bits: 23) 
 
* Is this correct [YES]: 
Updated Interface in IPCI configuration file: SYS$SYSROOT:[SYSEXE]TCPIP$CLUSTER.DAT; (13)
 
 
    HP TCP/IP Services for OpenVMS Interface & Address Configuration Menu 
 
 Hostname Details: Configured=Not Configured, Active=ORCHID 
 
 Configuration options: 
 
 0  -  Set The Target Node (Current Node: ORCHID) 
 1  -  IE0 Menu (EIA0: TwistedPair 100mbps) 
 2  - 10.0.1.2 /23   *noname*              IPCI 
 3  -  IE1 Menu (EIB0: TwistedPair 100mbps) 
[E] -  Exit menu 
 
Enter configuration option: E(14)
Enter your Default Gateway address []: 10.0.1.1(15)
* The default gateway will be: 10.0.1.1.  Correct [NO]: YES 
Updated Default Route in IPCI configuration file: SYS$SYSROOT:[SYSEXE]TCPIP$CLUSTER.DAT; 
TCPIP-I-IPCIDONE, Finished configuring IPCI address information (16)
Will ORCHID be a boot server [Y]? [Return] (17)
 
       TCP/IP BOOTP and TFTP services must be enabled on IA64 boot nodes. 
 
        Use SYS$MANAGER:TCPIP$CONFIG.COM on ORCHID to enable BOOTP and TFTP 
        services after ORCHID has booted into the cluster. 
 
Enter a value for ORCHID's ALLOCLASS parameter [7]: 
Does this cluster contain a quorum disk [N]? [Return]
 
The EXPECTED_VOTES system parameter of members of a cluster indicates the total 
number of votes present when all cluster members are booted, and is used to determine 
the minimum number of votes (QUORUM) needed for cluster operation. 
 
EXPECTED_VOTES value for this cluster: 1 
 
Warning:  Setting EXPECTED_VOTES to 1 allows this node to boot without 
being able to see any other nodes in the cluster.  If there is 
another instance of the cluster in existence that is unreachable via SCS but shares 
common drives (such as a Fibrechannel fabric)this may result in severe disk corruption. 
 
Do you wish to re-enter the value of EXPECTED_VOTES [Y]? N 
 
The use of a quorum disk is recommended for small clusters to maintain cluster 
quorum if cluster availability with only a single cluster node is a requirement. 
 
For complete instructions, check the section on configuring a cluster in 
the "OpenVMS Cluster Systems" manual. 
 
 
  WARNING: ORCHID will be a voting cluster member. EXPECTED_VOTES for 
           this and every other cluster member should be adjusted at 
           a convenient time before a reboot. For complete instructions, 
           check the section on configuring a cluster in the "OpenVMS 
           Cluster Systems" manual. 
 
Execute AUTOGEN to compute the SYSGEN parameters for your configuration and reboot 
ORCHID with the new parameters. This is necessary before ORCHID can become a cluster member. 
 
Do you want to run AUTOGEN now [Y]? N 
 
    Please run AUTOGEN to reboot ORCHID: 
 
     ORCHID$ @SYS$UPDATE:AUTOGEN GETDATA REBOOT (18)
Field Description
(1) Node ORCHID is currently a standalone, Integrity server node and is made as a member of a cluster. Only LAN or IP is used for cluster communication and no other interconnect is supported.
(2) Select IP for cluster communication in addition to LAN by entering "YES". The SYSGEN parameter, NISCS_USE_UDP is set to 1 and PEDRIVER uses IP in addition to LAN for cluster communication when the node is rebooted.
(3) The UDP port number to be used for cluster communication. The UDP port number must be same on all members of the cluster. Also, ensure that there is no other cluster in your environment using the same UDP port number and this port number must not be used by any other application.
(4) You can enable IP multicast for cluster communication if your environment allows IP multicast traffic between cluster nodes. Check with your network administrator to see if IP multicasting is enabled in your environment.
(5) Enter the IP multicast address for cluster, if IP multicasting is enabled. By default, the IP multicast address is selected from the administratively scoped IP multicast address range of 239.242.x.y. The last two octets x and y are generated based on the cluster group number. In the above example cluster group number is 1985 and is calculates as follows:
X= 1985/256

Y= 1985 - (256 *x)

The system administrator can override the default multicast address by a unique address for their environment.
(6) TTL is the time to live for IP multicast packets. It specifies the number of hops allowed for IP multicast packets.
(7) Enter "Yes" to enter the IP unicast address for remote nodes of the cluster which are not reachable using IP multicast address.
(8) In this example, 10.0.2.2 is the IP unicast address of node TULIP. Although, IP multicast is selected, TULIP's IP address is entered because the IP multicast connectivity between SITE A and SITE B is presumed to be non-existent in this example.
NOTE: Enter the list of IP unicast address of the cluster. All the information entered in [2], [3], [5], [6], and [7] are entered in the SYS$SYSTEM:PE$IP_CONFIG.DAT file. The PE$IP_CONFIG.DAT file is generated as shown in following example.
Also, the Unicast list in PE$IP_CONFIG.DAT in the local node should contain the remote node IP address for the local node to allow the remote node to join the cluster.

In this example, ORCHID must have TULIP's IP address and TULIP must have ORCHID's IP address. SYSTEM:PE$IP_CONFIG.DAT in node ORCHID:

! CLUSTER_CONFIG_LAN creating for CHANGE operation on 10-JUL-

2008 14:14:06.57
multicast_address=239.242.7.193
ttl=32
udp_port=49152
unicast=10.0.2.2
(9) Press [Return] after entering the unicast list.
(10) CLUSTER_CONFIG_LAN.COM invokes TCPIP$CONFIG.COM to configure the IP interfaces used for cluster communication. Currently, ORCHID is a standalone node, when TCPIP$CONFIG is invoked by the CLUSTER_CONFIG_LAN procedure, TCP/IP configuration is limited to IPCI. The interface, IE0 is selected for enabling cluster communications. Note: TCPIP$CONFIG must be invoked after joining the cluster for other TCP/IP configuration, such as, FTP, TELNET.
(11) IPv4 address for the IE0 interface is 10.0.1.2
(12) Network mask for the IE0 interface is 255.255.254.0
(13) The IE0 interface information along with network mask is entered in the TCPIP$CLUSTER.DAT file.
(14) Exit the interface menu after selecting the interface for cluster communication.
(15) The default gateway address for the interface IE0 is entered. Only one default gateway address is allowed for Cluster over IP communication.
(16) After the interface and default gateway are selected, TCPIP$CONFIG updates the TCPIP$CLUSTER.DAT with the default route or gateway information. This also completes the TCPIP$CONFIG required for cluster communications using IP. The interface information along with the default route is entered in the TCPIP$CLUSTER.DAT file as shown:
interface=IE0,EIA0,10.0.1.2,255.255.254.0

default_route=10.0.1.1
(17) Proceed with cluster configuration.
(18) After rebooting the system, run AUTOGEN. PEDRIVER in ORCHID will start using IP in addition to LAN for cluster communication and must be able to join TULIP.


Previous Next Contents Index