Minimum Downtime Upgrade of a VSX Cluster

Important - Before you upgrade a VSX Cluster: Step Instructions 1 Back up your current configuration (see Backing Up and Restoring). Important - Back up both the Management Server and the VSX Cluster Members. Follow sk100395. 2 See the Upgrade Options and Prerequisites. 3 Upgrade the Management Server and Log Servers. 4 See Planning a Cluster Upgrade. 5 Schedule a full maintenance window to make sure you can make all the custom configurations again after the upgrade.

The procedure below describes an example VSX Cluster with three VSX Cluster Members M1, M2, and M3.

However, you can use it for clusters that consist of two or more Cluster Members.

Procedure:

1. On the Management Server, upgrade the configuration of the VSX Cluster object to R80.40

   Step	Instructions
   1	Connect to the command line on the Security Management Server or Multi-Domain Server that manages this VSX Cluster.
   2	Log in to the Expert mode.
   3	On a Multi-Domain Server, go to the context of the Main Domain Management Server that manages this VSX Cluster object: mdsenv <IP Address or Name of Main Domain Management Server>
   4	Upgrade the configuration of the VSX Cluster object to R80.40: vsx_util upgrade This command is interactive.
   	Enter these details to log in to the management database: IP address of the Security Management Server or Main Domain Management Server that manages this VSX Cluster Management Server administrator's username Management Server administrator's password
   	Select your VSX Cluster.
   	Select R80.40.
   	For auditing purposes, save the vsx_util log file: On a Security Management Server: /opt/CPsuite-R80.40/fw1/log/vsx_util_YYYYMMDD_HH_MM.log On a Multi-Domain Server: /opt/CPmds-R80.40/customers/<Name_of_Domain>/CPsuite-R80.40/fw1/log/vsx_util_YYYYMMDD_HH_MM.log
   5	Connect with SmartConsole to the R80.40 Security Management Server or Main Domain Management Server that manages this VSX Cluster.
   6	From the left navigation panel, click Gateways & Servers.
   7	Open the VSX Cluster object.
   8	From the left tree, click the General Properties page.
   9	Make sure in the Platform section, the Version field shows R80.40.
   10	Click Cancel (do not click OK). Note - If you click OK, the Management Server pushes the VSX configuration to the VSX Cluster. Because the VSX Cluster is not upgraded yet, this operation would fail.

2. On each VSX Cluster Member, change the CCP mode to Broadcast

   Important - This step applies only to R80.30 and lower with the Linux kernel 2.6 (run the "uname -r" command).

   Best Practice - To avoid possible problems with switches around the cluster during the upgrade, we recommend to change the Cluster Control Protocol (CCP) mode to Broadcast.

   Note - In R80.40 and above, the Cluster Control Protocol (CCP) runs only in the Unicast mode. Therefore, after the upgrade, it is not necessary to change the CCP mode.

   Step	Instructions
   1	Connect to the command line on each VSX Cluster Member.
   2	Log in to the Expert mode.
   3	Change the CCP mode to Broadcast: cphaconf set_ccp broadcast Notes: This change does not require a reboot. This change applies immediately and survives reboot.
   4	Make sure the CCP mode is set to Broadcast: cphaprob -a if

3. On the VSX Cluster Member M3, upgrade to R80.40 with CPUSE, or perform a Clean Install of R80.40

   Important - You must reboot the VSX Cluster Member after the upgrade or clean install.

   Installation Method	Instructions
   Upgrade to R80.40 with CPUSE	See Installing Software Packages on Gaia. Follow the applicable action plan for the local or central installation. In local installation, select the R80.40 package and perform Upgrade. See sk92449 for detailed steps.
   Clean Install of R80.40 with CPUSE	Follow these steps: See Installing Software Packages on Gaia. Follow the applicable action plan for the local or central installation. In local installation, select the R80.40 package and perform Clean Install. See sk92449 for detailed steps. Important - In the Gaia First Time Configuration Wizard, for the Management Connection IP address, you must use the same IP address as was used by the previous VSX Cluster Member (prior to the upgrade). Run the "vsx_util reconfigure" command on the Management Server to push the VSX configuration to this VSX Cluster Member. See the R80.40 VSX Administration Guide > Chapter Command Line Reference > Section vsx_util > Section vsx_util reconfigure. Important - You must enter the same Activation Key you entered during the Gaia First Time Configuration Wizard of this VSX Cluster Member. Configure the required settings on this VSX Cluster Member: OS configuration (for example, DNS, NTP, DHCP, Dynamic Routing, DHCP Relay, and so on). Settings manually defined in various configuration files. Applicable Check Point configuration files.
   Clean Install of R80.40 from scratch	Follow these steps: Follow Installing a VSX Cluster - only the step "Install the VSX Cluster Members". Important - In the Gaia First Time Configuration Wizard, for the Management Connection IP address, you must use the same IP address as was used by the previous VSX Cluster Member (prior to the upgrade). Run the "vsx_util reconfigure" command on the Management Server to push the VSX configuration to this VSX Cluster Member. See the R80.40 VSX Administration Guide > Chapter Command Line Reference > Section vsx_util > Section vsx_util reconfigure. Important - You must enter the same Activation Key you entered during the Gaia First Time Configuration Wizard of this VSX Cluster Member. Configure the required settings on this VSX Cluster Member: OS configuration (for example, DNS, NTP, DHCP, Dynamic Routing, DHCP Relay, and so on). Settings manually defined in various configuration files. Applicable Check Point configuration files.

4. On the VSX Cluster Member M2, upgrade to R80.40 with CPUSE, or perform a Clean Install of R80.40

   Important - You must reboot the VSX Cluster Member after the upgrade or clean install.

   Installation Method	Instructions
   Upgrade to R80.40 with CPUSE	See Installing Software Packages on Gaia. Follow the applicable action plan for the local or central installation. In local installation, select the R80.40 package and perform Upgrade. See sk92449 for detailed steps.
   Clean Install of R80.40 with CPUSE	Follow these steps: See Installing Software Packages on Gaia. Follow the applicable action plan for the local or central installation. In local installation, select the R80.40 package and perform Clean Install. See sk92449 for detailed steps. Important - In the Gaia First Time Configuration Wizard, for the Management Connection IP address, you must use the same IP address as was used by the previous VSX Cluster Member (prior to the upgrade). Run the "vsx_util reconfigure" command on the Management Server to push the VSX configuration to this VSX Cluster Member. See the R80.40 VSX Administration Guide > Chapter Command Line Reference > Section vsx_util > Section vsx_util reconfigure. Important - You must enter the same Activation Key you entered during the Gaia First Time Configuration Wizard of this VSX Cluster Member. Configure the required settings on this VSX Cluster Member: OS configuration (for example, DNS, NTP, DHCP, Dynamic Routing, DHCP Relay, and so on). Settings manually defined in various configuration files. Applicable Check Point configuration files.
   Clean Install of R80.40 from scratch	Follow these steps: Follow Installing a VSX Cluster - only the step "Install the VSX Cluster Members". Important - In the Gaia First Time Configuration Wizard, for the Management Connection IP address, you must use the same IP address as was used by the previous VSX Cluster Member (prior to the upgrade). Run the "vsx_util reconfigure" command on the Management Server to push the VSX configuration to this VSX Cluster Member. See the R80.40 VSX Administration Guide > Chapter Command Line Reference > Section vsx_util > Section vsx_util reconfigure. Important - You must enter the same Activation Key you entered during the Gaia First Time Configuration Wizard of this VSX Cluster Member. Configure the required settings on this VSX Cluster Member: OS configuration (for example, DNS, NTP, DHCP, Dynamic Routing, DHCP Relay, and so on). Settings manually defined in various configuration files. Applicable Check Point configuration files.

5. In SmartConsole, establish SIC with the VSX Cluster Member M3

   Important - This step is required only if you performed a Clean Install of R80.40 on this VSX Cluster Member.

   Step	Instructions
   1	Connect with SmartConsole to the R80.40 Security Management Server or Main Domain Management Server that manages this VSX Cluster.
   2	From the left navigation panel, click Gateways & Servers.
   3	Open the cluster object.
   4	From the left tree, click Cluster Members.
   5	Select the object of this VSX Cluster Member.
   6	Click Edit.
   7	On the General tab, click the Communication button.
   8	Click Reset.
   9	In the One-time password field, enter the same Activation Key you entered during the First Time Configuration Wizard of the Cluster Member.
   10	In the Confirm one-time password field, enter the same Activation Key again.
   11	Click Initialize.
   12	The Trust state field must show Trust established.
   13	Click Close to close the Communication window.
   14	Click OK to close the Cluster Member Properties window.
   15	Click OK to close the Gateway Cluster Properties window.
   16	Publish the SmartConsole session.

6. In SmartConsole, establish SIC with the VSX Cluster Member M2

   Important - This step is required only if you performed a Clean Install of R80.40 on this VSX Cluster Member.

   Step	Instructions
   1	Connect with SmartConsole to the R80.40 Security Management Server or Main Domain Management Server that manages this VSX Cluster.
   2	From the left navigation panel, click Gateways & Servers.
   3	Open the cluster object.
   4	From the left tree, click Cluster Members.
   5	Select the object of this VSX Cluster Member.
   6	Click Edit.
   7	On the General tab, click the Communication button.
   8	Click Reset.
   9	In the One-time password field, enter the same Activation Key you entered during the First Time Configuration Wizard of the Cluster Member.
   10	In the Confirm one-time password field, enter the same Activation Key again.
   11	Click Initialize.
   12	The Trust state field must show Trust established.
   13	Click Close to close the Communication window.
   14	Click OK to close the Cluster Member Properties window.
   15	Click OK to close the Gateway Cluster Properties window.
   16	Publish the SmartConsole session.

7. In SmartConsole, install the Access Control Policy

   Step	Instructions
   1	Connect with SmartConsole to the R80.40 Security Management Server or Main Domain Management Server that manages this VSX Cluster.
   2	From the left navigation panel, click Gateways & Servers.
   3	Click Install Policy.
   4	In the Install Policy window: In the Policy field, select the default policy for this VSX Cluster object. This policy is called: <Name of VSX Cluster object>_VSX In the Install Mode section, configure these two options: Select Install on each selected gateway independently. Clear For gateway clusters, if installation on a cluster member fails, do not install on that cluster. Click Install.
   5	The policy installation: Succeeds on the upgraded VSX Cluster Members M2 and M3. Fails on the old VSX Cluster Member M1 with a warning. Ignore this warning.

8. On each VSX Cluster Member, examine the VSX configuration and cluster state

   Step	Instructions
   1	Connect to the command line on each VSX Cluster Member.
   2	Log in to the Expert mode.
   3	Examine the VSX configuration: vsx stat -v Important: Make sure all the configured Virtual Devices are loaded. Make sure all Virtual Systems and Virtual Routers have SIC Trust and policy.
   4	Examine the cluster state in one of these ways: In Gaia Clish (R80.20 and higher), run: set virtual-system 0 show cluster state In the Expert mode, run: vsenv 0 cphaprob state Important: The cluster states of the upgraded VSX Cluster Members M2 and M3 are Ready. The cluster state of the old VSX Cluster Member M1 is: In R80.20 and higher - Active(!). In R80.10 and lower - Active Attention.

9. On the old VSX Cluster Member M1, stop all Check Point services

   Step	Instructions
   1	Connect to the command line on the VSX Cluster Member M1.
   2	Stop all Check Point services: cpstop Notes: This forces a controlled cluster failover from the old VSX Cluster Member M1 to one of the upgraded VSX Cluster Members. At this moment, all connections that were initiated through the old VSX Cluster Member M1 are dropped (because VSX Cluster Members with different software versions cannot synchronize).

10. On the upgraded VSX Cluster Members M2 and M3, examine the cluster state

    Step	Instructions
    1	Connect to the command line on each Cluster Member M2 and M3.
    2	Examine the cluster state in one of these ways: In Gaia Clish, run: show cluster state In the Expert mode, run: cphaprob state Important: One of the VSX Cluster Members (M2 or M3) changes its cluster state to Active. The other VSX Cluster Member (M2 or M3) changes its cluster state to Standby.

11. On the old VSX Cluster Member M1, upgrade to R80.40 with CPUSE, or perform a Clean Install of R80.40

    Important - You must reboot the VSX Cluster Member after the upgrade or clean install.

    Installation Method	Instructions
    Upgrade to R80.40 with CPUSE	See Installing Software Packages on Gaia. Follow the applicable action plan for the local or central installation. In local installation, select the R80.40 package and perform Upgrade. See sk92449 for detailed steps.
    Clean Install of R80.40 with CPUSE	Follow these steps: See Installing Software Packages on Gaia. Follow the applicable action plan for the local or central installation. In local installation, select the R80.40 package and perform Clean Install. See sk92449 for detailed steps. Important - In the Gaia First Time Configuration Wizard, for the Management Connection IP address, you must use the same IP address as was used by the previous VSX Cluster Member (prior to the upgrade). Run the "vsx_util reconfigure" command on the Management Server to push the VSX configuration to this VSX Cluster Member. See the R80.40 VSX Administration Guide > Chapter Command Line Reference > Section vsx_util > Section vsx_util reconfigure. Important - You must enter the same Activation Key you entered during the Gaia First Time Configuration Wizard of this VSX Cluster Member. Configure the required settings on this VSX Cluster Member: OS configuration (for example, DNS, NTP, DHCP, Dynamic Routing, DHCP Relay, and so on). Settings manually defined in various configuration files. Applicable Check Point configuration files.
    Clean Install of R80.40 from scratch	Follow these steps: Follow Installing a VSX Cluster - only the step "Install the VSX Cluster Members". Important - In the Gaia First Time Configuration Wizard, for the Management Connection IP address, you must use the same IP address as was used by the previous VSX Cluster Member (prior to the upgrade). Run the "vsx_util reconfigure" command on the Management Server to push the VSX configuration to this VSX Cluster Member. See the R80.40 VSX Administration Guide > Chapter Command Line Reference > Section vsx_util > Section vsx_util reconfigure. Important - You must enter the same Activation Key you entered during the Gaia First Time Configuration Wizard of this VSX Cluster Member. Configure the required settings on this VSX Cluster Member: OS configuration (for example, DNS, NTP, DHCP, Dynamic Routing, DHCP Relay, and so on). Settings manually defined in various configuration files. Applicable Check Point configuration files.

12. In SmartConsole, establish SIC with the VSX Cluster Member M1

    Important - This step is required only if you performed a Clean Install of R80.40 on this VSX Cluster Member.

    Step	Instructions
    1	Connect with SmartConsole to the R80.40 Security Management Server or Main Domain Management Server that manages this VSX Cluster.
    2	From the left navigation panel, click Gateways & Servers.
    3	Open the cluster object.
    4	From the left tree, click Cluster Members.
    5	Select the object of this VSX Cluster Member.
    6	Click Edit.
    7	On the General tab, click the Communication button.
    8	Click Reset.
    9	In the One-time password field, enter the same Activation Key you entered during the First Time Configuration Wizard of the Cluster Member.
    10	In the Confirm one-time password field, enter the same Activation Key again.
    11	Click Initialize.
    12	The Trust state field must show Trust established.
    13	Click Close to close the Communication window.
    14	Click OK to close the Cluster Member Properties window.
    15	Click OK to close the Gateway Cluster Properties window.
    16	Publish the SmartConsole session.

13. In SmartConsole, install the policy

    Step	Instructions
    1	Connect with SmartConsole to the R80.40 Security Management Server or Main Domain Management Server that manages this VSX Cluster.
    2	From the left navigation panel, click Gateways & Servers.
    3	Install the default policy on the VSX Cluster object: Click Install Policy. In the Policy field, select the default policy for this VSX Cluster object. This policy is called: <Name of VSX Cluster object>_VSX In the Install Mode section, select these two options: Install on each selected gateway independently For gateway clusters, if installation on a cluster member fails, do not install on that cluster Click Install. The default policy install successfully on all the VSX Cluster Members.
    4	Install the Threat Prevention Policy on the VSX Cluster object: Click Install Policy. In the Policy field, select the applicable Threat Prevention Policy for this VSX Cluster object. Click Install. The Threat Prevention Policy must install successfully on all the VSX Cluster Members.

14. On each VSX Cluster Member, examine the VSX configuration and cluster state

    Step	Instructions
    1	Connect to the command line on each VSX Cluster Member.
    2	Log in to the Expert mode.
    3	Examine the VSX configuration: vsx stat -v Important: Make sure all the configured Virtual Devices are loaded. Make sure all Virtual Systems and Virtual Routers have SIC Trust and policy.
    4	Examine the cluster state in one of these ways: In Gaia Clish, run: set virtual-system 0 show cluster state In the Expert mode, run: vsenv 0 cphaprob state Important: All VSX Cluster Members must show the same information about the states of all VSX Cluster Members. In the High Availability mode, one VSX Cluster Member must be in the Active state, and all other VSX Cluster Members must be in Standby state. In the Virtual System Load Sharing mode, all VSX Cluster Members must be in the Active state. All Virtual Systems must show the same information about the states of all Virtual Systems.
    5	Examine the cluster interfaces in one of these ways: In Gaia Clish, run: set virtual-system 0 show cluster members interfaces all In the Expert mode, run: vsenv 0 cphaprob -a if

15. Test the functionality

    Step	Instructions
    1	Connect with SmartConsole to the R80.40 Security Management Server or each Target Domain Management Server that manages the Virtual Systems on this VSX Cluster.
    2	From the left navigation panel, click Logs & Monitor > Logs.
    3	Examine the logs from the Virtual Systems on this VSX Cluster to make sure they inspect the traffic as expected.

For more information, see the:

• R80.40 VSX Administration Guide.

• R80.40 CLI Reference Guide.