Hardware GuideSearch

Upgrade NICs or Fibre Channel HBAs

Before you begin

To replace the NICs or FC HBAs in your CS235, CS300, CS500, or CS700 array, see Replace a NIC or Fibre Channel HBA.

Time required: 30 minutes (Do not exceed 15 minutes per controller to avoid overheating.)
Parts required: New NICs/FC HBAs ordered from Nimble Storage
Tools required:
  • ESD (electrostatic discharge) strap or appropriate grounding device
Support contact: See Support.

HPE Nimble Storage recommends using the Maintenance Window functionality within the InfoSight portal to inform Nimble Storage Support of upcoming maintenance windows: https://infosight.nimblestorage.com/InfoSight/#wellness/maintenance-windows

This allows for disabling automated support case generation during planned maintenance. Once a Maintenance Window has been set, no further communication to Nimble Storage Support is required.

Note: You do not have to shut down the array or expansion shelf to perform the upgrade. A Nimble Storage array can function with one active controller while the NIC/FC HBA installation is performed on the Standby controller.
Important: Controllers may only be serviced in Standby mode. Never remove a controller running in Active mode.
CAUTION:
  • While a controller is removed (one at a time), the internal temperature of the chassis can rise to critical levels. Keep installation time to no more than 15 minutes per controller.
  • If you are adding additional ports during the upgrade process and you are running NimbleOS version 2.2.2 or earlier, contact Nimble Storage Support for assistance. Without assistance from Nimble Storage Support, the new ports cannot be correctly configured for proper use.
  • If you are adding new FC HBA(s), or moving an existing FC HBA to a different slot in the controller, you may need to run an update on the FC HBA(s) to reconfigure them in the system. This is only the case for arrays running NimbleOS version 2.3.12.x or later. Arrays running earlier versions will only need to run the update if both controllers have been upgraded to symmetrical configurations. (See step 7 for further details.)

Use this procedure to upgrade to new NICs or Fibre Channel (FC) HBAs if you want to scale your existing Nimble CS235, CS300, CS500, or CS700 array. You can install up to two NICs or FC HBAs into the slots on the same PCIe cage on a single controller, but both controllers must be upgraded (one at a time) with the same components.

Procedure

  1. Identify the controller that is in Standby mode.
    1. Log in to the array using the CLI.
    2. Determine which controller is in Standby mode:
      ctrlr --list --array array_name
  2. Physically remove the standby controller.
    1. Remove all cables from the controller, and label them to ensure proper recabIing.
    2. Unscrew the keeper to release the controller handle.
      Important: Use caution while removing the keeper screw to avoid having the screwdriver tip slip through the fan grill and hit the fan blade.


      CAUTION:
      Do not remove the power cord above the controller. If retention clips are installed, it is recommended to secure the clips around the power cord to avoid accidental power cord removal/displacement.
    3. Grasp the Standby controller by the handle, pull down, and use a firm, steady pressure to pull the controller out of the chassis bay. Use two hands to support the controller during removal.
      Important:

      To avoid electrostatic damage, place array components on a grounded anti-static mat. Use an ESD wrist strap during removal and replacement.

  3. Remove the PCIe cage from the controller:
    1. Loosen the green thumbscrew to remove the PCIe cage from the controller.
    2. Gently pull the PCIe cage up from the controller to unseat the PCIe cage riser card from the motherboard connector.
    3. Disassemble the PCIe cage by removing the two screws from the PCIe cage and separate it from the controller, as shown.

  4. Remove existing NIC(s)/FC HBA(s), if any, to make room for the NIC(s)/FC HBA(s) you intend to upgrade.
  5. Insert the new NIC(s)/FC HBA(s) into one or more open slots in the controller. Seat cards in the alignment teeth.
    Important: NICs/FC HBAs must be installed in the correct order, depending on your NIC/FC HBA component. Use the table below to determine the SKU and corresponding slot on your array. For the latest configurations, refer to the Array Compatibility Matrix (for your model array) available on InfoSight: https://infosight.hpe.com/. Choose Resources > Nimble Storage > Documentation > . From the left navigation pane, click Compatibility Matrix in the Document Type list, then locate the document for your model array.
    .
    Nimble PCI NIC / FC HBA Configuration Matrix
    Dynamic SKU NIC Component Description Slot 1 (Bottom) Slot 2 (Middle) Slot 3 (Top)
    2G Dual 1GbE (Qty. 1) PCI-1GT (empty) (empty)
    4G Dual 1GbE (Qty. 2) PCI-1GT PCI-1GT (empty)
    2T Dual 10GbaseT only (Qty. 1) PCI-10GT (empty) (empty)
    4T Dual 10GbaseT only (Qty. 2) PCI-10GT PCI-10GT (empty)
    2P Dual 10GbE Optical only (Qty. 1) PCI-10GSFP (empty) (empty)
    4P Dual 10GbE Optical only (Qty. 2) PCI-10GSFP PCI-10GSFP (empty)
    2F Dual 16GbFC only (Qty. 1) PCI-16FC (empty) (empty)
    4F Dual 16GbFC only (Qty. 2) PCI-16FC PCI-16FC (empty)
    6F Dual 16GbFC only (Qty. 3) PCI-16FC PCI-16FC PCI-16FC
    2T2F Dual 10GbaseT (Qty. 1) + Dual 16GbFC only (Qty. 1) PCI-10GT PCI-16FC (empty)
    2T4F Dual 10GbaseT (Qty. 1) + Dual 16GbFC only (Qty. 2) PCI-10GT PCI-16FC PCI-16FC
    2P2F Dual 10GbE Optical (Qty. 1) + Dual 16GbFC only (Qty. 1) PCI-10GSFP PCI-16FC (empty)
    2P4F Dual 10GbE Optical (Qty. 1) + Dual 16GbFC only (Qty. 2) PCI-10GSFP PCI-16FC PCI-16FC
  6. Reassemble and reinstall the PCIe cage, and reattach the controller.
    1. Reassemble the PCIe cage by rejoining the panel and inserting the two screws back into the PCIe cage. (See diagram in step 3c.)
    2. Carefully reseat the connector to the PCIe cage, then lower the PCIe cage into place.
    3. Fasten the green thumbscrew to secure the PCIe cage to the controller.
    4. Reinsert the controller into the chassis bay, then secure the keeper to the controller handle.
    5. Reattach the cables for the Standby controller using the labels you attached in step 2a.
    6. Press the Power button on the front of the array for one to three seconds to power on the array. (Powering on might take several minutes.)
      CAUTION:
      Do not press the Power button longer than three seconds. Holding it down too long (longer than three seconds) will completely power off the array.
  7. Determine if an array configuration update is required. An update is required if one of the following conditions applies (as completed in step 5):
    • An FC HBA was moved to a new slot, or
    • An additional FC HBA was added to the controller

    If at least one of these conditions applies, continue to step 8 to run the update.

    If neither condition applies, then no update is required (skip to step 9).

    Note: If only NICs were moved/added, or an FC HBA was only removed and reinserted into the same slot, then no update is necessary.
  8. Update the controller to generate and assign new WWPNs (World Wide Port Names) as determined in the previous step.

    Run the update command to communicate the new Fibre Channel configuration out to the fabric:

    fc --update_config

    WWPN values are tied to the physical slot in the system, not the physical HBA. When an HBA is replaced, the same WWPN values are automatically assigned to the new card that occupies the same physical slot. If a new HBA is added in a slot that did not previously hold an HBA, WWPN information is not available to the ports on the HBA until the configuration is updated or setup is run again.

    Important: Depending on what was added or moved, existing zones in the fabric may need to be modified. To do this, continue to the next step.
  9. Insert NIC(s)/FC HBA(s) into the other controller.
    1. While still logged into the array, run the command
      failover --array array_name
      .
      This command validates the network configuration before changing the Active/Standby states of the controllers. If anomalies are found, the command does not succeed. Correct any issue in the data IP addresses, subnets, and VLANDs and run the command again. Do not continue until the failover succeeds.
    2. Repeat steps 2 through 7 to insert the NIC into the second controller.
  10. Modify any zones in the fabric, and/or configure the correct switch VLANs.
    1. Modify zones in the fabric where either a new FC HBA was added, or an existing one was moved to a new slot. This must be done before upgrading the other controller.
    2. For NICs, configure the correct switch VLANs for the switch interfaces attached to the new ports. Failure to do so may lead to issues when performing array controller failover operations.
  11. Verify the success of the NIC/FC HBA installation.
    1. In the GUI, go to the Manage > Arrays page and select the appropriate array.
    2. Verify that the controllers are in Active/Standby. Ensure that the NIC/FC HBA ports are connected (green) on the Standby controller.
      Note: Any NIC/FC HBA ports that have not been configured for management or data traffic will have an unconfigured (grey) status (FC HBA ports cannot be configured for management traffic).