Upgrade a PCIe Card

Time required:	15 minutes per controller
Parts required:	New NIC or HBA ordered from HPE
Tools required:	ESD (electrostatic discharge) strap or appropriate grounding device Phillips screwdriver
Information required:	RMA (Return Materials Authorization) work order Case number Array name or serial number The array serial number can be found on the back of Controller A.
Support contact:	See Support.

HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows.

Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information.

You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page. After a maintenance window is set, no further communication with HPE Support is required.

IMPORTANT:

Controllers may only be serviced in Standby mode. Never remove a controller running in Active mode. You do not have to shut down the array or expansion shelf to replace or add a PCIe card. The storage array can function with one active controller while the PCIe card is added on the standby controller.

Caution:

While a controller is removed (one at a time), the internal temperature of the chassis can rise to critical levels. Keep installation time to no more than 15 minutes per controller.
If you are adding additional ports during the upgrade process and you are running NimbleOS version 2.2.2 or earlier, contact Nimble Storage Support for assistance. Without assistance from Nimble Storage Support, the new ports cannot be correctly configured for proper use.
If you are adding a new HBA, or moving an existing HBA to a different slot in the controller, you may need to run an update on the HBA to reconfigure it in the system. This update is needed for arrays running NimbleOS version 2.3.12.x or later. Arrays running earlier versions need to run the update only if both controllers have been upgraded to symmetrical configurations.
If you are upgrading a NIC or HBA in a CS1000 or CS1000H array, you can upgrade only one card, and you must install that new card in slot 1.
If you are upgrading an HBA, validate that the new WWPNs shown in the NimbleOS GUI have been added to the switch fabric zoning configuration. For port zoning, additional configuration is not required. For WWN zoning, the zoning configuration must be updated with the new WWPNs of the upgraded HBA.
If you are upgrading from a dual port HBA to a quad port HBA, your array must be running NimbleOS 3.6 or later.
If you are upgrading to a quad port 1GB NIC, your array must be running NimbleOS 3.7 or later.
If you are upgrading to a quad port 10 GB NIC or 10 GB SFP+ NIC, your array must be running NimbleOS 3.8 or later.

Use this procedure to upgrade NICs or HBAs in your array, including upgrading from dual port NICs or HBAs to quad port NICs or HBAs. Each upgrade kit contains two NICs or HBAs.

Identify and halt the controller that is in Standby mode.
1. Log in to the array using the CLI.
2. Determine which controller is in Standby or Unknown mode.
  ctrlr --list --array array_name
3. halt --array array_name --controller {A | B}
Physically remove the standby controller.
1. Label all cables to ensure proper recabling later, then remove them from the controller.
2. Loosen the keeper screw to release the controller handle.
  IMPORTANT: Use caution while removing the keeper screw to avoid screwdriver tip slipping through the fan grill and hitting the fan blade.
  Figure: Controller rear view
  1. Keeper screw
  2. Handle
  3. Thumbscrew
  4. PCIe card slot 1
  5. PCIe card slot 2
  6. PCIe card slot 3
  NOTE: Do not remove the power cord above the controller. If clips are installed, it is recommended to secure retention clips around the power cord to avoid accidental power cord removal or displacement.
3. Grasp the standby controller by the handle, pull down, and use firm, steady pressure to pull the controller out of the chassis bay. Use two hands to support the controller during removal.
  
  IMPORTANT:
  To avoid electrostatic damage, place array components on a grounded anti-static mat. Use an ESD wrist strap during removal and replacement.
Remove the PCIe cage from the controller.
1. Loosen the thumbscrew to release the PCIe cage from the controller.
2. Gently pull the PCIe cage up from the controller to unseat the PCIe cage riser card from the motherboard connector.
3. Remove the two screws to loosen the PCIe cage cover, then separate the cover from the cage.
  1. PCIe cage
  2. Controller panel
  3. Thumbscrew
  4. PCIe cage
4. Loosen the two thumbscrews on the PCIe cage, then slide the retention bracket out to loosen the PCIe cards.
  1. Thumbscrews
  2. Retention bracket
Upgrade the NIC or HBA.
1. Remove the existing NIC or HBA from the slot (see diagram in step 2). If you are installing a quad port 10Gbps SFP+ NIC card, you must remove the transceiver from port 1 before attempting to install the card.
  
  NOTE: If a NIC cage was shipped with your upgrade, remove all the cards from your existing NIC cage and install the ones you want to use, along with the upgraded card, in the NIC cage provided.
2. Install the new NIC or HBA. After the card is successfully installed, reinsert the transceiver into port 1 if you removed it.
  
  NOTE: If you are upgrading a NIC or HBA in a CS1000 or CS1000H array, you can upgrade only one card, and you must install that new card in slot 1.
3. To upgrade additional NICs or HBAs, repeat step 4.
Reassemble the PCIe cage, and reattach to the controller.
1. Slide the retention bracket in to secure the PCIe cards, then fasten the two thumbscrews to lock the retention bracket in place.
2. Reinstall the PCIe cage cover, and secure with two screws.
3. Carefully align the PCIe cage riser card with the motherboard connector, then gently seat the PCIe cage into place.
4. Reinsert the controller into the chassis bay, then secure the keeper screw to the controller handle.
5. Reattach the cables (use the labeling from step 2a as a guide).
  
  NOTE: You can wait until both NICs/HBAs have been upgraded to perform this step.
  
  NOTE: If you are upgrading from a dual port to a quad port NIC or HBA, you may need additional cables. Refer to the NimbleOS GUI for your array to view port mapping/WWPN information for the upgraded adapter.
If the new card has a change in the number of interfaces, do one of the following:
- For version 3.x or earlier, repeat steps 1-5 for the second controller.
- For version 4.3 or later:
NOTE: Skip this step if the number of interfaces is unchanged.
1. From the active controller, update the configuration of any NICs or FC HBAs that were removed from the standby controller:
  For NICs
  
  nic --unassign interface_name --netconfig draft --subnet subnet_name
  
  netconfig --validate draft
  
  netconfig --activate draft --force_ip_update
  
  For FC HBAs
  
  fc --update_config
2. Fail over to reverse controller roles:
  failover
3. When failover is complete, repeat steps 1-5 on the new standby controller.
Verify configuration of the new NICs or HBAs.
1. If you are upgrading an HBA, run the following command to communicate the new Fibre Channel configuration out to the fabric:On the active controller, unconfigure any NICs that were removed from the standby controller:
  fc --update_config
  
  NOTE: Use this command only when upgradingOn the active controller, unconfigure any NICs that were removed from an HBA, not when replacing a failed HBA. Running the command outside of an upgrade causes the WWPNs on the HBA to change, triggering an outage.
  
  WWPN values are tied to the physical slot in the system, not the physical HBA. When an HBA is replaced, the same WWPN values are automatically assigned to the new card that occupies the same physical slot. If a new HBA is added in a slot that did not previously hold an HBA, WWPN information is not available to the ports on the HBA until the configuration is updated or setup is run again.
  
  For a quad port HBA, the two WWPNs from the previously installed dual port HBA are reused and two new WWPNs are generated for the other two ports.
  
  NOTE: Validate that the new WWPNs shown in the NimbleOS GUI have been added to the switch fabric zoning configuration. If port zoning is being used, additional configuration is not required. If WWN zoning is being used, the zoning configuration must be updated with the new WWPNs of the upgraded HBA.
2. In the GUI, do one of the following:
  - For version 3.x or earlier, choose Manage → Arrays, then select the array that contains the new drives.
  - For version 4.x or later, click Hardware, then select the array that contains the new drives.
3. Verify that the controllers are in Active and Standby modes. Ensure that the ports are connected (green).
NOTE: Ports that are not configured for management traffic (NIC ports only) or data traffic (NIC or HBA ports) report an unconfigured (gray) status. HBA ports cannot be configured for management traffic.