Upgrade a PCIe Card

Time required:	15 minutes per controller
Parts required:	New NIC, HBA, or SCM ordered from HPE
Tools required:	ESD (electrostatic discharge) strap or appropriate grounding device
Information required:	RMA (Return Materials Authorization) work order Case number Array name or serial number The array serial number can be found on the pullout System Info tab.
Support contact:	See Support.

HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows.

Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information.

IMPORTANT:

Controllers may only be serviced in Standby mode. Never remove a controller running in Active mode. You do not have to shut down the array or expansion shelf to replace or add a component. The storage array can function with one active controller while the component is added on the standby controller.
Before removing a controller, address any power supply issues in the peer controller if the power supplies do not show proper operational status (green LED). For HPE Alletra 6030 and 6050 arrays with 800 W power supplies, this precaution is critical.

NOTE:

While a controller is removed (one at a time), the internal temperature of the chassis can rise to critical levels. Keep installation time to no more than 15 minutes per controller.
If you are adding a 100GbE NIC or a quad port 32Gb FC HBA, Slot 2 and Slot 5 are recommended.
If you are adding a new HBA, or moving an existing HBA to a different slot in the controller, you may need to run an update on the HBA to reconfigure it in the system.
If you are upgrading an HBA, validate that the new WWPNs shown in the GUI have been added to the switch fabric zoning configuration. For port zoning, additional configuration is not required. For WWN zoning, the zoning configuration must be updated with the new WWPNs of the upgraded HBA.

Use this procedure to upgrade network interface cards (NICs), host bus adapters (HBAs), or storage class memory (SCM) in your HPE storage array, including upgrading from dual to quad port NICs or HBAs. Each upgrade kit contains two PCIe cards.

Identify and halt the controller that is in Standby mode.
1. Log in to the array using the CLI.
2. Determine which controller is in Standby or Unknown mode.
  ctrlr --list --array array_name
3. Halt the standby controller.
  halt --array array_name --controller {A | B}
Remove the controller from the chassis.
1. Disconnect the power cords from the two controller power supplies.
2. Label all cables to ensure proper recabling later, then remove them from the controller.
3. Loosen the left and right thumbscrews to free the controller release levers from the controller.
  1. Thumbscrew
  2. Controller release lever
  3. Controller
4. Pull the controller release levers down until they stop. The controller ejects slightly from the chassis.
5. Supporting the weight of the controller, pull the controller release levers to slide the controller out of the chassis. Then place the controller on a flat surface.
  1. Controller release lever (open)
  2. Controller
  3. Chassis
  IMPORTANT:
  To avoid electrostatic damage, place array components on a grounded anti-static mat. Use an ESD wrist strap during removal and replacement.
Remove the PCIe cage from the controller.
- For the primary cage (left), proceed to Step 4.
- For the secondary cage (right), proceed to Step 5.
Remove the primary PCIe cage (left) from the controller.
1. Lift the tab of the fastener and turn the fastener one half turn (180°) counter clockwise to release the PCIe cage.
2. Grasp the PCIe cage with both hands and lift the cage out of the controller to unseat the underlying riser card from its connector.
  1. Fastener
  2. Riser card
  3. Connector
3. Turn the PCIe cage upside down and place it on a flat surface.
Remove the secondary PCIe cage (right), if present, from the controller.

NOTE: The HPE Alletra 6010 model does not include a secondary PCIe cage.
1. Lift the tab of the fastener and turn the fastener one half turn (180°) counter clockwise to release the PCIe cage.
2. Grasp both sides of the PCIe cage and lift the cage out of the controller.
  1. Right PCIe cage
  2. Fastener
  3. Riser card
  4. Connector
3. Turn the PCIe cage upside down and place it on a flat surface.
Remove the PCIe card.
1. Loosen the thumbscrew on the PCIe card holder.
  1. Thumbscrew
  2. PCIe card holder
  3. PCIe card
  4. Riser card
2. Open the PCIe card holder.
  1. PCIe card
  2. Connector
  3. Rubber tab
  4. PCIe cage slot
3. Pull the PCIe card straight out of the card slot.
Insert the new PCIe card.
1. Insert the PCIe card into the card slot.
2. Align the rubber tabs with PCIe cards, and close the PCIe card holder.
3. Tighten the thumbscrew to secure the PCIe card.
Install the PCIe cage into the controller.
- For the primary cage (left), proceed to Step 9.
- For the secondary cage (right), proceed to Step 10.
Install the primary PCIe cage (left) into the controller.
1. Align the PCIe cage and guide post with the grooves of the controller, and lower the cage into the controller.
  1. Guide post
  2. Groove
  3. Riser card
2. With the riser card and connector properly aligned, press down on the top of the PCIe cage to seat the riser card in the connector.
3. Press down on the fastener and turn the fastener tab one half turn (180°) clockwise to secure the PCIe cage.
Install the secondary PCIe cage (right), if present, into the controller.
1. Align the PCIe cage and guide post with the grooves of the controller, and lower the cage into the controller.
  1. Guide post
  2. Groove
  3. Riser card
  4. Connector
2. With the riser cards and connectors properly aligned, press down on the top of the PCIe cage to seat the riser cards in their connectors.
3. Press down on the fastener and turn the fastener tab one half turn (180°) clockwise to secure the PCIe cage.
Install the controller into the chassis.
1. Make sure the controller release lever is fully extended.
2. Slide the controller into the chassis bay. Do not force the controller. If it does not slide in easily, remove it and try again.
3. After the controller is in place, return the controller release lever to its original closed position, and then tighten the thumbscrews.
4. Reconnect all the network cables to the controller (as labeled from step 2).
5. Reconnect the power cables to both power supplies.
The controller automatically starts.
Based on the PCIe cards you added, do the following:
1. For NICs: On the active controller, unconfigure any NICs that were removed from the standby controller.
  nic --unassign interface_name --netconfig draft --subnet subnet_name
  
  netconfig --validate draft
  
  netconfig --activate draft --force_ip_update
2. For HBAs: Communicate the new Fibre Channel configuration out to the fabric.
  fc --update_config
  
  IMPORTANT: Use this command only when upgrading an HBA, not when replacing a failed HBA. Running the command outside of an upgrade causes the WWPNs on the HBA to change, triggering an outage.
  
  WWPN values are tied to the physical slot in the system, not the physical HBA. When an HBA is replaced, the same WWPN values are automatically assigned to the new card that occupies the same physical slot. If a new HBA is added in a slot that did not previously hold an HBA, WWPN information is not available to the ports on the HBA until the configuration is updated or setup is run again.
  
  For a quad port HBA, the two WWPNs from the previously installed dual port HBA are reused and two new WWPNs are generated for the other two ports.
  
  NOTE: Validate that the new WWPNs shown in the GUI have been added to the switch fabric zoning configuration. If port zoning is being used, additional configuration is not required. If WWN zoning is being used, the zoning configuration must be updated with the new WWPNs of the upgraded HBA.
Perform a failover to reverse the controller roles:
failover

NOTE: For an SCM card installation, a failover --force command is required to override all prechecks. This command will override all precheck failures incuding those not related to the SCM card, which could lead to unplanned down time. For assistance, contact HPE Support.
When failover is complete, repeat steps 1-12 on the new standby controller.
Verify configuration of new PCIe cards.
1. In the GUI, click Hardware.
2. Verify that the controllers are in Active and Standby modes. For NICs or HBAs, verify that the ports are connected (green). For SCM, verify that the icon is blue.
  
  NOTE: Ports that are not configured for management traffic (NIC ports only) or data traffic (NIC or HBA ports) report an unconfigured (gray) status. HBA ports cannot be configured for management traffic.