Network Connections

Depending on your desired Network Topology, the following network configuration examples show how to make the physical network connections to support that topology.

NOTE: Later, be sure to make the appropriate port settings that correspond to these network connections.

See Configure the Array Using the Nimble Setup Manager.

One Shared Network

In this configuration:
  • Management and data paths share the same subnet or network
  • Any traffic can use any type of port
In the following example, the eth1 port on each controller provides the management path (red cables). The eth4 port on each controller provides the data path (blue cables).

The management and data ports connect to the same network switch. The host also connects to the switch. This is a very simple network, but it still has redundant controllers to provide high availability.

Note that only one management connection and one data connection are shown. You can add more connections and use different ports as needed.

Figure: An example of network connections for one shared network
  1. Host/server
  2. Network Interface Cards (NICs)
  3. Ethernet switch 1
  4. Ethernet switch 2
  5. Array
  6. Data port fc4 on controller A
  7. Management port eth1 on controller A
  8. Management port eth1 on controller B
  9. Data port fc4 on controller B
  10. Host network connection
  11. Management interface pair
  12. Data interface pair

Two Dedicated Networks

In this configuration:
  • Management and data paths are on different subnets or networks
  • Ports eth1 and eth2 handle management traffic
  • Ports eth3 through eth6 handle data traffic
In the following example, the eth1 port on each controller provides the management path (red cables). The eth4 port on each controller provides the data path (blue cables). The management and data ports connect to different network switches. The host also connects to both switches. The separated management and data paths on this network provide higher performance and high availability.

Note that only one management connection and one data connection are shown. You can add more connections and use different ports as needed.

Figure: An example of network connections for two dedicated networks
  1. Host/server
  2. Network Interface Cards (NICs)
  3. Ethernet switch 1
  4. Ethernet switch 2
  5. Array
  6. Data port fc4 on controller A
  7. Management port eth1 on controller A
  8. Management port eth1 on controller B
  9. Data port fc4 on controller B
  10. Data port connections
  11. Management port connections
  12. Management interface pair
  13. Data interface pair

Advanced Configuration

In this configuration:
  • Management and data paths are on different subnets or networks
  • Port eth1 handles management traffic
  • Ports eth2 through eth6 handle data traffic

The following example shows one possible way to connect the cabling for an advanced configuration. Note that the subnet addresses in the illustration are just examples. Your settings will differ. The advanced configuration uses the maximum number of data connections on the iSCSI network, to obtain the best availability and throughput.

In more advanced configurations, you can define your own network configuration to handle the desired I/O flow.

Figure: An example of advanced network configuration: data connections
  1. Host/server
  2. Ethernet switch 1, subnet 10.10.30.x/24
  3. Ethernet switch 2, subnet 10.10.20.x/24
  4. Array
  5. Odd numbered data ports to switch 2
  6. Even numbered data ports to switch 1
Figure: Topology diagram - advanced network configuration, management connections
  1. Host/server
  2. Management network
  3. Array
  4. Management port connections

Group Configuration

In this configuration:
  • Management paths for all arrays are on the same subnet
  • Data paths for all arrays are on the same subnet or subnets
  • The group of arrays is assembled and managed through the NimbleOS software
The next example shows network connections for arrays that are managed as a group. This example started with a two-dedicated-network configuration, and then added a second array. It does not matter what the management and data connections are, as long as all management paths are on the same subnet and all data paths are on the same subnet. If you have multiple data subnets, be sure that each array has access to all of the data subnets.

Note that you must create the group using the NimbleOS software. You can have up to four arrays in a group.

For instructions on how to create groups, refer to the GUI Administration Guide or the CLI Administration Guide.

Figure: An example of network connections for a group
  1. Host/server
  2. Switch 1 management
  3. Switch 2 data
  4. Array A
  5. Array B
  6. Data port connections
  7. Management port connections

Dual Fabric Fibre Channel

In this configuration:
  • Management traffic uses an Ethernet switch
  • Data traffic uses Fibre Channel switches
  • Port eth1 handles management traffic
  • Ports fc1 and fc2 handle Fibre Channel data traffic
  • The active controller (A or B) receives data traffic from both Fibre Channel switches (dual fabric)
In the following example, the eth1 port on each controller provides the management path (red cables). The fc1 port on both controllers provides the data path from Fibre Channel Switch 1 (green cables). The fc2 port on both controllers provides the data path from Fibre Channel Switch 2 (blue cables). The management ports connect to an Ethernet switch. The host also connects to both Fibre Channel switches. The separated data paths on this network provide higher performance and high availability.

Note that only one management connection and one data connection are shown. You can add more connections and use different ports as needed.

Figure: An example of network connections for dual fabric Fibre Channel
  1. Host/server
  2. Host Bus Adapter (HBA)
  3. Management port
  4. Fibre Channel switch 1
  5. Fibre Channel switch 2
  6. Ethernet switch
  7. Fibre Channel array
  8. Data port fc4 on controller A
  9. Management port eth1 on controller A
  10. Management port eth1 on controller B
  11. Data port fc4 on controller B
  12. Host data port connections
  13. Management port connections
  14. Data fabric 1 connections
  15. Data fabric 2 connections