PS225
User Guide Quick Start Guide
2. If the driver is provided separately, it must be extracted and compiled for the kernel running on the x86 host and installed.
Example commands are provided below:
NOTE:
It is assumed that the delivered L2 source code is in the tarball brcm-nxt-l2-drv.tar.gz
.
tar zxf brcm-nxt-l2-drv.tar.gz
cd git/main/Cumulus/drivers/linux/v3/ make sudo make install
The driver name is bnxt_en.ko
and the last command installs it in the system in the
/lib/modules/<kernelversion>/updates/
directory.
3. Install the driver using the following command: sudo modprobe bnxt_en
3.4.2 Assigning an IP Address to the First New Host Interface
After a modprobe
or insmod
of the bnxt_en
driver, the new network interfaces show up on the x86 host. The number of interfaces/PFs that show up on the x86 host and separately on the ARM side is Nitro firmware-dependent. An example for x86 is shown below and the interfaces are highlighted
.
NOTE:
The exact names may differ from system to system and depend on the OS being used and the physical slot where the card is installed.
$ ip link show
1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: enp0s31f6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP mode DEFAULT group default qlen 1000
link/ether b0:6e:bf:30:44:65 brd ff:ff:ff:ff:ff:ff
19: enp1s0f0 : <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether 00:10:18:de:06:08 brd ff:ff:ff:ff:ff:ff
20: enp1s0f1d1 : <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether 00:10:18:de:06:09 brd ff:ff:ff:ff:ff:ff
21: enp1s0f2 : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
link/ether 00:10:18:de:06:0a brd ff:ff:ff:ff:ff:ff
22: enp1s0f3d1 : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 default qlen 1000
Broadcom
23: enp1s0f4 : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group
link/ether 00:10:18:de:06:0c brd ff:ff:ff:ff:ff:ff
24: enp1s0f5d1 : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
link/ether 00:10:18:de:06:0d brd ff:ff:ff:ff:ff:ff
25: enp1s0f6 : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
link/ether 00:10:18:de:06:0e brd ff:ff:ff:ff:ff:ff
26: enp1s0f7d1 : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
link/ether 00:10:18:de:06:0f brd ff:ff:ff:ff:ff:ff
Broadcom Confidential 5880X-PS225-UG101
13
PS225
User Guide Quick Start Guide
1. Assign an IP address on the 192.168.1.x subnet to the interface for function 0 (in the previous example, it is enp1s0f0).
Example: sudo ifconfig enp1s0f0 192.168.1.20 up
# OR sudo ip addr add 192.168.1.20/24 dev enp1s0f0
2. Check the new IP address with either an ifconfig
PS225) can now be pinged.
or ip addr show
command. The PS225 (the ARM host on the
Example:
$ ping 192.168.1.10
PING 192.168.1.10 (192.168.1.10) 56(84) bytes of data.
64 bytes from 192.168.1.10: icmp_seq=1 ttl=64 time=0.131 ms
64 bytes from 192.168.1.10: icmp_seq=2 ttl=64 time=0.046 ms
...
Figure 6 shows the connectivity of the first interface on the x86 host and the first interface on the ARM side. 192.168.1.20 is assigned to enp1s0f0 (on the x86 host) and 192.168.1.10 to enP8p1s0f0np0 on the ARM host on the PS225. These two interfaces are connected through Nitro (red arrow).
NOTE:
As shown in Figure 6 , each interface can send packets out on the 25GbE port (blue arrow for the x86 enp1s0f0
Figure 6: Interface Connectivity
Confidential
Host CPUs
enp1s0f0 (PF8)
PCIe x8
Broadcom
NIC
192.168.1.10 is always assigned to enp8p1s0f0np0 interface on new PS225 boards. Change
/etc/network/interfaces as appropriate for your setup.
NIC
PF0 PF1
A72 CPUs
A72(MAIA) cores to ports
Host(x86) to ports
Host(x86) to A72(MAIA) cores
Broadcom Confidential 5880X-PS225-UG101
14
PS225
User Guide Quick Start Guide
When sending packets to the external ports, the even-numbered interfaces on the x86 host (for example, enp1s0f0, enp1s0f2, enp1s0f4, and enp1s0f6) are connected to external port 0. This also applies to the even-numbered interfaces on the ARM side (enP8p1s0f0np0, enP8p1s0f2np0, enP8p1s0f4np0, and enP8p1s0f6np0). The odd-numbered interfaces on both the x86 host side and the ARM side are connected to external port 1.
Use the following steps to permanently assign a static IP address to the interface:
For Debian-based Linux OS (for example, Ubuntu) set a static IP address in
/etc/network/interface
with the following commands: auto enp1s0f0 iface enp1s0f0 inet static
address 192.168.1.20
netmask 255.255.255.0
For CentOS, create a new file using the following commands:
/etc/sysconfig/network-scripts/ifcfg-ens4f0
NOTE:
The previous example is provided for an interface named ens4f0.
The interface name may be different on different systems.
Add the following content:
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
BOOTPROTO="static"
DEFROUTE="yes"
NAME=" ens4f0 "
UUID="
660e94eb-a5b4-4975-8139-388675307f7d
"
DEVICE=" ens4f0 "
ONBOOT="no"
IPADDR=192.168.1.20
NETMASK=255.255.255.0
GATEWAY=192.168.1.20
Confidential
The content can be completely reused, but the highlighted
items must be replaced. The variables NAME and DEVICE contain the interface name that was determined above. The variable UUID contains the ID of the interface, which can be obtained by running uuidgen ens4f0
.
Broadcom
Broadcom Confidential 5880X-PS225-UG101
15
