[dpdk-users] Only the 1st KR of XL710 (4xKR NVRAM) can be initialized by DPDK l2fwd

[CH Huang]

Dear Sir:


For some reason, we need to use 10Gbps PF with promiscuous mode on XL710
(so we can't use VF because of  promiscuous mode and support up to 10Gbps
for each port) and we update the NVRAM to support 4xKR. Then we can see
there are 4xKR link up to 10Gbps in the OS.

But when we tried to run the DPDK l2fwd on 2 of the 4xKR (XL710). Only the 1
st KR port can be initialized by l2fwd.

Here are the summary of our testing:

1.      1st KR and 2nd KR: 2nd KR failed to be initialized by l2fwd

2.      1st KR and 3rd KR: 3rd KR failed to be initialized by l2fwd

3.      1st KR and 4th KR: 4th KR failed to be initialized by l2fwd

4.      2nd KR and 4th KR: 2nd KR failed to be initialized by l2fwd



Please check the below information and the log in RED. Does anyone has the
same experience and has the solution on this issue? Thanks a lot.



Information:

DPDK version:

dpdk-16.07



lspci:

……

05:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 for
10GbE backplane (rev 01)

05:00.1 Ethernet controller: Intel Corporation Ethernet Controller X710 for
10GbE backplane (rev 01)

05:00.2 Ethernet controller: Intel Corporation Ethernet Controller X710 for
10GbE backplane (rev 01)

05:00.3 Ethernet controller: Intel Corporation Ethernet Controller X710 for
10GbE backplane (rev 01)



Bind the 1st and 2nd KR to DPDK:

Network devices using DPDK-compatible driver

============================================

0000:05:00.0 'Ethernet Controller X710 for 10GbE backplane' drv=igb_uio
unused=

0000:05:00.1 'Ethernet Controller X710 for 10GbE backplane' drv=igb_uio
unused=



Run l2fwd:

[root at localhost build]# ./l2fwd -c 0xf0 -n 2 -- -p 0x3

EAL: Detected 12 lcore(s)

EAL: Probing VFIO support...

PMD: bnxt_rte_pmd_init() called for (null)

EAL: PCI device 0000:01:00.0 on NUMA socket 0

EAL:   probe driver: 8086:1523 rte_igb_pmd

EAL: PCI device 0000:02:00.0 on NUMA socket 0

EAL:   probe driver: 8086:1580 rte_i40e_pmd

EAL: PCI device 0000:04:00.0 on NUMA socket 0

EAL:   probe driver: 8086:1580 rte_i40e_pmd

EAL: PCI device 0000:04:00.1 on NUMA socket 0

EAL:   probe driver: 8086:1580 rte_i40e_pmd

EAL: PCI device 0000:05:00.0 on NUMA socket 0

EAL:   probe driver: 8086:1581 rte_i40e_pmd

PMD: eth_i40e_dev_init(): FW 5.0 API 1.5 NVM 05.00.04 eetrack 800024ff

EAL: PCI device 0000:05:00.1 on NUMA socket 0

EAL:   probe driver: 8086:1581 rte_i40e_pmd

PMD: eth_i40e_dev_init(): FW 5.0 API 1.5 NVM 05.00.04 eetrack 800024ff

PMD: eth_i40e_dev_init(): Failed to do parameter init: -22

EAL: Error - exiting with code: 1

  Cause: Requested device 0000:05:00.1 cannot be used



Regards,
CH Huang
chhuang789 at gmail.com