<!DOCTYPE html>
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body>
<div>
<p class="MsoNormal"><span lang="EN-IE">Hi Folks,</span></p>
<p class="MsoNormal"><span lang="EN-IE">I am trying to run
dpdk-testpmd on a Dell PowerEdge R730 server with Mellanox
ConnectX-4 Lx NIC card. I can bind the vfio-pci driver:</span></p>
<p class="MsoNormal"><span lang="EN-IE"><font face="monospace">root@dut3:~#
dpdk-devbind.py --status<br>
<br>
Network devices using DPDK-compatible driver<br>
============================================<br>
0000:05:00.0 'MT27710 Family [ConnectX-4 Lx] 1015'
drv=vfio-pci unused=mlx5_core,uio_pci_generic<br>
0000:05:00.1 'MT27710 Family [ConnectX-4 Lx] 1015'
drv=vfio-pci unused=mlx5_core,uio_pci_generic<br>
<br>
</font></span></p>
<p class="MsoNormal"><span lang="EN-IE">But EAL gives the
following messages:</span></p>
<p class="MsoNormal"><span lang="EN-IE"><font face="monospace">root@dut3:~#
dpdk-testpmd<br>
EAL: Detected 16 lcore(s)<br>
EAL: Detected 2 NUMA nodes<br>
EAL: Detected shared linkage of DPDK<br>
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket<br>
EAL: Selected IOVA mode 'VA'<br>
EAL: Probing VFIO support...<br>
EAL: VFIO support initialized<br>
EAL: Probe PCI driver: mlx5_pci (15b3:1015) device:
0000:05:00.0 (socket 0)<br>
mlx5_pci: no Verbs device matches PCI device 0000:05:00.0,
are kernel drivers loaded?<br>
common_mlx5: Failed to load driver = mlx5_pci.<br>
<br>
EAL: Requested device 0000:05:00.0 cannot be used<br>
EAL: Probe PCI driver: mlx5_pci (15b3:1015) device:
0000:05:00.1 (socket 0)<br>
mlx5_pci: no Verbs device matches PCI device 0000:05:00.1,
are kernel drivers loaded?<br>
common_mlx5: Failed to load driver = mlx5_pci.<br>
<br>
EAL: Requested device 0000:05:00.1 cannot be used<br>
EAL: Probe PCI driver: net_mlx4 (15b3:1007) device:
0000:82:00.0 (socket 1)<br>
testpmd: create a new mbuf pool <mb_pool_0>: n=235456,
size=2176, socket=0<br>
testpmd: preferred mempool ops selected: ring_mp_mc<br>
testpmd: create a new mbuf pool <mb_pool_1>: n=235456,
size=2176, socket=1<br>
testpmd: preferred mempool ops selected: ring_mp_mc<br>
Configuring Port 0 (socket 1)<br>
net_mlx4: 0x55e85e1b4b40: cannot attach flow rules (code 95,
"Operation not supported"), flow error type 2, cause
0x220040d200, message: flow rule rejected by device<br>
Fail to start port 0<br>
Configuring Port 1 (socket 1)<br>
net_mlx4: 0x55e85e1b8c00: cannot attach flow rules (code 95,
"Operation not supported"), flow error type 2, cause
0x220040cd80, message: flow rule rejected by device<br>
Fail to start port 1<br>
Please stop the ports first<br>
Done<br>
No commandline core given, start packet forwarding<br>
Not all ports were started<br>
Press enter to exit</font><br>
</span></p>
<p class="MsoNormal"><span lang="EN-IE">It seems that indeed there
is no such driver as "mlx_pci", as the 'find / -name
"*mlx5_pci*" ' command gives no results.</span></p>
<p class="MsoNormal"><span lang="EN-IE">Do I need to install
something?</span></p>
<p class="MsoNormal"><span lang="EN-IE">I tried doing some Google
search for '</span><span lang="EN-IE">common_mlx5: Failed to
load driver = mlx5_pci.</span><span lang="EN-IE">', but the
hits did not help. </span><span lang="EN-IE">As for the first
hit (
<a class="moz-txt-link-freetext" href="https://inbox.dpdk.org/users/CAE4=sSdsN7_CFMOS5ZF-3fEBLhN2af8+twJcO2t4xadNwTV68w@mail.gmail.com/T/">https://inbox.dpdk.org/users/CAE4=sSdsN7_CFMOS5ZF-3fEBLhN2af8+twJcO2t4xadNwTV68w@mail.gmail.com/T/</a>
), the result of the recommended checking is the following:</span></p>
<p class="MsoNormal"><span lang="EN-IE"><font face="monospace">root@dut3:~#
lsmod | grep mlx5_<br>
mlx5_ib 385024 0<br>
ib_uverbs 167936 3 mlx4_ib,rdma_ucm,mlx5_ib<br>
ib_core 413696 11
rdma_cm,ib_ipoib,rpcrdma,mlx4_ib,iw_cm,ib_iser,ib_umad,rdma_ucm,ib_uverbs,mlx5_ib,ib_cm<br>
mlx5_core 1183744 1 mlx5_ib<br>
mlxfw 32768 1 mlx5_core<br>
ptp 32768 4 igb,mlx4_en,mlx5_core,ixgbe<br>
pci_hyperv_intf 16384 1 mlx5_core<br>
<br>
</font></span></p>
<p class="MsoNormal"><span lang="EN-IE">The software versions are
the following ones:</span></p>
<p class="MsoNormal"><span lang="EN-IE"><font face="monospace">root@dut3:~#
cat /etc/debian_version<br>
11.9<br>
root@dut3:~# uname -r<br>
5.10.0-27-amd64<br>
root@dut3:~# apt list dpdk<br>
Listing... Done<br>
dpdk/oldstable,now 20.11.10-1~deb11u1 amd64 [installed]<br>
</font></span></p>
<p class="MsoNormal"><span lang="EN-IE">I also tried using the </span><span
lang="EN-IE">uio_pci_generic instead of vfio-pci, and the
result was the same.</span></p>
However, everything works fine with an X540-AT2 NIC.</div>
<div><br>
</div>
<div>Please advise me, how to resolve the issue!</div>
<div><br>
</div>
<div>As you may have noticed, there is another Mellanox NIC in the
server, but with that one, the situation is even worse. The two
ports have the same PCI address, and thus I cannot bind a DPDK
compatible drive to its second port. Here is the dpdk-devbind
output for the card:</div>
<div><br>
</div>
<div><font face="monospace">0000:82:00.0 'MT27520 Family [ConnectX-3
Pro] 1007' if=enp130s0d1,enp130s0 drv=mlx4_core
unused=vfio-pci,uio_pci_generic</font></div>
<div><br>
</div>
<div>Your advice for resolving that issue would also be helpful to
me. :-)<br>
</div>
<div><br>
</div>
<div>Thank you very much in advance!</div>
<div><br>
</div>
<div>Best regards,</div>
<div><br>
</div>
<div>Gábor Lencse<br>
</div>
<p></p>
</body>
</html>