<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Aptos",sans-serif;
mso-ligatures:standardcontextual;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#467886;
text-decoration:underline;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Arial",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#467886" vlink="#96607D" style="word-wrap:break-word">
<p style="font-family:Calibri;font-size:10pt;color:#0000FF;margin:5pt;font-style:normal;font-weight:normal;text-decoration:none;" align="Left">
[AMD Official Use Only - AMD Internal Distribution Only]<br>
</p>
<br>
<div>
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">Hi Jasvinder,
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">I was facing similar issue with Cx-7 and it appears that the issue is related to the network namespace.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">By configuring the Pod/container to use the "host's network namespace," the issue is effectively resolved.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">----<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif"> spec:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif"> nodeSelector:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif"> "feature.node.kubernetes.io/test-node": "true"<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">
<b>hostNetwork: true<o:p></o:p></b></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif"> containers:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">----<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">Thanks & Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif">Sivaprasad<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-family:"Calibri",sans-serif;mso-ligatures:none">From:</span></b><span style="font-family:"Calibri",sans-serif;mso-ligatures:none"> Singh, Jasvinder <jasvinder.singh@intel.com>
<br>
<b>Sent:</b> Tuesday, January 28, 2025 4:45 PM<br>
<b>To:</b> users@dpdk.org; Raslan Darawsheh <rasland@nvidia.com><br>
<b>Cc:</b> Marjanovic, Nemanja <nemanja.marjanovic@intel.com><br>
<b>Subject:</b> mlx5_common: failed to load mlx5_eth driver issue <o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="left" width="100%" style="width:100.0%">
<tbody>
<tr>
<td style="background:#FFB900;padding:5.0pt 2.0pt 5.0pt 2.0pt"></td>
<td width="100%" style="width:100.0%;background:#FFF8E5;padding:5.0pt 4.0pt 5.0pt 12.0pt">
<div>
<p class="MsoNormal" style="mso-element:frame;mso-element-frame-hspace:2.25pt;mso-element-wrap:around;mso-element-anchor-vertical:paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly">
<b><span style="font-size:12.0pt;color:#222222;mso-ligatures:none">Caution:</span></b><span style="font-size:12.0pt;color:#222222;mso-ligatures:none"> This message originated from an External Source. Use proper caution when opening attachments, clicking links,
or responding. <o:p></o:p></span></p>
</div>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span lang="EN-IE" style="font-size:12.0pt;mso-ligatures:none"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span lang="EN-IE">Hi Folks,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">I am trying to run dpdk-testpmd in a container with NVIDIA ConnectX-7 NIC card on the system and facing issue described below. Details on the system setup are as follow-
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-IE">Host Configuration for OFED and CX7:</span></b><span lang="EN-IE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">Nvidia CX7 is configured to use Ethernet as opposed to InfiniBand with the following steps:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-IE">OFED driver installation:</span></b><span lang="EN-IE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">./mlnxofedinstall --without-dkms --add-kernel-support --kernel 6.8.0-51-generic --without-fw-update --force<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-IE">Configuration:</span></b><span lang="EN-IE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">mlxconfig -d /dev/mst/mt4129_pciconf0 set LINK_TYPE_P1=2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">mlxconfig -d /dev/mst/mt4129_pciconf1 set LINK_TYPE_P1=2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">SRIOV has been also enabled on the NIC.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">The above configuration resulted in successfully deploying dpdk-testpmd on virtual functions on the host.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-IE">Container Configuration for OFED:</span></b><span lang="EN-IE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">Ubuntu 22.04 used within container.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"># Install mlnx OFED Drivers<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">RUN wget <a href="https://www.mellanox.com/downloads/ofed/MLNX_OFED-24.07-0.6.1.0/MLNX_OFED_LINUX-24.07-0.6.1.0-ubuntu24.04-x86_64.tgz" target="_blank" title="https://www.mellanox.com/downloads/ofed/mlnx_ofed-24.07-0.6.1.0/mlnx_ofed_linux-24.07-0.6.1.0-ubuntu24.04-x86_64.tgz">
https://www.mellanox.com/downloads/ofed/MLNX_OFED-24.07-0.6.1.0/MLNX_OFED_LINUX-24.07-0.6.1.0-ubuntu24.04-x86_64.tgz</a> \<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> && tar -xvf MLNX_OFED_LINUX-24.07-0.6.1.0-ubuntu24.04-x86_64.tgz \<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> && cd MLNX_OFED_LINUX-24.07-0.6.1.0-ubuntu24.04-x86_64 \<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> && ./mlnxofedinstall --force --without-fw-update --dpdk --upstream-libs<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"> <o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-IE" style="color:black">Dpdk-testpmd error log:<o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span lang="EN-IE" style="color:black"> <o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-IE">root@tpmd-0:/tmp/dpdk-build/app# ./dpdk-testpmd -n 4 -a 60:00.1 -a 60:00.2 -- -i<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Detected CPU lcores: 128<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Detected NUMA nodes: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Detected static linkage of DPDK<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Multi-process socket /var/run/dpdk/rte/mp_socket<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Selected IOVA mode 'VA'<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Probe PCI driver: mlx5_pci (15b3:101e) device: 0000:60:00.1 (socket 0)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE" style="background:yellow;mso-highlight:yellow">mlx5_net: Unable to recognize master/representors on the multiple IB devices.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE" style="background:yellow;mso-highlight:yellow">mlx5_common: Failed to load driver mlx5_eth<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE" style="background:yellow;mso-highlight:yellow">EAL: Requested device 0000:60:00.1 cannot be used<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE" style="background:yellow;mso-highlight:yellow">EAL: Probe PCI driver: mlx5_pci (15b3:101e) device: 0000:60:00.2 (socket 0)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE" style="background:yellow;mso-highlight:yellow">mlx5_net: Unable to recognize master/representors on the multiple IB devices.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE" style="background:yellow;mso-highlight:yellow">mlx5_common: Failed to load driver mlx5_eth</span><span lang="EN-IE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Requested device 0000:60:00.2 cannot be used<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">EAL: Bus (pci) probe failed.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">TELEMETRY: No legacy callbacks, legacy socket not created<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">testpmd: No probed ethernet devices<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">Interactive-mode selected<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">testpmd: create a new mbuf pool <mb_pool_0>: n=1163456, size=2176, socket=0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">testpmd: preferred mempool ops selected: ring_mp_mc<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">Done<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">testpmd> quit<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">Please provide help to resolve above.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">Thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE">Jasvinder<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-IE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN"><o:p> </o:p></span></p>
</div>
</div>
</div>
</body>
</html>