<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
p.xmsonormal, li.xmsonormal, div.xmsonormal
{mso-style-name:x_msonormal;
margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.xxcontentpasted8
{mso-style-name:x_xcontentpasted8;}
span.xxcontentpasted9
{mso-style-name:x_xcontentpasted9;}
span.xxcontentpasted7
{mso-style-name:x_xcontentpasted7;}
span.xxcontentpasted10
{mso-style-name:x_xcontentpasted10;}
span.EmailStyle28
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">Hi Haider:<o:p></o:p></span></p>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">From your first post, ofed version of B is higher, you are right. Fw version is lower – please ignore 16 and 22 prefix which is NIC type.<o:p></o:p></span></p>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">version: 5.4-3.1.0</span><o:p></o:p></p>
<p class="xmsonormal" style="background:white"><b><span style="font-size:12.0pt;color:black">firmware-version: 16.32.1010 (MT_0000000080)</span></b><o:p></o:p></p>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">version: 5.4-3.5.8</span><o:p></o:p></p>
<p class="xmsonormal" style="background:white"><b><span style="font-size:12.0pt;color:black">firmware-version: 22.31.1014 (MT_0000000436)</span></b><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">Xueming<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Haider Ali <haider@dreambigsemi.com> <br>
<b>Sent:</b> Tuesday, October 18, 2022 14:11<br>
<b>To:</b> Xueming(Steven) Li <xuemingl@nvidia.com><br>
<b>Cc:</b> users <users@dpdk.org>; Asaf Penso <asafp@nvidia.com><br>
<b>Subject:</b> Re: mlx5 - shared_rxq not working on some Connect x6 DX<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:12.0pt;color:black">Server B has higher versions of OFED and firmware than server A. Please let me know if are you asking me to downgrade OFED and firmware on server B. <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:12.0pt;color:black">Have you removed shared RXQ features in higher versions of OFED and firmware? <o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
<div id="Signature">
<div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Regards,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Haider<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="98%" align="center">
</div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="color:black">From:</span></b><span style="color:black"> Xueming(Steven) Li <<a href="mailto:xuemingl@nvidia.com">xuemingl@nvidia.com</a>><br>
<b>Sent:</b> Tuesday, October 18, 2022 11:04 AM<br>
<b>To:</b> Haider Ali <<a href="mailto:haider@dreambigsemi.com">haider@dreambigsemi.com</a>><br>
<b>Cc:</b> users <<a href="mailto:users@dpdk.org">users@dpdk.org</a>>; Asaf Penso <<a href="mailto:asafp@nvidia.com">asafp@nvidia.com</a>><br>
<b>Subject:</b> RE: mlx5 - shared_rxq not working on some Connect x6 DX</span> <o:p>
</o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="xmsonormal">Hi Haider,<o:p></o:p></p>
<p class="xmsonormal"> <o:p></o:p></p>
<p class="xmsonormal">The device capability is critical to support shared RXQ.<o:p></o:p></p>
<p class="xmsonormal">The OFED and firmware version of server B seems not up to date, could please align with server A?<o:p></o:p></p>
<p class="xmsonormal"> <o:p></o:p></p>
<p class="xmsonormal">Best Regards,<o:p></o:p></p>
<p class="xmsonormal">Xueming Li<o:p></o:p></p>
<p class="xmsonormal"> <o:p></o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal"><b>From:</b> Asaf Penso <<a href="mailto:asafp@nvidia.com">asafp@nvidia.com</a>>
<br>
<b>Sent:</b> Thursday, October 6, 2022 14:45<br>
<b>To:</b> Haider Ali <<a href="mailto:haider@dreambigsemi.com">haider@dreambigsemi.com</a>>; users <<a href="mailto:users@dpdk.org">users@dpdk.org</a>><br>
<b>Subject:</b> Re: mlx5 - shared_rxq not working on some Connect x6 DX<o:p></o:p></p>
</div>
</div>
<p class="xmsonormal"> <o:p></o:p></p>
<div>
<p class="xmsonormal">Hello Haider,<o:p></o:p></p>
</div>
<div>
<p class="xmsonormal">Besides the info print issue, can you describe what is the use case?<o:p></o:p></p>
</div>
<div>
<p class="xmsonormal">What do you try to achieve and whether you see any issue?<o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"> <o:p></o:p></p>
</div>
<div id="x_ms-outlook-mobile-signature">
<div>
<p class="xmsonormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="xmsonormal">Asaf Penso<o:p></o:p></p>
</div>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="98%" align="center">
</div>
<div id="x_divRplyFwdMsg">
<p class="xmsonormal"><b><span style="color:black">From:</span></b><span style="color:black"> Haider Ali <<a href="mailto:haider@dreambigsemi.com">haider@dreambigsemi.com</a>><br>
<b>Sent:</b> Tuesday, October 4, 2022 4:24:03 PM<br>
<b>To:</b> users <<a href="mailto:users@dpdk.org">users@dpdk.org</a>><br>
<b>Cc:</b> Asaf Penso <<a href="mailto:asafp@nvidia.com">asafp@nvidia.com</a>><br>
<b>Subject:</b> mlx5 - shared_rxq not working on some Connect x6 DX</span> <o:p></o:p></p>
<div>
<p class="xmsonormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">Hi,
</span><o:p></o:p></p>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">I used two servers A and B. Server A has <span class="xxcontentpasted8"><span style="background:white">Connect x5 and x6 DX cards while server B has </span></span><span class="xxcontentpasted9"><span style="background:white">Connect
x6 DX card.</span></span></span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="margin-bottom:12.0pt;background:white"><o:p> </o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">I have checked with Connect x5 and x6 DX cards on "server A" and I am able to get below rxq_share device capability:</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">testpmd> show port info all</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">Device capabilities: 0x14(
<b>RXQ_SHARE</b> FLOW_SHARED_OBJECT_KEEP )</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">Server A setting:</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"># ofed_info -s</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><b><span style="font-size:12.0pt;color:black">MLNX_OFED_LINUX-5.4-3.1.0.0:</span></b><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"># ethtool -i enp129s0f0</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">driver: mlx5_core</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">version: 5.4-3.1.0</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><b><span style="font-size:12.0pt;color:black">firmware-version: 16.32.1010 (MT_0000000080)</span></b><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">expansion-rom-version:</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">bus-info: 0000:81:00.0</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-statistics: yes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-test: yes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-eeprom-access: no</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-register-dump: no</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-priv-flags: yes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">But when I moved to server B with another Connect x6 DX card, I could not see this capability.</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span class="xxcontentpasted7"><span style="font-size:12.0pt;color:black">testpmd> show port info all</span></span><span style="font-size:12.0pt;color:black">
</span><o:p></o:p></p>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
</div>
<div>
<p class="xmsonormal" style="background:white"><span class="xxcontentpasted7"><span style="font-size:12.0pt;color:black">Device capabilities: 0x14(</span></span><span class="xxcontentpasted10"><span style="font-size:12.0pt;color:black"> </span></span><span class="xxcontentpasted7"><span style="font-size:12.0pt;color:black">FLOW_SHARED_OBJECT_KEEP
)</span></span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">Server B Settings:</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"># ofed_info -s</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><b><span style="font-size:12.0pt;color:black">MLNX_OFED_LINUX-5.4-3.5.8.0:</span></b><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"># ethtool -i enp132s0f0</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">driver: mlx5_core</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">version: 5.4-3.5.8</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><b><span style="font-size:12.0pt;color:black">firmware-version: 22.31.1014 (MT_0000000436)</span></b><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">expansion-rom-version:</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">bus-info: 0000:84:00.0</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-statistics: yes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-test: yes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-eeprom-access: no</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-register-dump: no</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">supports-priv-flags: yes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><b><span style="font-size:12.0pt;color:black">Although server B has higher versions of OFED and firmware, my question is do I need to enable/disable firmware settings? Or are there any other configurations we need
to apply?</span></b><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">Regards,</span><o:p></o:p></p>
</div>
<p class="xmsonormal" style="background:white"><span style="font-size:12.0pt;color:black">Haider</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>