<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=Windows-1252"> <style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style> </head> <body dir="ltr"> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof ContentPasted0"> Thanks Xueming.</div> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof ContentPasted0"> <br> </div> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof ContentPasted0"> I have updated my firmware and now shared_rxq is working. Please add a note if possible in your dpdk documents like the below for minimum requirements of <span style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); display: inline !important;" class="ContentPasted2">firmware and OFED version</span> for shared_rxq.</div> <div class="elementToProof"> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <img style="max-width:100%" class="ContentPasted1 w-895 h-126" size="12182" contenttype="image/png" data-outlook-trace="F:1|T:1" src="cid:1f21cc59-3850-4bcb-a8c6-bd4f9ffaef4b"><br> </div> <div id="Signature"> <div> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> Regards,</div> <div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"> Haider</div> </div> </div> </div> <div id="appendonsend"></div> <hr style="display:inline-block;width:98%" tabindex="-1"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Xueming(Steven) Li <xuemingl@nvidia.com><br> <b>Sent:</b> Tuesday, October 18, 2022 11:30 AM<br> <b>To:</b> Haider Ali <haider@dreambigsemi.com><br> <b>Cc:</b> users <users@dpdk.org>; Asaf Penso <asafp@nvidia.com><br> <b>Subject:</b> RE: mlx5 - shared_rxq not working on some Connect x6 DX</font> <div> </div> </div> <style>  </style> <div lang="EN-US" link="#0563C1" vlink="purple" style="word-wrap:break-word"> <div class="x_WordSection1"> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">Hi Haider:</span></p> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">From your first post, ofed version of B is higher, you are right. Fw version is lower – please ignore 16 and 22 prefix which is NIC type.</span></p> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">version: 5.4-3.1.0</span></p> <p class="x_xmsonormal" style="background:white"><b><span style="font-size:12.0pt; color:black">firmware-version: 16.32.1010 (MT_0000000080)</span></b></p> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">version: 5.4-3.5.8</span></p> <p class="x_xmsonormal" style="background:white"><b><span style="font-size:12.0pt; color:black">firmware-version: 22.31.1014 (MT_0000000436)</span></b></p> <p class="x_MsoNormal"> </p> <p class="x_MsoNormal">Thanks,</p> <p class="x_MsoNormal">Xueming</p> <p class="x_MsoNormal"> </p> <p class="x_MsoNormal"> </p> <div style="border:none; border-left:solid blue 1.5pt; padding:0in 0in 0in 4.0pt"> <div> <div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in"> <p class="x_MsoNormal"><b>From:</b> Haider Ali <haider@dreambigsemi.com> <br> <b>Sent:</b> Tuesday, October 18, 2022 14:11<br> <b>To:</b> Xueming(Steven) Li <xuemingl@nvidia.com><br> <b>Cc:</b> users <users@dpdk.org>; Asaf Penso <asafp@nvidia.com><br> <b>Subject:</b> Re: mlx5 - shared_rxq not working on some Connect x6 DX</p> </div> </div> <p class="x_MsoNormal"> </p> <div> <p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black">Server B has higher versions of OFED and firmware than server A. Please let me know if are you asking me to downgrade OFED and firmware on server B. </span></p> </div> <div> <p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black">Have you removed shared RXQ features in higher versions of OFED and firmware? </span></p> </div> <div> <div> <p class="x_MsoNormal"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div id="x_Signature"> <div> <div> <p class="x_MsoNormal"><span style="font-size:12.0pt; color:black">Regards,</span></p> </div> <div> <p class="x_MsoNormal"><span style="font-size:12.0pt; color:black">Haider</span></p> </div> </div> </div> </div> <div class="x_MsoNormal" align="center" style="text-align:center"> <hr size="2" width="98%" align="center"> </div> <div id="x_divRplyFwdMsg"> <p class="x_MsoNormal"><b><span style="color:black">From:</span></b><span style="color:black"> Xueming(Steven) Li <<a href="mailto:xuemingl@nvidia.com">xuemingl@nvidia.com</a>><br> <b>Sent:</b> Tuesday, October 18, 2022 11:04 AM<br> <b>To:</b> Haider Ali <<a href="mailto:haider@dreambigsemi.com">haider@dreambigsemi.com</a>><br> <b>Cc:</b> users <<a href="mailto:users@dpdk.org">users@dpdk.org</a>>; Asaf Penso <<a href="mailto:asafp@nvidia.com">asafp@nvidia.com</a>><br> <b>Subject:</b> RE: mlx5 - shared_rxq not working on some Connect x6 DX</span> </p> <div> <p class="x_MsoNormal"> </p> </div> </div> <div> <div> <p class="x_xmsonormal">Hi Haider,</p> <p class="x_xmsonormal"> </p> <p class="x_xmsonormal">The device capability is critical to support shared RXQ.</p> <p class="x_xmsonormal">The OFED and firmware version of server B seems not up to date, could please align with server A?</p> <p class="x_xmsonormal"> </p> <p class="x_xmsonormal">Best Regards,</p> <p class="x_xmsonormal">Xueming Li</p> <p class="x_xmsonormal"> </p> <div style="border:none; border-left:solid blue 1.5pt; padding:0in 0in 0in 4.0pt"> <div> <div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in"> <p class="x_xmsonormal"><b>From:</b> Asaf Penso <<a href="mailto:asafp@nvidia.com">asafp@nvidia.com</a>> <br> <b>Sent:</b> Thursday, October 6, 2022 14:45<br> <b>To:</b> Haider Ali <<a href="mailto:haider@dreambigsemi.com">haider@dreambigsemi.com</a>>; users <<a href="mailto:users@dpdk.org">users@dpdk.org</a>><br> <b>Subject:</b> Re: mlx5 - shared_rxq not working on some Connect x6 DX</p> </div> </div> <p class="x_xmsonormal"> </p> <div> <p class="x_xmsonormal">Hello Haider,</p> </div> <div> <p class="x_xmsonormal">Besides the info print issue, can you describe what is the use case?</p> </div> <div> <p class="x_xmsonormal">What do you try to achieve and whether you see any issue?</p> </div> <div> <p class="x_xmsonormal"> </p> </div> <div id="x_x_ms-outlook-mobile-signature"> <div> <p class="x_xmsonormal">Regards,</p> </div> <div> <p class="x_xmsonormal">Asaf Penso</p> </div> </div> <div class="x_MsoNormal" align="center" style="text-align:center"> <hr size="2" width="98%" align="center"> </div> <div id="x_x_divRplyFwdMsg"> <p class="x_xmsonormal"><b><span style="color:black">From:</span></b><span style="color:black"> Haider Ali <<a href="mailto:haider@dreambigsemi.com">haider@dreambigsemi.com</a>><br> <b>Sent:</b> Tuesday, October 4, 2022 4:24:03 PM<br> <b>To:</b> users <<a href="mailto:users@dpdk.org">users@dpdk.org</a>><br> <b>Cc:</b> Asaf Penso <<a href="mailto:asafp@nvidia.com">asafp@nvidia.com</a>><br> <b>Subject:</b> mlx5 - shared_rxq not working on some Connect x6 DX</span> </p> <div> <p class="x_xmsonormal"> </p> </div> </div> <div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">Hi, </span></p> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">I used two servers A and B. Server A has <span class="x_xxcontentpasted8"><span style="background:white">Connect x5 and x6 DX cards while server B has </span></span><span class="x_xxcontentpasted9"><span style="background:white">Connect x6 DX card.</span></span></span></p> </div> <div> <p class="x_xmsonormal" style="margin-bottom:12.0pt; background:white"> </p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">I have checked with Connect x5 and x6 DX cards on "server A" and I am able to get below rxq_share device capability:</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">testpmd> show port info all</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">Device capabilities: 0x14( <b>RXQ_SHARE</b> FLOW_SHARED_OBJECT_KEEP )</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">Server A setting:</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"># ofed_info -s</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><b><span style="font-size:12.0pt; color:black">MLNX_OFED_LINUX-5.4-3.1.0.0:</span></b></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"># ethtool -i enp129s0f0</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">driver: mlx5_core</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">version: 5.4-3.1.0</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><b><span style="font-size:12.0pt; color:black">firmware-version: 16.32.1010 (MT_0000000080)</span></b></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">expansion-rom-version:</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">bus-info: 0000:81:00.0</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-statistics: yes</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-test: yes</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-eeprom-access: no</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-register-dump: no</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-priv-flags: yes</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">But when I moved to server B with another Connect x6 DX card, I could not see this capability.</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span class="x_xxcontentpasted7"><span style="font-size:12.0pt; color:black">testpmd> show port info all</span></span><span style="font-size:12.0pt; color:black"> </span></p> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> </div> <div> <p class="x_xmsonormal" style="background:white"><span class="x_xxcontentpasted7"><span style="font-size:12.0pt; color:black">Device capabilities: 0x14(</span></span><span class="x_xxcontentpasted10"><span style="font-size:12.0pt; color:black"> </span></span><span class="x_xxcontentpasted7"><span style="font-size:12.0pt; color:black">FLOW_SHARED_OBJECT_KEEP )</span></span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">Server B Settings:</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"># ofed_info -s</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><b><span style="font-size:12.0pt; color:black">MLNX_OFED_LINUX-5.4-3.5.8.0:</span></b></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"># ethtool -i enp132s0f0</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">driver: mlx5_core</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">version: 5.4-3.5.8</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><b><span style="font-size:12.0pt; color:black">firmware-version: 22.31.1014 (MT_0000000436)</span></b></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">expansion-rom-version:</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">bus-info: 0000:84:00.0</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-statistics: yes</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-test: yes</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-eeprom-access: no</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-register-dump: no</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">supports-priv-flags: yes</span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><b><span style="font-size:12.0pt; color:black">Although server B has higher versions of OFED and firmware, my question is do I need to enable/disable firmware settings? Or are there any other configurations we need to apply?</span></b></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p> </div> <div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">Regards,</span></p> </div> <p class="x_xmsonormal" style="background:white"><span style="font-size:12.0pt; color:black">Haider</span></p> </div> </div> </div> </div> </div> </div> </div> </div> </body> </html>