<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:black;
font-weight:normal;
font-style:normal;
text-decoration:none none;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="FR-BE" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="color:black">Hello,<br>
<br>
I’m trying to use the TX scheduling feature on a ConnectX-6Dx with latest firmware and 21.11 version of DPDK.
<br>
But I see some strange behavior.<br>
<br>
When I advise the nic with the timestamp in the dynamic mbuf field the packet go out way too early.<br>
<br>
Time I want : 1662385925567940000<br>
Received time : 1662385925469600500<br>
<br>
The time I want is 100ms in the future of when calling rte_tx_burst.<br>
<br>
When looking at the xstats I see no packet in the past no packets in a too long future. But as shown below I see tx_pp_sync_lost, tx_pp_missed_interrupt_errors, tx_pp_rearm_queue_errors<br>
<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">Which seems to be a bad behavior.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black"><br>
tx_good_packets:83160<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_good_bytes:528950026<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_q0_packets:83160<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_q0_bytes:528950026<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">rx_multicast_packets:64<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">rx_multicast_bytes:6318<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_multicast_packets:66772<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_multicast_bytes:94358324<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_phy_packets:66750<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">rx_phy_packets:64<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_phy_bytes:94595646<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">rx_phy_bytes:6318<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_pp_missed_interrupt_errors:2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_pp_rearm_queue_errors:2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_pp_jitter:40<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">tx_pp_sync_lost:1<br>
<br>
For information my tx_pp is set to 500. My NIC is locked on PTP with ptp4l and phc2sys is used to synchronize the system clock<br>
<br>
Another strange thing is that the data rate and the pacing seams ok but every packets are too early but constant.<br>
<br>
Sometimes I also see the tx_pp_wander going really high at the start of the transition ( more than 30000000).<br>
<br>
I tried with testpmd and I see no error so it’s seams the problem is something I do that cause the issue.<br>
<br>
My question is what could cause the errors I see in the xstats, I think it’s the key to my problem.<br>
<br>
Could you also explain a bit what those tx_pp xstats represent because even when looking at the source code it doesn’t seems clear.<br>
<br>
Thank you in advance for your help.<br>
<br>
Regards,<br>
<br>
Antoine Pollenus<br>
<br>
<br>
<br>
<o:p></o:p></span></p>
</div>
</body>
</html>