<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"MS Gothic";
panose-1:2 11 6 9 7 2 5 8 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:DengXian;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@DengXian";
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"\@SimSun";
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Microsoft JhengHei";
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"\@Microsoft JhengHei";}
@font-face
{font-family:"\@MS Gothic";
panose-1:2 11 6 9 7 2 5 8 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
text-align:justify;
font-size:10.5pt;
font-family:DengXian;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72" style="word-wrap:break-word;text-justify-trim:punctuation">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hi Xing Wang,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Can you submit this code as RFC, it will enable us to provide review comments?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Honnappa<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" align="left" style="text-align:left"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">
</span><span style="font-size:11.0pt;font-family:"MS Gothic"">王星</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> <xing_wang@realsil.com.cn>
<br>
<b>Sent:</b> Thursday, August 25, 2022 9:36 PM<br>
<b>To:</b> Honnappa Nagarahalli <Honnappa.Nagarahalli@arm.com>; dev@dpdk.org<br>
<b>Cc:</b> </span><span style="font-size:11.0pt;font-family:"Microsoft JhengHei",sans-serif">陈立</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> <dali_chen@realsil.com.cn>;
</span><span style="font-size:11.0pt;font-family:"MS Gothic"">王</span><span style="font-size:11.0pt;font-family:"Microsoft JhengHei",sans-serif">颢</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> <howard_wang@realsil.com.cn>; Ruifeng Wang
<Ruifeng.Wang@arm.com>; nd <nd@arm.com>; nd <nd@arm.com>; Hau <hau@realtek.com><br>
<b>Subject:</b> </span><span style="font-size:11.0pt;font-family:"MS Gothic"">答复</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">: about RTL8168 PMD on ARM SoC<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" align="left" style="text-align:left"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">Hi Honnappa,
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">I<span lang="ZH-CN">’</span>m sorry I have to make a little correction,
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">This issue was actually on our new 2.5 Gigabit RTL8125 series, the attachment is latest r8125pmd,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">There is no essential difference w.r.t ARM platform though.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">BRs,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">Xing Wang<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" align="left" style="text-align:left"><b><span lang="ZH-CN" style="font-size:11.0pt;mso-fareast-language:ZH-CN">发件人</span></b><b><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">:</span></b><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">
<span lang="ZH-CN">王星</span> <br>
<b><span lang="ZH-CN">发送时间</span>:</b> 2022<span lang="ZH-CN">年</span>8<span lang="ZH-CN">月</span>26<span lang="ZH-CN">日</span> 10:06<br>
<b><span lang="ZH-CN">收件人</span>:</b> 'Honnappa Nagarahalli' <<a href="mailto:Honnappa.Nagarahalli@arm.com">Honnappa.Nagarahalli@arm.com</a>>;
<a href="mailto:dev@dpdk.org">dev@dpdk.org</a><br>
<b><span lang="ZH-CN">抄送</span>:</b> <span lang="ZH-CN">陈立</span> <<a href="mailto:dali_chen@realsil.com.cn">dali_chen@realsil.com.cn</a>>;
<span lang="ZH-CN">王颢</span> <<a href="mailto:howard_wang@realsil.com.cn">howard_wang@realsil.com.cn</a>>; Ruifeng Wang <<a href="mailto:Ruifeng.Wang@arm.com">Ruifeng.Wang@arm.com</a>>; nd <<a href="mailto:nd@arm.com">nd@arm.com</a>>; nd <<a href="mailto:nd@arm.com">nd@arm.com</a>>;
Hau <<a href="mailto:hau@realtek.com">hau@realtek.com</a>><br>
<b><span lang="ZH-CN">主题</span>:</b> <span lang="ZH-CN">答复</span>: about RTL8168 PMD on ARM SoC<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" align="left" style="text-align:left"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">Hi Honnappa,</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">The attachment is our current r8168pmd code for RTL8111/8168 Giga series
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">(currently 8111G, 8111H are supported, we will add others later)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">I will contact the SoC vendor to consult you about this issue and let you know some details about that SoC<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">Thanks a lot!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">BRs<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:ZH-CN">Xing Wang<o:p></o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" align="left" style="text-align:left"><b><span lang="ZH-CN" style="font-size:11.0pt;mso-fareast-language:ZH-CN">发件人</span></b><b><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">:</span></b><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">
Honnappa Nagarahalli [<a href="mailto:Honnappa.Nagarahalli@arm.com">mailto:Honnappa.Nagarahalli@arm.com</a>]
<br>
<b><span lang="ZH-CN">发送时间</span>:</b> 2022<span lang="ZH-CN">年</span>8<span lang="ZH-CN">月</span>25<span lang="ZH-CN">日</span> 22:41<br>
<b><span lang="ZH-CN">收件人</span>:</b> <span lang="ZH-CN">王星</span> <<a href="mailto:xing_wang@realsil.com.cn">xing_wang@realsil.com.cn</a>>;
<a href="mailto:dev@dpdk.org">dev@dpdk.org</a><br>
<b><span lang="ZH-CN">抄送</span>:</b> <span lang="ZH-CN">陈立</span> <<a href="mailto:dali_chen@realsil.com.cn">dali_chen@realsil.com.cn</a>>;
<span lang="ZH-CN">王颢</span> <<a href="mailto:howard_wang@realsil.com.cn">howard_wang@realsil.com.cn</a>>; Ruifeng Wang <<a href="mailto:Ruifeng.Wang@arm.com">Ruifeng.Wang@arm.com</a>>; nd <<a href="mailto:nd@arm.com">nd@arm.com</a>>; nd <<a href="mailto:nd@arm.com">nd@arm.com</a>><br>
<b><span lang="ZH-CN">主题</span>:</b> RE: about RTL8168 PMD on ARM SoC<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" align="left" style="text-align:left"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hello,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> I cannot find many details of the SoC on the internet. Does it use coherent IO? Depending on that, different barriers might be needed. Other than this, I would
not think it needs anything special.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">If you could send an RFC to the DPDK mailing list, I am happy to review and provide any feedback.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Honnappa<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" align="left" style="text-align:left"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN">
</span><span lang="ZH-CN" style="font-size:11.0pt;font-family:SimSun;mso-fareast-language:ZH-CN">王星</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN"> <</span><span style="mso-fareast-language:ZH-CN"><a href="mailto:xing_wang@realsil.com.cn"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">xing_wang@realsil.com.cn</span></a></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN">>
<br>
<b>Sent:</b> Wednesday, August 24, 2022 9:53 PM<br>
<b>To:</b> </span><span style="mso-fareast-language:ZH-CN"><a href="mailto:dev@dpdk.org"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">dev@dpdk.org</span></a></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN"><br>
<b>Cc:</b> </span><span lang="ZH-CN" style="font-size:11.0pt;font-family:SimSun;mso-fareast-language:ZH-CN">陈立</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN"> <</span><span style="mso-fareast-language:ZH-CN"><a href="mailto:dali_chen@realsil.com.cn"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">dali_chen@realsil.com.cn</span></a></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN">>;
</span><span lang="ZH-CN" style="font-size:11.0pt;font-family:SimSun;mso-fareast-language:ZH-CN">王颢</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN"> <</span><span style="mso-fareast-language:ZH-CN"><a href="mailto:howard_wang@realsil.com.cn"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">howard_wang@realsil.com.cn</span></a></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:ZH-CN">><br>
<b>Subject:</b> about RTL8168 PMD on ARM SoC<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" align="left" style="text-align:left"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">Hi DPDK,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">I am a pmd driver developer from Realtek NIC department,
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">when I was porting r8168pmd already verified on x86 to an ARM64 SoC Unisoc: UIS8650<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">I found that after NIC Rx init (in general, Rx ring and buffers should have been prepared for NIC to DMA read),
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">the NIC status reg showed RDU (Rx Descriptor Unavailable), which means NIC cannot read the proper desc content,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">later I sended some packets to NIC hold by testpmd rx_only mode, HW internal Rx packet counter can grow to some value, then stuck, 8168pmd Rx debug print reported it received less packets than that
value, and the print showed up even some minutes later!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">I doubt the phenomenon is caused by improper HW-based IO coherency support on this ARM SoC,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">I have read the ARM SoC support list on DPDK website, to name it: NV Bluefield, NXP DPAA, Marvell Octeon TX
<span lang="ZH-CN">…</span><o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">Does DPDK (or UIO/VFIO driver or hugetlb driver) need special HW IO cache coherency support on ARM platform, say, ACE and Device side MMU etc?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">Should the SoC provide specialized UIO/VFIO driver or hugetlb driver and/or specific DPDK lib to support such user mode DMA?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">Will you please give<span style="color:#1F497D">
</span>suggestions, thanks a lot!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:ZH-CN">BRs<o:p></o:p></span></p>
</div>
<p><span style="mso-fareast-language:ZH-CN"><br>
------Please consider the environment before printing this e-mail.<o:p></o:p></span></p>
</div>
</div>
</body>
</html>