<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word"> <div class="WordSection1"> <p class="MsoNormal">sure, I prefer to use a float too.<o:p></o:p></p> <p class="MsoNormal"><o:p> </o:p></p> <div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt"> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> <p class="MsoNormal"><b>From:</b> Owen Hilyard <ohilyard@iol.unh.edu> <br> <b>Sent:</b> 2021<span lang="ZH-CN" style="font-family:"Microsoft YaHei",sans-serif">年</span>3<span lang="ZH-CN" style="font-family:"Microsoft YaHei",sans-serif">月</span>24<span lang="ZH-CN" style="font-family:"Microsoft YaHei",sans-serif">日</span> 1:24<br> <b>To:</b> Tu, Lijuan <lijuan.tu@intel.com><br> <b>Cc:</b> David Liu <dliu@iol.unh.edu>; Ali Alnubani <alialnu@nvidia.com>; dts@dpdk.org; dpdklab@iol.unh.edu<br> <b>Subject:</b> Re: [dpdklab] Re: [dts] [PATCH] tests/nic_single_core_perf: modify accepted_tolerance to percentage<o:p></o:p></p> </div> </div> <p class="MsoNormal"><o:p> </o:p></p> <div> <p class="MsoNormal">Hello Lijuan,<o:p></o:p></p> <div> <p class="MsoNormal"><o:p> </o:p></p> </div> <div> <p class="MsoNormal">Would it be possible to have the delta be a float in the json representation? For example, a 20% delta would be encoded as "delta": .2 in json. Currently, most of the community lab's infrastructure expects to make pass/fail determinations on a numeric type, so having the delta as a float would reduce the required downtime to change everything over to percentages since we shouldn't need to patch all of our services to expect a string. <o:p></o:p></p> <p class="MsoNormal"><o:p> </o:p></p> </div> <div> <p class="MsoNormal"><o:p> </o:p></p> </div> <div> <p class="MsoNormal">Thanks,<o:p></o:p></p> </div> <div> <p class="MsoNormal">Owen Hilyard<o:p></o:p></p> </div> </div> <p class="MsoNormal"><o:p> </o:p></p> <div> <div> <p class="MsoNormal">On Tue, Mar 23, 2021 at 10:53 AM David Liu <<a href="mailto:dliu@iol.unh.edu">dliu@iol.unh.edu</a>> wrote:<o:p></o:p></p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <p class="MsoNormal">Thank you for Ali and Lijuan.<br> <br> We had tested the patch on the Arm machines setup. Other than the value issues, the test is running as expected.<o:p></o:p></p> </div> <p class="MsoNormal"><o:p> </o:p></p> <div> <div> <p class="MsoNormal">On Tue, Mar 23, 2021 at 4:48 AM Tu, Lijuan <<a href="mailto:lijuan.tu@intel.com" target="_blank">lijuan.tu@intel.com</a>> wrote:<o:p></o:p></p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <p class="MsoNormal"><br> <br> > -----Original Message-----<br> > From: Ali Alnubani <<a href="mailto:alialnu@nvidia.com" target="_blank">alialnu@nvidia.com</a>><br> > Sent: 2021<span lang="ZH-CN" style="font-family:DengXian">年</span>3<span lang="ZH-CN" style="font-family:DengXian">月</span>23<span lang="ZH-CN" style="font-family:DengXian">日</span> 16:44<br> > To: Tu, Lijuan <<a href="mailto:lijuan.tu@intel.com" target="_blank">lijuan.tu@intel.com</a>><br> > Cc: <a href="mailto:dts@dpdk.org" target="_blank">dts@dpdk.org</a>; <a href="mailto:dpdklab@iol.unh.edu" target="_blank"> dpdklab@iol.unh.edu</a><br> > Subject: RE: [dts] [PATCH] tests/nic_single_core_perf: modify<br> > accepted_tolerance to percentage<br> > <br> > > -----Original Message-----<br> > > From: dts <<a href="mailto:dts-bounces@dpdk.org" target="_blank">dts-bounces@dpdk.org</a>> On Behalf Of Lijuan Tu<br> > > Sent: Thursday, March 11, 2021 12:48 PM<br> > > To: <a href="mailto:dpdklab@iol.unh.edu" target="_blank">dpdklab@iol.unh.edu</a><br> > > Cc: <a href="mailto:dts@dpdk.org" target="_blank">dts@dpdk.org</a>; Lijuan Tu <<a href="mailto:lijuan.tu@intel.com" target="_blank">lijuan.tu@intel.com</a>><br> > > Subject: [dts] [PATCH] tests/nic_single_core_perf: modify<br> > > accepted_tolerance to percentage<br> > ><br> > > * accepted_tolerance in conf/nic_single_core_perf.cfg are changed to<br> > > percentage, e.g.<br> > > accepted_tolerance = '1%%'<br> > > if not set, it will be set to 2% by default.<br> > > * delat in json are chagned to percentage too, e.g.<br> > > 'delta': '1.5%'<br> > > * expected_throughput will be forced to 1Mpps for compute delat in<br> > > percentage<br> > > * add new conf test_interval in conf/nic_single_core_perf.cfg, which<br> > > indicates interval of getting throughput statistics in second, e.g.<br> > > test_interval = 10<br> > > if not set, it will be set to 5 seconds by default.<br> > > * collect better statistics , get multiple throughput statistics<br> > > during the test run, and compute the average as the final results.<br> > ><br> > > Signed-off-by: Lijuan Tu <<a href="mailto:lijuan.tu@intel.com" target="_blank">lijuan.tu@intel.com</a>><br> > > ---<br> > <snipped><br> > > +accepted_tolerance = '1%%'<br> > <snipped><br> > > + diff =<br> > > + (self.throughput[fwd_config][frame_size][nb_desc] -<br> > > +<br> > > self.expected_throughput[fwd_config][frame_size][nb_desc])/ \<br> > > +<br> > > self.expected_throughput[fwd_config][frame_size][nb_desc]<br> > <br> > The value of `diff` here is still a decimal, and needs to be multiplied by a 100<br> > before it can be compared to `accepted_tolerance`.<br> > <br> > I suggest splitting this patch into multiple ones. One for making the percentage<br> > change and one for taking the mean for multiple readings since they are<br> > unrelated changes.<br> > I also see other unrelated changes not explained in the commit message.<br> <br> Really appreciate for your review, I will accept your advices.<br> <br> > <br> > Thanks,<br> > Ali<o:p></o:p></p> </blockquote> </div> </blockquote> </div> </div> </div> </body> </html>