<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.m8122859493856938627msolistparagraph, li.m8122859493856938627msolistparagraph, div.m8122859493856938627msolistparagraph
{mso-style-name:m_8122859493856938627msolistparagraph;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:946471210;
mso-list-template-ids:-923631914;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;
mso-ansi-font-size:10.0pt;
font-family:Wingdings;}
@list l1
{mso-list-id:1175068615;
mso-list-template-ids:-2143788320;}
@list l1:level1
{mso-level-start-at:2;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2
{mso-list-id:1382556516;
mso-list-template-ids:-234462922;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">IMO, it varies from platform to platform. Adding Kai Ji for details on QAT.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">However, you can use as many VFs as you want. Generally, we use 1VF per core.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Do you plan to include other platforms as well?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">How about openssl PMD?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Andrew Bailey <abailey@iol.unh.edu>
<br>
<b>Sent:</b> Wednesday, January 21, 2026 9:57 PM<br>
<b>To:</b> Akhil Goyal <gakhil@marvell.com><br>
<b>Cc:</b> Patrick Robb <probb@iol.unh.edu>; fanzhang.oss@gmail.com; luca.vizzarro@arm.com; dmarx@iol.unh.edu; dev@dpdk.org<br>
<b>Subject:</b> Re: [EXTERNAL] Re: [RFC PATCH 3/3] dts: add cryptodev testsuite<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">have a few more questions for you regarding testing cryptodev. As a reminder, we're developing a test suite to detect performance or functional regressions in cryptodev,
using the dpdk-test-crypto-perf application with Throughput, Latency,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerStart<o:p></o:p></span></p>
</div>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;border-radius:4px">
<tbody>
<tr>
<td style="padding:0in 0in 7.5pt 0in">
<table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;background:#D2D0D0;border:none;border-top:solid #8D8C8C 3.0pt">
<tbody>
<tr>
<td valign="top" style="border:none;padding:0in 6.0pt 4.5pt 6.0pt">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="left">
<tbody>
<tr>
<td style="padding:0in 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal" style="line-height:15.0pt"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Prioritize security for external emails:
<o:p></o:p></span></b></p>
</td>
</tr>
<tr>
<td style="padding:0in 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal" style="line-height:12.0pt"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">Confirm sender and content safety before clicking links or opening attachments
<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="right">
<tbody>
<tr>
<td style="padding:0in 0in 3.0pt 0in">
<p class="MsoNormal" style="line-height:27.0pt"><span style="font-size:10.5pt"> <a href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/CRVmXkqW!uK3X-9Eb4hoauMV9EzXzTis813o0RIZqUEPdy9lsu2a7UusF9ZitMxmorqa-v2d3QcZ2mvqb8d1cVEIgIEXxH0zaLC9PUtWvU6Br3tNjRVRhEmxF3rRTk9zVNhM$" target="_blank"><strong><span style="font-family:"Arial",sans-serif;color:black;border:solid #666666 1.0pt;padding:5.0pt;font-weight:normal;text-decoration:none"> Report Suspicious </span></strong></a>
<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerEnd<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> have a few more questions for you regarding testing cryptodev. As a reminder, we're developing a test suite to detect performance or functional regressions in cryptodev, using the dpdk-test-crypto-perf application
with Throughput, Latency, and Verify ptest options. Right now we are testing with an Intel QAT 8970. It has 3 physical functions, and DTS automatically creates 16 VFs on each PF when the testrun starts. I have some questions regarding which VFs to use and
how many to use when checking for regressions:<o:p></o:p></p>
<ul type="disc">
<li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1">
Is it appropriate to specify only a single virtual function in the allowed ports list for our test suite?<o:p></o:p></li><li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1">
Under what circumstances should we allow multiple virtual functions?<o:p></o:p></li><li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1">
When allowing multiple virtual functions, should we include one from each physical function?<o:p></o:p></li></ul>
<p class="MsoNormal"><br>
Thank you for your guidance.<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, Jan 12, 2026 at 2:20<span style="font-family:"Arial",sans-serif"> </span>PM Akhil Goyal <<a href="mailto:gakhil@marvell.com">gakhil@marvell.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt">Hi Andrew,</span><o:p></o:p></p>
<ol start="1" type="1">
<li class="m8122859493856938627msolistparagraph" style="mso-list:l2 level1 lfo2">
Which metrics in the attached table below are relevant for checking for performance regressions in throughput testing? MOps? Gbps?<o:p></o:p></li></ol>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt">Mops and Gbps both are calculation based(Mops * packet_size = Gbps). You can use anyone of them.</span><o:p></o:p></p>
<ol start="2" type="1">
<li class="m8122859493856938627msolistparagraph" style="mso-list:l1 level1 lfo3">
What would be an acceptable throughput deviation between runs, and what percentage deviation should be considered a failure? For instance, right now I am thinking that if the test returns a Gbps reduction of 2% or greater from the given baseline, that will
trigger a failure.<o:p></o:p></li></ol>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt">IMO, 5% should be good enough.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt">Regards,</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt">Akhil</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Andrew Bailey <<a href="mailto:abailey@iol.unh.edu" target="_blank">abailey@iol.unh.edu</a>>
<br>
<b>Sent:</b> Monday, January 12, 2026 11:28 PM<br>
<b>To:</b> Patrick Robb <<a href="mailto:probb@iol.unh.edu" target="_blank">probb@iol.unh.edu</a>>; Akhil Goyal <<a href="mailto:gakhil@marvell.com" target="_blank">gakhil@marvell.com</a>>;
<a href="mailto:fanzhang.oss@gmail.com" target="_blank">fanzhang.oss@gmail.com</a><br>
<b>Cc:</b> <a href="mailto:luca.vizzarro@arm.com" target="_blank">luca.vizzarro@arm.com</a>;
<a href="mailto:dmarx@iol.unh.edu" target="_blank">dmarx@iol.unh.edu</a>; <a href="mailto:dev@dpdk.org" target="_blank">
dev@dpdk.org</a><br>
<b>Subject:</b> [EXTERNAL] Re: [RFC PATCH 3/3] dts: add cryptodev testsuite</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:1.0pt;color:white">Hello, I am Andrew, a software test developer at UNH-IOL working on the DPDK Test Suite (DTS) component in DPDK. We're adding crypto device
tests (both functional and performance) to DTS using the dpdk-test-crypto-perf application. These</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerStart</span><o:p></o:p></p>
</div>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;border-radius:4px">
<tbody>
<tr>
<td style="padding:0in 0in 7.5pt 0in">
<table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;background:#D2D0D0;border:none;border-top:solid #8D8C8C 3.0pt">
<tbody>
<tr>
<td valign="top" style="border:none;padding:0in 6.0pt 4.5pt 6.0pt">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="left">
<tbody>
<tr>
<td style="padding:0in 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:15.0pt">
<b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Prioritize security for external emails:
</span></b><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0in 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:12.0pt">
<span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">Confirm sender and content safety before clicking links or opening attachments
</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="right">
<tbody>
<tr>
<td style="padding:0in 0in 3.0pt 0in">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:27.0pt">
<span style="font-size:10.5pt"> <a href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/CRVmXkqW!uK3X-9Eb4hoauMMx8776juphaxuhWSpVPz0jRFbXZsENdFzDoFkHkisIFSRgpqYCKAsvJZ0J93ubWr88-ERDphsvU_UUPsR6-5g8RuDP-gdOzh7iwbOo1NwbQlg$" target="_blank"><strong><span style="font-family:"Arial",sans-serif;color:black;border:solid #666666 1.0pt;padding:5.0pt;font-weight:normal;text-decoration:none"> Report Suspicious </span></strong></a>
</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerEnd</span><o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hello,<br>
<br>
I am Andrew, a software test developer at UNH-IOL working on the DPDK Test Suite (DTS) component in DPDK. We're adding crypto device tests (both functional and performance) to DTS using the dpdk-test-crypto-perf application. These are tests which can be run
on real hardware, I.e. We have an Intel 8970 crypto card at the lab we are using for testing. I'm currently developing a performance test suite using option "--ptest throughput" that will fail tests when metrics deviate by n% from a baseline. I would like
to get your feedback regarding how I can correctly check for performance regressions in the test cases by using dpdk-crypto-perf.<br>
<br>
1. Which metrics in the attached table below are relevant for checking for performance regressions in throughput testing? MOps? Gbps?<br>
2. What would be an acceptable throughput deviation between runs, and what percentage deviation should be considered a failure? For instance, right now I am thinking that if the test returns a Gbps reduction of 2% or greater from the given baseline, that will
trigger a failure.<br>
<br>
<img border="0" width="562" height="179" style="width:5.8583in;height:1.8666in" id="m_8122859493856938627Picture_x0020_1" src="cid:image001.png@01DC8B3A.FC2EC5C0"><br>
Any guidance you can provide would be greatly appreciated.<br>
Best regards,<br>
Andrew<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</body>
</html>