<div dir="ltr"> have a few more questions for you regarding testing cryptodev. As a reminder, we're developing a test suite to detect performance or functional regressions in cryptodev, using the dpdk-test-crypto-perf application with Throughput, Latency, and Verify ptest options. Right now we are testing with an Intel QAT 8970. It has 3 physical functions, and DTS automatically creates 16 VFs on each PF when the testrun starts. I have some questions regarding which VFs to use and how many to use when checking for regressions:<br><br><span style="display:none"></span><ul><li>Is it appropriate to specify only a single virtual function in the allowed ports list for our test suite?<br><span style="display:none"></span></li><li>Under what circumstances should we allow multiple virtual functions?<br><span style="display:none"></span></li><li>When allowing multiple virtual functions, should we include one from each physical function?<br><span style="display:none"></span></li></ul><br>Thank you for your guidance.</div><br><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Mon, Jan 12, 2026 at 2:20 PM Akhil Goyal <<a href="mailto:gakhil@marvell.com">gakhil@marvell.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg8122859493856938627"> <div lang="EN-US" style="overflow-wrap: break-word;"> <div class="m_8122859493856938627WordSection1"> <p class="MsoNormal"><span style="font-size:11pt">Hi Andrew,<u></u><u></u></span></p> <ol style="margin-top:0in" start="1" type="1"> <li class="m_8122859493856938627MsoListParagraph" style="margin-left:0in">Which metrics in the attached table below are relevant for checking for performance regressions in throughput testing? MOps? Gbps?<u></u><u></u></li></ol> <p class="MsoNormal"><span style="font-size:11pt">Mops and Gbps both are calculation based(Mops * packet_size = Gbps). You can use anyone of them.<u></u><u></u></span></p> <ol style="margin-top:0in" start="2" type="1"> <li class="m_8122859493856938627MsoListParagraph" style="margin-left:0in"><span style="font-size:11pt"></span>What would be an acceptable throughput deviation between runs, and what percentage deviation should be considered a failure? For instance, right now I am thinking that if the test returns a Gbps reduction of 2% or greater from the given baseline, that will trigger a failure.<span style="font-size:11pt"><u></u><u></u></span></li></ol> <p class="MsoNormal"><span style="font-size:11pt">IMO, 5% should be good enough.<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:11pt"><u></u> <u></u></span></p> <p class="MsoNormal"><span style="font-size:11pt">Regards,<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:11pt">Akhil<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:11pt"><u></u> <u></u></span></p> <div style="border-top:none;border-right:none;border-bottom:none;border-left:1.5pt solid blue;padding:0in 0in 0in 4pt"> <div> <div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0in 0in"> <p class="MsoNormal"><b><span style="font-size:11pt;font-family:Calibri,sans-serif">From:</span></b><span style="font-size:11pt;font-family:Calibri,sans-serif"> Andrew Bailey <<a href="mailto:abailey@iol.unh.edu" target="_blank">abailey@iol.unh.edu</a>> <br> <b>Sent:</b> Monday, January 12, 2026 11:28 PM<br> <b>To:</b> Patrick Robb <<a href="mailto:probb@iol.unh.edu" target="_blank">probb@iol.unh.edu</a>>; Akhil Goyal <<a href="mailto:gakhil@marvell.com" target="_blank">gakhil@marvell.com</a>>; <a href="mailto:fanzhang.oss@gmail.com" target="_blank">fanzhang.oss@gmail.com</a><br> <b>Cc:</b> <a href="mailto:luca.vizzarro@arm.com" target="_blank">luca.vizzarro@arm.com</a>; <a href="mailto:dmarx@iol.unh.edu" target="_blank">dmarx@iol.unh.edu</a>; <a href="mailto:dev@dpdk.org" target="_blank">dev@dpdk.org</a><br> <b>Subject:</b> [EXTERNAL] Re: [RFC PATCH 3/3] dts: add cryptodev testsuite<u></u><u></u></span></p> </div> </div> <p class="MsoNormal"><u></u> <u></u></p> <div> <p class="MsoNormal"><span style="font-size:1pt;color:white">Hello, I am Andrew, a software test developer at UNH-IOL working on the DPDK Test Suite (DTS) component in DPDK. We're adding crypto device tests (both functional and performance) to DTS using the dpdk-test-crypto-perf application. These<u></u><u></u></span></p> </div> <div> <p class="MsoNormal"><span style="font-size:1pt;color:white">ZjQcmQRYFpfptBannerStart<u></u><u></u></span></p> </div> <table border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100%;border-radius:4px"> <tbody> <tr> <td style="padding:0in 0in 7.5pt"> <table border="1" cellspacing="0" cellpadding="0" width="100%" style="width:100%;background:rgb(210,208,208);border-right:none;border-bottom:none;border-left:none;border-top:3pt solid rgb(141,140,140)"> <tbody> <tr> <td valign="top" style="border:none;padding:0in 6pt 4.5pt"> <table border="0" cellspacing="0" cellpadding="0" align="left"> <tbody> <tr> <td style="padding:0in 6pt 3pt"> <p class="MsoNormal" style="line-height:15pt"><b><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:black">Prioritize security for external emails: <u></u><u></u></span></b></p> </td> </tr> <tr> <td style="padding:0in 6pt 3pt"> <p class="MsoNormal" style="line-height:12pt"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">Confirm sender and content safety before clicking links or opening attachments <u></u><u></u></span></p> </td> </tr> </tbody> </table> <table border="0" cellspacing="0" cellpadding="0" align="right"> <tbody> <tr> <td style="padding:0in 0in 3pt"> <p class="MsoNormal" style="line-height:27pt"><span style="font-size:10.5pt"> <a href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/CRVmXkqW!uK3X-9Eb4hoauMMx8776juphaxuhWSpVPz0jRFbXZsENdFzDoFkHkisIFSRgpqYCKAsvJZ0J93ubWr88-ERDphsvU_UUPsR6-5g8RuDP-gdOzh7iwbOo1NwbQlg$" target="_blank"><strong><span style="font-family:Arial,sans-serif;color:black;border:1pt solid rgb(102,102,102);padding:5pt;font-weight:normal;text-decoration:none"> Report Suspicious </span></strong></a> ‌ <u></u><u></u></span></p> </td> </tr> </tbody> </table> </td> </tr> </tbody> </table> </td> </tr> </tbody> </table> <div> <p class="MsoNormal"><span style="font-size:1pt;color:white">ZjQcmQRYFpfptBannerEnd<u></u><u></u></span></p> </div> <div> <div> <p class="MsoNormal">Hello,<br> <br> I am Andrew, a software test developer at UNH-IOL working on the DPDK Test Suite (DTS) component in DPDK. We're adding crypto device tests (both functional and performance) to DTS using the dpdk-test-crypto-perf application. These are tests which can be run on real hardware, I.e. We have an Intel 8970 crypto card at the lab we are using for testing. I'm currently developing a performance test suite using option "--ptest throughput" that will fail tests when metrics deviate by n% from a baseline. I would like to get your feedback regarding how I can correctly check for performance regressions in the test cases by using dpdk-crypto-perf.<br> <br> 1. Which metrics in the attached table below are relevant for checking for performance regressions in throughput testing? MOps? Gbps?<br> 2. What would be an acceptable throughput deviation between runs, and what percentage deviation should be considered a failure? For instance, right now I am thinking that if the test returns a Gbps reduction of 2% or greater from the given baseline, that will trigger a failure.<br> <br> <img border="0" width="562" height="179" style="width: 5.8583in; height: 1.8666in;" id="m_8122859493856938627Picture_x0020_1" src="cid:ii_19be16114714cff311"><br> Any guidance you can provide would be greatly appreciated.<br> Best regards,<br> Andrew<u></u><u></u></p> </div> </div> </div> </div> </div> </div></blockquote></div>