[RFC PATCH 3/3] dts: add cryptodev testsuite

[Andrew Bailey]

Hello,

I am Andrew, a software test developer at UNH-IOL working on the DPDK Test
Suite (DTS) component in DPDK. We're adding crypto device tests (both
functional and performance) to DTS using the dpdk-test-crypto-perf
application. These are tests which can be run on real hardware, I.e. We
have an Intel 8970 crypto card at the lab we are using for testing. I'm
currently developing a performance test suite using option "--ptest
throughput" that will fail tests when metrics deviate by n% from a
baseline. I would like to get your feedback regarding how I can correctly
check for performance regressions in the test cases by using
dpdk-crypto-perf.

1. Which metrics in the attached table below are relevant for checking for
performance regressions in throughput testing? MOps? Gbps?
2. What would be an acceptable throughput deviation between runs, and what
percentage deviation should be considered a failure? For instance, right
now I am thinking that if the test returns a Gbps reduction of 2% or
greater from the given baseline, that will trigger a failure.

[image: Screenshot From 2026-01-12 11-49-16.png]
Any guidance you can provide would be greatly appreciated.
Best regards,
Andrew
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mails.dpdk.org/archives/dev/attachments/20260112/c2241740/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screenshot From 2026-01-12 11-49-16.png
Type: image/png
Size: 122934 bytes
Desc: not available
URL: <http://mails.dpdk.org/archives/dev/attachments/20260112/c2241740/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screenshot From 2026-01-12 11-49-16.png
Type: image/png
Size: 122934 bytes
Desc: not available
URL: <http://mails.dpdk.org/archives/dev/attachments/20260112/c2241740/attachment-0003.png>