[PATCH v4 06/12] app/mldev: add test case to interleave inferences
Anup Prabhu
aprabhu at marvell.com
Mon Feb 20 07:31:42 CET 2023
> -----Original Message-----
> From: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Sent: Tuesday, February 7, 2023 9:20 PM
> To: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Cc: dev at dpdk.org; Shivah Shankar Shankar Narayan Rao
> <sshankarnara at marvell.com>; Jerin Jacob Kollanukkaran
> <jerinj at marvell.com>; Anup Prabhu <aprabhu at marvell.com>; Prince Takkar
> <ptakkar at marvell.com>; Parijat Shukla <pshukla at marvell.com>
> Subject: [PATCH v4 06/12] app/mldev: add test case to interleave inferences
>
> Added test case to interleave inference requests from multiple models.
> Interleaving would load and start all models and launch inference requests
> for the models using available queue-pairs
>
> Operations sequence when testing with N models and R reps,
>
> (load + start) x N -> (enqueue + dequeue) x N x R ...
> -> (stop + unload) x N
>
> Test can be executed by selecting "inference_interleave" test.
>
> Signed-off-by: Srikanth Yalavarthi <syalavarthi at marvell.com>
> ---
> app/test-mldev/meson.build | 1 +
> app/test-mldev/ml_options.c | 3 +-
> app/test-mldev/test_inference_common.c | 12 +--
> app/test-mldev/test_inference_interleave.c | 118
> +++++++++++++++++++++
> 4 files changed, 127 insertions(+), 7 deletions(-) create mode 100644
>
Acked-by: Anup Prabhu <aprabhu at marvell.com>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: winmail.dat
Type: application/ms-tnef
Size: 23187 bytes
Desc: not available
URL: <http://mails.dpdk.org/archives/dev/attachments/20230220/5d17fac8/attachment-0001.bin>
More information about the dev
mailing list