[PATCH v4 06/12] app/mldev: add test case to interleave inferences

Anup Prabhu aprabhu at marvell.com
Mon Feb 20 07:31:42 CET 2023



> -----Original Message-----
> From: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Sent: Tuesday, February 7, 2023 9:20 PM
> To: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Cc: dev at dpdk.org; Shivah Shankar Shankar Narayan Rao
> <sshankarnara at marvell.com>; Jerin Jacob Kollanukkaran
> <jerinj at marvell.com>; Anup Prabhu <aprabhu at marvell.com>; Prince Takkar
> <ptakkar at marvell.com>; Parijat Shukla <pshukla at marvell.com>
> Subject: [PATCH v4 06/12] app/mldev: add test case to interleave inferences
> 
> Added test case to interleave inference requests from multiple models.
> Interleaving would load and start all models and launch inference requests
> for the models using available queue-pairs
> 
> Operations sequence when testing with N models and R reps,
> 
> (load + start) x N -> (enqueue + dequeue) x N x R ...
> 	-> (stop + unload) x N
> 
> Test can be executed by selecting "inference_interleave" test.
> 
> Signed-off-by: Srikanth Yalavarthi <syalavarthi at marvell.com>
> ---
>  app/test-mldev/meson.build                 |   1 +
>  app/test-mldev/ml_options.c                |   3 +-
>  app/test-mldev/test_inference_common.c     |  12 +--
>  app/test-mldev/test_inference_interleave.c | 118
> +++++++++++++++++++++
>  4 files changed, 127 insertions(+), 7 deletions(-)  create mode 100644
> 
Acked-by: Anup Prabhu <aprabhu at marvell.com>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: winmail.dat
Type: application/ms-tnef
Size: 23187 bytes
Desc: not available
URL: <http://mails.dpdk.org/archives/dev/attachments/20230220/5d17fac8/attachment-0001.bin>


More information about the dev mailing list