[PATCH v4 09/12] app/mldev: enable support for inference batches

Anup Prabhu aprabhu at marvell.com
Mon Feb 27 04:46:46 CET 2023



> -----Original Message-----
> From: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Sent: Tuesday, February 7, 2023 9:20 PM
> To: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Cc: dev at dpdk.org; Shivah Shankar Shankar Narayan Rao
> <sshankarnara at marvell.com>; Jerin Jacob Kollanukkaran
> <jerinj at marvell.com>; Anup Prabhu <aprabhu at marvell.com>; Prince Takkar
> <ptakkar at marvell.com>; Parijat Shukla <pshukla at marvell.com>
> Subject: [PATCH v4 09/12] app/mldev: enable support for inference batches
> 
> Enabled support to execute multiple batches of inferences per each
> enqueue request. Input and reference for the test should be appropriately
> provided for multi-batch run. Number of batches can be specified through "--
> batches" option.
> 
> Signed-off-by: Srikanth Yalavarthi <syalavarthi at marvell.com>
> ---
>  app/test-mldev/ml_options.c            | 15 ++++++++++++---
>  app/test-mldev/ml_options.h            |  2 ++
>  app/test-mldev/test_inference_common.c | 22 +++++++++++++---------
>  app/test-mldev/test_model_common.c     |  6 ++++++
>  app/test-mldev/test_model_common.h     |  1 +
>  5 files changed, 34 insertions(+), 12 deletions(-)
> 
Acked-by: Anup Prabhu <aprabhu at marvell.com>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: winmail.dat
Type: application/ms-tnef
Size: 23113 bytes
Desc: not available
URL: <http://mails.dpdk.org/archives/dev/attachments/20230227/4d865e65/attachment-0001.bin>


More information about the dev mailing list