[PATCH v4 08/12] app/mldev: enable support for queue pairs and size
Anup Prabhu
aprabhu at marvell.com
Thu Mar 2 09:15:13 CET 2023
> -----Original Message-----
> From: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Sent: Tuesday, February 7, 2023 9:20 PM
> To: Srikanth Yalavarthi <syalavarthi at marvell.com>
> Cc: dev at dpdk.org; Shivah Shankar Shankar Narayan Rao
> <sshankarnara at marvell.com>; Jerin Jacob Kollanukkaran
> <jerinj at marvell.com>; Anup Prabhu <aprabhu at marvell.com>; Prince Takkar
> <ptakkar at marvell.com>; Parijat Shukla <pshukla at marvell.com>
> Subject: [PATCH v4 08/12] app/mldev: enable support for queue pairs and
> size
>
> Added support to create multiple queue-pairs per device to enqueue and
> dequeue inference requests. Number of queue pairs to be created can be
> specified through "--queue_pairs" option.
> Support is also enabled to control the number of descriptors per each queue
> pair through "--queue_size" option. Inference requests for a model are
> distributed across all available queue-pairs.
>
> Signed-off-by: Srikanth Yalavarthi <syalavarthi at marvell.com>
> ---
> app/test-mldev/ml_options.c | 40 ++++++++++---
> app/test-mldev/ml_options.h | 4 ++
> app/test-mldev/test_common.c | 2 +-
> app/test-mldev/test_inference_common.c | 79
> +++++++++++++++++++++----- app/test-mldev/test_inference_common.h
> | 1 +
> 5 files changed, 102 insertions(+), 24 deletions(-)
>
Acked-by: Anup Prabhu <aprabhu at marvell.com>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: winmail.dat
Type: application/ms-tnef
Size: 23116 bytes
Desc: not available
URL: <http://mails.dpdk.org/archives/dev/attachments/20230302/4044a46b/attachment-0001.bin>
More information about the dev
mailing list