[dpdk-test-report] |FAILURE| pw89052-89055 [PATCH] [4/4] net: replace Windows networking shim

[dpdklab at iol.unh.edu]

Test-Label: iol-mellanox-Performance
Test-Status: FAILURE
http://dpdk.org/patch/89055

_Performance Testing issues_

Submitter: Dmitry Kozlyuk <dmitry.kozliuk at gmail.com>
Date: Saturday, March 13 2021 01:56:16 
DPDK git baseline: Repo:dpdk
  Branch: master
  CommitID:1e28e842e08428ff5716fbe909bf5acd0365aaf6

89052-89055 --> performance testing fail

Test environment and result as below:

Ubuntu 18.04
Kernel: 4.15.0-generic
Compiler: gcc 7.4
NIC: Mellanox ConnectX-5 100000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 0/6

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 256     | 0.28687%                            |
+------------+---------+-------------------------------------+
| 128        | 256     | 0.05359%                            |
+------------+---------+-------------------------------------+
| 256        | 256     | -0.47073%                           |
+------------+---------+-------------------------------------+
| 512        | 256     | -0.78256%                           |
+------------+---------+-------------------------------------+
| 1024       | 256     | -1.9281%                            |
+------------+---------+-------------------------------------+
| 1518       | 256     | 0.16529%                            |
+------------+---------+-------------------------------------+

Ubuntu 18.04
Kernel: 4.15.0-generic
Compiler: gcc 7.4
NIC: Mellanox ConnectX-4 Lx 25000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 0/6

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 256     | 0.0799%                             |
+------------+---------+-------------------------------------+
| 128        | 256     | 0.05187%                            |
+------------+---------+-------------------------------------+
| 256        | 256     | 0.98515%                            |
+------------+---------+-------------------------------------+
| 512        | 256     | 0.28329%                            |
+------------+---------+-------------------------------------+
| 1024       | 256     | -0.13382%                           |
+------------+---------+-------------------------------------+
| 1518       | 256     | -0.07387%                           |
+------------+---------+-------------------------------------+

Ubuntu 18.04 ARM
Kernel: 4.15.0-132-generic
Compiler: gcc 7.5
NIC: Arm Mellanox ConnectX-5 10000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 2/4

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 128     | -51.55956%                          |
+------------+---------+-------------------------------------+
| 64         | 256     | -51.55662%                          |
+------------+---------+-------------------------------------+
| 64         | 512     | -4.45519%                           |
+------------+---------+-------------------------------------+
| 64         | 2048    | -2.58603%                           |
+------------+---------+-------------------------------------+

Ubuntu 18.04
Kernel: 4.15.0-generic
Compiler: gcc 7.4
NIC: Mellanox ConnectX-4 Lx 40000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 0/6

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 256     | 0.04277%                            |
+------------+---------+-------------------------------------+
| 128        | 256     | 1.44355%                            |
+------------+---------+-------------------------------------+
| 256        | 256     | 0.13173%                            |
+------------+---------+-------------------------------------+
| 512        | 256     | 0.0533%                             |
+------------+---------+-------------------------------------+
| 1024       | 256     | 0.30322%                            |
+------------+---------+-------------------------------------+
| 1518       | 256     | 0.24653%                            |
+------------+---------+-------------------------------------+

To view detailed results, visit:
https://lab.dpdk.org/results/dashboard/patchsets/15923/

UNH-IOL DPDK Community Lab

To manage your email subscriptions, visit: 
https://lab.dpdk.org/results/dashboard/preferences/subscriptions/