<div dir="ltr"><div class="gmail_default" style="font-size:small">Hi All,</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">I'm not sure if it will help, but this is an example of a failing case in the CI: <a href="https://lab.dpdk.org/results/dashboard/patchsets/20222/">https://lab.dpdk.org/results/dashboard/patchsets/20222/</a></div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">The test is running within a docker container. CI is set up to only allow one active unit test at a time, so the host might be running compile jobs, but not other unit tests. This ensures there isn't "competition" for resources like hugepages between two running unit test jobs. The host is actually a VM running on VMware vCenter, not a bare-metal host, the VM's sole purpose is running the docker jobs.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">The command to start the unit test run is pretty generic (script is below).</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">#!/bin/bash<br><br>####################################################<br># $1 argument: extra arguments to send to meson test<br>####################################################<br><br># Exit on first command failure<br>set -e<br><br># Extract dpdk.tar.gz<br>tar xzfm dpdk.tar.gz<br><br># Compile DPDK<br>cd dpdk<br>meson build --werror<br>ninja -C build install<br><br># Unit test<br>cd build<br>meson test --suite fast-tests -t 60 $1<br></div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">I think a starting point is to understand if the unit test expects or makes assumptions on the system / environment. If it has sole access to a CPU core, minimum number of hugepages, etc. If it would help, I can also give you the DockerFile to build the container (note the RHEL images have to be built on a licensed Redhat server, based on being able to install the required packages).</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">Cheers,<br>Lincoln</div><div class="gmail_default" style="font-size:small"><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Nov 19, 2021 at 11:54 AM Dumitrescu, Cristian <<a href="mailto:cristian.dumitrescu@intel.com">cristian.dumitrescu@intel.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
<br>
> -----Original Message-----<br>
> From: Thomas Monjalon <<a href="mailto:thomas@monjalon.net" target="_blank">thomas@monjalon.net</a>><br>
> Sent: Friday, November 19, 2021 7:26 AM<br>
> To: Dumitrescu, Cristian <<a href="mailto:cristian.dumitrescu@intel.com" target="_blank">cristian.dumitrescu@intel.com</a>>; David Marchand<br>
> <<a href="mailto:david.marchand@redhat.com" target="_blank">david.marchand@redhat.com</a>>; Lincoln Lavoie <<a href="mailto:lylavoie@iol.unh.edu" target="_blank">lylavoie@iol.unh.edu</a>>;<br>
> Ajmera, Megha <<a href="mailto:megha.ajmera@intel.com" target="_blank">megha.ajmera@intel.com</a>>; Singh, Jasvinder<br>
> <<a href="mailto:jasvinder.singh@intel.com" target="_blank">jasvinder.singh@intel.com</a>>; Liguzinski, WojciechX<br>
> <<a href="mailto:wojciechx.liguzinski@intel.com" target="_blank">wojciechx.liguzinski@intel.com</a>><br>
> Cc: dev <<a href="mailto:dev@dpdk.org" target="_blank">dev@dpdk.org</a>>; Aaron Conole <<a href="mailto:aconole@redhat.com" target="_blank">aconole@redhat.com</a>>; Yigit,<br>
> Ferruh <<a href="mailto:ferruh.yigit@intel.com" target="_blank">ferruh.yigit@intel.com</a>>; <a href="mailto:ci@dpdk.org" target="_blank">ci@dpdk.org</a>; Zegota, AnnaX<br>
> <<a href="mailto:annax.zegota@intel.com" target="_blank">annax.zegota@intel.com</a>><br>
> Subject: Re: [dpdk-dev] [Bug 826] red_autotest random failures<br>
> <br>
> 18/11/2021 23:10, Liguzinski, WojciechX:<br>
> > Hi,<br>
> ><br>
> > I was trying to reproduce this test failure, but for me RED tests are passing.<br>
> > I was running the exact test command like the one described in Bug 826 -<br>
> 'red_autotest' on the current main branch.<br>
> <br>
> The test is not always failing.<br>
> There are some failing conditions, please find them.<br>
> I think you should try in a container with more limited resources.<br>
> <br>
<br>
Hi Thomas,<br>
<br>
This is not a fair request IMO. We want to avoid wasting everybody's time, including Wojciech's time. Can the bug originator provide the details on the setup to reproduce the failure, please? Thank you!<br>
<br>
On a different point, we should probably tweak our autotests to differentiate between logical failures and those failures related to resources not being available, and flag the test result accordingly in the report. For example, if memory allocation fails, the test should be flagged as "Not enough resources" instead of simply "Failed". In the first case, the next step should be fixing the test setup, while in the second case the next step should be fixing the code. What do people think on this?<br>
<br>
Regards,<br>
Cristian<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><b>Lincoln Lavoie</b><br></div><div>Principal Engineer, Broadband Technologies</div><div>21 Madbury Rd., Ste. 100, Durham, NH 03824</div><div><a href="mailto:lylavoie@iol.unh.edu" target="_blank">lylavoie@iol.unh.edu</a></div><div><a href="https://www.iol.unh.edu" target="_blank">https://www.iol.unh.edu</a></div><div>+1-603-674-2755 (m)</div><div><a href="https://www.iol.unh.edu" target="_blank"><img src="https://docs.google.com/uc?export=download&id=1j_iI6anwrnbQWNpTyuvukMLSNJJ8_8QU&revid=0B_0ujwABDnFZTmJiR3EzK0d1VjFKTjQvMENBWVM0QnA4ajhjPQ" width="200" height="43"></a><br></div></div></div></div></div></div></div></div></div></div></div>