[dpdk-ci] [Bug 431] Missing performance results in Patchwork checks, and possible false positives

[bugzilla at dpdk.org]

https://bugs.dpdk.org/show_bug.cgi?id=431

Brandon Lo (blo at iol.unh.edu) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |FIXED
             Status|IN_PROGRESS                 |RESOLVED

--- Comment #5 from Brandon Lo (blo at iol.unh.edu) ---
Fixed.

This issue is due to concurrent running tests.

Our internal testing job would run a job to send a performance report email to
vendors for a given patch. The problem is that this email would be sent after
all of a given vendor's machines are done testing (vendor A), but it could
occur before all of the machines of another vendor finishes (vendor B). 

This results in all of the results from the first vendor (A) being sent, but
the internal script will pick up the existing results created by the unfinished
vendor B and send those out as well.

This can be seen with email timings. An unfinished Mellanox report email could
have one single testbed's result in the email, and it will always be sent at
the same time as another vendor's email (Intel for example). 

The fix was to add support for sending a specific vendor's email only when all
of the given vendor's testbeds are finished testing. 
We have tested this by using dry runs of the email sending script with
successful separation of vendor testbed results.

-- 
You are receiving this mail because:
You are the assignee for the bug.