[dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment

[bugzilla at dpdk.org]

https://bugs.dpdk.org/show_bug.cgi?id=459

            Bug ID: 459
           Summary: Performance Turning and Results Stability Issues on
                    NXP test environment
           Product: lab
           Version: unspecified
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: normal
          Priority: Normal
         Component: UNH infra
          Assignee: ci at dpdk.org
          Reporter: lylavoie at iol.unh.edu
                CC: dpdklab at iol.unh.edu
  Target Milestone: ---

The NXP test environment seems to exhibit drops in performance on patches that
should not have impacted performance testing. The system should be turned by
NXP participants to avoid false negative results (i.e. drops in performance).  

Some ideas raised during the testing meeting on April 21 include running each
patch multiple times, to either average or throw out outlying measurements. 
This would require changes to the CI scripts.

Other option is to provide additional measurements (i.e. CPU temp) to determine
if that is impacting the performance.

Less ideal would be increasing the threshold for the failure (i.e. to 2% loss,
etc.).  That is up to each lab participant to set for their hardware.

-- 
You are receiving this mail because:
You are the assignee for the bug.