<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
text-align:justify;
text-justify:inter-ideograph;
font-size:10.5pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
/* Page Definitions */
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="ZH-CN" link="#0563C1" vlink="#954F72" style="text-justify-trim:punctuation">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">During the pressure test on the CX6 using DPDK, the process exits abnormally. It is located that the problem is caused by a bug of the DPDK mlx5 driver. Please check whether the latest firmware and driver fix this coredump.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">By default, the DPDK enables the rxtx_vect and compress CQE functions, and the receive ringbuffer is 1024. During the service process pressure, the service process receives SIGFAULT and exits.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Call stack information:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> #2 0x0000000000e72437 in signal_captured_function (signo=11, si=0x7f6310f46eb0, ucontext=0x7f6310f46d80) at ../v1/handle_signal.c:499<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> #3 <signal handler called><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> #4 _mm_storeu_si128 (__B=..., __P=<optimized out>) at /usr/lib/gcc/x86_64-linux-gnu/7.3.0/include/emmintrin.h:720<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> #5 rxq_cq_decompress_v (elts=0x20217ff394e8, cq=0x20217f8538c0, rxq=0x20217ff36e00) a<span style="color:red">t
<b>../drivers/net/mlx5/mlx5_rxtx_vec_sse.h:159</b></span><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> #6 rxq_burst_v (no_cq=<synthetic pointer>, err=<synthetic pointer>, pkts_n=9, pkts=0x2004e278c9d8, rxq=0x20217ff36e00) at ../drivers/net/mlx5/mlx5_rxtx_vec.c:349<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> #7 mlx5_rx_burst_vec (dpdk_rxq=0x20217ff36e00, pkts=0x2004e278c9d8, pkts_n=128) at ../drivers/net/mlx5/mlx5_rxtx_vec.c:393<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> #8 0x0000000001086448 in rte_eth_rx_burst (nb_pkts=128, rx_pkts=0x2004e278c9d8, queue_id=7, port_id=<optimized out>) at ../include/dpdk/rte_ethdev.h:5339<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Ethernet controller: Mellanox Technologies MT2892 Family [ConnectX-6 Dx]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Version:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> [root@localhost ~]# ofed_info -s<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> MLNX_OFED_LINUX-23.04-0.5.3.3:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> [root@localhost ~]# ethtool -i eth6|grep fir<o:p></o:p></span></p>
<p class="MsoNormal" style="text-indent:12.75pt"><span lang="EN-US">firmware-version: 22.37.1014 (MT_0000000359)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">dpdk version: DPDK 21.11<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="color:red">../drivers/net/mlx5/mlx5_rxtx_vec_sse.h:159</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">157: /* B.1 store rearm data to mbuf. */<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">158: _mm_storeu_si128((__m128i *)&elts[pos + 2]->rearm_data, rearm);<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">159: _mm_storeu_si128((__m128i *)&elts[pos + 3]->rearm_data, rearm);<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Root cause: When processing compressed CQEs, 9 mini CQEs need to be processed and (*rxq->elts)[1021] -> (*rxq->elts)[1028] is accessed. Only [0, 1027] are reserved during the initialization of the receive queue. A null
pointer is accessed due to out-of-bounds access. As a result, a core dump occurs in the process.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><img width="664" height="661" style="width:6.9166in;height:6.8854in" id="_x56fe__x7247__x0020_1" src="cid:image001.png@01D9E747.3D977290"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[0] <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$149 = (struct rte_mbuf *) 0x2006945a8000 //</span><span lang="EN-US" style="font-family:SimSun">first round</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[1]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$150 = (struct rte_mbuf *) 0x2006945aa1c0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[2]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$151 = (struct rte_mbuf *) 0x2006945ac380<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[3]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$152 = (struct rte_mbuf *) 0x20217ff36f80<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[4]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$153 = (struct rte_mbuf *) 0x20217ff36f80 //</span><span lang="EN-US" style="font-family:SimSun">Second round</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[5]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$154 = (struct rte_mbuf *) 0x20217ff36f80<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[6]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$155 = (struct rte_mbuf *) 0x20217ff36f80
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts[7]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$156 = (struct rte_mbuf *) 0x0 //</span><span lang="EN-US" style="font-family:SimSun">coredump</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">(gdb) p elts - (*rxq->elts)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">$157 = 1021<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
</body>
</html>