<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:12.0pt;
font-family:"Calibri",sans-serif;
mso-ligatures:standardcontextual;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style></head><body lang=EN-US link="#0563C1" vlink="#954F72" style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt'>Hi,<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>We are using DPDK 25.11 with an Intel E810 with Firmware 4.90 and comms DDP 1.3.55 configured 8x10G<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>We generate traffic and direct it to one of the server’s nics, which is configured to forward it back to the generator via l2fwd:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Courier New"'>./build/l2fwd -l 14,16 -a 0000:4b:00.4 -a 0000:4b:00.5 -- -p 0x3 -P<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>Everything works fine if we leave all defaults.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>Problems arise when we diminish the number of mbufs: l2fwd has a nice formula to compute it:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'> </span><span style='font-size:11.0pt;font-family:"Courier New"'>nb_mbufs = RTE_MAX(nb_ports * (nb_rxd + nb_txd + MAX_PKT_BURST + nb_lcores * MEMPOOL_CACHE_SIZE), 8192U);<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>(in our example, this amounts to 8192)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>If we then divide this by 4:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'> </span><span style='font-size:11.0pt;font-family:"Courier New"'>nb_mbufs /= 4;<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>recompile and run it again, </span><span style='font-size:11.0pt'>the effect is that only 2k packets are forwarded, then everything blocks, as seen in the l2fwd output: the number of “Total packets sent” remains at 2032.</span><span style='font-size:11.0pt'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>Using dpdk-telemetry we see that "rx_mbuf_allocation_errors" counter grows indefinitely.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>In our understanding, diminishing the number of mbufs could degrade performance but not block the forwarding, as mbufs would eventually be freed by the nic once the packets are sent. And in fact this is the behavior we see using mlx5 driver for example.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>Are we missing some specific configuration? Or is it an unexpected behavior?<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>Thanks<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p></div></body></html>