<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:宋体;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:等线;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@等线";
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"\@宋体";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:宋体;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:宋体;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="ZH-CN" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif">Hi
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif">I've had the same error. It may be caused by this parameter:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif"><a href="https://github.com/DPDK/dpdk/blob/v22.11/config/rte_config.h#L33C9-L33C33">https://github.com/DPDK/dpdk/blob/v22.11/config/rte_config.h#L33C9-L33C33</a><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif">If you use 2MB hugepages, the max memory size is 2MB * 8192 = 16GB. This error will occur when you allocate more than 16GB of memory per numa.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif">But should not have this error if you use 512 MB of memory, can you show RTE_MAX_MEMSEG_PER_LIST in your dpdk?
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif">Check whether the other sizes hugepage is used, Theoretically, this error indicates that the rte_eal_init init fails and the program should exit.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:等线">发件人<span lang="EN-US">:</span></span></b><span lang="EN-US" style="font-size:11.0pt;font-family:等线"> Don Trotter <djtrotter@yahoo.com>
<br>
</span><b><span style="font-size:11.0pt;font-family:等线">发送时间<span lang="EN-US">:</span></span></b><span lang="EN-US" style="font-size:11.0pt;font-family:等线"> 2023</span><span style="font-size:11.0pt;font-family:等线">年<span lang="EN-US">9</span>月<span lang="EN-US">8</span>日<span lang="EN-US">
5:33<br>
</span><b>收件人<span lang="EN-US">:</span></b><span lang="EN-US"> Stephen Hemminger <stephen@networkplumber.org><br>
</span><b>抄送<span lang="EN-US">:</span></b><span lang="EN-US"> users@dpdk.org<br>
</span><b>主题<span lang="EN-US">:</span></b><span lang="EN-US"> Re: EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list<o:p></o:p></span></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A">On Thursday, September 7, 2023 at 03:21:12 PM CDT, Stephen Hemminger <</span><span lang="EN-US"><a href="mailto:stephen@networkplumber.org"><span style="font-family:"Helvetica",sans-serif">stephen@networkplumber.org</span></a></span><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A">>
wrote:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A"><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A">On Thu, 7 Sep 2023 19:58:35 +0000 (UTC)<o:p></o:p></span></p>
<div id="ydpbe11d152yqtfd76773">
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A"><br>
Don Trotter <</span><span lang="EN-US"><a href="mailto:djtrotter@yahoo.com" target="_blank"><span style="font-family:"Helvetica",sans-serif;color:#196AD4">djtrotter@yahoo.com</span></a></span><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A">>
wrote:<br>
<br>
> To clarify, the log message when my application called rte_mempool_create() to create the "node_pool", and the call succeeded.<br>
> Thanks,Don Trotter<br>
> On Thursday, September 7, 2023 at 01:54:08 PM CDT, Don Trotter <</span><span lang="EN-US"><a href="mailto:djtrotter@yahoo.com" target="_blank"><span style="font-family:"Helvetica",sans-serif;color:#196AD4">djtrotter@yahoo.com</span></a></span><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A">>
wrote: <br>
> <br>
> Hi,<br>
> I have recently started using DPDK. I am working on a project on OcteonTX2 with DPDK 11.23.01. I am seeing this message from EAL during EAL init, but everything is working.<br>
> EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list<br>
> The system has 96GB of memory. These 2 pools get created and everything works fine.<br>
> mempool <mbuf_pool>@0x13fed3e00 flags=10 socket_id=0 pool=0x1140300000 iova=0x13fed3e00 nb_mem_chunks=1 size=65535 populated_size=65535 header_size=128 elt_size=10200 trailer_size=40 total_obj_size=10368 private_data_size=128 ops_index=0 ops_name:
<cn9k_mempool_ops> avg bytes/object=10368.558602<br>
> mempool <node_pool>@0x1575d8180 flags=10 socket_id=-1 pool=0x19ffffd00 iova=0x1575d8180 nb_mem_chunks=2 size=134217727 populated_size=134217727 header_size=128 elt_size=256 trailer_size=0 total_obj_size=384 private_data_size=0 ops_index=3 ops_name:
<ring_mp_mc> avg bytes/object=384.000094<br>
> You read that right. I’ve got 128*1024*1024 256 byte buffers created for data.<br>
> I also see there is still heap left, although pretty low after.<br>
> Heap id:0 Heap name:socket_0 Heap_size:55834574848, Free_size:2403644544, Alloc_size:53430930304, Greatest_free_size:536870016, Alloc_count:293, Free_count:5,<br>
> Linux free stats.<br>
> tmp# free -h -w total used free shared buffers cache availableMem: 95Gi 88Gi 6.5Gi 444Mi 0B 470Mi 599MiSwap: 0B 0B 0B<br>
> Is there anything wrong with that EAL log? Is there a lurking problem?<br>
> Thanks,Don Trotter<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#26282A"><br>
><br>
> <br>
<br>
Did you setup hugepages?<br>
How many and what size?<br>
Is this a NUMA system?<br>
<br>
Also 11.23.01 seems like a weird release number.<br>
The DPDK release numbering scheme is year followed by month. I.e. 22.11 was released in November of 2022<o:p></o:p></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif"># cat /sys/kernel/mm/hugepages/hugepages-524288kB/nr_hugepages<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif">176<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif">Yes it is a NUMA system.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif">You are correct sir. The SDK is SDK11.23.01 (2023-01) and DPDK is 22.11.<o:p></o:p></span></p>
</div>
</div>
<div id="ydpbe11d152yahoo_quoted_4658645739">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282A"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282A">Thanks, Don Trotter<o:p></o:p></span></p>
</div>
<div>
<div>
<div id="ydpbe11d152yqtfd36134">
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282A"><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>