<html><head></head><body><div class="ydp724a820byahoo-style-wrap" style="font-family:Helvetica Neue, Helvetica, Arial, sans-serif;font-size:16px;"><div></div> <div><span style="color: rgb(38, 40, 42); font-size: 13px;">On Thursday, September 7, 2023 at 09:26:34 PM CDT, jiangheng (G) <jiangheng14@huawei.com> wrote:</span><br></div></div><div id="ydp8379302yahoo_quoted_4376035868" class="ydp8379302yahoo_quoted"><div style="font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;font-size:13px;color:#26282a;"> <div><br></div> <div><br></div> <div><div id="ydp8379302yiv7091734964"> <div class="ydp8379302yiv7091734964WordSection1"> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;">Hi </span></p> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;">I've had the same error. It may be caused by this parameter:</span></p> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;"><a shape="rect" href="https://github.com/DPDK/dpdk/blob/v22.11/config/rte_config.h#L33C9-L33C33" rel="nofollow" target="_blank">https://github.com/DPDK/dpdk/blob/v22.11/config/rte_config.h#L33C9-L33C33</a></span></p> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;">If you use 2MB hugepages, the max memory size is 2MB * 8192 = 16GB. This error will occur when you allocate more than 16GB of memory per numa.</span></p> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;"> </span></p> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;">But should not have this error if you use 512 MB of memory, can you show RTE_MAX_MEMSEG_PER_LIST in your dpdk? </span></p> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;">Check whether the other sizes hugepage is used, Theoretically, this error indicates that the rte_eal_init init fails and the program should exit.</span></p> <div><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;"> </span></div><div dir="ltr" data-setdir="false"><div><div dir="ltr" data-setdir="false">My initial statement was that the log was seen "<span><span style="color: rgb(38, 40, 42); font-family: sans-serif;">from EAL during EAL init", but that is not right. The call to rte_eal_init() is successful. Later I allocate the memory, using <span>rte_mempool_create("node_pool", <span>(128 * 1024 * 1024 - 1), 256, 256, 0, NULL, NULL, NULL, NULL, rte_socket_id(), 0). That is when I see the message. And the call to allocate the memory is successful, and I am processing packets and allocating nodes just fine. Here is the information from rte_config.h.</span></span></span></span></div><div dir="ltr" data-setdir="false"><span><span style="color: rgb(38, 40, 42); font-family: sans-serif;"><br></span></span></div><div>$ grep RTE_MAX_MEM ./cn98xx-release-output/build/dpdk/config/rte_config.h</div><div>#define RTE_MAX_MEMSEG_LISTS 128</div><div>#define RTE_MAX_MEMSEG_PER_LIST 8192</div><div>#define RTE_MAX_MEM_MB_PER_LIST 32768</div><div>#define RTE_MAX_MEMSEG_PER_TYPE 32768</div><div>#define RTE_MAX_MEM_MB_PER_TYPE 65536</div><div>#define RTE_MAX_MEMZONE 2560</div><div><br></div></div></div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:sans-serif;"> </span></p> <div id="ydp8379302yiv7091734964yqt99887" class="ydp8379302yiv7091734964yqt7600279688"><div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm;"> <p class="ydp8379302yiv7091734964MsoNormal"><b><span style="font-size:11.0pt;">发件人<span lang="EN-US">:</span></span></b><span lang="EN-US" style="font-size:11.0pt;"> Don Trotter <djtrotter@yahoo.com> <br clear="none"> </span><b><span style="font-size:11.0pt;">发送时间<span lang="EN-US">:</span></span></b><span lang="EN-US" style="font-size:11.0pt;"> 2023</span><span style="font-size:11.0pt;">年<span lang="EN-US">9</span>月<span lang="EN-US">8</span>日<span lang="EN-US"> 5:33<br clear="none"> </span><b>收件人<span lang="EN-US">:</span></b><span lang="EN-US"> Stephen Hemminger <stephen@networkplumber.org><br clear="none"> </span><b>抄送<span lang="EN-US">:</span></b><span lang="EN-US"> users@dpdk.org<br clear="none"> </span><b>主题<span lang="EN-US">:</span></b><span lang="EN-US"> Re: EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list</span></span></p> </div> </div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US"> </span></p> <div> <div> <div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;color:#26282A;">On Thursday, September 7, 2023 at 03:21:12 PM CDT, Stephen Hemminger <</span><span lang="EN-US"><a shape="rect" href="mailto:stephen@networkplumber.org" rel="nofollow" target="_blank"><span style="font-family:sans-serif;">stephen@networkplumber.org</span></a></span><span lang="EN-US" style="font-family:sans-serif;color:#26282A;">> wrote:</span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;color:#26282A;"> </span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;color:#26282A;"> </span></p> </div> <div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;color:#26282A;">On Thu, 7 Sep 2023 19:58:35 +0000 (UTC)</span></p> <div id="ydp8379302yiv7091734964ydpbe11d152yqtfd76773"> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;color:#26282A;"><br clear="none"> Don Trotter <</span><span lang="EN-US"><a shape="rect" href="mailto:djtrotter@yahoo.com" rel="nofollow" target="_blank"><span style="font-family:sans-serif;color:#196AD4;">djtrotter@yahoo.com</span></a></span><span lang="EN-US" style="font-family:sans-serif;color:#26282A;">> wrote:<br clear="none"> <br clear="none"> > To clarify, the log message when my application called rte_mempool_create() to create the "node_pool", and the call succeeded.<br clear="none"> > Thanks,Don Trotter<br clear="none"> > On Thursday, September 7, 2023 at 01:54:08 PM CDT, Don Trotter <</span><span lang="EN-US"><a shape="rect" href="mailto:djtrotter@yahoo.com" rel="nofollow" target="_blank"><span style="font-family:sans-serif;color:#196AD4;">djtrotter@yahoo.com</span></a></span><span lang="EN-US" style="font-family:sans-serif;color:#26282A;">> wrote: <br clear="none"> > <br clear="none"> > Hi,<br clear="none"> > I have recently started using DPDK. I am working on a project on OcteonTX2 with DPDK 11.23.01. I am seeing this message from EAL during EAL init, but everything is working.<br clear="none"> > EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list<br clear="none"> > The system has 96GB of memory. These 2 pools get created and everything works fine.<br clear="none"> > mempool <mbuf_pool>@0x13fed3e00 flags=10 socket_id=0 pool=0x1140300000 iova=0x13fed3e00 nb_mem_chunks=1 size=65535 populated_size=65535 header_size=128 elt_size=10200 trailer_size=40 total_obj_size=10368 private_data_size=128 ops_index=0 ops_name: <cn9k_mempool_ops> avg bytes/object=10368.558602<br clear="none"> > mempool <node_pool>@0x1575d8180 flags=10 socket_id=-1 pool=0x19ffffd00 iova=0x1575d8180 nb_mem_chunks=2 size=134217727 populated_size=134217727 header_size=128 elt_size=256 trailer_size=0 total_obj_size=384 private_data_size=0 ops_index=3 ops_name: <ring_mp_mc> avg bytes/object=384.000094<br clear="none"> > You read that right. I’ve got 128*1024*1024 256 byte buffers created for data.<br clear="none"> > I also see there is still heap left, although pretty low after.<br clear="none"> > Heap id:0 Heap name:socket_0 Heap_size:55834574848, Free_size:2403644544, Alloc_size:53430930304, Greatest_free_size:536870016, Alloc_count:293, Free_count:5,<br clear="none"> > Linux free stats.<br clear="none"> > tmp# free -h -w total used free shared buffers cache availableMem: 95Gi 88Gi 6.5Gi 444Mi 0B 470Mi 599MiSwap: 0B 0B 0B<br clear="none"> > Is there anything wrong with that EAL log? Is there a lurking problem?<br clear="none"> > Thanks,Don Trotter</span></p> </div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;color:#26282A;"><br clear="none"> ><br clear="none"> > <br clear="none"> <br clear="none"> Did you setup hugepages?<br clear="none"> How many and what size?<br clear="none"> Is this a NUMA system?<br clear="none"> <br clear="none"> Also 11.23.01 seems like a weird release number.<br clear="none"> The DPDK release numbering scheme is year followed by month. I.e. 22.11 was released in November of 2022</span></p> </div> </div> </div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;"> </span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;"> </span></p> </div> <div> <div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;"># cat /sys/kernel/mm/hugepages/hugepages-524288kB/nr_hugepages</span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;">176</span></p> </div> </div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;"> </span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;">Yes it is a NUMA system.</span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;"> </span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-family:sans-serif;">You are correct sir. The SDK is SDK11.23.01 (2023-01) and DPDK is 22.11.</span></p> </div> </div></div> <div id="ydp8379302yiv7091734964ydpbe11d152yahoo_quoted_4658645739"> <div> <div id="ydp8379302yiv7091734964yqt91702" class="ydp8379302yiv7091734964yqt7600279688"><div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span></p> </div> <div> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">Thanks, Don Trotter</span></p> </div></div> <div> <div> <div id="ydp8379302yiv7091734964ydpbe11d152yqtfd36134"> <p class="ydp8379302yiv7091734964MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> <br></span></p> </div> </div> </div> </div> </div> </div> </div></div> </div> </div></body></html>