<div dir="ltr"><div>Hi,</div><div><br></div><div>We found an issue with newer kernels (5.13+) that are found on newer OSes (Ubuntu22, Rocky9, Ubuntu20 with kernel 5.15) where a 2M page that was allocated for DPDK was migrated (moved into another physical page) when a 1G page was allocated.</div><div><br></div><div>From our reading of the kernel commits this started with commit ae37c7ff79f1f030e28ec76c46ee032f8fd07607<br>    mm: make alloc_contig_range handle in-use hugetlb pages</div><div><br></div><div>This caused what looked like memory corruptions to us and cases where the rings were moved from their physical location and communication was no longer possible.</div><div><br></div><div>I wanted to ask if anyone else hit this issue and what mitigations are available?</div><div><br></div><div>We are currently looking at using a kernel driver to pin the pages but I expect that this issue will affect others and that a more general approach is needed.</div><div><br></div><div>Thanks,</div><div>Baruch<br></div><div><br><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div><table cellspacing="0" cellpadding="0" border="0"><tbody><tr><td style="font-size:0px;height:10px" height="10"></td></tr><tr><td style="font-size:0px;height:10px" height="10"></td></tr><tr><td><table style="width:510px" width="510" cellspacing="0" cellpadding="0" border="0"><tbody><tr><td><table cellspacing="0" cellpadding="0" border="0"></table></td></tr><tr><td style="padding-top:10px">
<div> <div style="max-width:510px"> <table style="width:510px" width="510" cellspacing="0" cellpadding="0" border="0"> <tbody><tr><td style="vertical-align:top;padding-right:12px;width:113.0px" width="113.0" valign="top"> <table cellspacing="0" cellpadding="0" border="0"> <tbody><tr> <td><img src="https://d4d8xd20er8lg.cloudfront.net/996a286d-104f-4862-86c3-38e6ff576b6b/uWcoN7kq5T52WAzl4ESe1yVt5JWBh1at.png" style="width:113.0px;height:82.0px;border-radius:5px;border-radius:5px" width="113.0" height="82.0"> </td> </tr> </tbody></table> </td><td> <table style="width:100%" width="100%" cellspacing="0" cellpadding="0" border="0"> <tbody><tr> <td style="padding-bottom:6px;border-bottom:1px solid #acacac;font-size:16px;line-height:24px"> <span style="color:#773dbe;padding:0px;margin:0px;font-weight:bold;font-family:Arial;font-size:18px">Baruch Even</span><br> <span style="font-family:Arial">Platform Technical Lead, </span> <span style="color:#773dbe;font-family:Arial">WEKA</span> </td> </tr> <tr> <td style="padding-top:6px;padding-bottom:7px;line-height:16px"> <table style="color:#444;padding-left:2px;font-weight:normal;width:100%" width="100%" cellspacing="0" cellpadding="0" border="0"> <tbody><tr> <td style="font-size:16px;line-height:24px"> <span style="color:#773dbe;font-weight:bold;font-family:Arial">E </span><a href="mailto:baruch@weka.io" style="text-decoration:none;color:#4e4b4c;font-family:Arial" target="_blank">baruch@weka.io</a><i style="color:#fff"> ­</i><span style="color:#773dbe;font-weight:bold;font-family:Arial">W </span><a href="https://www.weka.io?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature" style="text-decoration:none;color:#4e4b4c;font-family:Arial" target="_blank">www.weka.io</a><i style="color:#fff"> ­</i><span style="color:#773dbe;font-weight:bold;font-family:Arial"> </span><span style="color:#4e4b4c;font-family:Arial"></span><i style="color:#fff"> ­</i>  </td> </tr> </tbody></table> </td> </tr> <tr> <td> <table style="color:#4e4b4c;padding-left:2px;font-weight:bold;width:100%" width="100%" cellspacing="0" cellpadding="0" border="0"> <tbody><tr> <td><table cellspacing="0" cellpadding="0" border="0"><tbody><tr></tr></tbody></table></td> </tr> </tbody></table> </td> </tr> <tr> <td style="padding-top:6px"> </td> </tr> </tbody></table> </td> </tr> </tbody></table> </div></div></td></tr><tr><td><table cellspacing="0" cellpadding="0" border="0"><tbody><tr><td style="padding-top:8px;padding-right:8px"><div style="width:100%" width="100%"> <a href="https://www.weka.io/lp/weka-named-a-2023-customers-choice-by-gartner-peer-insights/?utm_source=signature&utm_medium=email" target="_blank"> <img src="https://d4d8xd20er8lg.cloudfront.net/7ff3fdb3-08f5-45bc-9e9f-af4382dbb940/u9B16WGa53zbO0yvcA1FtyAeRH14RmVD.png" style="width:319px;height:83px" width="319" height="83"> </a></div></td></tr></tbody></table></td></tr></tbody></table></td></tr><tr><td><img style="display:none" src="https://tracy.srv.wisestamp.com/px/teams/eyJkb21haW4iOiAid2VrYS5pbyIsICJzaWduYXR1cmVfaWQiOiA0ODY3NTgyMjg3OTM3NTM2LCAidXNlcl9lbWFpbCI6ICJiYXJ1Y2hAd2VrYS5pbyIsICJwbGFuIjogIlBsYXRpbnVtIn0=.png" alt=""></td></tr></tbody></table></div></div></div></div>