<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word"> <div class="WordSection1"> Hi Pavel,<o:p></o:p> <o:p> </o:p> You can use a symmetric key,<o:p></o:p> Or even better, in case of MLNX devices you can use RTE_ETH_HASH_FUNCTION_SYMMETRIC_TOEPLITZ_SORT as the hash function,<o:p></o:p> This will sort the fields based on their value and only do the hash, resulting in a symmetric hash.<o:p></o:p> <o:p> </o:p> Best,<o:p></o:p> Ori<o:p></o:p> <o:p> </o:p> <o:p> </o:p> <div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt"> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: Pavel Vazharov <freakpv@gmail.com> Sent: Thursday, February 22, 2024 8:49 AM To: Yaron Illouz <yaroni@radcom.com> Cc: Ori Kam <orika@nvidia.com>; dev@dpdk.org; users@dpdk.org Subject: Re: rss calculation as the nic<o:p></o:p> </div> </div> <o:p> </o:p> <div> <div> <o:p> </o:p> </div> <o:p> </o:p> <div> <div> On Wed, Feb 21, 2024 at 9:40 PM Yaron Illouz <<a href="mailto:yaroni@radcom.com">yaroni@radcom.com</a>> wrote:<o:p></o:p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> <div> Hi Ori Thank you for your answer it helped me But I can see the load balancing is not done to the same instance for both directions I would like to have ip + port pairs arrive to same instance Now ip1+port1 -> ip2+port2 arrive to instance x and ip2+port2 -> ip1+port1 arrive to another instance How can I solve this?<o:p></o:p> <o:p></o:p> <div> <div style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0cm 0cm 0cm;border-color:currentcolor currentcolor"> From: Ori Kam <<a href="mailto:orika@nvidia.com" target="_blank">orika@nvidia.com</a>> Sent: Wednesday, February 14, 2024 6:07 PM To: Yaron Illouz <<a href="mailto:yaroni@radcom.com" target="_blank">yaroni@radcom.com</a>>; <a href="mailto:dev@dpdk.org" target="_blank">dev@dpdk.org</a>; '<a href="mailto:users@dpdk.org" target="_blank">users@dpdk.org</a>' <<a href="mailto:users@dpdk.org" target="_blank">users@dpdk.org</a>> Subject: RE: rss calculation as the nic<o:p></o:p> </div> </div> <o:p></o:p> <table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="background:#FFF2CC;border-collapse:collapse"> <tbody> <tr> <td width="576" valign="top" style="width:432.35pt;background:#FBE4D5;padding:0cm 5.4pt 0cm 5.4pt"> <a name="m_-7692156074670919738__Hlk88152779">EXTERNAL EMAIL:</a> Do not click links or attachments unless you recognize the sender and know the content is safe<o:p></o:p> </td> </tr> </tbody> </table> <o:p></o:p> <div> Hi Yaron,<o:p></o:p> <o:p></o:p> I can see some possible issues with your code, please see below.<o:p></o:p> </div> </div> </div> </div> </blockquote> <div> If I understand your case correctly, you need to use a symmetric RSS key.<o:p></o:p> </div> <div> We use this one in production - <a href="https://www.ndsl.kaist.edu/~kyoungsoo/papers/TR-symRSS.pdf"> https://www.ndsl.kaist.edu/~kyoungsoo/papers/TR-symRSS.pdf</a><o:p></o:p> </div> <div> And you'll need to set it accordingly when configuring the device: port_conf.rx_adv_conf.rss_conf.rss_key = rss_key; port_conf.rx_adv_conf.rss_conf.rss_key_len = rss_key_size;<o:p></o:p> </div> <div> HTH.<o:p></o:p> </div> <div> <o:p> </o:p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> <div> <div> <o:p></o:p> <div style="border:none;border-left:solid windowtext 1.5pt;padding:0cm 0cm 0cm 4.0pt;border-color:currentcolor currentcolor currentcolor blue"> <div> <div style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0cm 0cm 0cm;border-color:currentcolor currentcolor"> From: Yaron Illouz <<a href="mailto:yaroni@radcom.com" target="_blank">yaroni@radcom.com</a>> Sent: Saturday, February 3, 2024 7:03 PM To: <a href="mailto:dev@dpdk.org" target="_blank">dev@dpdk.org</a>; '<a href="mailto:users@dpdk.org" target="_blank">users@dpdk.org</a>' <<a href="mailto:users@dpdk.org" target="_blank">users@dpdk.org</a>> Subject: rss calculation as the nic<o:p></o:p> </div> </div> <o:p></o:p> [Snip]<o:p></o:p> <o:p></o:p> static inline uint32_t<o:p></o:p> do_softrss(struct rte_mbuf *m)<o:p></o:p> {<o:p></o:p> uint32_t input_len;<o:p></o:p> struct rte_ipv4_tuple ipv4_tuple;<o:p></o:p> <o:p></o:p> char * pRawPacket = static_cast<char*>(rte_pktmbuf_mtod(pi_mbuf, void* ));<o:p></o:p> IpHeader * pIpHeader = (IpHeader *)(pRawPacket + offsetOfIp);<o:p></o:p> if(pIpHeader->GetVersion()==4)<o:p></o:p> {<o:p></o:p> ipv4_tuple.src_addr = rte_be_to_cpu_32(pIpHeader->dwSrcAddressBigEndian);<o:p></o:p> ipv4_tuple.dst_addr = rte_be_to_cpu_32(pIpHeader->dwDstAddressBigEndian);<o:p></o:p> [Ori] here you are converting BE to CPU <o:p></o:p> ipv4_tuple.sport = *(uint16_t*)(pRawPacket + transportLayerOffset);<o:p></o:p> ipv4_tuple.dport = *(uint16_t*)(pRawPacket + transportLayerOffset+2);<o:p></o:p> [Ori] here you keep the values as BE<o:p></o:p> input_len = RTE_THASH_V4_L3_LEN;<o:p></o:p> return rte_softrss_be((uint32_t *)&ipv4_tuple, input_len, rss_key_be);<o:p></o:p> [Ori] the above function expects to get everything in BE and you should also call rte_convert_rss_key before the use of the above function.<o:p></o:p> }<o:p></o:p> return 0;<o:p></o:p> }<o:p></o:p> new_rss = do_softrss(mbuf_pointer);<o:p></o:p> std::cout<< std::hex << mbuf_pointer->hash.rss << " -> " << new_rss << std::dec << std::endl;<o:p></o:p> <o:p></o:p> And i get a different value than the mbuf_pointer->hash.rss<o:p></o:p> 5ed28a5c -> 33eb33eb<o:p></o:p> 974c1896 -> 24e224e2<o:p></o:p> 1edf1638 -> 21752175<o:p></o:p> 8a54c19 -> 80638063<o:p></o:p> 459a6f76 -> 1b351b35<o:p></o:p> 1cdf1d1c -> e53be53b<o:p></o:p> <o:p></o:p> <o:p></o:p> **** I understand it is possible to do it, but i don't get the same value ***<o:p></o:p> ethtool -i ens5f0<o:p></o:p> driver: mlx5_core<o:p></o:p> version: 5.8-3.0.7<o:p></o:p> firmware-version: 22.32.2004 (MT_0000000437)<o:p></o:p> expansion-rom-version:<o:p></o:p> bus-info: 0000:83:00.0<o:p></o:p> supports-statistics: yes<o:p></o:p> supports-test: yes<o:p></o:p> supports-eeprom-access: no<o:p></o:p> supports-register-dump: no<o:p></o:p> supports-priv-flags: yes<o:p></o:p> <o:p></o:p> </div> </div> </div> </div> </div> </blockquote> </div> </div> </div> </div> </body> </html>