<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=Windows-1252"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang="en-DE" link="blue" vlink="purple" style="word-wrap:break-word"> <div class="WordSection1"> Hello Asaf,<o:p></o:p> <o:p> </o:p> Thanks for sharing this info, and looking forward to support this feature.<o:p></o:p> <o:p> </o:p> Best regards,<o:p></o:p> Tao<o:p></o:p> <o:p> </o:p> <div id="mail-editor-reference-message-container"> <div> <div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: Asaf Penso <asafp@nvidia.com> Date: Tuesday, 26. March 2024 at 20:43 To: Tao Li <byteocean@hotmail.com>, users@dpdk.org <users@dpdk.org> Subject: Re: Finer matching granularity with async template API<o:p></o:p> </div> <div> Hello Tao,<o:p></o:p> </div> <div> <o:p> </o:p> </div> <div> Currently, we don't support IPinIP with template API.<o:p></o:p> </div> <div id="ms-outlook-mobile-signature"> <div> We have it in our roadmap, but still no concrete release date for it.<o:p></o:p> </div> <div> <o:p> </o:p> </div> <div> Regards,<o:p></o:p> </div> <div> Asaf Penso<o:p></o:p> </div> </div> <div id="mail-editor-reference-message-container"> <o:p> </o:p> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="0" width="100%" align="center"> </div> <div id="divRplyFwdMsg"> From: Tao Li <byteocean@hotmail.com> Sent: Friday, March 22, 2024 5:08:46 pm To: Asaf Penso <asafp@nvidia.com>; users@dpdk.org <users@dpdk.org> Subject: Re: Finer matching granularity with async template API<o:p></o:p> </div> <o:p> </o:p> <div> Hello Asaf,<o:p></o:p> <o:p></o:p> We generate incoming IPinIP packets by using our complex solution, but below you can find a Python script to generate such packets to serve this purpose. I hope it is helpful to reproduce this issue. Thanks again.<o:p></o:p> <o:p></o:p> <Code snippet to generate IPinIP packets><o:p></o:p> #!/usr/bin/python3<o:p></o:p> from scapy.all import *<o:p></o:p> from scapy.layers.inet import Ether, UDP, ICMP<o:p></o:p> from scapy.layers.inet6 import *<o:p></o:p> <o:p></o:p> ether = Ether()<o:p></o:p> ether.src = "src mac"<o:p></o:p> ether.dst = "dst mac"<o:p></o:p> ether.type = 0x86DD<o:p></o:p> <o:p></o:p> ipv6 = IPv6()<o:p></o:p> ipv6.src = "src ipv6 addr"<o:p></o:p> ipv6.dst = "dst ipv6 addr"<o:p></o:p> ipv6.nh = 4<o:p></o:p> <o:p></o:p> pkt = ether / ipv6 / IP(src="192.168.129.5",dst="172.32.4.9") / ICMP(type=8)<o:p></o:p> <o:p></o:p> print(pkt.show())<o:p></o:p> sendp(pkt, iface ="ens1f0np0")<o:p></o:p> < /Code snippet to generate IPinIP packets ><o:p></o:p> <o:p></o:p> Cheers,<o:p></o:p> Tao<o:p></o:p> <o:p></o:p> <div id="mail-editor-reference-message-container"> <div> <div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: Tao Li <byteocean@hotmail.com> Date: Friday, 22. March 2024 at 14:19 To: Asaf Penso <asafp@nvidia.com>, users@dpdk.org <users@dpdk.org> Subject: Re: Finer matching granularity with async template API<o:p></o:p> </div> <div> Hellp Asaf,<o:p></o:p> <o:p></o:p> Thanks for your speedy reply. Please find additional information based on your questions, and I hope they would help to understand our purpose and issue.<o:p></o:p> <o:p></o:p> <ol style="margin-top:0cm" start="1" type="1"> <li class="MsoListParagraph" style="margin-top:0cm;margin-bottom:0cm;mso-list:l2 level1 lfo3"> Why ipv6/ipv4/icmp? <o:p></o:p></li></ol> We are performing IPinIP tunnelling for traffic, and in this provided test-pmd example we encapsulate IPv4 packets from VMs into IPv6 underlay packets. The refence RFCs for this approach are RFC 1853 and RFC 2473. This <a href="https://www.h3c.com/en/Support/Resource_Center/HK/Switches/H3C_S7500E_X/S7500E-X/Technical_Documents/Configure___Deploy/Configuration_Guides/H3C_S7500E-X_CG-Release7178-6W100/05/201602/914694_294551_0.htm">article</a> also provides good visualization on packet structures for this IPinIP tunnelling approach. <o:p></o:p> <o:p></o:p> <ol style="margin-top:0cm" start="2" type="1"> <li class="MsoListParagraph" style="margin-top:0cm;margin-bottom:0cm;mso-list:l3 level1 lfo6"> What output /error message?<o:p></o:p></li></ol> No crashing error message or similar happens, thus it is difficult for us to debug what is exactly going on. What is observed is that incoming packets cannot be captured and processed by this flow rule, compared with using the flow rule only performs eth/ipv6 matching. After removing relevant commands or code that perform inner header matching for IPv4 and ICMP, packets can be successfully processed. The code snippets to programmably achieve the above described IPinIP tunnelling approach are as following:<o:p></o:p> <o:p></o:p> <Code snippet to initialise pattern masks><o:p></o:p> static const struct rte_flow_item_eth flow_item_eth_mask = {<o:p></o:p> .hdr.ether_type = 0xffff,<o:p></o:p> };<o:p></o:p> <o:p></o:p> static const struct rte_flow_item_ipv6 flow_item_ipv6_dst_mask = {<o:p></o:p> .hdr.proto = 0xff,<o:p></o:p> };<o:p></o:p> <o:p></o:p> static const struct rte_flow_item_ipv4 flow_item_ipv4_proto_mask = {<o:p></o:p> .hdr.next_proto_id = 0xff,<o:p></o:p> };<o:p></o:p> <o:p></o:p> static const struct rte_flow_item_icmp flow_item_icmp_mask = {<o:p></o:p> .hdr.icmp_type = 0xff,<o:p></o:p> };<o:p></o:p> </Code snippet to initialise pattern masks><o:p></o:p> <o:p></o:p> <Code snippet to create pattern template><o:p></o:p> // pattern template<o:p></o:p> struct rte_flow_item pattern[] = {<o:p></o:p> [0] = {.type = RTE_FLOW_ITEM_TYPE_REPRESENTED_PORT, .mask = &represented_port_mask},<o:p></o:p> [1] = {.type = RTE_FLOW_ITEM_TYPE_ETH, .mask = &flow_item_eth_mask},<o:p></o:p> [2] = {.type = RTE_FLOW_ITEM_TYPE_IPV6, .mask = &flow_item_ipv6_dst_mask},<o:p></o:p> [3] = {.type = RTE_FLOW_ITEM_TYPE_IPV4, .mask = &flow_item_ipv4_proto_mask},<o:p></o:p> [4] = {.type = RTE_FLOW_ITEM_TYPE_ICMP, .mask = &flow_item_icmp_mask},<o:p></o:p> [5] = {.type = RTE_FLOW_ITEM_TYPE_END,},<o:p></o:p> }; <o:p></o:p> port_template_info_pf.pattern_templates[0] = create_pattern_template(main_eswitch_port, pattern);<o:p></o:p> </Code snippet to create pattern template><o:p></o:p> <o:p></o:p> <Code snippet to create patterns><o:p></o:p> struct rte_flow_item_eth eth_pattern = {.type = htons(0x86DD)};<o:p></o:p> <o:p></o:p> struct rte_flow_item_ipv6 ipv6_hdr = {0};<o:p></o:p> ipv6_hdr.hdr.proto = IPPROTO_IPIP;<o:p></o:p> <o:p></o:p> struct rte_flow_item_ipv4 ipv4_hdr = {0};<o:p></o:p> ipv4_hdr.hdr.next_proto_id = IPPROTO_ICMP;<o:p></o:p> <o:p></o:p> struct rte_flow_item_icmp icmp_hdr = {0};<o:p></o:p> icmp_hdr.hdr.icmp_type = RTE_IP_ICMP_ECHO_REQUEST;<o:p></o:p> <o:p></o:p> struct rte_flow_item_ethdev represented_port = {.port_id = pf_port_id};<o:p></o:p> <o:p></o:p> struct rte_flow_item concrete_patterns[6];<o:p></o:p> <o:p></o:p> concrete_patterns[0].type = RTE_FLOW_ITEM_TYPE_REPRESENTED_PORT;<o:p></o:p> concrete_patterns[0].spec = &represented_port;<o:p></o:p> concrete_patterns[0].mask = NULL;<o:p></o:p> concrete_patterns[0].last = NULL;<o:p></o:p> <o:p></o:p> <o:p></o:p> concrete_patterns[1].type = RTE_FLOW_ITEM_TYPE_ETH;<o:p></o:p> concrete_patterns[1].spec = &eth_pattern;<o:p></o:p> concrete_patterns[1].mask = NULL;<o:p></o:p> concrete_patterns[1].last = NULL;<o:p></o:p> <o:p></o:p> concrete_patterns[2].type = RTE_FLOW_ITEM_TYPE_IPV6;<o:p></o:p> concrete_patterns[2].spec = &ipv6_hdr;<o:p></o:p> concrete_patterns[2].mask = NULL;<o:p></o:p> concrete_patterns[2].last = NULL;<o:p></o:p> <o:p></o:p> concrete_patterns[3].type = RTE_FLOW_ITEM_TYPE_IPV4;<o:p></o:p> concrete_patterns[3].spec = &ipv4_hdr;<o:p></o:p> concrete_patterns[3].mask = NULL;<o:p></o:p> concrete_patterns[3].last = NULL;<o:p></o:p> <o:p></o:p> concrete_patterns[4].type = RTE_FLOW_ITEM_TYPE_ICMP;<o:p></o:p> concrete_patterns[4].spec = &icmp_hdr;<o:p></o:p> concrete_patterns[4].mask = NULL;<o:p></o:p> concrete_patterns[4].last = NULL;<o:p></o:p> <o:p></o:p> concrete_patterns[5].type = RTE_FLOW_ITEM_TYPE_END;<o:p></o:p> concrete_patterns[5].spec = NULL;<o:p></o:p> concrete_patterns[5].mask = NULL;<o:p></o:p> concrete_patterns[5].last = NULL;<o:p></o:p> </Code snippet to create patterns><o:p></o:p> <o:p></o:p> <o:p></o:p> Looking forward to your further support, and many thanks in advance.<o:p></o:p> <o:p></o:p> Best regards,<o:p></o:p> Tao<o:p></o:p> <o:p></o:p> <o:p></o:p> <div id="mail-editor-reference-message-container"> <div> <div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: Asaf Penso <asafp@nvidia.com> Date: Thursday, 21. March 2024 at 20:18 To: Tao Li <byteocean@hotmail.com>, users@dpdk.org <users@dpdk.org> Subject: Re: Finer matching granularity with async template API<o:p></o:p> </div> <div> BTW,<o:p></o:p> </div> <div> In the non working example I see ipv6 / ipv4 / ICMP. Was this your intention or did you mean ipv6 / ICMP?<o:p></o:p> </div> <div> <o:p></o:p> </div> <div id="ms-outlook-mobile-signature"> <div> Regards,<o:p></o:p> </div> <div> Asaf Penso<o:p></o:p> </div> </div> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="0" width="100%" align="center"> </div> <div id="divRplyFwdMsg"> From: Asaf Penso <asafp@nvidia.com> Sent: Thursday, March 21, 2024 9:17:04 PM To: Tao Li <byteocean@hotmail.com>; users@dpdk.org <users@dpdk.org> Subject: Re: Finer matching granularity with async template API <o:p></o:p> <div> <o:p></o:p> </div> </div> <div> <div> Hello Tao,<o:p></o:p> </div> <div> <o:p></o:p> </div> <div> What is the output / error message you get?<o:p></o:p> </div> <div> <o:p></o:p> </div> <div> <o:p></o:p> </div> <div id="x_ms-outlook-mobile-signature"> <div> Regards,<o:p></o:p> </div> <div> Asaf Penso<o:p></o:p> </div> </div> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="0" width="100%" align="center"> </div> <div id="x_divRplyFwdMsg"> From: Tao Li <byteocean@hotmail.com> Sent: Thursday, March 21, 2024 5:44:00 PM To: users@dpdk.org <users@dpdk.org> Subject: Finer matching granularity with async template API <o:p></o:p> <div> <o:p></o:p> </div> </div> <div> <div> Hi all,<o:p></o:p> <o:p></o:p> I am using async template API to install flow rules to perform actions on packets to achieve IP(v4)inIP(v6) tunnelling. Currently I am facing an issue where I cannot perform incoming traffic matching with finer granularity. The test-pmd commands in use are as following:<o:p></o:p> <o:p></o:p> <Not working test-pmd commands><o:p></o:p> port stop all<o:p></o:p> <o:p></o:p> flow configure 0 queues_number 4 queues_size 64 counters_number 0 aging_counters_number 0 meters_number 0 flags 0 # PF0<o:p></o:p> <o:p></o:p> flow configure 1 queues_number 4 queues_size 64 counters_number 0 aging_counters_number 0 meters_number 0 flags 0<o:p></o:p> <o:p></o:p> flow configure 2 queues_number 4 queues_size 64 counters_number 0 aging_counters_number 0 meters_number 0 flags 0<o:p></o:p> <o:p></o:p> flow configure 3 queues_number 4 queues_size 64 counters_number 0 aging_counters_number 0 meters_number 0 flags 0 # PF1V0<o:p></o:p> <o:p></o:p> port start all<o:p></o:p> set verbose 1<o:p></o:p> <o:p></o:p> flow pattern_template 0 create transfer relaxed no pattern_template_id 10 template represented_port ethdev_port_id is 0 / eth / ipv6 / ipv4 / icmp / end<o:p></o:p> <o:p></o:p> set raw_decap 0 eth / ipv6 / end_set<o:p></o:p> set raw_encap 0 eth src is 11:22:33:44:55:66 dst is 66:9d:a7:fd:fb:43 type is 0x0800 / end_set<o:p></o:p> <o:p></o:p> flow actions_template 0 create transfer actions_template_id 10 template raw_decap index 0 / raw_encap index 0 / represented_port / end mask raw_decap index 0 / raw_encap index 0 / represented_port / end<o:p></o:p> <o:p></o:p> flow template_table 0 create group 0 priority 0 transfer wire_orig table_id 5 rules_number 8 pattern_template 10 actions_template 10<o:p></o:p> <o:p></o:p> flow queue 0 create 0 template_table 5 pattern_template 0 actions_template 0 postpone no pattern represented_port ethdev_port_id is 0 / eth / ipv6 / ipv4 / icmp / end actions raw_decap index 0 / raw_encap index 0 / represented_port ethdev_port_id 3 / end<o:p></o:p> <o:p></o:p> flow push 0 queue 0<o:p></o:p> </Not working test-pmd commands><o:p></o:p> <o:p></o:p> Once I remove matching patterns for the inner packet headers( ipv4 / icmp) as following, I can see the processed packets inside VMs using tcpdump.<o:p></o:p> <o:p></o:p> <Working test-pmd commands><o:p></o:p> �<o:p></o:p> flow pattern_template 0 create transfer relaxed no pattern_template_id 10 template represented_port ethdev_port_id is 0 / eth / ipv6 / end<o:p></o:p> �<o:p></o:p> flow queue 0 create 0 template_table 5 pattern_template 0 actions_template 0 postpone no pattern represented_port ethdev_port_id is 0 / eth / ipv6 / end actions raw_decap index 0 / raw_encap index 0 / represented_port ethdev_port_id 3 / end<o:p></o:p> �<o:p></o:p> </Working test-pmd commands><o:p></o:p> <o:p></o:p> Similar combination works when using the synchronous rte_flow API. Any comment or suggestion on this issue is much appreciated. Many thanks in advance.<o:p></o:p> <o:p></o:p> Best regards,<o:p></o:p> Tao<o:p></o:p> <o:p></o:p> <o:p></o:p> </div> </div> </div> </div> </div> </div> </div> </div> </div> <o:p> </o:p> </div> </div> </div> </div> </body> </html>