<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"><html><head><meta content="text/html;charset=UTF-8" http-equiv="Content-Type"></head><body ><div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;"><div>Hi, </div><div><div> </div><div>after assigning the flow to non-root table (by setting the flow group value greater than 0), the flow was created successfully without any errors. </div><div> </div><div>Thanks, </div><div>Gopinath K </div></div><div> </div><div id="Zm-_Id_-Sgn" data-sigid="8035361000000008028" data-zbluepencil-ignore="true"><div>Sent using <a target="_blank" style="color: rgb(89, 143, 222);">Zoho Mail</a> </div></div><div> </div><div class="zmail_extra_hr" style="border-top: 1px solid rgb(204, 204, 204); height: 0px; margin-top: 10px; margin-bottom: 10px; line-height: 0px;"> </div><div class="zmail_extra" data-zbluepencil-ignore="true"><div> </div><div id="Zm-_Id_-Sgn1">---- On Wed, 06 Nov 2024 14:52:10 +0530 Gopinath K <gopinath.gk@zohomail.com> wrote --- </div><div> </div><blockquote id="blockquote_zmail" style="margin: 0px;"><div><div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt"><div>FW version: 16.35.1012 (MT_0000000425) </div><div>OFED version: 24.07-0.6.1 </div><div> </div><div id="x_960937842Zm-_Id_-Sgn"><div>Sent using <a style="color: rgb(89, 143, 222);" target="_blank">Zoho Mail</a> </div></div><div> </div><div style="border-top: 1px solid rgb(204, 204, 204); min-height: 0px; margin-top: 10px; margin-bottom: 10px; line-height: 0px" class="x_960937842zmail_extra_hr"> </div><div class="x_960937842zmail_extra"><div> </div><div id="x_960937842Zm-_Id_-Sgn1">---- On Wed, 06 Nov 2024 14:46:15 +0530 Bing Zhao <<a target="_blank" href="mailto:bingz@nvidia.com">bingz@nvidia.com</a>> wrote --- </div><div> </div><div id="zmail_block"> </div></div><div> </div></div> </div><blockquote style="margin: 0px" id="x_960937842blockquote_zmail"><div class="zm_8178111060221268416_parse_9069091796139378113"><div class="x_1806222849WordSection1">Which FW and OFED version are you using? BTW, have you tried on 6-Dx and can you try on the non-root (>0) group? I remember of the send_to_kernel is only supported on non-root tables. <div style="border: none; border-left: solid blue 1.5pt; padding: 0in 0in 0in 4pt"><div><div style="border: none; border-top: solid rgb(225, 225, 225) 1pt; padding: 3pt 0in 0in 0in">From: Gopinath K <<a href="mailto:gopinath.gk@zohomail.com" target="_blank">gopinath.gk@zohomail.com</a>> Sent: Tuesday, November 5, 2024 4:23 PM To: users <<a href="mailto:users@dpdk.org" target="_blank">users@dpdk.org</a>> Subject: Error with SEND_TO_KERNEL Action during Flow creation on Mellanox CX-5</div></div> <table class="x_1806222849MsoNormalTable" border="1" cellpadding="0" style="background: rgb(255, 235, 156);"><tbody><tr><td style="padding: 0.75pt 0.75pt 0.75pt 0.75pt">External email: Use caution opening links or attachments </td></tr></tbody></table> <div><div><div><div><div>Hi, I'm new to DPDK, and have been working on creating flow rules by using DPDK, to steer traffic to the kernel. To understand the functionality of the Mellanox Bifuracted drive, i attempted to steer ICMP packets to Linux Kernel and other traffics to DPDK application. first i tried to create simple flow rule which drops the packet whose destination equals 192.168.3.2 <a href="https://doc.dpdk.org/guides/howto/rte_flow.html" target="_blank">(refrenced from from API examples)</a> the flow created successfully without an error.</div><div> </div><div> However the issue arises when I attempt to use the RTE_FLOW_ACTION_TYPE_SEND_TO_KERNEL, which results in an error. </div><div> </div><div>Below the sample code. 1. functions to validate and create flow rule.</div><div><blockquote style="border: solid rgb(204, 204, 204) 1pt; padding: 5pt 5pt 5pt 5pt; margin-top: 5pt; margin-bottom: 5pt"><div>static ::rte_flow* create_flow(uint16_t port_id, rte_flow_attr& attr, rte_flow_item& pattern, rte_flow_action& actions) { </div><div> rte_flow_error error; </div><div> auto flow = rte_flow_create(port_id, &attr, &pattern, &actions, &error); </div><div> if (!flow) { </div><div> printf("[create flow rule] failed to create flow rule, error: %s.\n", error.message); </div><div> } </div><div> return flow; </div><div>} </div><div> </div><div>bool validate_flow(uint16_t port_id, rte_flow_attr& attr, rte_flow_item& pattern, rte_flow_action& action) { </div><div> rte_flow_error error; </div><div> auto res = rte_flow_validate(port_id, &attr, &pattern, &action, &error); </div><div> if (res < 0) { </div><div> printf("[validate flow rule] validate flow failed, error: %s\n", error.message); </div><div> return false; </div><div> } </div><div> return true; </div><div>} </div></blockquote></div></div><div> </div><div> 2. function to enable isolated mode on network port. </div><div><blockquote style="border: solid rgb(204, 204, 204) 1pt; padding: 5pt 5pt 5pt 5pt; margin-top: 5pt; margin-bottom: 5pt"><div>bool enable_isolated_mode(uint16_t port_id) { </div><div> rte_flow_error error; </div><div> </div><div> // enable isolated mode. </div><div> if (rte_flow_isolate(port_id, 1, &error) < 0) { </div><div> printf("[isolated mode] failed to enable isolated mode on port %u, error: %s\n", port_id, error.message); </div><div> return false; </div><div> } </div><div> </div><div> printf("[isolated mode] isolated mode enabled on port %u\n", port_id); </div><div> return true; </div><div>} </div></blockquote></div><div> </div><div><div> 3. port initialization function. </div><blockquote style="border: solid rgb(204, 204, 204) 1pt; padding: 5pt 5pt 5pt 5pt; margin-top: 5pt; margin-bottom: 5pt"><div>static inline int </div><div>port_initilization(uint16_t port, rte_mempool *mbuf_pool) { </div><div> rte_eth_conf port_conf; </div><div> </div><div> if (!rte_eth_dev_is_valid_port(port)) { </div><div> printf("[port init] port %u is not a valid port\n", port); </div><div> return -1; </div><div> } </div><div> if (!enable_isolated_mode(port)) { </div><div> return -1; </div><div> } </div><div> memset(&port_conf, 0, sizeof(rte_eth_conf)); </div><div> rte_eth_dev_info device_info; </div><div> auto retval = rte_eth_dev_info_get(port, &device_info); </div><div> if (retval != 0) { </div><div> printf("[pirt init] getting device(port %u) info, error: %d [%s]\n", port, rte_errno, ::rte_strerror(rte_errno)); </div><div> return retval; </div><div> } </div><div> </div><div> if (device_info.tx_offload_capa & RTE_ETH_TX_OFFLOAD_MBUF_FAST_FREE) </div><div> port_conf.txmode.offloads |= RTE_ETH_TX_OFFLOAD_MBUF_FAST_FREE; </div><div> </div><div> uint16_t rx_rings = 1; </div><div> uint16_t tx_rings = 1; </div><div> retval = rte_eth_dev_configure(port, rx_rings, tx_rings, &port_conf); </div><div> if (retval != 0) { </div><div> printf("[port init] failed to configure port(%u), error: %d [%s]\n", port, rte_errno, ::rte_strerror(rte_errno)); </div><div> return retval; </div><div> } </div><div> </div><div> uint16_t nb_rxd = RX_RING_SIZE; </div><div> uint16_t nb_txd = TX_RING_SIZE; </div><div> retval = rte_eth_dev_adjust_nb_rx_tx_desc(port, &nb_rxd, &nb_txd); </div><div> if (retval != 0) { </div><div> printf("[port init] rte_eth_dev_adjust failed, error: %d [%s]\n", rte_errno, ::rte_strerror(rte_errno)); </div><div> return retval; </div><div> } </div><div> </div><div> for (auto q = 0; q < rx_rings; q++) { </div><div> retval = rte_eth_rx_queue_setup(port, q, nb_rxd, rte_eth_dev_socket_id(port), NULL, mbuf_pool); </div><div> if (retval < 0) </div><div> return retval; </div><div> } </div><div> </div><div> auto tx_conf = device_info.default_txconf; </div><div> tx_conf.offloads = port_conf.txmode.offloads; </div><div> for (auto q = 0; q < tx_rings; q++) { </div><div> retval = rte_eth_tx_queue_setup(port, q, nb_txd, rte_eth_dev_socket_id(port), &tx_conf); </div><div> if (retval < 0) </div><div> return retval; </div><div> } </div><div> </div><div> ::rte_ether_addr addr; </div><div> retval = rte_eth_macaddr_get(port, &addr); </div><div> if (retval != 0) </div><div> return retval; </div><div> </div><div> retval = rte_eth_dev_start(port); </div><div> if (retval != 0) { </div><div> printf("[port init] starting port %u failed, error: %d [%s]\n", port, rte_errno, rte_strerror(rte_errno)); </div><div> return retval; </div><div> } </div><div> printf("[port init] successfully started port: %u\n", port); </div><div> printf("port %u MAC: %02" PRIx8 " %02" PRIx8 " %02" PRIx8 " %02" PRIx8 " %02" PRIx8 " %02" PRIx8 "\n", port, RTE_ETHER_ADDR_BYTES(&addr)); </div><div> init_ingress_flow_rules(port); </div><div> init_egress_flow_rule(port); </div><div> </div><div> return 0; </div><div>} </div></blockquote></div><div> </div><div> 4. Flow rule </div></div><div><blockquote style="border: solid rgb(204, 204, 204) 1pt; padding: 5pt 5pt 5pt 5pt; margin-top: 5pt; margin-bottom: 5pt"><div>static void init_ingress_flow_rule(uint32_t port_id) { </div><div> rte_flow_attr attr = {0}; </div><div> rte_flow_item pattern[4]; </div><div> rte_flow_action action[2]; </div><div> </div><div> attr.ingress = 1; </div><div> memset(pattern, 0, sizeof pattern); </div><div> rte_flow_item_eth eth_spec; </div><div> rte_flow_item_eth eth_mask; </div><div> memset(&eth_spec, 0, sizeof eth_spec); </div><div> memset(&eth_mask, 0, sizeof eth_mask); </div><div> pattern[0].type = RTE_FLOW_ITEM_TYPE_ETH; </div><div> pattern[0].spec = &eth_spec; </div><div> </div><div> rte_flow_item_ipv4 ipv4_spec; </div><div> rte_flow_item_ipv4 ipv4_mask; </div><div> memset(&ipv4_spec, 0, sizeof ipv4_spec); </div><div> memset(&ipv4_mask, 0, sizeof ipv4_mask); </div><div> pattern[1].type = RTE_FLOW_ITEM_TYPE_IPV4; </div><div> pattern[1].spec = &ipv4_spec; </div><div> pattern[1].mask = &ipv4_mask; </div><div> </div><div> rte_flow_item_icmp icmp_spec; </div><div> rte_flow_item_icmp icmp_mask; </div><div> memset(&icmp_spec, 0, sizeof icmp_spec); </div><div> memset(&icmp_mask, 0, sizeof icmp_mask); </div><div> icmp_spec.hdr.icmp_type = 0; </div><div> pattern[2].type = RTE_FLOW_ITEM_TYPE_ICMP; </div><div> pattern[2].spec = &icmp_spec; </div><div> pattern[2].mask = &icmp_mask; </div><div> pattern[3].type = RTE_FLOW_ITEM_TYPE_END; </div><div> </div><div> action[0].type = RTE_FLOW_ACTION_TYPE_SEND_TO_KERNEL; </div><div> action[1].type = RTE_FLOW_ACTION_TYPE_END; </div><div> </div><div> if (validate_flow(port_id, attr, pattern[0], action[0])) { </div><div> printf("[init flow rule] validated successfully.\n"); </div><div> auto flow = create_flow(port_id, attr, pattern[0], action[0]); </div><div> if (flow != NULL) { </div><div> printf("[rte flow rule] successfully created a egress flow rule in port %u\n", port_id); </div><div> } </div><div> } </div><div>} </div></blockquote><div> </div><div>When I try to run the above program, the flow rule validated successfully with `rte_flow_validate()`, but failed on creating the flow with an error of `hardware refuses to create flow`. </div><blockquote style="border: solid rgb(204, 204, 204) 1pt; padding: 5pt 5pt 5pt 5pt; margin-top: 5pt; margin-bottom: 5pt"><div>[init flow rule] validated successfully. </div><div>[create flow rule] failed to create flow rule, error: hardware refuses to create flow. </div></blockquote><div>The same error arise when try to create the flow in `dpdk-testpmd` program. </div><blockquote style="border: solid rgb(204, 204, 204) 1pt; padding: 5pt 5pt 5pt 5pt; margin-top: 5pt; margin-bottom: 5pt"><div>testpmd> flow isolate 0 true </div><div>testpmd> port start 0 </div><div>testpmd> flow create 0 ingress pattern eth / ipv4 / icmp / end actions send_to_kernel / end </div><div>port_flow_complain(): Caught PMD error type 1 (cause unspecified): hardware refuses to create flow: Operation not supported Can anyone tell me whether my code is correct or not?</div></blockquote><div> </div><div>Can anyone tell me whether my code is correct or not? and any idea how to use SEND_TO_KERNEL Action on Mellanox CX-5 NIC's. System specification. Operating System: Debian</div><div> OS Version: 12.7 DPDK version: 24.07 Thanks and Regards, Gopinath.</div></div><div><div> </div></div><div><div><div><div id=""><div>Sent using Zoho Mail </div></div></div></div></div><div> </div></div> </div></div></div></div></blockquote></blockquote></div><div> </div></div> </body></html>