<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang="EN-GB" link="blue" vlink="purple" style="word-wrap:break-word"> <div class="WordSection1"> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US">[Top posting, as HTML email]<o:p></o:p></span></font></p> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></font></p> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US">HI Chakka,<o:p></o:p></span></font></p> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></font></p> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US">When linking against DPDK in Shared-library mode, the .so files to handle drivers are not automatically loaded;<o:p></o:p></span></font></p> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US"><a href="https://doc.dpdk.org/guides-20.05/linux_gsg/linux_eal_parameters.html#linux-specific-eal-parameters">https://doc.dpdk.org/guides-20.05/linux_gsg/linux_eal_parameters.html#linux-specific-eal-parameters</a></span></font><span style="mso-fareast-language:EN-US"><o:p></o:p></span></p> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></font></p> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Notice the -d flag in particular: "-d <path to shared object or directory>", when used and pointed to the correct .so for the ice pmd .so file,<o:p></o:p></span></font></p> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt;mso-fareast-language:EN-US">DPDK will be able to initialize the NIC.<o:p></o:p></span></font></p> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></font></p> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt;mso-fareast-language:EN-US">As a workaround/alternative, static-linking against DPDK will avoid the requirement to use "-d" EAL arg to load the PCI device .so drivers.<o:p></o:p></span></font></p> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></font></p> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Hope that helps, -Harry<o:p></o:p></span></font></p> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></font></p> <p class="MsoNormal"><font size="2" color="#f6f6f6" face="Calibri"><span style="font-size:11.0pt;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></font></p> <div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt"> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> <p class="MsoNormal"><b><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt;font-weight:bold">From:</span></font></b><span lang="EN-US"> Lokesh Chakka <lvenkatakumarchakka@gmail.com> <br> <b><span style="font-weight:bold">Sent:</span></b> Monday, August 1, 2022 9:20 AM<br> <b><span style="font-weight:bold">To:</span></b> Tkachuk, Georgii <georgii.tkachuk@intel.com><br> <b><span style="font-weight:bold">Cc:</span></b> users <users@dpdk.org><br> <b><span style="font-weight:bold">Subject:</span></b> Re: intel 100 Gbps Network card shutting down after enabling dpdk<o:p></o:p></span></p> </div> </div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> <div> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">After booting the server, the following are commands I have executed. Immediately after doing devbind -b, cards are going down. I am able to see that green leds are turning off.<o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> </div> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">following is the two lines of code and output of code. number of ports are reporting as zero<o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> </div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++<o:p></o:p></span></font></p> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">$ lspci | grep -i intel<br> c3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)<br> c3:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)<br> <br> $ sudo dpdk-devbind.py -b vfio-pci c3:00.0 c3:00.1<br> $ sudo dpdk-devbind.py -s<br> <br> Network devices using DPDK-compatible driver<br> ============================================<br> 0000:c3:00.0 'Ethernet Controller E810-C for QSFP 1592' drv=vfio-pci unused=ice<br> 0000:c3:00.1 'Ethernet Controller E810-C for QSFP 1592' drv=vfio-pci unused=ice<br> <br> Network devices using kernel driver<br> ===================================<br> 0000:05:00.0 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=eno1 drv=tg3 unused=vfio-pci <br> 0000:05:00.1 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=eno2 drv=tg3 unused=vfio-pci <br> 0000:05:00.2 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=eno3 drv=tg3 unused=vfio-pci <br> 0000:05:00.3 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=eno4 drv=tg3 unused=vfio-pci <br> 0000:83:00.0 'BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet 1750' if=ens3f0np0 drv=bnxt_en unused=vfio-pci <br> 0000:83:00.1 'BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet 1750' if=ens3f1np1 drv=bnxt_en unused=vfio-pci <br> <br> No 'Baseband' devices detected<br> ==============================<br> <br> Crypto devices using kernel driver<br> ==================================<br> 0000:02:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=ccp unused=vfio-pci <br> 0000:03:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1456' drv=ccp unused=vfio-pci <br> 0000:41:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=ccp unused=vfio-pci <br> 0000:42:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1456' drv=ccp unused=vfio-pci <br> 0000:81:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=ccp unused=vfio-pci <br> 0000:82:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1456' drv=ccp unused=vfio-pci <br> 0000:c1:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=ccp unused=vfio-pci <br> 0000:c2:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1456' drv=ccp unused=vfio-pci <br> <br> No 'DMA' devices detected<br> =========================<br> <br> No 'Eventdev' devices detected<br> ==============================<br> <br> No 'Mempool' devices detected<br> =============================<br> <br> No 'Compress' devices detected<br> ==============================<br> <br> No 'Misc (rawdev)' devices detected<br> ===================================<br> <br> No 'Regex' devices detected<br> ===========================<br> <br> $ cat one.c <br> #include <inttypes.h><br> #include <rte_ethdev.h><br> <br> <br> int main(int argc, char *argv[])<br> {<br> struct rte_mempool *mbuf_pool;<br> unsigned nb_ports;<br> uint16_t portid;<br> <br> /* Initializion the Environment Abstraction Layer (EAL). 8< */<br> int ret = rte_eal_init(argc, argv);<br> if (ret < 0)<br> rte_exit(EXIT_FAILURE, "Error with EAL initialization\n");<br> /* >8 End of initialization the Environment Abstraction Layer (EAL). */<br> <br> argc -= ret;<br> argv += ret;<br> <br> fprintf( stderr, "%s %d\n", __func__, __LINE__ );<br> /* Check that there is an even number of ports to send/receive on. */<br> nb_ports = rte_eth_dev_count_avail();<br> fprintf( stderr, "%s %d nb_ports: %u\n", __func__, __LINE__, nb_ports );<br> }<br> <br> $ gcc one.c `pkg-config --cflags libdpdk --libs libdpdk`<br> $ sudo ./a.out <br> EAL: Detected CPU lcores: 64<br> EAL: Detected NUMA nodes: 4<br> EAL: Detected shared linkage of DPDK<br> EAL: Multi-process socket /var/run/dpdk/rte/mp_socket<br> EAL: Selected IOVA mode 'VA'<br> EAL: No available 1048576 kB hugepages reported<br> EAL: VFIO support initialized<br> EAL: Using IOMMU type 1 (Type 1)<br> EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.0 (socket 3)<br> set_mempolicy: Invalid argument<br> EAL: Releasing PCI mapped resource for 0000:c3:00.0<br> EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4102000000<br> EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4104000000<br> EAL: Requested device 0000:c3:00.0 cannot be used<br> EAL: Using IOMMU type 1 (Type 1)<br> EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.1 (socket 3)<br> set_mempolicy: Invalid argument<br> EAL: Releasing PCI mapped resource for 0000:c3:00.1<br> EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4104010000<br> EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4106010000<br> EAL: Requested device 0000:c3:00.1 cannot be used<br> TELEMETRY: No legacy callbacks, legacy socket not created<br> main 20<br> main 23 nb_ports: 0<o:p></o:p></span></font></p> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> </div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ <o:p></o:p></span></font></p> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><br> Thanks & Regards<br> --<br> Lokesh Chakka.<o:p></o:p></span></font></p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> </div> </div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p> <div> <div> <p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">On Mon, Aug 1, 2022 at 12:44 PM Tkachuk, Georgii <<a href="mailto:georgii.tkachuk@intel.com" target="_blank">georgii.tkachuk@intel.com</a>> wrote:<o:p></o:p></span></font></p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">Please check “sudo dpdk-devbind.py -s” to see if both ports are bound to vfio-pci <o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">And some questions: <o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">What DPDK app are you running? <o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">What are your EAL command line arguments? <o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">What do you mean by going down (as reported by what?) <o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">Thank you,<o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">Georgii<o:p></o:p></span></font></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> <div style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0cm 0cm 0cm;border-color:currentcolor currentcolor"> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt;font-weight:bold">From:</span></font></b><span lang="EN-US"> Lokesh Chakka <<a href="mailto:lvenkatakumarchakka@gmail.com" target="_blank">lvenkatakumarchakka@gmail.com</a>> <br> <b><span style="font-weight:bold">Sent:</span></b> Monday, August 01, 2022 12:09 AM<br> <b><span style="font-weight:bold">To:</span></b> users <<a href="mailto:users@dpdk.org" target="_blank">users@dpdk.org</a>><br> <b><span style="font-weight:bold">Subject:</span></b> intel 100 Gbps Network card shutting down after enabling dpdk<o:p></o:p></span></p> </div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> <div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">hello,<o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">Recently I have bought one intel network card <o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"><a href="https://ark.intel.com/content/www/us/en/ark/products/210969/intel-ethernet-network-adapter-e8102cqda2.html" target="_blank">https://ark.intel.com/content/www/us/en/ark/products/210969/intel-ethernet-network-adapter-e8102cqda2.html</a><o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">The moment I do devbind, cards are shutting down.<o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">$ lspci | grep -i intel<br> c3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)<br> c3:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)<br> <br> $ sudo dpdk-devbind.py -b vfio-pci c3:00.0 c3:00.1<br> <br> After this, cards are going down. EAL is giving following error<o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">EAL: Requested device 0000:c3:00.1 cannot be used<br> EAL: Error - exiting with code: 1<br> Cause: Error: number of ports must be even<o:p></o:p></span></font></p> </div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"> <o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt">Did anyone face this issue or anyone know how to fix the issue?<o:p></o:p></span></font></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><font size="2" face="Calibri"><span lang="EN-US" style="font-size:11.0pt"><br> Thanks & Regards<br> --<br> Lokesh Chakka.<o:p></o:p></span></font></p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </blockquote> </div> </div> </div> </body> </html>