[dpdk-dev] DPDK failure -- DMA error - HP GEN9 - RHEL7.2

[Boaron, Yossi (Nokia - IL)]

Hi All,

After successful deployment of OVS (2.4) -DPDK (2.0) on HP GEN 7 blade  ,
I  tried to activate it also  on HP GEN9 (BL460C), got DMA error  ("PTE Read access is not set" , see attached  file).

I found several  discussions describing similar scenarios (for HP GEN8),
http://permalink.gmane.org/gmane.comp.networking.dpdk.devel/22140
http://comments.gmane.org/gmane.comp.networking.dpdk.devel/2281

But couldn't find any solution/work around   , you can find below compute details.

Your help is highly appreciated.

Kind regards
Yossi




Compute details :

Compute HW :
HP C7K , BL460c-G9


Bios configuration (See attached  file):
Virtaulization Technology = Enabled
Intel(R0 VT-d = Enable
SRIOV = tried it with both Enable and Disable , no success


Kernel version :
[root at compute-0-1 ~]# uname -a
Linux compute-0-1.local 3.10.0-327.10.1.el7.x86_64 #1 SMP Sat Jan 23 04:54:55 EST 2016 x86_64 x86_64 x86_64 GNU/Linux


Kernel config :
[root at compute-0-1 ~]# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-3.10.0-327.10.1.el7.x86_64 root=UUID=c79b653b-d2bf-4f76-9ed1-f8445cd6acec ro vconsole.keymap=us vconsole.font=latarcyrheb-sun16 rhgb quiet LANG=en_US.UTF-8 crashkernel=auto vga=normal nomodeset 3 selinux=0 default_hugepagesz=1G hugepagesz=1G hugepages=87 iommu=pt intel_iommu=on
[root at compute-0-1 ~]#


Adding port to OVS as dpdk port :

modprobe uio_pci_generic
dpdk_nic_bind.py --bind=uio_pci_generic 0000:08:00.0
ovs-vsctl add-port ..........



DMA error (see also attached file) :

[root at compute-0-1 ~]# dmesg | grep dma
[    0.053730] dmar: Host address width 46
[    0.053731] dmar: DRHD base: 0x000000fbffc000 flags: 0x0
[    0.053737] dmar: IOMMU 0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020df
[    0.053738] dmar: DRHD base: 0x000000c7ffc000 flags: 0x1
[    0.053741] dmar: IOMMU 1: reg_base_addr c7ffc000 ver 1:0 cap d2078c106f0466 ecap f020df
[    0.053742] dmar: RMRR base: 0x00000079171000 end: 0x00000079173fff
[    0.053744] dmar: RMRR base: 0x000000791ed000 end: 0x000000791f0fff
[    0.053744] dmar: RMRR base: 0x000000791dd000 end: 0x000000791ecfff
[    0.053745] dmar: RMRR base: 0x000000791ca000 end: 0x000000791dafff
[    0.053746] dmar: RMRR base: 0x000000791db000 end: 0x000000791dcfff
[    0.053750] dmar: RMRR base: 0x0000005ac9d000 end: 0x0000005acdcfff
[    1.020336] pnp 00:01: [dma 4]
[    3.755796] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    3.756468] ioatdma 0000:00:04.0: irq 302 for MSI/MSI-X
[    3.757199] ioatdma 0000:00:04.1: irq 304 for MSI/MSI-X
[    3.757597] ioatdma 0000:00:04.2: irq 305 for MSI/MSI-X
[    3.758044] ioatdma 0000:00:04.3: irq 306 for MSI/MSI-X
[    3.758352] ioatdma 0000:00:04.4: irq 307 for MSI/MSI-X
[    3.758669] ioatdma 0000:00:04.5: irq 308 for MSI/MSI-X
[    3.758978] ioatdma 0000:00:04.6: irq 309 for MSI/MSI-X
[    3.759292] ioatdma 0000:00:04.7: irq 310 for MSI/MSI-X
[    3.759600] ioatdma 0000:80:04.0: irq 312 for MSI/MSI-X
[    3.759849] ioatdma 0000:80:04.1: irq 314 for MSI/MSI-X
[    3.760093] ioatdma 0000:80:04.2: irq 316 for MSI/MSI-X
[    3.760356] ioatdma 0000:80:04.3: irq 318 for MSI/MSI-X
[    3.760599] ioatdma 0000:80:04.4: irq 319 for MSI/MSI-X
[    3.760828] ioatdma 0000:80:04.5: irq 320 for MSI/MSI-X
[    3.761189] ioatdma 0000:80:04.6: irq 321 for MSI/MSI-X
[    3.761407] ioatdma 0000:80:04.7: irq 322 for MSI/MSI-X
[    8.554411] RPC: Registered rdma transport module.
[  222.278558] dmar: DRHD: handling fault status reg 2
[  222.278627] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr 52633d000
[  224.168760] dmar: DRHD: handling fault status reg 102
[  224.169003] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr 52633d000
[  225.164728] dmar: DRHD: handling fault status reg 202
[  225.164978] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr 52633d000
[  225.200170] dmar: DRHD: handling fault status reg 302
[  225.200398] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr 52633d000
[  226.172331] dmar: DRHD: handling fault status reg 402
[  226.172569] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr 52633d000
[  227.199846] dmar: DRHD: handling fault status reg 502
[  227.200088] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr 52633d000
[root at compute-0-1 ~]# Connection to compute-0-1 closed by remote host.