[dpdk-dev] [PATCH] eal: forcing IOVA as PA in ppc

Takeshi T Yoshimura TYOS at jp.ibm.com
Thu Aug 1 07:25:22 CEST 2019


-----David Marchand <david.marchand at redhat.com> wrote: -----

>To: Takeshi T Yoshimura <TYOS at jp.ibm.com>
>From: David Marchand <david.marchand at redhat.com>
>Date: 08/01/2019 02:01PM
>Cc: dev <dev at dpdk.org>, David Christensen <drc at linux.vnet.ibm.com>
>Subject: [EXTERNAL] Re: [dpdk-dev] [PATCH] eal: forcing IOVA as PA in
>ppc
>
>Hello,
>
>On Thu, Aug 1, 2019 at 6:10 AM Takeshi T Yoshimura <TYOS at jp.ibm.com>
>wrote:
>> Here's the full debug log I got. I ran upstream SPDK on NVMe on IBM
>Power9 AC922.
>> The operating system is Ubuntu 18.04 and Linux 4.17.
>>
>> Starting SPDK v19.07-pre / DPDK 19.08.0-rc3 initialization...
>> [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0
>--log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6
>--log-level=lib.eal:8 --base-virtaddr=0x200000000000
>--match-allocations --file-prefix=spdk_pid139059 ]
>
>We are missing the initial logs here (eal log level is set twice, but
>this should not be a problem).
>Is it truncated by spdk ? Is there a way to get them ?
>
>Thanks.
>
>-- 
>David Marchand
>
>

Okay. I should have set the --log-level=lib.*:debug. Here is the log.

Starting SPDK v19.10-pre / DPDK 19.08.0-rc3 initialization...
[ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --log-level=lib.*:debug --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159692 ]
EAL: Detected lcore 0 as core 0 on socket 0
EAL: Detected lcore 1 as core 0 on socket 0
EAL: Detected lcore 2 as core 0 on socket 0
EAL: Detected lcore 3 as core 0 on socket 0
EAL: Detected lcore 4 as core 4 on socket 0
EAL: Detected lcore 5 as core 4 on socket 0
EAL: Detected lcore 6 as core 4 on socket 0
EAL: Detected lcore 7 as core 4 on socket 0
EAL: Detected lcore 8 as core 8 on socket 0
EAL: Detected lcore 9 as core 8 on socket 0
EAL: Detected lcore 10 as core 8 on socket 0
EAL: Detected lcore 11 as core 8 on socket 0
EAL: Detected lcore 12 as core 12 on socket 0
EAL: Detected lcore 13 as core 12 on socket 0
EAL: Detected lcore 14 as core 12 on socket 0
EAL: Detected lcore 15 as core 12 on socket 0
EAL: Detected lcore 16 as core 24 on socket 0
EAL: Detected lcore 17 as core 24 on socket 0
EAL: Detected lcore 18 as core 24 on socket 0
EAL: Detected lcore 19 as core 24 on socket 0
EAL: Detected lcore 20 as core 28 on socket 0
EAL: Detected lcore 21 as core 28 on socket 0
EAL: Detected lcore 22 as core 28 on socket 0
EAL: Detected lcore 23 as core 28 on socket 0
EAL: Detected lcore 24 as core 32 on socket 0
EAL: Detected lcore 25 as core 32 on socket 0
EAL: Detected lcore 26 as core 32 on socket 0
EAL: Detected lcore 27 as core 32 on socket 0
EAL: Detected lcore 28 as core 36 on socket 0
EAL: Detected lcore 29 as core 36 on socket 0
EAL: Detected lcore 30 as core 36 on socket 0
EAL: Detected lcore 31 as core 36 on socket 0
EAL: Detected lcore 32 as core 48 on socket 0
EAL: Detected lcore 33 as core 48 on socket 0
EAL: Detected lcore 34 as core 48 on socket 0
EAL: Detected lcore 35 as core 48 on socket 0
EAL: Detected lcore 36 as core 52 on socket 0
EAL: Detected lcore 37 as core 52 on socket 0
EAL: Detected lcore 38 as core 52 on socket 0
EAL: Detected lcore 39 as core 52 on socket 0
EAL: Detected lcore 40 as core 56 on socket 0
EAL: Detected lcore 41 as core 56 on socket 0
EAL: Detected lcore 42 as core 56 on socket 0
EAL: Detected lcore 43 as core 56 on socket 0
EAL: Detected lcore 44 as core 60 on socket 0
EAL: Detected lcore 45 as core 60 on socket 0
EAL: Detected lcore 46 as core 60 on socket 0
EAL: Detected lcore 47 as core 60 on socket 0
EAL: Detected lcore 48 as core 64 on socket 0
EAL: Detected lcore 49 as core 64 on socket 0
EAL: Detected lcore 50 as core 64 on socket 0
EAL: Detected lcore 51 as core 64 on socket 0
EAL: Detected lcore 52 as core 68 on socket 0
EAL: Detected lcore 53 as core 68 on socket 0
EAL: Detected lcore 54 as core 68 on socket 0
EAL: Detected lcore 55 as core 68 on socket 0
EAL: Detected lcore 56 as core 72 on socket 0
EAL: Detected lcore 57 as core 72 on socket 0
EAL: Detected lcore 58 as core 72 on socket 0
EAL: Detected lcore 59 as core 72 on socket 0
EAL: Detected lcore 60 as core 76 on socket 0
EAL: Detected lcore 61 as core 76 on socket 0
EAL: Detected lcore 62 as core 76 on socket 0
EAL: Detected lcore 63 as core 76 on socket 0
EAL: Detected lcore 64 as core 80 on socket 0
EAL: Detected lcore 65 as core 80 on socket 0
EAL: Detected lcore 66 as core 80 on socket 0
EAL: Detected lcore 67 as core 80 on socket 0
EAL: Detected lcore 68 as core 84 on socket 0
EAL: Detected lcore 69 as core 84 on socket 0
EAL: Detected lcore 70 as core 84 on socket 0
EAL: Detected lcore 71 as core 84 on socket 0
EAL: Detected lcore 72 as core 88 on socket 0
EAL: Detected lcore 73 as core 88 on socket 0
EAL: Detected lcore 74 as core 88 on socket 0
EAL: Detected lcore 75 as core 88 on socket 0
EAL: Detected lcore 76 as core 92 on socket 0
EAL: Detected lcore 77 as core 92 on socket 0
EAL: Detected lcore 78 as core 92 on socket 0
EAL: Detected lcore 79 as core 92 on socket 0
EAL: Detected lcore 80 as core 2048 on socket 8
EAL: Detected lcore 81 as core 2048 on socket 8
EAL: Detected lcore 82 as core 2048 on socket 8
EAL: Detected lcore 83 as core 2048 on socket 8
EAL: Detected lcore 84 as core 2052 on socket 8
EAL: Detected lcore 85 as core 2052 on socket 8
EAL: Detected lcore 86 as core 2052 on socket 8
EAL: Detected lcore 87 as core 2052 on socket 8
EAL: Detected lcore 88 as core 2056 on socket 8
EAL: Detected lcore 89 as core 2056 on socket 8
EAL: Detected lcore 90 as core 2056 on socket 8
EAL: Detected lcore 91 as core 2056 on socket 8
EAL: Detected lcore 92 as core 2060 on socket 8
EAL: Detected lcore 93 as core 2060 on socket 8
EAL: Detected lcore 94 as core 2060 on socket 8
EAL: Detected lcore 95 as core 2060 on socket 8
EAL: Detected lcore 96 as core 2064 on socket 8
EAL: Detected lcore 97 as core 2064 on socket 8
EAL: Detected lcore 98 as core 2064 on socket 8
EAL: Detected lcore 99 as core 2064 on socket 8
EAL: Detected lcore 100 as core 2068 on socket 8
EAL: Detected lcore 101 as core 2068 on socket 8
EAL: Detected lcore 102 as core 2068 on socket 8
EAL: Detected lcore 103 as core 2068 on socket 8
EAL: Detected lcore 104 as core 2072 on socket 8
EAL: Detected lcore 105 as core 2072 on socket 8
EAL: Detected lcore 106 as core 2072 on socket 8
EAL: Detected lcore 107 as core 2072 on socket 8
EAL: Detected lcore 108 as core 2076 on socket 8
EAL: Detected lcore 109 as core 2076 on socket 8
EAL: Detected lcore 110 as core 2076 on socket 8
EAL: Detected lcore 111 as core 2076 on socket 8
EAL: Detected lcore 112 as core 2080 on socket 8
EAL: Detected lcore 113 as core 2080 on socket 8
EAL: Detected lcore 114 as core 2080 on socket 8
EAL: Detected lcore 115 as core 2080 on socket 8
EAL: Detected lcore 116 as core 2084 on socket 8
EAL: Detected lcore 117 as core 2084 on socket 8
EAL: Detected lcore 118 as core 2084 on socket 8
EAL: Detected lcore 119 as core 2084 on socket 8
EAL: Detected lcore 120 as core 2088 on socket 8
EAL: Detected lcore 121 as core 2088 on socket 8
EAL: Detected lcore 122 as core 2088 on socket 8
EAL: Detected lcore 123 as core 2088 on socket 8
EAL: Detected lcore 124 as core 2092 on socket 8
EAL: Detected lcore 125 as core 2092 on socket 8
EAL: Detected lcore 126 as core 2092 on socket 8
EAL: Detected lcore 127 as core 2092 on socket 8
EAL: Detected lcore 128 as core 2096 on socket 8
EAL: Detected lcore 129 as core 2096 on socket 8
EAL: Detected lcore 130 as core 2096 on socket 8
EAL: Detected lcore 131 as core 2096 on socket 8
EAL: Detected lcore 132 as core 2100 on socket 8
EAL: Detected lcore 133 as core 2100 on socket 8
EAL: Detected lcore 134 as core 2100 on socket 8
EAL: Detected lcore 135 as core 2100 on socket 8
EAL: Detected lcore 136 as core 2104 on socket 8
EAL: Detected lcore 137 as core 2104 on socket 8
EAL: Detected lcore 138 as core 2104 on socket 8
EAL: Detected lcore 139 as core 2104 on socket 8
EAL: Detected lcore 140 as core 2108 on socket 8
EAL: Detected lcore 141 as core 2108 on socket 8
EAL: Detected lcore 142 as core 2108 on socket 8
EAL: Detected lcore 143 as core 2108 on socket 8
EAL: Detected lcore 144 as core 2112 on socket 8
EAL: Detected lcore 145 as core 2112 on socket 8
EAL: Detected lcore 146 as core 2112 on socket 8
EAL: Detected lcore 147 as core 2112 on socket 8
EAL: Detected lcore 148 as core 2116 on socket 8
EAL: Detected lcore 149 as core 2116 on socket 8
EAL: Detected lcore 150 as core 2116 on socket 8
EAL: Detected lcore 151 as core 2116 on socket 8
EAL: Detected lcore 152 as core 2136 on socket 8
EAL: Detected lcore 153 as core 2136 on socket 8
EAL: Detected lcore 154 as core 2136 on socket 8
EAL: Detected lcore 155 as core 2136 on socket 8
EAL: Detected lcore 156 as core 2140 on socket 8
EAL: Detected lcore 157 as core 2140 on socket 8
EAL: Detected lcore 158 as core 2140 on socket 8
EAL: Detected lcore 159 as core 2140 on socket 8
EAL: Support maximum 1536 logical core(s) by configuration.
EAL: Detected 160 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No shared files mode enabled, IPC will be disabled
EAL: No shared files mode enabled, IPC is disabled
EAL: VFIO PCI modules not loaded
EAL: Bus pci wants IOVA as 'DC'
EAL: Buses did not request a specific IOVA mode.
EAL: IOMMU is available, selecting IOVA as VA mode.
EAL: Module /sys/module/rte_kni not found! error 2 (No such file or directory)
EAL: Selected IOVA mode 'VA'
EAL: No available hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL:   IOMMU type 1 (Type 1) is not supported
EAL:   IOMMU type 7 (sPAPR) is supported
EAL:   IOMMU type 8 (No-IOMMU) is not supported
EAL: VFIO support initialized
EAL: Ask a virtual area of 0x30000 bytes
EAL: Virtual area found at 0x200000000000 (size = 0x30000)
EAL: Setting up physically contiguous memory...
EAL: Setting maximum number of open files to 1048576
EAL: Detected memory type: socket_id:0 hugepage_sz:2097152
EAL: Detected memory type: socket_id:8 hugepage_sz:2097152
EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x200000030000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 0
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x200000200000 (size = 0x400000000)
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x200400200000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 0
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x200400400000 (size = 0x400000000)
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x200800400000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 0
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x200800600000 (size = 0x400000000)
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x200c00600000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 0
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x200c00800000 (size = 0x400000000)
EAL: Creating 4 segment lists: n_segs:8192 socket_id:8 hugepage_sz:2097152
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x201000800000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 8
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x201000a00000 (size = 0x400000000)
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x201400a00000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 8
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x201400c00000 (size = 0x400000000)
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x201800c00000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 8
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x201800e00000 (size = 0x400000000)
EAL: Ask a virtual area of 0x70000 bytes
EAL: Virtual area found at 0x201c00e00000 (size = 0x70000)
EAL: Memseg list allocated: 0x800kB at socket 8
EAL: Ask a virtual area of 0x400000000 bytes
EAL: Virtual area found at 0x201c01000000 (size = 0x400000000)
EAL: Hugepages will be freed exactly as allocated.
EAL: No shared files mode enabled, IPC is disabled
EAL: TSC frequency is ~510000 KHz
EAL: Master lcore 0 is ready (tid=7430194644a0;cpuset=[0])
EAL: Trying to obtain current memory policy.
EAL: Setting policy MPOL_PREFERRED for socket 0
EAL: Restoring previous memory policy: 0
EAL: request: mp_malloc_sync
EAL: No shared files mode enabled, IPC is disabled
EAL: Heap on socket 0 was expanded by 2MB
EAL: No shared files mode enabled, IPC is disabled
EAL: Mem event callback 'spdk:(nil)' registered
EAL: PCI device 0000:01:00.0 on NUMA socket 0
EAL:   probe driver: 144d:a822 spdk_nvme
EAL:   Expecting 'PA' IOVA mode but current mode is 'VA', not initializing
EAL: Requested device 0000:01:00.0 cannot be used
EAL: PCI device 0003:01:00.0 on NUMA socket 0
EAL:   probe driver: 144d:a822 spdk_nvme
EAL:   Expecting 'PA' IOVA mode but current mode is 'VA', not initializing
EAL: Requested device 0003:01:00.0 cannot be used
EAL: PCI device 0030:01:00.0 on NUMA socket 8
EAL:   probe driver: 144d:a822 spdk_nvme
EAL:   Expecting 'PA' IOVA mode but current mode is 'VA', not initializing
EAL: Requested device 0030:01:00.0 cannot be used
No NVMe controllers found.



More information about the dev mailing list