[dpdk-dev] Compilation of MLX5 driver

[Asaf Sinai]

Hi Shahaf,

Thanks for the useful information!

-----Original Message-----
From: Shahaf Shuler [mailto:shahafs at mellanox.com] 
Sent: Tuesday, July 3, 2018 02:16 PM
To: Asaf Sinai <AsafSi at Radware.com>
Cc: dev at dpdk.org; Nitin Katiyar <nitin.katiyar at ericsson.com>; Nélio Laranjeiro <nelio.laranjeiro at 6wind.com>
Subject: RE: [dpdk-dev] Compilation of MLX5 driver

Tuesday, July 3, 2018 10:01 AM, Asaf Sinai:
> Subject: Re: [dpdk-dev] Compilation of MLX5 driver
> 
> Additional questions:
> Is it possible to use MLNX_OFED-4.3 on Ubuntu 12.04?

I am not sure if there is such build, the oldest OFED build I see is for ubuntu14.10. ubuntu12.04 is really old.

> Why is the driver related to OS version?

Because once you install MLNX_OFED it needs to backport patches, so the base version is important. 

> 
> -----Original Message-----
> From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Asaf Sinai
> Sent: Monday, July 2, 2018 05:22 PM
> To: Shahaf Shuler <shahafs at mellanox.com>
> Cc: dev at dpdk.org; Nitin Katiyar <nitin.katiyar at ericsson.com>; Nélio 
> Laranjeiro <nelio.laranjeiro at 6wind.com>
> Subject: Re: [dpdk-dev] Compilation of MLX5 driver
> 
> Hi Shahaf,
> 
> 1. Can you please explain what is the meaning of upstream-libs?

Upstream-libs means the DPDK works w/ rdma-core library instead of legacy verbs which exists only on Mellanox OFED.

> 2. We use Ubuntu 12.04. so if we would like to stay with it, and use 
> MLNX_OFED-4.0, which latest DPDK version should be used?

That will be v17.05

> 
> Thanks,
> Asaf
> 
> -----Original Message-----
> From: Shahaf Shuler [mailto:shahafs at mellanox.com]
> Sent: Monday, July 2, 2018 05:11 PM
> To: Asaf Sinai <AsafSi at Radware.com>
> Cc: dev at dpdk.org; Nitin Katiyar <nitin.katiyar at ericsson.com>; Nélio 
> Laranjeiro <nelio.laranjeiro at 6wind.com>
> Subject: RE: [dpdk-dev] Compilation of MLX5 driver
> 
> Hi Asaf,
> 
> Monday, July 2, 2018 3:46 PM, Asaf Sinai:
> > Subject: RE: [dpdk-dev] Compilation of MLX5 driver
> >
> > Additional details:
> >
> > Ubuntu: 12.04.3
> > Linux: 3.2.0-53-virtual
> > GCC: 4.7.2 (Ubuntu/Linaro 4.7.2-11precise2)
> >
> > I tried to build DPDK 18.05 after installing the Mellanox OFED 
> > driver
> 
> DPDK version 18.05 supports only upstream-libs (rdma-core).
> 
> > (MLNX_OFED_LINUX-4.0-2.0.0.1-ubuntu12.04-x86_64), but it failed with 
> > the mentioned error.
> > So I removed the OFED driver and installed the EN driver 
> > (mlnx-en-4.0- 2.0.0.1-ubuntu12.04-x86_64), but it also failed with the same error.
> > Both drivers were compiled with "--dpdk" argument ("--upstream-libs"
> > is not supported).
> 
> Yes MLNX_OFED-4.0 is too old for upstream libs. You should use
> MLNX_OFED-4.2 and above.
> Or alternatively use an older DPDK version (not recommended).
> 
> >
> > -----Original Message-----
> > From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Asaf Sinai
> > Sent: Monday, July 2, 2018 03:20 PM
> > To: Shahaf Shuler <shahafs at mellanox.com>
> > Cc: dev at dpdk.org; Nitin Katiyar <nitin.katiyar at ericsson.com>; Nélio 
> > Laranjeiro <nelio.laranjeiro at 6wind.com>
> > Subject: Re: [dpdk-dev] Compilation of MLX5 driver
> >
> > Hi Shahaf,
> >
> > I face similar problem with DPDK 18.05, where missing file is "mlx5dv.h":
> >
> > 	== Build drivers/net/mlx5
> > 	  CC mlx5.o
> > 	In file included from
> > /net/emcradware/CM_Users/asafsi/work/drivers/dpdk/dpdk-
> > 18.05/drivers/net/mlx5/mlx5.h:35:0,
> > 	                 from
> > /net/emcradware/CM_Users/asafsi/work/drivers/dpdk/dpdk-
> > 18.05/drivers/net/mlx5/mlx5.c:40:
> > 	/net/emcradware/CM_Users/asafsi/work/drivers/dpdk/dpdk-
> > 18.05/drivers/net/mlx5/mlx5_mr.h:19:31: fatal error: infiniband/mlx5dv.h:
> > No such file or 	directory
> > 	 #include <infiniband/mlx5dv.h>
> > 	                               ^
> > 	compilation terminated.
> >
> > Can you please advise?
> >
> > Thanks,
> > Asaf
> >
> > -----Original Message-----
> > From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Nitin Katiyar
> > Sent: Thursday, May 31, 2018 02:44 PM
> > To: Nélio Laranjeiro <nelio.laranjeiro at 6wind.com>
> > Cc: Shahaf Shuler <shahafs at mellanox.com>; dev at dpdk.org
> > Subject: Re: [dpdk-dev] Compilation of MLX5 driver
> >
> > Thanks Shahaf, it worked after removing the options you specified.
> >
> > Regards,
> > Nitin
> >
> > -----Original Message-----
> > From: Nélio Laranjeiro [mailto:nelio.laranjeiro at 6wind.com]
> > Sent: Thursday, May 31, 2018 3:23 PM
> > To: Nitin Katiyar <nitin.katiyar at ericsson.com>
> > Cc: Shahaf Shuler <shahafs at mellanox.com>; dev at dpdk.org
> > Subject: Re: [dpdk-dev] Compilation of MLX5 driver
> >
> > On Thu, May 31, 2018 at 09:14:03AM +0000, Nitin Katiyar wrote:
> > > Yes,I installed it using --dpdk --upstream-libs. What is the way 
> > > forward now?
> >
> > In v17.05 MLX5 PMD is still relying on libibverbs and libmlx5, the 
> > way Those options you used are necessary to select in their package 
> > the installation of
> > libverbs,libmlx5 or rdma-core.
> > Doing this you have selected rdma-core which is not supported in
> > v17.05 DPDK version.
> >
> > You need to install Mellanox OFED without those two options to 
> > select libibverbs, libmlx5 to make it work.
> >
> > Regards,
> >
> > > Regards,
> > > Nitin
> > >
> > > -----Original Message-----
> > > From: Nélio Laranjeiro [mailto:nelio.laranjeiro at 6wind.com]
> > > Sent: Thursday, May 31, 2018 1:36 PM
> > > To: Nitin Katiyar <nitin.katiyar at ericsson.com>
> > > Cc: Shahaf Shuler <shahafs at mellanox.com>; dev at dpdk.org
> > > Subject: Re: [dpdk-dev] Compilation of MLX5 driver
> > >
> > > On Thu, May 31, 2018 at 07:01:17AM +0000, Nitin Katiyar wrote:
> > > > Hi,
> > > > It has following files:
> > > >
> > > > arch.h  ib.h  kern-abi.h  mlx4dv.h  mlx5dv.h  opcode.h  sa.h 
> > > > sa-kern-abi.h  verbs.h
> > > >
> > > > I tried with both MLNX_OFED_LINUX-4.2-1.0.0.0 and
> > > > MLNX_OFED_LINUX-4.2-1.2.0.0-ubuntu14.04-x86_64
> > >
> > > Did you installed Mellanox OFED with the --dpdk --upstream-libs
> > arguments for the installation script?
> > >
> > > If it is the case, you should not add them for this version, those 
> > > options are
> > for DPDK v17.11 and higher.
> > >
> > > Regards,
> > >
> > > > Regards,
> > > > Nitin
> > > >
> > > > -----Original Message-----
> > > > From: Shahaf Shuler [mailto:shahafs at mellanox.com]
> > > > Sent: Thursday, May 31, 2018 10:51 AM
> > > > To: Nitin Katiyar <nitin.katiyar at ericsson.com>; Nélio Laranjeiro 
> > > > <nelio.laranjeiro at 6wind.com>
> > > > Cc: dev at dpdk.org
> > > > Subject: RE: [dpdk-dev] Compilation of MLX5 driver
> > > >
> > > > Wednesday, May 30, 2018 7:45 PM, Nitin Katiyar:
> > > > >
> > > > > Hi,
> > > > > I was compiling 17.05.02.
> > > > > Regards,
> > > > > Nitin
> > > > >
> > > > > -----Original Message-----
> > > > > From: Nélio Laranjeiro [mailto:nelio.laranjeiro at 6wind.com]
> > > > > Sent: Wednesday, May 30, 2018 6:42 PM
> > > > > To: Nitin Katiyar <nitin.katiyar at ericsson.com>
> > > > > Cc: dev at dpdk.org
> > > > > Subject: Re: [dpdk-dev] Compilation of MLX5 driver
> > > > >
> > > > > Hi,
> > > > >
> > > > > On Wed, May 30, 2018 at 11:54:31AM +0000, Nitin Katiyar wrote:
> > > > > > Hi,
> > > > > > I am trying to compile MLX5 PMD driver by setting
> > > > > "CONFIG_RTE_LIBRTE_MLX5_PMD=y" and hitting following
> compilation
> > > > > error.
> > > > > >
> > > > > > fatal error: infiniband/mlx5_hw.h: No such file or directory
> > > >
> > > > Can you list the files you have under /usr/include/infiniband ?
> > > >
> > > > > >
> > > > > > I have installed MLNX_OFED _LINUX-4.2-1.2.0 on my Ubuntu 
> > > > > > 14.04 machine
> > > > > but still hitting the same error. Am I missing some other package?
> > > > >
> > > > > Which version of DPDK are you using (it is important to help)?
> > > > >
> > > > > Regards,
> > > > >
> > > > > --
> > > > > Nélio Laranjeiro
> > > > > 6WIND
> > >
> > > --
> > > Nélio Laranjeiro
> > > 6WIND
> >
> > --
> > Nélio Laranjeiro
> > 6WIND