ibverbs_1.8 not found

[Kevin Williams]

Hi,

I have just installed a fresh Rocky 8.8 on a server with two Mellanox interfaces, which seem to have the correct firmware according to Nvidia:

  Device Type:      ConnectX3
  Part Number:      MCX353A-FCB_A2-A5
  Description:      ConnectX-3 VPI adapter card; single-port QSFP; FDR IB (56Gb/s) and 40GigE; PCIe3.0 x8 8GT/s; RoHS R6
  PCI Device Name:  /dev/mst/mt4099_pci_cr1
  Versions:         Current        Available
     FW             2.42.5000      N/A
     PXE            3.4.0752       N/A

  Status:           No matching image found

I have followed all instructions on the Ettus web page (https://kb.ettus.com/Getting_Started_with_DPDK_and_UHD) which proceeded without any issues.

When running an Ettus benchmark utility I get the following error.

[root at rflab-r720 python]# ./benchmark_rate.py --rx_rate 184.32e6 --rx_subdev "A:0 B:0" --rx_channels "0" --tx_rate 184.32e6 --tx_subdev "A:0 B:0" --tx_channels 0 --args "addr=10.28.128.3,second_addr=10.29.128.3,master_clock_rate=184.32e6,use_dpdk=1"
[INFO] [UHD] linux; GNU C++ version 8.5.0 20210514 (Red Hat 8.5.0-20); Boost_106600; DPDK_21.11; UHD_
EAL: Detected CPU lcores: 24
EAL: Detected NUMA nodes: 2
EAL: Detected shared linkage of DPDK
EAL: /usr/lib64/libibverbs.so.1: version `IBVERBS_1.8' not found (required by /usr/lib64/dpdk-pmds/librte_common_mlx5.so.22.0)
EAL: FATAL: Cannot init plugins
EAL: Cannot init plugins
[ERROR] [DPDK] Error with EAL initialization
[ERROR] [UHD] Device discovery error: RuntimeError: Error with EAL initialization
EAL: Detected CPU lcores: 24
EAL: Detected NUMA nodes: 2
EAL: Option -l is ignored, because (-l) is set!

I see there are two locations for libibverbs.so.1, but setting LD_LIBRARY_PATH to either results in the same error.

/usr/lib64/mlnx_ofed/valgrind/libibverbs.so.1
/usr/lib64/libibverbs.so.1

I can't install a new libibverbs RPM because of obsolescence issues.

Can anyone offer any advice?

Many thanks, Kevin