Enabling multiport eswitch (mlx5) breaks PF1 bifurcation immediately

[Dariusz Sosnowski]

Hi,

> From: Guelce, Guevenc <guevenc.guelce at sap.com> 
> Sent: Friday, June 14, 2024 11:18
> To: users at dpdk.org
> Cc: Dariusz Sosnowski <dsosnowski at nvidia.com>
> Subject: Enabling multiport eswitch (mlx5) breaks PF1 bifurcation immediately 
> Hi all, Hi Dariusz,
> 
> 
> Thanks a lot for your help so far. We really appreciate it.
> I just want to touch base with this question which was asked by my colleague Tao a while back.
> 
> Our question is actually quite simple. Issuing the commands listed below on a ConnectX-6 Dx Card breaks the 
> bifurcated nature of the mlx5 driver in linux kernel for PF1. (No traffic is forwarded to linux kernel anymore on PF1)
> You don’t need to start any testpmd or dpdk application. Just issuing the following commands below breaks the PF1 
> in linux kernel already.
> 
> sudo devlink dev eswitch set pci/0000:8a:00.0 mode switchdev
> sudo devlink dev eswitch set pci/0000:8a:00.1 mode switchdev
> sudo devlink dev param set pci/0000:8a:00.0 name esw_multiport value true cmode runtime
> sudo devlink dev param set pci/0000:8a:00.1 name esw_multiport value true cmode runtime
> 
> 
> ----<test environment>-----
> pci/0000:8a:00.0:
>   driver mlx5_core
>   versions:
>       fixed:
>         fw.psid MT_0000000359
>       running:
>         fw.version 22.39.2048
>         fw 22.39.2048
> Linux kernel version: 6.6.16
> DPDK: 23.11 (But not really needed to reproduce the issue)
> ----</test environment>------
> 
> 
> This makes the eswitch multiport feature for us unusable. Could you please advise whether we are missing smt here ?
> As we are really keen to use this feature.

Could you please send us the following info? It would help with debugging the issue.

- Despite the Multiport E-Switch configuration, do you configure any additional bonding?
- Output of commands:
    - sudo devlink dev param show
    - for f in /sys/kernel/debug/mlx5/0000:8a:00.0/lag/*; do echo $f; cat $f; done
    - for f in /sys/kernel/debug/mlx5/0000:8a:00.1/lag/*; do echo $f; cat $f; done
- Output of dmesg, ideally all logs since boot.

> 
> Thanks & Regards
> 
> 
> Guvenc Gulce
> 

Best regards,
Dariusz Sosnowski