RE: mlx5 sub function issue

Hi Ze wang,

From: ze wang <redacted>
Sent: Wednesday, March 10, 2021 2:59 PM

Hi Parav,
      Thanks for your help. I did enabled VFs, and after turning off SR-IOV, it
works.

Happy to hear that.

Now the each PF can create 255 SFs, which is probably enough for us.
Is it convenient
to reveal how many SFs can be created at most?

Yes, it is. We will be doing this, mostly as devlink resource as discussed last time with Jacob, David, Samudrala in past.
It is in my todo list already. Until its available, please use the existing tooling.

Ze Wang

Parav Pandit [off-list ref] 于2021年3月9日周二 下午8:36写道：

quoted

Hi Ze Wang,

quoted

From: ze wang <redacted>
Sent: Tuesday, March 9, 2021 8:34 AM

Hi David,
      I can see that the variable settings are in effect：
# mlxconfig -d b3:00.0 s PF_BAR2_ENABLE=0 PER_PF_NUM_SF=1
PF_SF_BAR_SIZE=8 # mlxconfig -d b3:00.0 s PER_PF_NUM_SF=1
PF_TOTAL_SF=192 PF_SF_BAR_SIZE=8 # mlxconfig -d b3:00.1 s
PER_PF_NUM_SF=1 PF_TOTAL_SF=192 PF_SF_BAR_SIZE=8

after cold reboot:
# mlxconfig -d b3:00.0 q|grep BAR
PF_BAR2_ENABLE                           False(0)
# mlxconfig -d b3:00.0 q|grep SF
Description:    ConnectX-6 Dx EN adapter card; 25GbE; Dual-port SFP28;
PCIe 4.0 x8; Crypto and Secure Boot
         PER_PF_NUM_SF                   True(1)
         PF_TOTAL_SF                         192
         PF_SF_BAR_SIZE                   8
# mlxconfig -d b3:00.1 q|grep SF
Description:    ConnectX-6 Dx EN adapter card; 25GbE; Dual-port SFP28;
PCIe 4.0 x8; Crypto and Secure Boot
         PER_PF_NUM_SF                  True(1)
         PF_TOTAL_SF                        192
         PF_SF_BAR_SIZE                  8

I tried to create as many SF as possible, then I found each PF can
create up to
132 SFs. I want to confirm the maximum number of SFs that
CX6 can create. If the mft version is correct, can I think that CX6
can create up to 132 SFs per PF?

Do  you have VFs enabled on the system? mlxconfig -d b3:00.0 q | grep
VF If so, please disable SRIOV.

quoted

David Ahern [off-list ref] 于2021年3月8日周一 下午11:48写

道

quoted

quoted

：

quoted

On 3/8/21 12:21 AM, ze wang wrote:

quoted

mlxconfig tool from mft tools version 4.16.52 or higher to set
number of

SF.

quoted

quoted

mlxconfig -d b3:00.0  PF_BAR2_ENABLE=0 PER_PF_NUM_SF=1
PF_SF_BAR_SIZE=8 mlxconfig -d b3:00.0  PER_PF_NUM_SF=1
PF_TOTAL_SF=192 PF_SF_BAR_SIZE=8 mlxconfig -d b3:00.1
PER_PF_NUM_SF=1 PF_TOTAL_SF=192 PF_SF_BAR_SIZE=8

Cold reboot power cycle of the system as this changes the BAR
size in device

Is that capability going to be added to devlink?