netdev - Re: mlx5 sub function issue

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-ID: <CANS1P8E8uPpR+SN4Qs9so_3Lve3p2jxsRg_3Grg5JBK5m55=Tw@mail.gmail.com>
Date:   Mon, 8 Mar 2021 15:21:55 +0800
From:   ze wang <wangze712@...il.com>
To:     Parav Pandit <parav@...dia.com>
Cc:     Saeed Mahameed <saeedm@...dia.com>, netdev@...r.kernel.org
Subject: Re: mlx5 sub function issue

Hi Parav,

Thanks for the answer.
There are more than two hundred CPUs on our machine, we're planning to
put SFs into the containers, This may requires allocate one SF per
CPU,so we want to know the upper limit of creating SFs.

By the way, the latest version of the MFT download center is 4.16.1-9,
does this meet the 4.16.52 version requirements? If not satisfied,
where can I get mft-4.16.52?

Ze Wang


Parav Pandit <parav@...dia.com> 於 2021年3月8日週一 下午1:17寫道：
>
> Hi Ze Wang,
>
>
>
> How many SFs do you prefer to create?
> What applications would you like to run on more than 128 sfs?
> How many CPUs do you have in system which will use this many sfs?
>
>
>
> You need to use following.
>
> mlxconfig tool from mft tools version 4.16.52 or higher to set number of SF.
>
> mlxconfig -d b3:00.0  PF_BAR2_ENABLE=0 PER_PF_NUM_SF=1 PF_SF_BAR_SIZE=8
> mlxconfig -d b3:00.0  PER_PF_NUM_SF=1 PF_TOTAL_SF=192 PF_SF_BAR_SIZE=8
> mlxconfig -d b3:00.1  PER_PF_NUM_SF=1 PF_TOTAL_SF=192 PF_SF_BAR_SIZE=8
>
> Cold reboot power cycle of the system as this changes the BAR size in device
>
>
>
> Parav
>
>
>
> From: ze wang <wangze712@...il.com>
> Sent: Monday, March 8, 2021 7:22 AM
> To: Saeed Mahameed <saeedm@...dia.com>; Parav Pandit <parav@...dia.com>
> Subject: mlx5 sub function issue
>
>
>
> Hi all,
>       I have some confusion with mlx5 sub function feature. I tested it with Mellanox ConnectX-6 Dx recently, then I
>
> found the maximum amount of SF in each PF is just 128,I‘m not sure if there is a problem with my configuration,
>
> or there are some limits of SF in ConnectX-6.
> Here is the environment:
> system: CentOS Linux release 7.9.2009
> NIC:  Mellanox Technologies MT2892 Family [ConnectX-6 Dx]
> firmware-version: 22.29.2002 (MT_0000000430)
> kernel: net-next master branch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net-next.git/
> mlxconfig:
> PF_BAR2_ENABLE    True(1)
> PF_BAR2_SIZE      8
> PER_PF_NUM_SF     True(1)
> PF_TOTAL_SF       65535
> PF_SF_BAR_SIZE    0
>
> When I tried to create more SF:
>
> ~# devlink port add pci/0000:b3:00.0 flavour pcisf pfnum 0 sfnum 128
> devlink answers: No space left on device
>
> Is there anything missed in configuration? Can I create more sub functions in ConnectX-6?
>
> Trully yours,
> wangze