netdev - RE: [net-next 2/9] ice: Create and register virtual bus for RDMA

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <61CC2BC414934749BD9F5BF3D5D940449866CCA8@ORSMSX112.amr.corp.intel.com>
Date:   Mon, 20 Apr 2020 23:47:15 +0000
From:   "Kirsher, Jeffrey T" <jeffrey.t.kirsher@...el.com>
To:     Jason Gunthorpe <jgg@...pe.ca>
CC:     "davem@...emloft.net" <davem@...emloft.net>,
        "gregkh@...uxfoundation.org" <gregkh@...uxfoundation.org>,
        "Ertman, David M" <david.m.ertman@...el.com>,
        "netdev@...r.kernel.org" <netdev@...r.kernel.org>,
        "linux-rdma@...r.kernel.org" <linux-rdma@...r.kernel.org>,
        "nhorman@...hat.com" <nhorman@...hat.com>,
        "sassmann@...hat.com" <sassmann@...hat.com>,
        "ranjani.sridharan@...ux.intel.com" 
        <ranjani.sridharan@...ux.intel.com>,
        "pierre-louis.bossart@...ux.intel.com" 
        <pierre-louis.bossart@...ux.intel.com>,
        "Nguyen, Anthony L" <anthony.l.nguyen@...el.com>,
        "Bowers, AndrewX" <andrewx.bowers@...el.com>
Subject: RE: [net-next 2/9] ice: Create and register virtual bus for RDMA

> -----Original Message-----
> From: Jason Gunthorpe <jgg@...pe.ca>
> Sent: Friday, April 17, 2020 12:18
> To: Kirsher, Jeffrey T <jeffrey.t.kirsher@...el.com>
> Cc: davem@...emloft.net; gregkh@...uxfoundation.org; Ertman, David M
> <david.m.ertman@...el.com>; netdev@...r.kernel.org; linux-
> rdma@...r.kernel.org; nhorman@...hat.com; sassmann@...hat.com;
> ranjani.sridharan@...ux.intel.com; pierre-louis.bossart@...ux.intel.com; Nguyen,
> Anthony L <anthony.l.nguyen@...el.com>; Bowers, AndrewX
> <andrewx.bowers@...el.com>
> Subject: Re: [net-next 2/9] ice: Create and register virtual bus for RDMA
> 
> On Fri, Apr 17, 2020 at 10:10:27AM -0700, Jeff Kirsher wrote:
> > From: Dave Ertman <david.m.ertman@...el.com>
> >
> > The RDMA block does not have its own PCI function, instead it must
> > utilize the ice driver to gain access to the PCI device. Create a
> > virtual bus device so the irdma driver can register a virtual bus
> > driver to bind to it and receive device data. The device data contains
> > all of the relevant information that the irdma peer will need to
> > access this PF's IIDC API callbacks.
> 
> Can you please provide examples of what the sysfs paths for all this stuff looks
> like?
[Kirsher, Jeffrey T] 

Here is an example using ice and irdma driver registered:
/sys/bus/virtbus/devices/intel,ice,rdma.7
/sys/bus/virtbus/devices/intel,ice,rdma.5
/sys/bus/virtbus/devices/intel,ice,rdma.6
/sys/bus/virtbus/devices/intel,ice,rdma.4
/sys/bus/virtbus/drivers/irdma/intel,ice,rdma.7
/sys/bus/virtbus/drivers/irdma/intel,ice,rdma.5
/sys/bus/virtbus/drivers/irdma/intel,ice,rdma.6
/sys/bus/virtbus/drivers/irdma/intel,ice,rdma.4
/sys/devices/pci0000:00/0000:00:1c.4/0000:09:00.0/intel,ice,rdma.4
/sys/devices/pci0000:00/0000:00:1c.4/0000:09:00.3/intel,ice,rdma.7
/sys/devices/pci0000:00/0000:00:1c.4/0000:09:00.1/intel,ice,rdma.5
/sys/devices/pci0000:00/0000:00:1c.4/0000:09:00.2/intel,ice,rdma.6
/sys/module/virtual_bus/holders/ice
/sys/module/ice
/sys/module/ice/drivers/pci:ice
/sys/bus/pci/drivers/ice

/sys/bus/virtbus/drivers/irdma
/sys/module/virtual_bus/holders/irdma
/sys/module/irdma
/sys/module/irdma/drivers/virtbus:irdma
/sys/module/ib_core/holders/irdma
/sys/module/ib_uverbs/holders/irdma

> 
> Does power management work right?
[Kirsher, Jeffrey T] 

The power management we tested so far is working.  Are you seeing any issue?

> 
> Jason