[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <CAP5jrPExLX5nF7BWSSc1LeE_HOSWsDNLiGB52U0dzxfXFKb+Lw@mail.gmail.com>
Date: Mon, 3 Apr 2023 09:42:09 -0600
From: Max Georgiev <glipus@...il.com>
To: Vladimir Oltean <vladimir.oltean@....com>
Cc: kory.maincent@...tlin.com, kuba@...nel.org, netdev@...r.kernel.org,
maxime.chevallier@...tlin.com
Subject: Re: [PATCH net-next RFC v2] Add NDOs for hardware timestamp get/set
On Mon, Apr 3, 2023 at 6:26 AM Vladimir Oltean <vladimir.oltean@....com> wrote:
>
> On Sun, Apr 02, 2023 at 08:24:35AM -0600, Maxim Georgiev wrote:
> > Current NIC driver API demands drivers supporting hardware timestamping
> > to support SIOCGHWTSTAMP/SIOCSHWTSTAMP IOCTLs. Handling these IOCTLs
> > requires dirivers to implement request parameter structure translation
> > between user and kernel address spaces, handling possible
> > translation failures, etc. This translation code is pretty much
> > identical across most of the NIC drivers that support SIOCGHWTSTAMP/
> > SIOCSHWTSTAMP.
> > This patch extends NDO functiuon set with ndo_hwtstamp_get/set
> > functions, implements SIOCGHWTSTAMP/SIOCSHWTSTAMP IOCTL translation
> > to ndo_hwtstamp_get/set function calls including parameter structure
> > translation and translation error handling.
> >
> > This patch is sent out as RFC.
> > It still pending on basic testing.
>
> Who should do that testing? Do you have any NIC with the hardware
> timestamping capability?
I'm planning to do the testing with netdevsim. I don't have access to
any NICs with
hardware timestamping support.
>
> > Implementing ndo_hwtstamp_get/set in netdevsim driver should allow
> > manual testing of the request translation logic. Also is there a way
> > to automate this testing?
>
> Automatic testing would require manual testing as a first step, to iron
> out the procedure, right?
Yes, absolutely.
>
> The netdevsim driver should be testable by anyone using 'echo "0 1" >
> /sys/bus/netdevsim/new_device', and then 'hwstamp_ctl -i eni0np1 -t 1'
> (or 'testptp', or 'ptp4l', or whatever). Have you tried doing at least
> that, did it work?
Let me rebase my patch on top of your changes. I'll test it on
netdevsim then.
>
> >
> > Suggested-by: Jakub Kicinski <kuba@...nel.org>
> > Signed-off-by: Maxim Georgiev <glipus@...il.com>
> > ---
> > Changes in v2:
> > - Introduced kernel_hwtstamp_config structure
> > - Added netlink_ext_ack* and kernel_hwtstamp_config* as NDO hw timestamp
> > function parameters
> > - Reodered function variable declarations in dev_hwtstamp()
> > - Refactored error handling logic in dev_hwtstamp()
> > - Split dev_hwtstamp() into GET and SET versions
> > - Changed net_hwtstamp_validate() to accept struct hwtstamp_config *
> > as a parameter
> > ---
> > drivers/net/ethernet/intel/e1000e/netdev.c | 39 ++++++-----
> > drivers/net/netdevsim/netdev.c | 26 +++++++
> > drivers/net/netdevsim/netdevsim.h | 1 +
> > include/linux/netdevice.h | 21 ++++++
> > include/uapi/linux/net_tstamp.h | 15 ++++
> > net/core/dev_ioctl.c | 81 ++++++++++++++++++----
> > 6 files changed, 149 insertions(+), 34 deletions(-)
> >
> > diff --git a/drivers/net/ethernet/intel/e1000e/netdev.c b/drivers/net/ethernet/intel/e1000e/netdev.c
> > index 6f5c16aebcbf..5b98f7257c77 100644
> > --- a/drivers/net/ethernet/intel/e1000e/netdev.c
> > +++ b/drivers/net/ethernet/intel/e1000e/netdev.c
> > @@ -6161,7 +6161,9 @@ static int e1000_mii_ioctl(struct net_device *netdev, struct ifreq *ifr,
> > /**
> > * e1000e_hwtstamp_set - control hardware time stamping
> > * @netdev: network interface device structure
> > - * @ifr: interface request
> > + * @config: hwtstamp_config structure containing request parameters
> > + * @kernel_config: kernel version of config parameter structure.
> > + * @extack: netlink request parameters.
> > *
> > * Outgoing time stamping can be enabled and disabled. Play nice and
> > * disable it when requested, although it shouldn't cause any overhead
> > @@ -6174,20 +6176,19 @@ static int e1000_mii_ioctl(struct net_device *netdev, struct ifreq *ifr,
> > * specified. Matching the kind of event packet is not supported, with the
> > * exception of "all V2 events regardless of level 2 or 4".
> > **/
> > -static int e1000e_hwtstamp_set(struct net_device *netdev, struct ifreq *ifr)
> > +static int e1000e_hwtstamp_set(struct net_device *netdev,
> > + struct hwtstamp_config *config,
> > + struct kernel_hwtstamp_config *kernel_config,
> > + struct netlink_ext_ack *extack)
> > {
> > struct e1000_adapter *adapter = netdev_priv(netdev);
> > - struct hwtstamp_config config;
> > int ret_val;
> >
> > - if (copy_from_user(&config, ifr->ifr_data, sizeof(config)))
> > - return -EFAULT;
> > -
> > - ret_val = e1000e_config_hwtstamp(adapter, &config);
> > + ret_val = e1000e_config_hwtstamp(adapter, config);
> > if (ret_val)
> > return ret_val;
> >
> > - switch (config.rx_filter) {
> > + switch (config->rx_filter) {
> > case HWTSTAMP_FILTER_PTP_V2_L4_SYNC:
> > case HWTSTAMP_FILTER_PTP_V2_L2_SYNC:
> > case HWTSTAMP_FILTER_PTP_V2_SYNC:
> > @@ -6199,22 +6200,24 @@ static int e1000e_hwtstamp_set(struct net_device *netdev, struct ifreq *ifr)
> > * by hardware so notify the caller the requested packets plus
> > * some others are time stamped.
> > */
> > - config.rx_filter = HWTSTAMP_FILTER_SOME;
> > + config->rx_filter = HWTSTAMP_FILTER_SOME;
> > break;
> > default:
> > break;
> > }
> > -
> > - return copy_to_user(ifr->ifr_data, &config,
> > - sizeof(config)) ? -EFAULT : 0;
> > + return ret_val;
> > }
> >
> > -static int e1000e_hwtstamp_get(struct net_device *netdev, struct ifreq *ifr)
> > +static int e1000e_hwtstamp_get(struct net_device *netdev,
> > + struct hwtstamp_config *config,
> > + struct kernel_hwtstamp_config *kernel_config,
> > + struct netlink_ext_ack *extack)
> > {
> > struct e1000_adapter *adapter = netdev_priv(netdev);
> >
> > - return copy_to_user(ifr->ifr_data, &adapter->hwtstamp_config,
> > - sizeof(adapter->hwtstamp_config)) ? -EFAULT : 0;
> > + memcpy(config, &adapter->hwtstamp_config,
> > + sizeof(adapter->hwtstamp_config));
> > + return 0;
> > }
> >
> > static int e1000_ioctl(struct net_device *netdev, struct ifreq *ifr, int cmd)
> > @@ -6224,10 +6227,6 @@ static int e1000_ioctl(struct net_device *netdev, struct ifreq *ifr, int cmd)
> > case SIOCGMIIREG:
> > case SIOCSMIIREG:
> > return e1000_mii_ioctl(netdev, ifr, cmd);
> > - case SIOCSHWTSTAMP:
> > - return e1000e_hwtstamp_set(netdev, ifr);
> > - case SIOCGHWTSTAMP:
> > - return e1000e_hwtstamp_get(netdev, ifr);
> > default:
> > return -EOPNOTSUPP;
> > }
> > @@ -7365,6 +7364,8 @@ static const struct net_device_ops e1000e_netdev_ops = {
> > .ndo_set_features = e1000_set_features,
> > .ndo_fix_features = e1000_fix_features,
> > .ndo_features_check = passthru_features_check,
> > + .ndo_hwtstamp_get = e1000e_hwtstamp_get,
> > + .ndo_hwtstamp_set = e1000e_hwtstamp_set,
> > };
>
> The conversion per se looks almost in line with what I was expecting to
> see, except for the comments. I guess you can convert a single driver
> first (e1000 seems fine), to get the API merged, then more people could
> work in parallel?
The conversions are going to be easy (that was the point of adding these NDO
functions). But there is still a problem of validating these
conversions with testing.
Unfortunately I don't have an e1000 card available to validate this conversion.
I'll let you and Jakub decide what will be the best strategy here.
>
> Or do you want netdevsim to cover hardware timestamping from the
> beginning too, Jakub?
>
> >
> > /**
> > diff --git a/drivers/net/netdevsim/netdev.c b/drivers/net/netdevsim/netdev.c
> > index 35fa1ca98671..502715c6e9e1 100644
> > --- a/drivers/net/netdevsim/netdev.c
> > +++ b/drivers/net/netdevsim/netdev.c
> > @@ -238,6 +238,30 @@ nsim_set_features(struct net_device *dev, netdev_features_t features)
> > return 0;
> > }
> >
> > +static int
> > +nsim_hwtstamp_get(struct net_device *dev,
> > + struct hwtstamp_config *config,
> > + struct kernel_hwtstamp_config *kernel_config,
> > + struct netlink_ext_ack *extack)
> > +{
> > + struct netdevsim *ns = netdev_priv(dev);
> > +
> > + memcpy(config, &ns->hw_tstamp_config, sizeof(ns->hw_tstamp_config));
> > + return 0;
> > +}
> > +
> > +static int
> > +nsim_hwtstamp_ges(struct net_device *dev,
> > + struct hwtstamp_config *config,
> > + struct kernel_hwtstamp_config *kernel_config,
> > + struct netlink_ext_ack *extack)
> > +{
> > + struct netdevsim *ns = netdev_priv(dev);
> > +
> > + memcpy(&ns->hw_tstamp_config, config, sizeof(ns->hw_tstamp_config));
> > + return 0;
> > +}
>
> Please keep conversion patches separate from patches which add new
> functionality.
Let me split my monolithic patch into a stack of patches in the next version.
e1000e and netdevsim should be definitely arranged as separate patches
which could be reviewed and accepted/rejected independently.
>
> Also, does the netdevsim portion even do something useful? Wouldn't
> you need to implement ethtool_ops :: get_ts_info() in order for user
> space to know that there is a PHC, and that the device supports hardware
> timestamping?
I was thinking of exposing hw timestamping settings to testfs, but the ethtool
approach can be easier to implement. Let me fix it!
>
> > +
> > static const struct net_device_ops nsim_netdev_ops = {
> > .ndo_start_xmit = nsim_start_xmit,
> > .ndo_set_rx_mode = nsim_set_rx_mode,
> > @@ -256,6 +280,8 @@ static const struct net_device_ops nsim_netdev_ops = {
> > .ndo_setup_tc = nsim_setup_tc,
> > .ndo_set_features = nsim_set_features,
> > .ndo_bpf = nsim_bpf,
> > + .ndo_hwtstamp_get = nsim_hwtstamp_get,
> > + .ndo_hwtstamp_set = nsim_hwtstamp_get,
> > };
> >
> > static const struct net_device_ops nsim_vf_netdev_ops = {
> > diff --git a/drivers/net/netdevsim/netdevsim.h b/drivers/net/netdevsim/netdevsim.h
> > index 7d8ed8d8df5c..c6efd2383552 100644
> > --- a/drivers/net/netdevsim/netdevsim.h
> > +++ b/drivers/net/netdevsim/netdevsim.h
> > @@ -102,6 +102,7 @@ struct netdevsim {
> > } udp_ports;
> >
> > struct nsim_ethtool ethtool;
> > + struct hwtstamp_config hw_tstamp_config;
> > };
> >
> > struct netdevsim *
> > diff --git a/include/linux/netdevice.h b/include/linux/netdevice.h
> > index c8c634091a65..078c9284930a 100644
> > --- a/include/linux/netdevice.h
> > +++ b/include/linux/netdevice.h
> > @@ -57,6 +57,8 @@
> > struct netpoll_info;
> > struct device;
> > struct ethtool_ops;
> > +struct hwtstamp_config;
> > +struct kernel_hwtstamp_config;
> > struct phy_device;
> > struct dsa_port;
> > struct ip_tunnel_parm;
> > @@ -1411,6 +1413,17 @@ struct netdev_net_notifier {
> > * Get hardware timestamp based on normal/adjustable time or free running
> > * cycle counter. This function is required if physical clock supports a
> > * free running cycle counter.
> > + * int (*ndo_hwtstamp_get)(struct net_device *dev,
> > + * struct hwtstamp_config *config,
> > + * struct kernel_hwtstamp_config *kernel_config,
> > + * struct netlink_ext_ack *extack);
> > + * Get hardware timestamping parameters currently configured for NIC
> > + * device.
> > + * int (*ndo_hwtstamp_set)(struct net_device *dev,
> > + * struct hwtstamp_config *config,
> > + * struct kernel_hwtstamp_config *kernel_config,
> > + * struct netlink_ext_ack *extack);
> > + * Set hardware timestamping parameters for NIC device.
>
> I would expect that in the next version, you only pass struct
> kernel_hwtstamp_config * to these and not struct hwtstamp_config *,
> since the former was merged in a form that contains all that struct
> hwtstamp_config does, right?
Yes, I guess I'll just follow your lead and use the kernel_hwtstamp_config
you defined to pass parameters to ndo_hwtstamp_get/set. Jakub, do you
have any objections here?
>
> > */
> > struct net_device_ops {
> > int (*ndo_init)(struct net_device *dev);
> > @@ -1645,6 +1658,14 @@ struct net_device_ops {
> > ktime_t (*ndo_get_tstamp)(struct net_device *dev,
> > const struct skb_shared_hwtstamps *hwtstamps,
> > bool cycles);
> > + int (*ndo_hwtstamp_get)(struct net_device *dev,
> > + struct hwtstamp_config *config,
> > + struct kernel_hwtstamp_config *kernel_config,
> > + struct netlink_ext_ack *extack);
> > + int (*ndo_hwtstamp_set)(struct net_device *dev,
> > + struct hwtstamp_config *config,
> > + struct kernel_hwtstamp_config *kernel_config,
> > + struct netlink_ext_ack *extack);
> > };
> >
> > struct xdp_metadata_ops {
> > diff --git a/include/uapi/linux/net_tstamp.h b/include/uapi/linux/net_tstamp.h
> > index a2c66b3d7f0f..547f73beb479 100644
> > --- a/include/uapi/linux/net_tstamp.h
> > +++ b/include/uapi/linux/net_tstamp.h
> > @@ -79,6 +79,21 @@ struct hwtstamp_config {
> > int rx_filter;
> > };
> >
> > +/**
> > + * struct kernel_hwtstamp_config - %SIOCGHWTSTAMP and %SIOCSHWTSTAMP parameter
> > + *
> > + * @dummy: a placeholder field added to work around empty struct language
> > + * restriction
> > + *
> > + * This structure passed as a parameter to NDO methods called in
> > + * response to SIOCGHWTSTAMP and SIOCSHWTSTAMP IOCTLs.
> > + * The structure is effectively empty for now. Before adding new fields
> > + * to the structure "dummy" placeholder field should be removed.
> > + */
> > +struct kernel_hwtstamp_config {
> > + u8 dummy;
> > +};
>
> In include/uapi? No-no. That's exported to user space, which contradicts
> the whole point of having a structure visible just to the kernel.
>
> See net-next commit c4bffeaa8d50 ("net: add struct kernel_hwtstamp_config
> and make net_hwtstamp_validate() use it") by the way.
Yes, I realized that I touched the wrong file when I was reading through your
patch stack. You already defined kernel_hwtstamp_config, so my changes to
include/uapi/linux/net_tstamp.h should be reverted anyway.
>
> > +
> > /* possible values for hwtstamp_config->flags */
> > enum hwtstamp_flags {
> > /*
> > diff --git a/net/core/dev_ioctl.c b/net/core/dev_ioctl.c
> > index 846669426236..c145afb3f77e 100644
> > --- a/net/core/dev_ioctl.c
> > +++ b/net/core/dev_ioctl.c
> > @@ -183,22 +183,18 @@ static int dev_ifsioc_locked(struct net *net, struct ifreq *ifr, unsigned int cm
> > return err;
> > }
> >
> > -static int net_hwtstamp_validate(struct ifreq *ifr)
> > +static int net_hwtstamp_validate(struct hwtstamp_config *cfg)
> > {
> > - struct hwtstamp_config cfg;
> > enum hwtstamp_tx_types tx_type;
> > enum hwtstamp_rx_filters rx_filter;
> > int tx_type_valid = 0;
> > int rx_filter_valid = 0;
> >
> > - if (copy_from_user(&cfg, ifr->ifr_data, sizeof(cfg)))
> > - return -EFAULT;
> > -
> > - if (cfg.flags & ~HWTSTAMP_FLAG_MASK)
> > + if (cfg->flags & ~HWTSTAMP_FLAG_MASK)
> > return -EINVAL;
> >
> > - tx_type = cfg.tx_type;
> > - rx_filter = cfg.rx_filter;
> > + tx_type = cfg->tx_type;
> > + rx_filter = cfg->rx_filter;
> >
> > switch (tx_type) {
> > case HWTSTAMP_TX_OFF:
> > @@ -277,6 +273,63 @@ static int dev_siocbond(struct net_device *dev,
> > return -EOPNOTSUPP;
> > }
> >
> > +static int dev_hwtstamp_get(struct net_device *dev, struct ifreq *ifr)
> > +{
> > + const struct net_device_ops *ops = dev->netdev_ops;
> > + struct hwtstamp_config config;
> > + int err;
> > +
> > + err = dsa_ndo_eth_ioctl(dev, ifr, SIOCGHWTSTAMP);
> > + if (err == 0 || err != -EOPNOTSUPP)
> > + return err;
> > +
> > + if (!ops->ndo_hwtstamp_get)
> > + return dev_eth_ioctl(dev, ifr, SIOCGHWTSTAMP);
> > +
> > + if (!netif_device_present(dev))
> > + return -ENODEV;
> > +
> > + err = ops->ndo_hwtstamp_get(dev, &config, NULL, NULL);
> > + if (err)
> > + return err;
> > +
> > + if (copy_to_user(ifr->ifr_data, &config, sizeof(config)))
> > + return -EFAULT;
> > + return 0;
> > +}
> > +
> > +static int dev_hwtstamp_set(struct net_device *dev, struct ifreq *ifr)
> > +{
> > + const struct net_device_ops *ops = dev->netdev_ops;
> > + struct hwtstamp_config config;
> > + int err;
> > +
> > + if (copy_from_user(&config, ifr->ifr_data, sizeof(config)))
> > + return -EFAULT;
> > +
> > + err = net_hwtstamp_validate(&config);
> > + if (err)
> > + return err;
> > +
> > + err = dsa_ndo_eth_ioctl(dev, ifr, SIOCSHWTSTAMP);
> > + if (err == 0 || err != -EOPNOTSUPP)
> > + return err;
> > +
> > + if (!ops->ndo_hwtstamp_set)
> > + return dev_eth_ioctl(dev, ifr, SIOCSHWTSTAMP);
> > +
> > + if (!netif_device_present(dev))
> > + return -ENODEV;
> > +
> > + err = ops->ndo_hwtstamp_set(dev, &config, NULL, NULL);
> > + if (err)
> > + return err;
>
> Here, when you rebase over commit 4ee58e1e5680 ("net: promote
> SIOCSHWTSTAMP and SIOCGHWTSTAMP ioctls to dedicated handlers"),
> I expect that you will add another helper function to include/linux/net_tstamp.h
> called hwtstamp_config_from_kernel(), which translates back from the
> struct kernel_hwtstamp_config into something on which copy_from_user()
> can be called, correct?
Yes, that's what I'm planning to do as part of rebasing this patch.
>
> > +
> > + if (copy_to_user(ifr->ifr_data, &config, sizeof(config)))
> > + return -EFAULT;
> > + return 0;
> > +}
> > +
> > static int dev_siocdevprivate(struct net_device *dev, struct ifreq *ifr,
> > void __user *data, unsigned int cmd)
> > {
> > @@ -391,11 +444,11 @@ static int dev_ifsioc(struct net *net, struct ifreq *ifr, void __user *data,
> > rtnl_lock();
> > return err;
> >
> > + case SIOCGHWTSTAMP:
> > + return dev_hwtstamp_get(dev, ifr);
> > +
> > case SIOCSHWTSTAMP:
> > - err = net_hwtstamp_validate(ifr);
> > - if (err)
> > - return err;
> > - fallthrough;
> > + return dev_hwtstamp_set(dev, ifr);
> >
> > /*
> > * Unknown or private ioctl
> > @@ -407,9 +460,7 @@ static int dev_ifsioc(struct net *net, struct ifreq *ifr, void __user *data,
> >
> > if (cmd == SIOCGMIIPHY ||
> > cmd == SIOCGMIIREG ||
> > - cmd == SIOCSMIIREG ||
> > - cmd == SIOCSHWTSTAMP ||
> > - cmd == SIOCGHWTSTAMP) {
> > + cmd == SIOCSMIIREG) {
> > err = dev_eth_ioctl(dev, ifr, cmd);
> > } else if (cmd == SIOCBONDENSLAVE ||
> > cmd == SIOCBONDRELEASE ||
> > --
> > 2.39.2
> >
Powered by blists - more mailing lists