Message-ID: <CAGS+omDF3mi_tXXxHR2XOyjJMfuc=j2rWBMctJRGr7GeeE+yRg@mail.gmail.com>
Date:	Thu, 6 Oct 2011 14:25:39 +0800
From:	Daniel Kurtz <djkurtz@...omium.org>
To:	Dmitry Torokhov <dmitry.torokhov@...il.com>
Cc:	Chase Douglas <chasedouglas@...il.com>,
	Henrik Rydberg <rydberg@...omail.se>,
	linux-input@...r.kernel.org, linux-kernel@...r.kernel.org
Subject: Re: [PATCH] Input: evdev - use monotonic clock for event timestamps

On Thu, Oct 6, 2011 at 11:42 AM, Dmitry Torokhov
<dmitry.torokhov@...il.com> wrote:
> On Wed, Oct 05, 2011 at 03:35:11PM +0100, Chase Douglas wrote:
>> On 10/05/2011 10:23 AM, Henrik Rydberg wrote:
>> >> I understand your concern about breaking random drivers, and am hoping
>> >> that someon on this list could indicate whether this is a real concern
>> >> or not.  To get a better feeling for possible regressions, I checked
>> >> xf86-input-evdev & -synaptics, and neither uses the evdev timestamp in
>> >> their current incarnations.  Any idea what else might be a good place
>> >> to check?
>> >
>> > The input system is used for all sorts of events - switches, for
>> > instance. The point is that it is nearly impossible to know if
>> > something will break or not, hence the reluctance to modify interfaces.
>> >
>> >> One option is to make the evdev timestamp clock source a per-driver
>> >> configuration option (controllable from userspace?).  This sounds like
>> >> it is doable, but would be significantly more complicated.
>> >>
>> >> Another option would be to timestamp with monotonicraw + boottime +
>> >> sleeptime.  This would be approximately wall clock time, but without
>> >> ntp and slew adjustments.  But, I fear this would just make the rare
>> >> driver issue less obvious, since it would only become obvious when the
>> >> two clock sources started drifting apart.
>> >
>> > I agree, the problem is not really solvable. Dmitry?
>>
>> We could put it into the -next tree early on in the cycle, and then it
>> will be in -next for a cycle and in Linus' tree for the real dev cycle.
>> By that time we would hope any issues would have emerged.
>
> No, I do not think so - as we already descovered users of that field (if
> they are exist) are pretty obscure and I doubt that they actively track
> development kernels.
>
>>
>> I'm not sure if that is a responsible approach. I agree that the change
>> would be good, but how sure would we be that nothing would break based
>> only on testing in development trees?
>>
>> My personal thoughts are that I doubt it would cause issues. Based on
>> that gut feel, I would say that this approach is reasonable. However,
>> I'm just one voice in all this :).
>
> I can see key loggers wanting to see real time of captured events
> instead of monotonic time...

Such a userspace key logger or driver that uses the timestamp field
today is probably comparing it to userspace time queried by
gettimeofday().  To work with a monotonic timestamp, they could use
clock_gettime(CLOCK_MONOTONIC, &ts) instead.

> If we really need this I think we'll have to go per-file descriptor time
> source selection and ioctl way. However can we get the use case
> explained again? Why is wall clock jumps so much in middle of the
> motion? Can userspace detect negative time jumps and simply abort
> gestures in such cases?

Userspace can detect 'time going backwards' easily enough, but
detecting 'time slowing down' or 'time speeding up' is harder.

> Thanks.
>
> --
> Dmitry

Userspace (touch/mouse) input drivers that want to do ballistics
calculations would benefit from a good, accurate, monotonic timestamp
as low down in the stack as possible to reduce jitter.  In particular,
the timestamp deltas are used to determine contact velocity, and can also
be used to better understand and compensate for response latency and jitter
throughout the entire stack.

Another approach could be:
  Treat the "evdev-layer-assigned" timestamp as purely informational -
it is applied per-event anyway, which isn't really what userspace
needs.  Instead, have touch kernel drivers use another "timestamp"
axis/valuator (ABS_TIMESTAMP?), based off of a monotonic time source,
(preferably get_monotonic_boottime()) taken somewhere early in irq processing.

   My concern about this approach was that it would make drivers
significantly more chatty.  evdev currently squashes events, or even
entire reports (I don't know the proper term for collection of events
terminated by EV_SYN), if the values don't change.  The timestamp axis
would always change, hence it would always be sent, even if no other
axes change.  Of course, we can mitigate this with special-case
handling of the ABS_TIMESTAMP in the evdev layer.

Thoughts?

- Daniel
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists