Multitouch latency reduction

Posted on June 5, 2008

1


This morning I was at the office of CanTouch to see the multitouch table and have fun being together with Geeks. With me were Adrien Jeanjean and Mark Barcinski, two very talented Flash developers. the current prototype they have makes use of TouchLib, Flosc and Flash.

The main issue with multitouch tables in general is latency. There is a time-lag between the movements made by the user and the response by the software.

The main chain consists of the following:

latency

One of the possible response-killers is Flosc + XML sockets. Flosc translates the X/Y coordinates from TouchLib to XML and offers the result to Flahs via XML Sockets. Flosc, however, offers no intelligence. Every event regarding changes registered in TouchLib is immediately fired to Flash via XML Sockets. More events (more fingers on the table) equals more data packets fired to Flash.

Being dependent of Flash polling for data, XML Sockets are not immediate / zero time latency as well.

When brainstorming about this with Erik van der Pluijm we came up with the following setup:

Latency reduction

The C# wrapper is directly connected to TouchLib and the Flash Active X component. Any event in TouchLib is passed to Flash with “no” loss of time.

In the next week or so, this solution will be implemented.

Advertisements
Posted in: multitouch