Andruid Kerne

Trans-surface interaction addresses moving information objects across multi-display environments that support sensory interaction modalities such as touch, pen, and free-air. Embodiment means using spatial relationships among surfaces and human bodies to facilitate users' understanding of interaction. In the present embodied trans-surface interaction technique, a peripheral NFC tag array provides tangible affordances for connecting mobile devices to positions on a collaborative surface… Show more

Trans-surface interaction addresses moving information objects across multi-display environments that support sensory interaction modalities such as touch, pen, and free-air. Embodiment means using spatial relationships among surfaces and human bodies to facilitate users' understanding of interaction. In the present embodied trans-surface interaction technique, a peripheral NFC tag array provides tangible affordances for connecting mobile devices to positions on a collaborative surface. Touching a tag initiates a trans-surface portal. Each portal visually associates a mobile device and its user with a place on the collaborative surface. The portal's manifestation at the top of the mobile device supports 'flicking over' interaction, like playing cards. The technique is simple, inexpensive, reliable, scalable, and generally applicable for co-located collaboration. We developed a co-located collaborative rich information prototype to demonstrate the embodied trans-surface interaction technique and support imagining and planning tasks. Show less

Trans-surface interaction addresses moving information objects across multi-display environments that support sensory interaction modalities such as touch, pen, and free-air. Embodiment means using spatial relationships among surfaces and human bodies to facilitate users' understanding of interaction. In the present embodied trans-surface interaction technique, a peripheral NFC tag array provides tangible affordances for connecting mobile devices to positions on a collaborative surface… Show more

Trans-surface interaction addresses moving information objects across multi-display environments that support sensory interaction modalities such as touch, pen, and free-air. Embodiment means using spatial relationships among surfaces and human bodies to facilitate users' understanding of interaction. In the present embodied trans-surface interaction technique, a peripheral NFC tag array provides tangible affordances for connecting mobile devices to positions on a collaborative surface. Touching a tag initiates a trans-surface portal. Each portal visually associates a mobile device and its user with a place on the collaborative surface. The portal's manifestation at the top of the mobile device supports 'flicking over' interaction, like playing cards. The technique is simple, inexpensive, reliable, scalable, and generally applicable for co-located collaboration. We developed a co-located collaborative rich information prototype to demonstrate the embodied trans-surface interaction technique and support imagining and planning tasks. Show less

Research in multi-touch interaction has typically been focused on direct spatial manipulation; techniques have been create to result in the most intuitive mapping between the movement of the hand and the resultant change in the virtual object. However, as we attempt to design for more complex operations, the expectation of spatial manipulation becomes infeasible.
We introduce Multi-tap Sliders for operation in what we call abstract parametric spaces that do not have an obvious literal… Show more

Research in multi-touch interaction has typically been focused on direct spatial manipulation; techniques have been create to result in the most intuitive mapping between the movement of the hand and the resultant change in the virtual object. However, as we attempt to design for more complex operations, the expectation of spatial manipulation becomes infeasible.
We introduce Multi-tap Sliders for operation in what we call abstract parametric spaces that do not have an obvious literal spatial representation, such as exposure, brightness, contrast and saturation for image editing. This new widget design promotes multi-touch interaction for prolonged use in
scenarios that require adjustment of multiple parameters as part of an operation. The multi-tap sliders encourage the user to keep her visual focus on the target, instead of the requiring
to look back at the interface. Show less

Electronic Sports (eSports) is the professional play and spectating of digital games. Real-time strategy games are a form of eSport that require particularly high- performance and precise interaction. Prior eSports HCI has been keyboard and mouse based. We investigate the real-time strategy eSports context to design novel interactions with embodied modalities, because of its rigorous needs and requirements, and the centrality of the human-computer interface as the medium of game mechanics. To… Show more

Electronic Sports (eSports) is the professional play and spectating of digital games. Real-time strategy games are a form of eSport that require particularly high- performance and precise interaction. Prior eSports HCI has been keyboard and mouse based. We investigate the real-time strategy eSports context to design novel interactions with embodied modalities, because of its rigorous needs and requirements, and the centrality of the human-computer interface as the medium of game mechanics. To sense pen + multi-touch interaction, we augment a Wacom Cintiq with a ZeroTouch multi-finger sensor[1]. We used this modality to design new pen + touch interaction for play in real-time strategy eSports. Show less

Electronic Sports (eSports) is the professional play and spectating of digital games. Real-time strategy games are a form of eSport that require particularly high- performance and precise interaction. Prior eSports HCI has been keyboard and mouse based. We investigate the real-time strategy eSports context to design novel interactions with embodied modalities, because of its rigorous needs and requirements, and the centrality of the human-computer interface as the medium of game mechanics. To… Show more

Electronic Sports (eSports) is the professional play and spectating of digital games. Real-time strategy games are a form of eSport that require particularly high- performance and precise interaction. Prior eSports HCI has been keyboard and mouse based. We investigate the real-time strategy eSports context to design novel interactions with embodied modalities, because of its rigorous needs and requirements, and the centrality of the human-computer interface as the medium of game mechanics. To sense pen + multi-touch interaction, we augment a Wacom Cintiq with a ZeroTouch multi-finger sensor[1]. We used this modality to design new pen + touch interaction for play in real-time strategy eSports. Show less

ZeroTouch (ZT) is a unique optical sensing technique and architecture that allows precision sensing of hands, fingers, and other objects within a constrained 2-dimensional plane. ZeroTouch provides tracking at 80 Hz, and up to 30 concurrent touch points. Integration with LCDs is trivial. While designed for multi-touch sensing, ZT enables other new modalities, such as pen+touch and free-air interaction. In this paper, we contextualize ZT innovations with a review of other flat-panel sensing… Show more

ZeroTouch (ZT) is a unique optical sensing technique and architecture that allows precision sensing of hands, fingers, and other objects within a constrained 2-dimensional plane. ZeroTouch provides tracking at 80 Hz, and up to 30 concurrent touch points. Integration with LCDs is trivial. While designed for multi-touch sensing, ZT enables other new modalities, such as pen+touch and free-air interaction. In this paper, we contextualize ZT innovations with a review of other flat-panel sensing technologies. We present the modular sensing architecture behind ZT, and examine early diverse uses of ZT sensing. Show less

We present zero-thickness optical multi-touch sensing, a technique that simplifies sensordisplay integration, and enables new forms of interaction not previously possible with other multi-touch sensing techniques. Using low-cost modulated infrared sensors to quickly determine the visual hull of an interactive area, we enable robust real-time sensing of fingers and hands, even in the presence of strong ambient lighting. Our technology allows for 20+ fingers to be detected, many more than through… Show more

We present zero-thickness optical multi-touch sensing, a technique that simplifies sensordisplay integration, and enables new forms of interaction not previously possible with other multi-touch sensing techniques. Using low-cost modulated infrared sensors to quickly determine the visual hull of an interactive area, we enable robust real-time sensing of fingers and hands, even in the presence of strong ambient lighting. Our technology allows for 20+ fingers to be detected, many more than through prior visual hull techniques, and our use of wide-angle optoelectonics allows for excellent touch resolution, even in the corners of the sensor. With the ability to track objects in free space, as well as its use as a traditional multi-touch sensor, ZeroTouch opens up a new world of interaction possibilities. Show less

We describe a new method of multi-touch sensing which can be unobtrusively added to existing displays. By coupling individually controlled optoelectronics to the edge of a planar waveguide, our scanning approach overcomes prior disadvantages of optoelectronic multi-touch sensing. Our approach allows for a completely transparent touch surface and easy integration with existing LCD displays.

We describe a new method of multi-touch sensing which can be unobtrusively added to existing displays. By coupling individually controlled optoelectronics to the edge of a planar waveguide, our scanning approach overcomes prior disadvantages of optoelectronic multi-touch sensing. Our approach allows for a completely transparent touch surface and easy integration with existing LCD displays.