Project Overview:

Kinesthetic interaction systems on mobile augmented reality (MAR) platforms remain largely conceptual. To explore this design space, we present karP, an experiential prototype that serves as a proof of concept for integrating kinesthetic systems with MAR. karP's device features a manipulandum-exoskeleton design that supports kinesthetic input and output for striking gestures with handheld items. Leveraging the native capabilities of MAR, the smartphone functions simultaneously as the visual-spatial interface and spatial tracker, coordinating with the kinesthetic device to control the avatar's physical interaction in virtual environments. We further introduce game-mechanism-inspired experiential scenes to demonstrate diverse interactions made possible by our system. Ultimately, karP embodies our vision for kinesthetic design in MAR that is playful, portable, and producible.