SurfaceLink

SurfaceLink is a system where users can make natural surface gestures to control association and information transfer among a set of devices placed on a mutually shared surface (e.g., a table). SurfaceLink uses a combination of on-device accelerometers, vibration motors, speakers, and microphones (and, optionally, an off-device contact microphone for greater sensitivity) to sense gestures performed on the shared surface. SurfaceLink was a project that Mayank Goel started with me when he was a summer intern at Samsung Research America. I was Mayank’s mentor and also provided the use cases and scenarios for this work focused on multi-device interactions. Watch the video above for a quick overview of how it works or read the paper below for additional technical details.

Reference: Mayank Goel, Brendan Lee, Md. Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, and Bo Begole. 2014. SurfaceLink: using inertial and acoustic sensing to enable multi-device interaction on a surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 1387-1396. (pdf, video)

Related patent: Device communication system with proximity synchronization mechanism and method of operation thereof, issued November 3, 2015, US patent 9,179,243.