MatchPoint: Spontaneous Spatial Coupling of Body Movement for Touchless Pointing
summary
MatchPoint is a webcam-only implementation that lets any body part or tangible object become a temporary pointer by matching user motion to on-screen moving targets (they demo six rotating targets, three clockwise and three anticlockwise with distinct phases). The system uses feature detection, dense optical flow, Pearson correlation + RANSAC to fit ideal motion, then initializes a modified median-flow tracker for cursor control. It requires no training or calibration, runs on a desktop (feature detection is the CPU bottleneck), supports multiple concurrent pointers and persistent object bindings, and showed usable but not-yet-stress-tested performance.
AI-written summary · about
chapters (8)
- 0:00Introduction to spatial coupling
- 0:42Interaction mechanism
- 2:00Combining interaction paradigms
- 3:47Technical implementation
- 5:34Advanced interaction patterns
- 8:52Tangible object integration
- 11:04Deployment and future potential
- 13:12Q&A session
related talks
19mHaptoClone (Haptic-Optical Clone) for Mutual Tele-Environment by Real-time 3D Image Transfer ...
05mReady, Steady, Touch! — Sensing Physical Contact with a Finger-Mounted IMU
21mPmomo: Projection Mapping on Movable 3D Object
17mFast and Unassisted Eye Tracker Calibration for Gaze-Based Pervasive Human-Computer Interaction
18mFinexus: Tracking Precise Motions of Multiple Fingertips Using Magnetic Sensing
18mM.Gesture: An Acceleration-Based Gesture Authoring System on Multiple Handheld and Wearable Devices
21mMateriable: Rendering Dynamic Material Properties in Response to Direct Physical Touch with ...
19mTRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a ...