Type Without Plastic
The hardware keyboard is a 150-year-old artifact. Hand-tracking spatial keyboards are the replacement. But stripping away physical constraints introduces severe latency, layout, and haptic challenges. This is the technical reality of building them.
The 60ms Threshold
Physical keyboards provide instantaneous tactile feedback. A switch actuates in 1-2ms. Optical hand tracking pipelines typically ingest 30-60Hz camera feeds, process via ML inferences (like MediaPipe or Meta's Presence Platform), and render the result.
By the time the user visually confirms a keystroke, 40-80ms have passed. This loop breaks the neural expectations of fast typists, capping raw WPM purely based on visual feedback reliance.
Read the full latency breakdown →Input Pipeline Latency Budget
| Stage | Typical Cost (ms) |
|---|---|
| Camera Exposure & Transfer | 16.6ms (60Hz) |
| Skeletal Inference (NPU/GPU) | 10.0 - 25.0ms |
| Pinch/Tap Heuristics | 2.0 - 5.0ms |
| Render & Display Photon | 11.1ms (90Hz) |
| Total End-to-End | ~40 - 58ms |
Interactive Demo: Virtual Plane Hit-Testing
How do you determine a "press" when there are no physical keys? You define a mathematical plane in 3D space and calculate the intersection of the index finger tip joint. Try the interactive visualizer below.
The "Gorilla Arm" Reality
In 1980, touchscreens on vertical monitors failed commercially due to "Gorilla Arm" — the acute fatigue of holding arms unsupported in mid-air. Spatial keyboards face the exact same biomechanical limitation.
A 2022 ergonomic study showed that unsupported mid-air typing induces significant deltoid and bicep fatigue within 3.5 minutes of continuous text entry.
Read the fatigue analysis →Core Documentation
Hardware Constraints
Camera fields of view, refresh rates, thermal budgets, and NPU allocation for skeletal tracking algorithms.
Layout Optimization
Why QWERTY fails in VR. Analysis of chorded keyboards, split architectures, and gaze-plus-pinch target mechanics.
Biomechanics
The absence of haptics, fatigue limits, resting postures, and the necessity of lap-anchored virtual planes.
Comprehensive Technical Directory
Explore all topics related to spatial text entry: