Cutting‑edge gesture control from the University of Tokyo
Researchers at the University of Tokyo’s Dragon Lab have unveiled a groundbreaking data glove that lets users pilot drones using natural hand and finger gestures. This wearable device supports true six degrees of freedom (6‑DoF) control—covering pitch, yaw, roll, altitude, and spatial translation—breaking free from the limits of traditional joystick remotes .
How it works
- Sensor-equipped glove: The glove includes motion‑tracking markers on the shoulder, wrist, and fingers, wirelessly transmitting gesture data with sub‑second latency (0.3–0.5 s) .
- Four intuitive control modes:
- Spherical Mode: Moves the drone directionally by orienting the hand.
- Cartesian Mode: Enables direct linear movement within a 3D grid.
- Operation Mode: Provides fine‑tuned control for manipulating objects.
- Locking Mode: Holds position while allowing the operator to reposition .
- Gesture‑based mode switching: Finger flexing triggers transitions between modes, without extra controls .
- On‑screen feedback: Color cues and text displays guide the pilot on active mode and status .
Real‑world performance & feedback
The prototype has been field-tested in:
- Obstacle‑rich corridors, demonstrating precise navigation.
- Valve‑turning tasks, showcasing fine motor control.
- Dynamic repositioning, using Locking Mode to maintain orientation .
Test pilots report “natural control, instant learning, surgical precision”. Among the modes, Spherical Mode feels most intuitive, while Cartesian offers clarity and Operation Mode excels in precision—though it lacks haptic feedback
Why it matters
- Democratizes drone control: Shortens training—what used to take weeks now takes mere minutes.
- Enables complex tasks: Useful in industrial inspections, search-and-rescue, even remote surgery or maintenance in challenging environments.
- Advances HMI design: Leverages gesture interfaces to replace clunky joysticks—mirroring the shift from buttons to touchscreens.
- Path to autonomy: Researchers aim to miniaturize sensors for fully embedded systems and to add force feedback in future versions .
What’s next?
- Integrating onboard sensors in both drone and glove to remove motion‑capture dependencies
- Developing haptic feedback, for realistic touch responses .
- Exploring precision control applications in sectors like industrial inspection, medical robotics, and AR‑enhanced drone piloting.
Final take
This “sci‑fi glove” represents a leap forward in human‑machine interaction, transforming drone piloting into a natural, intuitive dance of the hands. With low latency and robust mode switching, it promises greater accessibility and efficiency for complex teleoperation tasks. As the technology matures, adding haptics and embedded sensors, we may soon see gesture-driven control extend far beyond the lab—into everyday robotics, rescue operations, and even AR-supported workflows.