Summary
The F1 Hand Controller, a prototype developed by Associate Professor Martin Thaler and Faysal Biobaku (MDes 2025) in collaboration with Fluid Reality, uses advanced haptic feedback technology that lets operators actually feel what their robots touch.
The team transforms a complex technological challenge into an intuitive solution that enhances human capabilities and expands the possibilities of remote operation.
F1 Hand Controller
From remote surgery to hazardous environment exploration, the gap between human operators and robotic systems has been a persistent challenge. Applications in a range of specialized fields demand real-time control and situational awareness for success.
OPPORTUNITY
Redefining Remote Control
Traditional remote control systems often leave operators disconnected from the physical reality of the robotic interactions. By integrating Fluid Reality’s cutting-edge haptic technology, the F1 Hand Controller would allow users to experience precise tactile sensations, corresponding to a robot’s actions and encounters.
VIDEO
Testing the F1 Hand Controller
“In developing the F1 teleoperation controller, we explored how remote interaction might be redefined through the lens of touch. Shown here, a participant uses the F1 to twist open a jar.” -Faysal Biobaku (MDes 2025)
Video: Faysal Biobaku/ LinkedIn
PROCESS
Observations and discussion at the Northwestern Center for Robotics and Biosystems. Faysal Biobaku, Joe Mullenbach, and Toby John Buckley.
Discovery to Development
The development process began with primary research at Northwestern University’s NSF-funded HAND lab, where the team interviewed engineers working with teleoperated devices. This research revealed crucial insights into current limitations and workarounds used in the field.
The team then analyzed existing VR controllers and their potential applications in teleoperation, identifying key areas for improvements. Building on these insights they sketched initial concepts, built Franken-prototypes to test form and usability, and refined their concepts. Once aligned with the design objectives, they created orthographic drawings for CAD modeling, iterating with 3D-printed models and feedback to meet user needs and technical requirements.
Franken-prototypes
Early F1 prototype
Rendering, F1 controller side view
Rendering, F1 left and right hand controllers
IMPACT
Bridging Virtual and Physical Realities
The F1 Hand Controller features several innovative elements:
- Dynamic feedback mechanisms that translate robot interactions into tactile sensations
- Multi-surface material detection capabilities
- Real-time response systems for immediate operator feedback
Looking Ahead
The F1 Hand Controller has significant implications for multiple industries. Its applications range from improving precision in remote surgical procedures to enhancing safety in hazardous environment exploration and increasing efficiency in industrial automation.
The project exemplifies ID’s commitment to developing solutions that push technological boundaries while maintaining a focus on human needs and experiences. As teleoperation continues to grow across industries, the F1 conceptual prototype is leading to the next evolution in hand controller design. The ID team and Fluid Reality are currently collaborating on the next generation of the concept, which Fluid Reality will then advance commercially.
TEAM
Faysal Biobaku (MDes 2025)
Martin Thaler, Associate Teaching Professor
Joe Mullenbach, CEO + Founder, Fluid Reality