Project Info
Robot teleporation through mixted reality
Yangming Shi
yangming.shi@mines.edu
Project Goals and Description:
We are developing a system that allows a person to effectively “step into” a remote robot’s body through virtual or augmented reality. By wearing a special headset, the operator will see and hear what the robot sees and hears, all in real-time. As the robot moves and interacts with its surroundings, the human operator experiences the environment as though they are physically present. This immersive technology could be a game-changer in fields such as disaster relief, space exploration, and remote maintenance work, where human safety and access are major challenges.
More Information:
Grand Challenge: Enhance virtual reality.
- Construction Robot Teleoperation Safeguard Based on Real-Time Human Hand Motion Prediction (https://ascelibrary.org/doi/abs/10.1061/%28ASCE%29CO.1943-7862.0002289)
- Neurobehavioral assessment of force feedback simulation in industrial robotic teleoperation (https://www.sciencedirect.com/science/article/abs/pii/S0926580521001254)
Primary Contacts:
Yangming Shi, yangming.shi@mines.edu
Frankie Zhu, frankie.zhu@mines.edu
Student Preparation
Qualifications
The student should have a strong programming background (C++, C#, etc) and know ROS.
TIME COMMITMENT (HRS/WK)
3-5 hours of work per week
SKILLS/TECHNIQUES GAINED
1. Gain knowledge of virtual and augmented reality concepts and how they apply to teleoperated robots.
2. Learn how to combine hardware (robotic platforms, sensors, headsets) and software (control algorithms, real-time data streaming) into a cohesive system.
3. Explore methods to improve user experience, focusing on intuitive controls, realistic visuals, and ease of operation.
4. Tackle design and engineering challenges relevant to emergency response, space exploration, or other high-risk scenarios.
MENTORING PLAN
The student will have regular meetings with the professors and related graduate students
Preferred Student Status
Sophomore
Junior
Senior