Difference between revisions of "Category:Teleop"
| (10 intermediate revisions by 3 users not shown) | |||
| Line 2: | Line 2: | ||
Teleoperation is the art of controlling a robot from a distance (prefix "tele-" comes from the Ancient Greek word tēle, which means "far off, at a distance, far away, far from"). | Teleoperation is the art of controlling a robot from a distance (prefix "tele-" comes from the Ancient Greek word tēle, which means "far off, at a distance, far away, far from"). | ||
| + | Robots specifically designed to be teleoperated by a human are known as a Proxy. | ||
== Whole Body Teleop == | == Whole Body Teleop == | ||
| Line 11: | Line 12: | ||
* https://x.com/haoshu_fang/status/1707434624413306955 | * https://x.com/haoshu_fang/status/1707434624413306955 | ||
* https://x.com/aditya_oberai/status/1762637503495033171 | * https://x.com/aditya_oberai/status/1762637503495033171 | ||
| + | * https://what-is-proxy.com | ||
| + | * https://github.com/wuphilipp/gello_software | ||
| + | * https://www.ais.uni-bonn.de/papers/Humanoids_2023_Schwarz_Lenz_NimbRo_Avatar.pdf | ||
| + | * https://www.ais.uni-bonn.de/papers/SORO_2023_Lenz_Schwarz_NimbRo_Avatar.pdf | ||
| + | * https://robot.neu.edu/project/avatar/ | ||
== VR Teleop == | == VR Teleop == | ||
| − | In VR teleop the user controls a simulated version of the robot. The robot and VR headset are usually on the same LAN and communication is done via gRPC | + | In VR teleop the user controls a simulated version of the robot. The robot and VR headset are usually on the same LAN and communication is done via gRPC, WebRTC, ZMQ. |
* https://github.com/Improbable-AI/VisionProTeleop | * https://github.com/Improbable-AI/VisionProTeleop | ||
| Line 22: | Line 28: | ||
* https://x.com/AndreTI/status/1780665435999924343 | * https://x.com/AndreTI/status/1780665435999924343 | ||
* https://holo-dex.github.io/ | * https://holo-dex.github.io/ | ||
| + | * https://what-is-proxy.com | ||
| + | * https://github.com/ToruOwO/hato/tree/main?tab=readme-ov-file#collecting-demonstration-data | ||
| + | * https://github.com/rail-berkeley/oculus_reader | ||
| + | * https://github.com/OpenTeleVision/TeleVision/tree/main | ||
== Controller Teleop == | == Controller Teleop == | ||
| − | In | + | In controller teleop, the user uses joysticks, keyboards, and other controllers to control the robot. The buttons map to hardcoded behaviors on the robot. |
* https://github.com/ros-teleop | * https://github.com/ros-teleop | ||
* https://x.com/ShivinDass/status/1606156894271197184 | * https://x.com/ShivinDass/status/1606156894271197184 | ||
| + | * https://what-is-proxy.com | ||
== Latency == | == Latency == | ||
| Line 35: | Line 46: | ||
* https://link.springer.com/article/10.1007/s10846-022-01749-3 | * https://link.springer.com/article/10.1007/s10846-022-01749-3 | ||
* https://twitter.com/watneyrobotics/status/1769058250731999591 | * https://twitter.com/watneyrobotics/status/1769058250731999591 | ||
| − | |||
| − | |||
| − | |||
Latest revision as of 16:54, 30 April 2024
TeleopEdit
Teleoperation is the art of controlling a robot from a distance (prefix "tele-" comes from the Ancient Greek word tēle, which means "far off, at a distance, far away, far from"). Robots specifically designed to be teleoperated by a human are known as a Proxy.
Whole Body TeleopEdit
In whole-body teleop, the user controls a hardware replica of the robot directly. The real robot directly mimcis the pose of the replica robot.
- https://mobile-aloha.github.io/
- https://www.youtube.com/watch?v=PFw5hwNVhbA
- https://x.com/haoshu_fang/status/1707434624413306955
- https://x.com/aditya_oberai/status/1762637503495033171
- https://what-is-proxy.com
- https://github.com/wuphilipp/gello_software
- https://www.ais.uni-bonn.de/papers/Humanoids_2023_Schwarz_Lenz_NimbRo_Avatar.pdf
- https://www.ais.uni-bonn.de/papers/SORO_2023_Lenz_Schwarz_NimbRo_Avatar.pdf
- https://robot.neu.edu/project/avatar/
VR TeleopEdit
In VR teleop the user controls a simulated version of the robot. The robot and VR headset are usually on the same LAN and communication is done via gRPC, WebRTC, ZMQ.
- https://github.com/Improbable-AI/VisionProTeleop
- https://github.com/fazildgr8/VR_communication_mujoco200
- https://github.com/pollen-robotics/reachy2021-unity-package
- https://freetale.medium.com/unity-grpc-in-2023-98b739cb115
- https://x.com/AndreTI/status/1780665435999924343
- https://holo-dex.github.io/
- https://what-is-proxy.com
- https://github.com/ToruOwO/hato/tree/main?tab=readme-ov-file#collecting-demonstration-data
- https://github.com/rail-berkeley/oculus_reader
- https://github.com/OpenTeleVision/TeleVision/tree/main
Controller TeleopEdit
In controller teleop, the user uses joysticks, keyboards, and other controllers to control the robot. The buttons map to hardcoded behaviors on the robot.
- https://github.com/ros-teleop
- https://x.com/ShivinDass/status/1606156894271197184
- https://what-is-proxy.com