Driving Wuji Hand 2 with Apple Vision Pro or a camera

What you need

Make sure you have everything before you start.

You provideApple Vision Proor RealSense / video

Free downloadTracking Streamer

App Store ↗

IncludedWuji Hand 2simulation works without it

You providePC (Python)

Download Python ↗

Steps

1. 

   Vision ProWi-Fi

   →

   

   PCretargeting

   →

   

   Hand 2Ethernet
   1

   How it works

   Hand motion → 20 joint angles.

2. Terminal

   $ git clone --recurse-submodules https://github.com/wuji-technology/wuji-retargeting.git

   $ cd wuji-retargeting && git lfs pull

   $ pip install -r requirements.txt && pip install -e .
   2

   Install

   Copy three lines.

   Wuji Retargeting →
3. Tracking Streamer

   StatusStreaming

   IP192.168.x.x
   3

   Find the IP

   Shown in Tracking Streamer on Vision Pro.

4. Terminal

   $ cd example

   $ python teleop_sim.py --input visionpro --ip <IP> --hand left
   4

   Simulation first

   Check the on-screen hand follows you.

5. Terminal

   $ python teleop_real.py --input visionpro --ip <IP> --hand left
   5

   Run on the hand

   Start with small motions.

   Full steps →

Related documentation