8000 GitHub - ZefanW/JustRUA: A RoboDojo robot policy with predicted depth, measured gripper feedback and a persistent coding actor. · GitHub
[go: up one dir, main page]

Skip to content
ZefanWPublic

About

A RoboDojo robot policy with predicted depth, measured gripper feedback and a persistent coding actor.

Resources

Stars

2 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

JustRUA

Paper · Project page · 中文主页 · Episode replays

This repository holds the policy from JustRUA: A Controlled Study of GPT-6 Robot-Use Agents (arXiv:2611.16009).

JustRUA is a robot policy for the dual-arm ARX X5 in RoboDojo. The actor gets three RGB views, a depth estimate for each view, camera calibration, and measured finger and wrist readings. For example, a close command can coexist with fingers that stop partway. The next decision sees both the command and the measured positions.

One persistent GPT-6 Astra conversation controls each episode. The actor can use a local coding runtime to calculate a target from the observations, inspect its previous work, or issue an absolute end-effector target directly. The Cartesian planner converts that target into robot controls. Each motion executes at most its first 20 controls. The actor then sees the actual state and arrival error before deciding again. There is no policy limit on decision count; the simulator enforces its own episode budget.

Results

Scores are on the 111-episode RoboDojo evaluation set of the paper, which covers all 42 tasks. Each row adds one change to the row above, and the last row is the policy in this repository. Cost is per first-round episode.

Configuration Score Success (%) Cost ($)
Official L3 harness 29.7
+ Codex session with the full episode history 34.7 27.1 3.76
+ At most 20 control steps per motion 38.0 31.0 4.94
+ Compact robot readings 39.8 33.3 5.51
+ Depth predicted from RGB 42.4 35.4 7.74
+ Coordinate solving in code, no decision cap (JustRUA) 50.3 43.3 12.53

The paper reports every design we tested, including the ones this policy leaves out.

Use with XPolicyLab

This repository contains the complete JustRUA policy adapter. It runs inside the public RoboDojo and XPolicyLab projects. Install from the three public repositories below. A full evaluation also requires RoboDojo's simulator and assets, the external Depth Pro checkpoint, and an existing provider account with access to the selected actor.

From a new workspace:

git clone https://github.com/ZefanW/JustRUA.git
git clone --filter=blob:none https://github.com/RoboDojo-Benchmark/RoboDo
70A1
jo.git
export ROBODOJO_ROOT="$(cd RoboDojo && pwd)"

git -C "$ROBODOJO_ROOT" submodule update --init XPolicyLab
XPL="$ROBODOJO_ROOT/XPolicyLab"
XPL_REV=6baccd57ff958570d0db1588370289ee36c8bb70
git -C "$XPL" fetch origin "$XPL_REV"
git -C "$XPL" checkout --detach "$XPL_REV"

# Copy the adapter into an empty policy slot.
test ! -e "$XPL/policy/JustRUA" && cp -R JustRUA/policy/JustRUA "$XPL/policy/"
cd "$XPL"

With an existing RoboDojo installation, use its XPolicyLab checkout if it already includes the Direct EEF planner. The revision above is the tested base. Follow the adapter setup and evaluation instructions from the XPolicyLab root. They include commands for installing the depth model and the coding runtime, running an offline WebSocket check, and evaluating a task.

Source map

Directory or file What it does
observations/ Reads robot and camera measurements, and predicts colorized depth from RGB.
actor/ Keeps one native coding conversation per episode and isolates its writable scratch space.
policy.py Applies the control limit to a planned motion and passes measured feedback to the next decision.
deploy.py Connects those components to RoboDojo's environment and XPolicyLab's planner.

Citation

@article{justrua2026,
  title   = {JustRUA: A Controlled Study of GPT-6 Robot-Use Agents},
  author  = {Zefan Wang and Yufan Dang and Xuanwei Shi and Mingqi Gao and Cheng Yin and SikYuen Tam and Hanyu Liu and Yasheng Wang and Yaxi Lu and Songyang Zhang and Xin Cong and Yuan Yao},
  journal = {arXiv preprint arXiv:2611.16009},
  year    = {2026}
}

License

The adapter is distributed under Apache License 2.0. The robot measurement implementation in observations/ includes code covered by its accompanying MIT license. Apple distributes the Depth Pro weights separately under the terms on the pinned model card.

About

A RoboDojo robot policy with predicted depth, measured gripper feedback and a persistent coding actor.

Resources

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages

0