8000 XLANG Lab · GitHub
[go: up one dir, main page]

Skip to content
@xlang-ai

XLANG Lab

Developing embodied AI agents that empower users to use language to interact with digital and physical environments to carry out real-world tasks.

Welcome to the Executable Language Grounding (XLANG) Lab! We are part of the HKU NLP Group at the University of Hong Kong. XLang focuses on building language model agents that transform (“grounding”) language instructions into code or actions executable in real-world environments, including databases (data agent), web applications (plugins/web agent), and the physical world (robotic agent) etc,. It lies at the heart of language model agents or natural language interfaces that can interact with and learn from these real-world environments to facilitate human interaction with data analysis, web applications, and robotic instruction through conversation. Recent advances in XLang incorporate techniques such as LLM + external tools, code generation, semantic parsing, and dialog or interactive systems.

Pinned Loading

  1. OpenCUA OpenCUA Public

    [NeurIPS 2025 Spotlight] OpenCUA: Open Foundations for Computer-Use Agents

    Python 874 110

  2. OSWorld OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Python 3.3k 556

  3. aguvis aguvis Public

    [ICML2025] Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

    Python 394 31

  4. OpenAgents OpenAgents Public

    [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

    Python 4.9k 525

  5. Spider2 Spider2 Public

    [ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

    HTML 886 155

  6. instructor-embedding instructor-embedding Public

    [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

    Python 2k 159

Repositories

Showing 10 of 33 repositories
  • OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    xlang-ai/OSWorld's past year of commit activity
    Python 3,254 Apache-2.0 556 151 20 Updated Nov 2, 2026
  • OpenAgents Public

    [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

    xlang-ai/OpenAgents's past year of commit activity
    Python 4,869 Apache-2.0 525 10 6 Updated Oct 27, 2026
  • OSWorld-V2 Public

    OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks

    xlang-ai/OSWorld-V2's past year of commit activity
    Python 411 Apache-2.0 60 45 14 Updated Oct 23, 2026
  • FineVLA Public

    NeurIPS2026 , Scalable annotation pipeline for action-aglined fine-grained instruciton for Visual-language-Action model

    xlang-ai/FineVLA's past year of commit activity
    Python 100 Apache-2.0 1 1 0 Updated Oct 4, 2026
  • osworld_image Public
    xlang-ai/osworld_image's past year of commit activity
    Shell 4 0 0 0 Updated Sep 14, 2026
  • CUA-Gym-Hub Public

    CUA-Gym-Hub: mock web apps as reproducible RL training environments for computer-use agents

    xlang-ai/CUA-Gym-Hub's past year of commit activity
    JavaScript 83 14 0 3 Updated Sep 3, 2026
  • Qwen-CUA Public

    Qwen-CUA: Native Computer Use for (Almost) Everything — a screenshot-driven agent that operates computers with keyboard and mouse, jointly developed by the Qwen Team and XLang Lab.

    xlang-ai/Qwen-CUA's past year of commit activity
    246 Apache-2.0 17 2 0 Updated Aug 26, 2026
  • CUA-Gym Public

    Scalable pipeline for synthesizing verifiable RLVR training data for computer-use agents

    xlang-ai/CUA-Gym's past year of commit activity
    Python 227 21 8 1 Updated Aug 13, 2026
  • Spider2 Public

    [ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

    xlang-ai/Spider2's past year of commit activity
    HTML 886 MIT 155 133 7 Updated Aug 12, 2026
  • xlang-ai.github.io Public

    The official website of xlang.ai

    xlang-ai/xlang-ai.github.io's past year of commit activity
    TypeScript 4 0 0 0 Updated Aug 5, 2026
0