Starred repositories
Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Make any agent harness multimodal-native.
Open-source end-to-end omni interaction agent for natural full-duplex voice collaboration, continuous audio-visual perception, and asynchronous long-horizon agentic execution.
A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models
Meta-Framework of Spatiotemporal Composability
DeepSeek Harness: Everything is a Plugin.
This is a simple demonstration of more advanced, agentic patterns built on top of the Realtime API.
Build voice agents with open-source models
MAGI-2-preview: Scaling Video Generation Models Efficiently
The agent that grows with you
A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents
你想蒸馏的下一个员工,何必是同事。蒸馏任何人的思维方式——心智模型、决策启发式、表达DNA。Distill how anyone thinks.
Open-source, low-cost 10.5 GHz PLFM phased array RADAR system
[TACL'26] VoiceBench: Benchmarking LLM-Based Voice Assistants
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
JoyAI-VL-Interaction: An Open Real-time Video-Language Interaction System
Example of using Realtime API as a meeting assistant to manage a Kanban Board
Covo-Audio is a 7B-parameter end-to-end large audio language model that directly processes continuous audio inputs and generates audio outputs within a single unified architecture.
X-Talk is an open-source full-duplex cascaded spoken dialogue system framework enabling low-latency, interruptible, and human-like speech interaction with a lightweight, pure-Python, production-rea…
A curated list of full-duplex spoken dialogue models & benchmarks
JoyAI-Echo-1.5: Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
DuplexSLA: A Full-Duplex Spoken Language Model with Synchronized Speech, Language, and Action