Stars
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
FlashInfer: Kernel Library for LLM Serving
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
🐧 Unified and Stable RSI Platform
Reverse engineer anything with agents, from app behavior down to native binaries.
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models
Local-first search across your workspace, built for humans and AI agents.
Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (N…
A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents
Turn any idea, plan, or codebase into a beautiful interactive diagram. An agent skill for Claude Code, Codex, and more.
RayLLM - LLMs on Ray (Archived). Read README for more info.
DeepSeek Harness: Everything is a Plugin.
[TMLR] Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy injectors to reality checkers. Each agent is a specialized expert with personality, processes…
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.
A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for Apple silicon.
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control.
Official, Anthropic-managed directory of high quality Claude Code Plugins.
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
high-performance linear attention kernel library built on TileLang
Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.