Lists (19)
AI
Benchmark
Compiler & DSL
CV & CG
Diffusion
Framework
Hardware
HPC
Instrumention&Reverse&Assemble
LAB
Math
NLP
Operating Systems
Recommendation
ROCM
Simulators
Template & Theme
Tools
Tutorial & Examples
Stars
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Kimi Code CLI — The Starting Point for Next-Gen Agents
Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
🚀 Efficient implementations for emerging model architectures
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
An LLM post-training framework with vLLM for RL Scaling
A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
A Datacenter Scale Distributed Inference Serving Framework
DeepSeek Harness: Everything is a Plugin.
TokenSpeed is a speed-of-light LLM inference engine.
A framework for efficient model inference with omni-modality models
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflo…
Lightweight coding agent that runs in your terminal
An asynchronous streaming data management module for efficient post-training.
A framework for few-shot evaluation of language models.
A high-performance and light-weight router for vLLM large scale deployment
slime is an LLM training framework for RL Scaling.
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…
Accurate, large-scale, and extensible simulator for LLM inference Systems
Offline optimization of your disaggregated Dynamo graph
Claude Opus 4.6 wrote a dependency-free C compiler in Rust, with backends targeting x86 (64- and 32-bit), ARM, and RISC-V, capable of compiling a booting Linux kernel.
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
[Archived] Legacy Python Kimi CLI, no longer maintained. Please use Kimi Code CLI: https://github.com/MoonshotAI/kimi-code