Lists (6)
Starred repositories
Reverse engineer anything with agents, from app behavior down to native binaries.
Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
A framework for efficient model inference with omni-modality models
🚀MCP server for accessing RedNote(XiaoHongShu, xhs).
Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
Robust Speech Recognition via Large-Scale Weak Supervision
A feature-rich command-line audio/video downloader
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available distributed systems.
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
TiDB operator creates and manages TiDB clusters running in Kubernetes.
Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero.
Real-time analytics on Postgres tables
A Datacenter Scale Distributed Inference Serving Framework
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
776F
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
A high-throughput and memory-efficient inference and serving engine for LLMs
SGLang is a high-performance serving framework for large language models and multimodal models.
A General-purpose Task-parallel Programming System in C++
The official GitHub page for the survey paper "A Survey of Large Language Models".
Probably the fastest coroutine lib in the world!
FlatBuffers: Memory Efficient Serialization Library