8000 andyxning (Ning Xie) / Starred · GitHub
[go: up one dir, main page]

Skip to content
View andyxning's full-sized avatar
🎯
Focusing
🎯
Focusing
  • Beijing, China

Organizations

@nsqio @kubernetes @vllm-project

Block or report andyxning

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Starred repositories

Showing results

Agent Substrate: the core system

Go 8,098 887 Updated Nov 21, 2026

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

Python 26,297 3,244 Updated Nov 19, 2026

Open-source framework for the research and development of foundation models.

Python 4,136 356 Updated Nov 22, 2026

A curated list of awesome approaches to AI model routing

254 37 Updated Mar 24, 2025

Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

Python 858 49 Updated Oct 27, 2026

Recipes and resources for training, building generative AI with Fireworks

Python 245 74 Updated Nov 21, 2026

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Python 1,811 200 Updated Nov 20, 2026

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

Python 7,324 703 Updated Jul 9, 2026

DeepEP: an efficient expert-parallel communication library

Cuda 10,464 1,566 Updated Nov 20, 2026

mKernel: fast multi-node, multi-GPU fused kernels

Cuda 317 29 Updated Nov 16, 2026

Tile primitives for speedy kernels

Cuda 3,805 350 Updated Sep 12, 2026

A curated list of best cuda programming books

1,004 33 Updated May 19, 2026

Machine Learning Engineering Open Book

Python 19,738 1,305 Updated Nov 21, 2026

Module, Model, and Tensor Serialization/Deserialization

Python 329 55 Updated Nov 17, 2026

Benchmark suite for LLMs from Fireworks.ai

Python 121 45 Updated Nov 19, 2026

High Performance LLM Inference Operator Library

C++ 1,191 151 Updated Nov 19, 2026

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Python 5,564 445 Updated Oct 20, 2026

SkyRL: A Modular Full-stack RL Library for LLMs

Python 2,546 497 Updated Nov 21, 2026

LLMPerf is a library for validating and benchmarking LLMs

Python 1,127 201 Updated Dec 9, 2024

Manages Unified Access to Generative AI Services built on Envoy Gateway

Go 2,429 476 Updated Nov 19, 2026
C++ 553 45 Updated Aug 27, 2026

Inference server benchmarking tool

Rust 178 35 Updated Sep 23, 2026

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

Go 2,000 1,265 Updated Nov 20, 2026

Using CRDs to manage GPU resources in Kubernetes.

Go 215 30 Updated Nov 21, 2022

Heterogeneous GPU Sharing on Kubernetes

Go 5,044 897 Updated Nov 21, 2026

AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kubernetes Engine

Jupyter Notebook 327 241 Updated Jun 23, 2025
Next
0