8000 ymwangg (Yanming W.) / Starred · GitHub
[go: up one dir, main page]

Skip to content
View ymwangg's full-sized avatar

Block or report ymwangg

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results

🚀 The Architecture of Open Source Applications Volume 1 & 2, 500 Lines or Less, Software Design by Example, Performance of Open Source Applications (PDF)

Python 337 70 Updated Jun 1, 2025

🚀 Efficient implementations for emerging model architectures

Python 6,073 825 Updated Nov 21, 2026

high-performance linear attention kernel library built on TileLang

Python 761 89 Updated Oct 30, 2026

AWS Neuron's extension of TorchTitan that adds AWS Trainium support with TorchNeuron for training generative AI models

Python 17 3 Updated Nov 17, 2026

A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

Python 1 Updated Aug 28, 2026

NKIPy: Rapid Prototyping on Trainium

Python 30 12 Updated Oct 19, 2026
Python 79 21 Updated Oct 19, 2026

A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

Python 995 192 Updated Nov 21, 2026
Python 20 6 Updated Oct 1, 2026

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Rust 11,271 1,277 Updated Nov 20, 2026

Every front-end GUI client for ChatGPT, Claude, and other LLMs

4,026 303 Updated Nov 19, 2026

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Python 5,564 445 Updated Oct 20, 2026

PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices

Python 44 28 Updated Jan 31, 2024

CUDA Templates and Python DSLs for High-Performance Linear Algebra

C++ 10,753 2,189 Updated Nov 20, 2026

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downs…

Python 5,647 828 Updated Nov 22, 2026

This repository contains integer operators on GPUs for PyTorch.

Python 234 55 Updated Sep 29, 2023

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Python 11,069 1,158 Updated Jul 1, 2024

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & V…

1,317 76 Updated Mar 9, 2025

The official Meta Llama 3 GitHub site

Python 29,144 3,515 Updated Jan 26, 2025

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

Python 1,180 98 Updated Sep 4, 2024

A framework for few-shot evaluation of language models.

Python 14,516 3,823 Updated Nov 4, 2026

📰 Must-read papers and blogs on Speculative Decoding ⚡️

1,309 87 Updated Jun 27, 2026

FlashInfer: Kernel Library for LLM Serving

Cuda 6,983 1,794 Updated Nov 21, 2026

Measuring Massive Multitask Language Understanding | ICLR 2021

Python 1,625 121 Updated May 28, 2023

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Python 2,343 311 Updated May 11, 2025

SGLang is a high-performance serving framework for large language models and multimodal models.

Python 38,905 10,692 Updated Nov 22, 2026

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Python 8,998 635 Updated May 3, 2024

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Python 3,667 327 Updated Jul 17, 2025

Numbers every LLM developer should know

4,312 139 Updated Jan 16, 2024

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Python 64,982 11,176 Updated Nov 12, 2025
Next
0