Stars
A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.
An open-source AI accelerator, developed by AI: RTL, ISA, simulator, compiler and profiler in one repo. Runs Qwen3, LFM2.5 and Qwen3.5 on a Kintex-7 PCIe card.
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
Tier-aware custom allocator using C++ Reflection / Annotations
A sandbox environment for C++ experimentation
A collection of resources on modern C++
Playing around "Less Slow" coding practices in C++ 20, C, CUDA, PTX, & Assembly, from numerics & SIMD to coroutines, ranges, exception handling, networking and user-space IO
Hexagon-MLIR is a compiler toolchain for compiling and executing AI kernels and models on Qualcomm Hexagon Neural Processing Units (NPUs).
A curated list of awesome libraries, packages, strategies, books, blogs, tutorials for systematic trading.
Build a compiler to solve Anthropic's interview challenge.
Anthropic's original performance take-home, now open for you to try!
Various translations of OSTEP can be found here. Help the cause and contribute!
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
TradingAgents: Multi-Agents LLM Financial Trading Framework
A tutorial on modern GPU programming for machine learning systems
Multi-Joint dynamics with Contact. A general purpose physics simulator.
Implementation of the std::execution (P2300, sender/receiver) proposal
Learn AI Engineering! Learn it. Build it. Ship it for others.
Lightweight structured concurrency for C++20
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.