Stars
A high-throughput and memory-efficient inference and serving engine for LLMs
An all-in-one CLI tool for performance monitoring, analysis, and debugging.
Helping developers to use AWS Graviton2, Graviton3, and Graviton4 processors which power the 6th, 7th, and 8th generation of Amazon EC2 instances (C6g[d], M6g[d], R6g[d], T4g, X2gd, C6gn, I4g, Im4g…
Tensors and Dynamic neural networks in Python with strong GPU acceleration