Starred repositories
Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflo…
C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
An elegant PyTorch deep reinforcement learning library.
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
🙌 OpenHands: AI-Driven Development
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
Model Context Protocol Reference Servers
A toolkit to run Ray applications on Kubernetes
FlashMLA: Efficient Multi-head Latent Attention Kernels
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.
Crane is a FinOps Platform for Cloud Resource Analytics and Economics in Kubernetes clusters. The goal is not only to help users to manage cloud cost easier but also ensure the quality of applicati…
Making large AI models cheaper, faster and more accessible
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Ongoing research training transformer models at scale
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
A high-throughput and memory-efficient inference and serving engine for LLMs
OpenTelemetry Auto Instrumentation using eBPF
Various materials about Profile Guided Optimization and other similar stuff like AutoFDO, Bolt, etc.
deepspeedai / Megatron-DeepSpeed
Forked from NVIDIA/Megatron-LMOngoing research training transformer language models at scale, including: BERT & GPT-2
A pluggable, high-performance RPC framework written in golang
OpenTelemetry filter implementations of tRPC-Go
Delve is a debugger for the Go programming language.
FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, le…
ncnn is a high-performance neural network inference framework optimized for the mobile platform