8000 Infini-AI-Lab · GitHub
[go: up one dir, main page]
Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Next Generation AI algorithms and systems

Popular repositories Loading

  1. hermit hermit Public

    A framework for continual learning and recursive self-improvement through harness adapter evolution.

    Python 489 45

  2. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 376 37

  3. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 280 21

  4. MagicPIG MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 256 21

  5. MagicDec MagicDec Public

    [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 162 14

  6. MonarchRT MonarchRT Public

    Python 147 13

8000

Repositories

Showing 10 of 49 repositories
View all repositories

Top languages

Loading…

Most used topics

Loading…
0