8000 OpenMOSE (OpenMOSE) · GitHub
[go: up one dir, main page]
Skip to content
View OpenMOSE's full-sized avatar
44 followers · 13 following

Achievements

Achievement: YOLOAchievement: QuickdrawAchievement: Pull Sharkx2Achievement: Starstruck

Achievements

Achievement: YOLOAchievement: QuickdrawAchievement: Pull Sharkx2Achievement: Starstruck

Block or report OpenMOSE

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. RWKV-Infer-Next RWKV-Infer-Next Public

    An inference server for RWKV-7 text models, built for multi-GPU throughput: tensor parallelism, continuous batching on CUDA graphs, int6 weights and MTP speculative decoding, behind an OpenAI-compa…

    Python 1

  2. RWKV-Infer RWKV-Infer Public

    A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy on docker. Supports true multi-batch generation and dynamic…

    Python 52 2

  3. RWKV-LM-RLHF RWKV-LM-RLHF Public

    Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the possibilities for deeper fine-tuning of RWKV.

    Python 65 6

  4. RWKV-infctx-trainer-LoRA RWKV-infctx-trainer-LoRA Public

    RWKV v5, v6 infctx LoRA trainer with 4bit quantization,Cuda and Rocm supported, for training arbitary context sizes, to 10k and beyond!

    Python 8 2

  5. RWKV5-LM-LoRA RWKV5-LM-LoRA Public

    RWKV v5,v6 LoRA Trainer on Cuda and Rocm Platform. RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN an…

    Python 13 5

  6. RWKV-LM-RLHF-DPO-LoRA RWKV-LM-RLHF-DPO-LoRA Public

    Forked from Triang-jyed-driung/RWKV-LM-RLHF-DPO

    Direct Preference Optimization LoRA for RWKV, aiming for RWKV-5 and 6.

    Python 1

0