[go: up one dir, main page]
Skip to content

@EmbeddedLLM EmbeddedLLM

Change the repository type filter

All

    Repositories list

    36 repositories

    • torchac_rocm

      Public
      ROCm Implementation of torchac_cuda from LMCache
      Cuda
      •1•0•0•0•Updated Nov 17, 2024Nov 17, 2024

    • vllm

      Public
      vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
      inferencepytorchtransformergptamdgpurocmmodel-servingllmllm-inference
      Python
      •
      Apache License 2.0
      •4.6k•89•4•0•Updated Nov 16, 2024Nov 16, 2024

    • infinity-executable

      Public
      Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of text-embedding models and frameworks.
      Python
      •
      MIT License
      •113•0•0•1•Updated Nov 16, 2024Nov 16, 2024

    • axolotl-amd

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •872•0•0•0•Updated Nov 16, 2024Nov 16, 2024

    • Liger-Kernel

      Public
      Efficient Triton Kernels for LLM Training
      Python
      •
      BSD 2-Clause "Simplified" License
      •202•0•0•0•Updated Nov 16, 2024Nov 16, 2024

    • LMCache-ROCm

      Public
      ROCm support of Ultra-Fast and Cheaper Long-Context LLM Inference
      Python
      •
      Apache License 2.0
      •23•0•0•0•Updated Nov 14, 2024Nov 14, 2024

    • jamaibase-ts-docs

      Public
      Typescript Documentation of JamAISDK
      HTML
      •0•0•0•0•Updated Nov 14, 2024Nov 14, 2024

    • skypilot

      Public
      SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
      Python
      •
      Apache License 2.0
      •510•0•0•0•Updated Nov 7, 2024Nov 7, 2024

    • flash-attention-docker

      Public
      This is a repository that contains a CI/CD that will try to compile docker images that already built flash attention into the image to facilitate quicker development and deployment of other frameworks.
      Shell
      •
      Apache License 2.0
      •0•1•0•0•Updated Oct 26, 2024Oct 26, 2024

    • flash-attention-rocm

      Public
      ROCm Fork of Fast and memory-efficient exact attention (The idea of this branch is to hope to generate flash attention pypi package to be readily installed and used.
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.3k•0•0•0•Updated Oct 26, 2024Oct 26, 2024

    • vllm-rocmfork

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •4.6k•0•0•0•Updated Oct 23, 2024Oct 23, 2024

    • etalon

      Public
      LLM Serving Performance Evaluation Harness
      Python
      •
      Apache License 2.0
      •5•0•0•0•Updated Oct 17, 2024Oct 17, 2024

    • unstructured-python-client

      Public
      A Python client for the Unstructured hosted API
      Python
      •
      MIT License
      •17•0•0•1•Updated Oct 14, 2024Oct 14, 2024

    • embeddedllm

      Public
      EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
      windowscpullamagemmamistraldirectx-12openvinonpuopenvino-inference-engineaipc
      Python
      •0•21•6•2•Updated Oct 6, 2024Oct 6, 2024

    • github-bot

      Public
      Go
      •1•0•0•0•Updated Sep 26, 2024Sep 26, 2024

    • JamAIBase

      Public
      The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.
      pythonworkflowaiserverlesschatbotspreadsheetsvelteorchestrationbaasagents
      Python
      •
      Apache License 2.0
      •17•426•2•1•Updated Sep 23, 2024Sep 23, 2024

    • PowerToys

      Public
      Windows system utilities to maximize productivity
      C#
      •
      MIT License
      •6.6k•0•0•0•Updated Aug 9, 2024Aug 9, 2024

    • arena-hard-auto

      Public
      Arena-Hard-Auto: An automatic LLM benchmark.
      Jupyter Notebook
      •
      Apache License 2.0
      •71•0•0•0•Updated Jul 15, 2024Jul 15, 2024

    • unstructured-api-executable

      Public
      Python
      •
      Apache License 2.0
      •117•0•0•0•Updated Jul 11, 2024Jul 11, 2024

    • unstructured-inference-executable

      Public
      Python
      •
      Apache License 2.0
      •53•0•0•0•Updated Jul 9, 2024Jul 9, 2024

    • unstructured-executable

      Public
      Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
      HTML
      •
      Apache License 2.0
      •755•1•0•0•Updated Jul 9, 2024Jul 9, 2024

    • workshop

      Public
      Jupyter Notebook
      •0•0•0•0•Updated Jun 25, 2024Jun 25, 2024

    • ai-town

      Public
      A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.
      TypeScript
      •
      MIT License
      •708•0•0•0•Updated Jun 23, 2024Jun 23, 2024

    • jamaibase-cookbook

      Public
      JamAI Base cookbook repo
      Python
      •
      Apache License 2.0
      •0•4•0•0•Updated Jun 10, 2024Jun 10, 2024

    • jamaibase-expressjs-vercel

      Public
      TypeScript
      •1•0•0•0•Updated May 31, 2024May 31, 2024

    • jamaibase-nextjs-vercel

      Public
      TypeScript
      •0•1•0•0•Updated May 31, 2024May 31, 2024

    • nlux-jamai

      Public
      The 𝗣𝗼𝘄𝗲𝗿𝗳𝘂𝗹 Conversational AI JavaScript Library
      TypeScript
      •
      Other
      •64•0•0•0•Updated May 31, 2024May 31, 2024

    • mamba-rocm

      Public
      Python
      •
      Apache License 2.0
      •1.1k•5•0•0•Updated Apr 22, 2024Apr 22, 2024

    • dspy

      Public
      DSPy: The framework for programming—not prompting—foundation models
      Python
      •
      MIT License
      •1.4k•0•0•0•Updated Apr 19, 2024Apr 19, 2024

    • causal-conv1d-rocm

      Public
      Causal depthwise conv1d in CUDA, with a PyTorch interface
      Cuda
      •
      BSD 3-Clause "New" or "Revised" License
      •61•0•0•0•Updated Apr 12, 2024Apr 12, 2024