Stars
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
happyme531 / llama3.np-RKNPU2
Forked from likejazz/llama3.npExperimental RKNPU2 accelerated llama3.np
YoloV5 NPU multithread for the RK3566/68/88 (200 FPS)
Pelochus / ezrknn-llm
Forked from airockchip/rknn-llmEasier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
The project is a multi-threaded inference demo of Yolo running on the RK3588 platform, which has been adapted for reading video files and camera feeds. The demo uses the Yolov8n model for file infe…