AI Hub is a highly optimized, native Windows desktop application built in Rust using the egui framework. It acts as an interactive bridge to open-source LLMs, featuring multi-threaded chunked download pipelines, background asynchronous task workers, local file integrity gates, and direct integration with Candle for GPU/hardware acceleration.
- ⚡ Fluid Asynchronous Runtime: Built on top of a multi-threaded Tokio thread pool. Heavy network requests and heavy background weights are isolated from the main thread, keeping the immediate-mode GUI processing at a crisp 60 FPS.
- 📥 Resumable Chunked Downloader: Orchestrates HTTP range-request channels to break deep learning binaries down into chunks. Downloads occur concurrently over safe memory partitions.
- 🛡 Validation Gatekeeper: Runs rapid local diagnostics to check file sizes and missing boundaries before registering model files locally.
- 🔌 Model Context Protocol (MCP): Exposes active runtime registries, permitting integration with Telegram/Discord network broadcasts.
To build and run AI Hub from source, you must configure a native C++ compile platform and a stable Rust environment toolchain layout.
The GPU libraries and desktop rendering systems require the native MSVC compiler tools.
- Download the Visual Studio Installer.
- Run the installer and check the box for Desktop development with C++.
- Ensure the following individual components are included on the right-hand panel:
- MSVC v143 - VS 2022 C++ x64/x86 build tools
- Windows 11 SDK (or Windows 10 SDK depending on your OS)
- Click Install and restart your computer if requested.
- Download and execute rustup-init.exe.
- When prompted in the terminal panel, press 1 to proceed with the standard system installation.
- Once completed, reload your PowerShell terminal or run
refreshenvto verify compiler availability:rustc --version cargo --version
Run these commands inside your terminal to clone your repository, switch folders, and trigger an optimized compilation run:
# Clone the repository tree
git clone https://github.com
cd AI_Hub
# Compile the stable production binary layout
cargo build --releaseThe optimized executable will be generated at .\target\release\ai_hub_app.exe.
When you launch the application window, you can run the following standard string operations down inside the text shell terminal input box:
download <model_id>: Spawns the concurrent background downloader engine to safely pull down file bytes without blocking frame painting loops.clear: Flushes the active text console buffer window back to a clean terminal state.
AI Hub now supports persistent local workspace storage structures:
- State Management: Keeps track of active, sorted multi-threaded chat entries.
- Serialization Mechanics: Flawless custom JSON serialization layer via serde.
- Egui Sidebar Integration: Responsive drawer layout to interactively spawn and select historical records on the fly.