A tool to check if your local system can run specific AI models by analyzing your hardware specifications and comparing them with model requirements.
This tool is designed to run locally only and cannot be deployed on Streamlit Cloud or similar platforms because it needs direct access to your system's hardware information (CPU, GPU, RAM).
-
Clone the repository:
git clone https://github.com/YOUR_USERNAME/ai-model-compatibility-checker.git cd ai-model-compatibility-checker -
Create and activate a Python virtual environment:
python -m venv venv # On Windows: .\venv\Scripts\activate # On Unix/MacOS: source venv/bin/activate
-
Install dependencies:
pip install -r requirements.txt
-
Create a
.envfile in the root directory and add your OpenRouter API key:OPENROUTER_API_KEY=your-api-key-here -
Run the application:
cd app streamlit run main.py
- 📊 Real-time system specifications detection (CPU, RAM, GPU)
- 🤖 HuggingFace model requirements analysis
- 💾 Memory estimation for different precision and quantization settings
- 🎯 Compatibility scoring and recommendations
- 🔄 Automatic memory requirement adjustments based on inference settings
- 🧠 Intelligent model requirement extraction using DeepSeek via OpenRouter
- 📝 Detailed source information and confidence scores
- 💡 Dynamic inference configuration updates
- 🔍 Regex-based parameter extraction as fallback
- 🚀 Improved response handling with increased token limits
- ⚡ Optimized API calls with proper error handling
- 🗃️ Caches results for faster repeated checks
The application uses OpenRouter to access the DeepSeek model for intelligent requirement extraction. To set up:
- Sign up at OpenRouter
- Get your API key from the dashboard
- Add to your
.envfile:OPENROUTER_API_KEY=your-api-key-here
Recent improvements:
- Increased max_tokens to 4000 for better response handling
- Added timeout handling for API calls
- Improved error handling with fallback to regex extraction
- Enhanced prompt engineering for more accurate extraction
- Added confidence scores for extracted information
- Dynamic recalculation of requirements when changing inference settings
- Python 3.8 or higher
- NVIDIA GPU (optional, for GPU compatibility checks)
- Windows/Linux/MacOS
- Internet connection (for fetching model information)
- Fork the repository
- Create a feature branch
- Make your changes
- Submit a pull request
Contributions are welcome! Please feel free to submit a Pull Request.
This project is licensed under the MIT License - see the LICENSE file for details.