Intel® AI Inference Samples provide example code for deploying optimized inference in Intel platforms.

• Serving optimized BERT models with Intel® Extension for PyTorch (IPEX), Intel® Distribution of OpenVINO™ toolkit and Triton Inference Server framework
• Optimized Large Language Model (LLM) GPT-j with Intel® Extension for PyTorch (IPEX)
• Serving optimized DenseNet model with Intel® Extension for PyTorch (IPEX) and Triton Inference Server framework
• Deploy optimized LLM model with Intel® Extension for PyTorch (IPEX) and Torchserve on AWS Sagemaker

Please submit your questions, feature requests, and bug reports on the GitHub issues page.

Intel® AI Inference Samples is licensed under Apache License Version 2.0. Refer to the LICENSE file for the full license text and copyright notice.

This distribution includes third party software governed by separate license terms.

This third party software, even if included with the distribution of the Intel software, may be governed by separate license terms, including without limitation, third party license terms, other Intel software license terms, and open source software license terms. These separate license terms govern your use of the third party programs as set forth in the THIRD-PARTY-PROGRAMS file.

Intel, the Intel logo, OpenVINO, the OpenVINO logo and Intel Xeon are trademarks of Intel Corporation or its subsidiaries.

• Other names and brands may be claimed as the property of others.

©Intel Corporation