8000 Sagemaker deploy by AlbertDeFusco · Pull Request #121 · anaconda/anaconda-ai · GitHub
[go: up one dir, main page]

Skip to content

Sagemaker deploy - #121

Merged
AlbertDeFusco merged 22 commits into
mainfrom
sagemaker-deploy
May 8, 2026
Merged

AlbertDeFusco merged 22 commits into
mainfrom
sagemaker-deploy

Conversation

@AlbertDeFusco
@AlbertDeFusco AlbertDeFusco commented May 5, 2026 •
Copy link
Copy Markdown
Collaborator

Deploy Anaconda AI Catalog models to SageMaker real-time endpoints from the SDK and CLI using and Anaconda-provided runtime image.

SDK (anaconda_ai.integrations.sagemaker)

  • AnacondaModel: wraps the sagemaker-core v3 API (Model, EndpointConfig, Endpoint)
  • .stage(): optional uploads GGUF to S3 via CodeBuild (auto-provisions IAM role, project, SSM)
  • .build(): registers a deployable model in SageMaker (staged or unstaged)
  • .deploy(): creates endpoint, waits for InService
  • Deterministic model naming — same config = same model resource, no duplicates
  • SSO-aware role resolution (creates AmazonSageMaker-DefaultRole when needed)
  • All llama-server LLAMA_ARG_* params exposed as constructor kwargs

CLI

  • anaconda ai stage MODEL: optional stage to S3, --list, --force
  • anaconda ai deploy MODEL --image-uri URI: full deploy with --stage, --build-only
  • Grouped --help panels: Endpoint, AWS, Staging, llama-server, Anaconda
  • Post-deploy output shows Python, AWS CLI, and Console URL examples

Config

  • [plugin.ai.stage.sagemaker] in config.toml for bucket/prefix/region defaults
  • sagemaker-core>=2.0.0 (not the full sagemaker meta-package — avoids torch/onnx/mlflow)
  • Bucket naming uses sagemaker-* pattern for IAM policy compatibility

8000
@AlbertDeFusco
AlbertDeFusco marked this pull request as ready for review May 8, 2026 16:57
@robbdawg13
robbdawg13 self-requested a review May 8, 2026 17:04
@robbdawg13 robbdawg13 left a comment
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@AlbertDeFusco
AlbertDeFusco added this pull request to the merge queue May 8, 2026
Merged via the queue into main with commit cd25312 May 8, 2026
8 checks passed
@AlbertDeFusco
AlbertDeFusco deleted the sagemaker-deploy branch May 8, 2026 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

0