Discussions

Ask a Question
Back to All

Is possible to add a AWS Sagemaker serverless inference guide

Hi

Current guide for realtime inference with AWS Sagemaker, force users to keep a running EC2 living and consuming hourly rates.


AWS has a serverless inferencing billed by ms. https://docs.aws.amazon.com/sagemaker/latest/dg/serverless-endpoints.html

With this the pay as you go will be more afordable.

Admin

Hi Miguel,

Thanks for the feedback! Today, AWS SageMaker Serverless does not support AWS marketplace model packages (It's in the page you referenced under "Feature exclusions"). We are actively working to get on Amazon Bedrock for a serverless (with per token pricing) solution on AWS.

Best,

-Wen

sounds great!! thanks for the answer

留学生作业代写不仅仅是为了应付当前的课程,更是一种长期的学习策略。