New Amazon SageMaker AI customers can now land in a fully configured SageMaker Studio environment in only a few steps. Sign up with an identity you…
Tag: Artificial Intelligence
Amazon SageMaker JumpStart: 2026 year-to-date in review
Amazon SageMaker JumpStart onboarded over 100 new models from 30 providers in the first three quarters of 2026. This recap covers the model-onboarding…
Pegasus 1.5 from TwelveLabs is now available in Amazon Bedrock
TwelveLabs Pegasus 1.5 is now available in Amazon Bedrock. The video language model turns long-form video into structured, timestamped metadata: define…
How Deepgram optimized voice AI at scale with AWS Trainium
Deepgram worked with the AWS Forward Deployed Engineering team to port its Nova-3 speech-to-text model to AWS Trainium2 for offline batch inference. This…
Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM
vLLM’s prefill-decode disaggregation splits LLM inference across engine instances but must transfer the KV cache between them. This post introduces a…
Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM
Multi-turn agentic workloads reprocess growing conversation context each turn, driving up latency. See how bi-directional KV cache transfer lets prefill…
Meta’s Muse Spark Open now available in Amazon SageMaker JumpStart
Muse Spark Open, Meta’s coding-optimized open-weight model, is now available in Amazon SageMaker JumpStart. Deploy it to a SageMaker AI endpoint in your…
Building trust in AI agents: A production-ready evaluation framework with Amazon Bedrock AgentCore
Autonomous AI agents fail softly: latency stays flat while answer quality quietly erodes. This post shares a nine-stage evaluation framework, built on…
Trust in Depth: Giving agents more autonomy without losing control
Enterprise leaders want AI agents to take on more work but don’t fully trust them to act correctly every time. Trust in Depth is AWS’s layered…
Introducing Reflection Beam: an open-weight model for agentic coding on AWS
Reflection AI’s Beam is an open-weight model for agentic coding and long-horizon tasks. This post shows how to deploy Beam on AWS: start with an Amazon…