Multi-agent systems fail in ways traditional monitoring misses. This post presents a dual-layer approach to monitoring production agents: Amazon Bedrock…
Category: Artificial Intelligence
Beyond the price per token: Choosing the right OpenAI model on Amazon Bedrock for your workload
Comparing models on dollars per million tokens misses what production workloads actually pay for: outcomes. This post shares an open-source benchmarking…
ICYMI: What landed for AI builders in August 2026
A recap of August 2026 launches for AI builders across Amazon Bedrock, Amazon Bedrock AgentCore, and Strands: million-token context for OpenAI models,…
Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM
Learn how to deploy Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter open-weight model, on Amazon SageMaker HyperPod with vLLM. This walkthrough covers cluster…
How Heurist Finance built an AI-native investment workbench on Amazon Bedrock AgentCore
Learn how Heurist built Heurist Finance, a conversational AI investment workbench, on Amazon Bedrock AgentCore. This customer story shows how AgentCore…
Simplify and support your TorchServe workloads using Ray Serve Deep Learning Containers
TorchServe is no longer maintained, leaving teams to own the entire GPU inference stack. The AWS Ray Serve Deep Learning Container is a supported,…
Automate user-level custom permissions for Amazon Quick
Amazon Quick custom permissions let you enforce least-privilege access by toggling features per user. This post walks through four patterns to automate…
Reduce LLM latency with prefix-aware routing on Amazon SageMaker Inference
Amazon SageMaker Inference now offers prefix-aware routing, a routing strategy that sends requests sharing the same prompt prefix to the same instance so…
Reduce inference cold starts on Amazon SageMaker HyperPod with model caching
Amazon SageMaker HyperPod now supports model caching for inference, which pre-loads model weights and container images onto cluster nodes so pods read…
Video and image search in Amazon Bedrock Knowledge Base using Marengo 3.0
TwelveLabs Marengo Embed 3.0 is now generally available as an embedding model in Amazon Bedrock Knowledge Bases, bringing fully managed natural language…