AWS introduced Amazon SageMaker HyperPod Global Inference Gateway on November 20, 2026, giving customers one managed endpoint for inference requests across registered HyperPod clusters in a single AWS Region or multiple Regions. The service selects a cluster using capacity, queue, proximity and error signals, with automatic failover when a cluster becomes unavailable. The launch adds a second
[…]
Content was trimmed to protect the source. Please visit the original article for the full text.
Read the original article:
AWS Routes HyperPod Inference Across Regions From One Endpoint
