Train Qwen3 on AWS Trainium with torchtitan three ways on a single trn2.48xlarge: the Hugging Face Transformers v5 modeling backend, torchtitan’s native…
Tag: Artificial Intelligence
How U.S. Hunger connects leaders and data using Amazon Quick
U.S. Hunger, a nonprofit addressing food insecurity, uses Amazon Quick to connect organizational data with leadership decisions. Leaders explore applicant…
Amazon SageMaker JumpStart: 2026 year-to-date in review
Amazon SageMaker JumpStart onboarded over 100 new models from 30 providers in the first three quarters of 2026. This recap covers the model-onboarding…
Pegasus 1.5 from TwelveLabs is now available in Amazon Bedrock
TwelveLabs Pegasus 1.5 is now available in Amazon Bedrock. The video language model turns long-form video into structured, timestamped metadata: define…
How Deepgram optimized voice AI at scale with AWS Trainium
Deepgram worked with the AWS Forward Deployed Engineering team to port its Nova-3 speech-to-text model to AWS Trainium2 for offline batch inference. This…
Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM
vLLM’s prefill-decode disaggregation splits LLM inference across engine instances but must transfer the KV cache between them. This post introduces a…
Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM
Multi-turn agentic workloads reprocess growing conversation context each turn, driving up latency. See how bi-directional KV cache transfer lets prefill…
Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch
Learn how i14 trained and served Laplace 3B, a linear attention model, on AWS Trainium2 using native PyTorch. Its recurrent state stays fixed at 29.5 MB…
From data to decisions: Conversational supply chain intelligence with Amazon Quick and Amazon Bedrock AgentCore
Enterprise supply chains are data-rich but insight-poor, with the data to decide scattered across ERP, monitoring, procurement, and email. This post shows…
Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod
Learn how we fine-tuned GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod, and how to decide between supervised fine-tuning (SFT) and…