Fresh intelligence
Cut self-hosted LLM cost and latency with the distributed KV caching agent skill
Self-hosting LLMs on GPUs means paying to recompute the same context on every turn. Distributed KV caching with Amazon ElastiCache can cut inference cost by up to 40% and time to first token by up to 80%. This post walks through the distrib
AWS 人工智能 · Published 11/21/2026, 08:14Introducing managed cluster extensions for observability and user management in Amazon SageMaker HyperPod Slurm
Amazon SageMaker HyperPod now offers managed cluster extensions for observability and user management, bringing declarative, API- and console-driven configuration to the software running on Slurm cluster nodes. This post explains how the ex
AWS 人工智能 · Published 11/21/2026, 07:07Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters
Amazon SageMaker HyperPod introduces the Global Inference Gateway, one managed endpoint that routes inference requests across your HyperPod clusters in one Region or across Regions. It picks the best cluster, fails over automatically, and a
AWS 人工智能 · Published 11/21/2026, 06:35Introducing enhanced infrastructure observability in Amazon SageMaker HyperPod
Amazon SageMaker HyperPod now offers enhanced observability to help you diagnose GPU training issues faster. It brings together diagnostic and profiling capabilities for training workloads on both Amazon EKS and Slurm orchestrators, pinpoin
AWS 人工智能 · Published 11/21/2026, 02:24Amazon SageMaker Inference: 2026 launches in review, part 2
This second installment reviews 13 more Amazon SageMaker AI inference launches from 2026, spanning configuration recommendations, fitting more models onto each GPU, serving models too large for one instance, cross-Region routing, and post-l
AWS 人工智能 · Published 11/20/2026, 08:34Use Kimi Code CLI with models on Amazon Bedrock
Kimi Code CLI v2.7.0 adds a native Amazon Bedrock provider, so you can connect the open source coding agent to models like Kimi K3.1 Pro using your standard AWS credential chain (named profiles or SSO) instead of a separate API key. This po
AWS 人工智能 · Published 11/20/2026, 08:33Enable AI agents to pay for AWS Marketplace x402 products with Amazon Bedrock AgentCore payments
Amazon Bedrock AgentCore payments now supports AWS Marketplace, so agents can discover and buy x402-enabled products, APIs, data, and content and pay in USD on the developer's AWS bill, with no stablecoin wallets or API keys. This post walk
AWS 人工智能 · Published 11/20/2026, 07:02Amazon SageMaker AI now detects latency drift, idle GPUs, and missed optimizations on your inference endpoints
Amazon SageMaker AI now monitors your generative AI inference endpoints by default and tells you when a change could improve performance or lower cost. It tracks latency, GPU utilization, and serving configuration, then sends a finding thro
AWS 人工智能 · Published 11/20/2026, 05:28Inside Amazon Connect Talent: The science of structured AI interviews
For organizations hiring hundreds or thousands of people, every interview presents the same challenge: How do you give candidates a consistent opportunity to demonstrate their skills while gathering the evidence needed to make informed hiri
AWS 人工智能 · Published 11/20/2026, 05:23Amazon Bedrock AgentCore harness adds Strands harness defaults, built-in tools, and lifecycle hooks
Amazon Bedrock AgentCore harness now runs on the open-source Strands harness, bringing a recommended model, task-oriented defaults, automatic prompt caching, proactive context management, and new built-in tools. It also adds lifecycle hooks
AWS 人工智能 · Published 11/20/2026, 04:01Amazon Polly launches voice cloning: A unique voice for your brand
Voice cloning in Amazon Polly is now generally available. Give Amazon Polly a few minutes of recordings from a consenting speaker, and it builds a custom voice that reads new text in that speaker's voice. Cloned voices run on the Amazon Pol
AWS 人工智能 · Published 11/20/2026, 03:53Optimize AI economics on Amazon Bedrock with Accenture’s sequenced approach
As enterprises scale AI on Amazon Bedrock, token spend can grow even as per-token prices fall. This post walks through six composable optimization levers, shows how Accenture applied them across four client engagements, and recommends a seq
AWS 人工智能 · Published 11/20/2026, 02:48Keep inference running through regional capacity shortfalls with cross-Region inference routing in Amazon SageMaker AI
Cross-Region inference routing in Amazon SageMaker AI gives your application one invocation path across the endpoints and inference components you already run, in one or more AWS Regions and AWS accounts. The router prefers its own Region a
AWS 人工智能 · Published 11/20/2026, 02:20Protect agent tool calls with Skyflow and Amazon Bedrock AgentCore Gateway
Learn how Skyflow and Amazon Bedrock AgentCore Gateway keep sensitive data out of the tools your AI agents call. Added as a gateway interceptor, Skyflow de-identifies data before any tool, model, or log sees it, and restores it for authoriz
AWS 人工智能 · Published 11/20/2026, 02:14PolyAI Dialog-RSN-1 is now on Amazon SageMaker JumpStart
PolyAI Dialog-RSN-1, a reasoning model built for real-time complex dialog, is available today on AWS Marketplace and Amazon SageMaker JumpStart. Discover it, evaluate it on your own data, and deploy it to a secure SageMaker endpoint in your
AWS 人工智能 · Published 11/20/2026, 01:28Using NVIDIA Run:ai GPU Fractioning on Amazon EKS
Learn how to run two memory-bounded Kubernetes Pods on a single NVIDIA A10G GPU using open-source NVIDIA Run:ai GPU Fractioning on Amazon EKS. This walkthrough builds a custom Amazon Linux 2023 image, installs KAI Scheduler and the GPU Frac
AWS 人工智能 · Published 11/20/2026, 00:13Full Fine-Tuning (FFT) on SageMaker AI Serverless Model Customization
Amazon SageMaker AI Serverless Model Customization now supports Full Fine-Tuning (FFT). This post explores when FFT outperforms LoRA across key benchmarks, examines the spectral properties of model weight matrices behind the quality gap, sh
AWS 人工智能 · Published 11/19/2026, 08:15Introducing workload recovery and expanded infrastructure checks on Amazon SageMaker HyperPod
Large training jobs can stall or compute wrong results even when every node looks healthy. Amazon SageMaker HyperPod now adds workload recovery and expanded infrastructure checks that catch these failures sooner and raise the goodput of you
AWS 人工智能 · Published 11/19/2026, 07:03Introducing the Amazon SageMaker JumpStart Model Leaderboard
The Amazon SageMaker JumpStart Model Leaderboard compares 70+ foundation models side by side on quality, speed, and cost, directly in SageMaker Studio. Learn what the leaderboard shows, how AWS benchmarks models, and how to go from a shortl
AWS 人工智能 · Published 11/19/2026, 06:31How Airbnb uses cost per task to operate coding agents on Amazon Bedrock
Airbnb runs evals on real engineering tasks and uses Amazon Bedrock observability to choose models for its coding agents and control production costs. This post shows how cost per task guides model selection, why production spending can dif
AWS 人工智能 · Published 11/19/2026, 05:48Design responsible AI controls for Amazon Aurora PostgreSQL
Learn how to make RAG chatbot answers traceable with Amazon Aurora PostgreSQL, pgvector, and Amazon Bedrock Guardrails, logging sources, scores, and guardrail traces in SQL.
AWS 人工智能 · Published 11/19/2026, 05:38Private certificate authority support in Amazon Bedrock AgentCore Identity
Amazon Bedrock AgentCore Identity now supports private certificate authorities (CAs), so your agents can connect to self-hosted identity providers that use a private CA. This post shows how to issue an IdP certificate with AWS Private CA, c
AWS 人工智能 · Published 11/19/2026, 04:53How Salesforce is advancing global-scale model serving with cross-Region inference routing in Amazon SageMaker AI
Learn how Salesforce uses the cross-Region inference router in Amazon SageMaker AI to turn fragmented Regional capacity into reliable model serving. Salesforce adds capacity securely across Regions and accounts while keeping its data reside
AWS 人工智能 · Published 11/19/2026, 04:13Connect Amazon Bedrock AgentCore Gateway to private APIs in a hub-and-spoke network with centralized inspection
Many enterprises run a centralized network model: one account owns every VPC and a central firewall inspects all traffic. This post shows a tested pattern for connecting Amazon Bedrock AgentCore Gateway to private APIs and MCP servers in th
AWS 人工智能 · Published 11/19/2026, 03:05