Artificial Intelligence

Safely Releasing Frontier Models to Customers

Safely Releasing Frontier Models to Customers

It’s our goal for AWS to be the most secure place to run any workload, and in support of that we’ve been deeply investing in security across our services since AWS’s inception more than two decades ago. Our AI services like Amazon Bedrock are built on this foundation and with the same focus. 

New in AWS Quick: More capable flows, an updated web experience, and agents that work together

New in AWS Quick: More capable flows, an updated web experience, and agents that work together

AWS Quick is the AI workspace built only for work. Today we’re releasing updates that help your team get more done: build and run business-process flows in chat, triage your day in the updated web app, get more complete answers from multiple agents at once, and connect new data sources like Meta ads and Amplitude.

Cut self-hosted LLM cost and latency with the distributed KV caching agent skill

Cut self-hosted LLM cost and latency with the distributed KV caching agent skill

Self-hosting LLMs on GPUs means paying to recompute the same context on every turn. Distributed KV caching with Amazon ElastiCache can cut inference cost by up to 40% and time to first token by up to 80%. This post walks through the distributed KV caching skill in the Agent Toolkit for AWS, which evaluates and sets up the cache from your coding agent.

Introducing managed cluster extensions for observability and user management in Amazon SageMaker HyperPod Slurm

Amazon SageMaker HyperPod now offers managed cluster extensions for observability and user management, bringing declarative, API- and console-driven configuration to the software running on Slurm cluster nodes. This post explains how the extensions work and follows a platform team through a quarter of running a shared Slurm cluster with them.

Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

Amazon SageMaker HyperPod introduces the Global Inference Gateway, one managed endpoint that routes inference requests across your HyperPod clusters in one Region or across Regions. It picks the best cluster, fails over automatically, and authenticates every request with SigV4 and IAM over AWS PrivateLink.

How Standard Bank Group automates AI risk assessment for generative AI

How Standard Bank Group automates AI risk assessment for generative AI

Standard Bank Group automated the evidence behind its generative AI approval gates. Working with AWS Professional Services, the bank built an assessment in its own AWS account that scores each use case against international AI standards and its own policies using LLM-as-a-judge on Amazon Bedrock, giving risk committees consistent, traceable evidence.

Announcing Amazon Textract Insights: Verifiable generative AI for documents

Announcing Amazon Textract Insights: Verifiable generative AI for documents

Announcing the general availability of Amazon Textract Insights, a new generative AI feature of Amazon Textract. Describe the fields you need in natural language, submit a document or a mixed packet, and receive structured results with a confidence score and page-level grounding for each value, with no model training required.

Introducing enhanced infrastructure observability in Amazon SageMaker HyperPod

Introducing enhanced infrastructure observability in Amazon SageMaker HyperPod

Amazon SageMaker HyperPod now offers enhanced observability to help you diagnose GPU training issues faster. It brings together diagnostic and profiling capabilities for training workloads on both Amazon EKS and Slurm orchestrators, pinpointing issues across GPU, network, and host layers.

Amazon SageMaker Inference: 2026 launches in review, part 2

Amazon SageMaker Inference: 2026 launches in review, part 2

This second installment reviews 13 more Amazon SageMaker AI inference launches from 2026, spanning configuration recommendations, fitting more models onto each GPU, serving models too large for one instance, cross-Region routing, and post-launch tuning, bringing the year’s total to 26.

Enable AI agents to pay for AWS Marketplace x402 products with Amazon Bedrock AgentCore payments

Enable AI agents to pay for AWS Marketplace x402 products with Amazon Bedrock AgentCore payments

Amazon Bedrock AgentCore payments now supports AWS Marketplace, so agents can discover and buy x402-enabled products, APIs, data, and content and pay in USD on the developer’s AWS bill, with no stablecoin wallets or API keys. This post walks through a research agent that finds a tool, pays per request through AWS Billing, and answers with sources.