Artificial Intelligence

Safely Releasing Frontier Models to Customers

Safely Releasing Frontier Models to Customers

It’s our goal for AWS to be the most secure place to run any workload, and in support of that we’ve been deeply investing in security across our services since AWS’s inception more than two decades ago. Our AI services like Amazon Bedrock are built on this foundation and with the same focus. 

Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference

Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference

Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.

Reducing token costs and latency in Amazon Bedrock AgentCore JSON workloads

Reducing token costs and latency in Amazon Bedrock AgentCore JSON workloads

As production agents on Amazon Bedrock AgentCore process multi-megabyte JSON payloads, token costs and latency climb. This post shares three composable strategies: offloading heavy artifacts to Amazon S3, on-demand result paging, and dictionary compaction. Together they cut per-turn token use by up to 71% and latency by up to 80%.

Amazon SageMaker AI real-time endpoints now support KV cache aware routing

Amazon SageMaker AI real-time endpoints now support KV cache aware routing

Amazon SageMaker AI real-time endpoints now support KV cache-aware routing, a new strategy that routes each request to the instance holding the longest cached match for its prompt. Learn how it works, when to use it compared with prefix-aware routing, and how to enable, invoke, and verify it on single model and inference component endpoints.

Govern and discover records with common metadata in AWS Agent Registry

Govern and discover records with common metadata in AWS Agent Registry

Custom metadata schemas in AWS Agent Registry let an administrator define typed, validated fields that every agent, MCP server, and skill must carry. This post follows an MCP record from schema definition through registration, enrichment, approval, and discovery, so teams govern and find resources with one shared set of facts.

Secure OAuth patterns for Snowflake Cortex AI through Amazon Bedrock AgentCore

Secure OAuth patterns for Snowflake Cortex AI through Amazon Bedrock AgentCore

When an AI agent on Amazon Bedrock AgentCore calls Snowflake Cortex AI over MCP, how does it authenticate? This post walks through three OAuth patterns we tested on AgentCore Identity: Snowflake OAuth, three-legged OAuth with a corporate IdP, and two-legged OAuth, so you can match your organization’s identity, audit, and compliance needs.

Announcing AI data preparation capabilities in Amazon SageMaker AI: Build high-quality training and evaluation data with agent skill and APIs

Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows

Amazon SageMaker AI now offers AI data preparation capabilities for building high-quality training and evaluation data. Generate synthetic examples, assess and improve datasets, auto-label at scale, and bring in expert review through Python SDK APIs and an agent skill, all from your own notebook or IDE.

Build WhatsApp AI agents with Amazon Bedrock AgentCore

Build WhatsApp AI agents with Amazon Bedrock AgentCore

SMART, an open-source Python SDK and Terraform stack, deploys the full WhatsApp channel layer to your AWS account with one command. Bring any agent that runs on Amazon Bedrock AgentCore, and SMART handles webhook ingestion, media, conversation memory, scheduling, and Meta message templates.

Reason over time-series data with OpenTSLM on Amazon SageMaker JumpStart

Reason over time-series data with OpenTSLM on Amazon SageMaker JumpStart

OpenTSLM, an open source family of time-series language models, is now available in Amazon SageMaker JumpStart. See how Nexthink and Aionic Labs apply it to proactive IT support, then deploy OpenTSLM to a real-time endpoint and fine-tune it on your own data with TimeNet and a SageMaker training job.