Artificial Intelligence

Category: Advanced (300)

Write your own training loop — without managing GPUs — with Amazon SageMaker training session APIs

Write your own training loop — without managing GPUs — with Amazon SageMaker training session APIs

Amazon SageMaker AI training session APIs let you write your own LLM training loop (SFT, RL, or custom objectives) in a Python script while the service runs the GPUs. This post introduces the programming model and three SDK clients, then walks through a GRPO loop on GSM8K and a reinforcement learning workload on competitive programming.

Securing Quick access from corporate networks with AWS PrivateLink

Securing Quick access from corporate networks with AWS PrivateLink

Learn how to connect on-premises data sources to Amazon Quick privately with AWS PrivateLink, keeping analytics traffic off the public internet. This walkthrough covers VPC endpoints for user and API access, VPC connections for data sources, DNS and endpoint policies, identity federation, and enforcing VPC-endpoint-only access for compliance.

5 production challenges in multi-agent systems and how Deep Insight solved them

5 production challenges in multi-agent systems and how Deep Insight solved them

Many teams build a multi-agent AI prototype in days but hit a wall in production. This post defines five production challenges (orchestration, per-agent model selection, reliable operation, secure code execution, and monitoring) and shows how Deep Insight, an open source multi-agent system on AWS, solves each.

Adaptive agentic intelligence framework using Strands Agents

Adaptive agentic intelligence framework using Strands Agents

The Adaptive Agentic Intelligence Framework (AAIF), built with Strands Agents, handles routine tasks locally with small language models and routes complex requests to cloud models through Amazon Bedrock. This post walks through building AAIF with local SLMs through Ollama and Amazon Bedrock, using an Internet of Things monitoring scenario.

Train Qwen3 on AWS Trainium with torchtitan

Train Qwen3 on AWS Trainium with torchtitan

Train Qwen3 on AWS Trainium with torchtitan three ways on a single trn2.48xlarge: the Hugging Face Transformers v5 modeling backend, torchtitan’s native Qwen3, and NKI mixture-of-experts kernels. The same torchrun launcher and config structure work unchanged across all three paths, including loading and saving published Hugging Face safetensors.

Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch

Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch

Learn how i14 trained and served Laplace 3B, a linear attention model, on AWS Trainium2 using native PyTorch. Its recurrent state stays fixed at 29.5 MB per sequence regardless of context length, avoiding the growing key-value cache of transformer models and keeping serving memory predictable.

From data to decisions: Conversational supply chain intelligence with Amazon Quick and Amazon Bedrock AgentCore

From data to decisions: Conversational supply chain intelligence with Amazon Quick and Amazon Bedrock AgentCore

Enterprise supply chains are data-rich but insight-poor, with the data to decide scattered across ERP, monitoring, procurement, and email. This post shows how Amazon Bedrock AgentCore exposes those systems as a governed tool layer, and how Amazon Quick turns them into one conversational experience for business users, with a deploy-it-yourself walkthrough.

Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod

Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod

Learn how we fine-tuned GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod, and how to decide between supervised fine-tuning (SFT) and reinforcement learning with GRPO. SFT took reasoning-language accuracy from 22% to 100%, and GRPO added measurable gains where headroom existed.

Securing AI agent identity with X.509 PKI on AWS

Securing AI agent identity with X.509 PKI on AWS

Learn how to secure multi-agent AI systems with cryptographic identity using Keyfactor EJBCA and AWS services. This reference architecture combines signed request envelopes, user-signed delegation assertions, RFC 8693 audience-scoped tokens, and real-time OCSP revocation to prove agent identity and prevent request forgery across agent-to-agent and MCP tool calls.