- AWS Solutions Library›
- Guidance for Deploying AI Agents to Device Fleets by Using AWS IoT Greengrass
Guidance for Deploying AI Agents to Device Fleets by Using AWS IoT Greengrass
Overview
This Guidance demonstrates how to leverage AWS IoT Greengrass to deploy StrandsAgents with local Small Language Models (SLMs) at the edge, enabling robust agentic operations across distributed device fleets. It helps organizations achieve critical operational requirements including low-latency processing, offline capabilities, and enhanced data confidentiality. The solution is particularly valuable for industries with stringent edge computing needs, such as robotics, automotive, oil and gas, and smart home automation. By combining cloud support with edge processing through Ollama inference engine, businesses can maintain reliable operations even with intermittent connectivity while ensuring sensitive data remains secure and local.
Benefits
Deploy AI capabilities directly to your device fleet with locally running foundation models through Ollama. Your operations continue uninterrupted with local intelligence even when cloud connectivity is limited or unavailable.
Manage AI model distribution to thousands of edge devices through a centralized workflow using AWS IoT Greengrass and S3. Focus on developing intelligent applications while AWS services handle secure model deployment and device management.
Empower edge devices to reason across multiple data sources including documentation and OPC-UA industrial systems. The orchestration capabilities of Amazon Strands Agents SDK intelligently coordinate specialized agents to deliver contextual responses to complex queries.
How it works
These technical details feature an architecture diagram to illustrate how to effectively use this solution. The architecture diagram shows the key components and their interactions, providing an overview of the architecture's structure and functionality step-by-step.
Deploy with confidence
Ready to deploy? Review the sample code on GitHub for detailed deployment instructions to deploy as-is or customize to fit your needs.
Disclaimer
The sample code; software libraries; command line tools; proofs of concept; templates; or other related technology (including any of the foregoing that are provided by our personnel) is provided to you as AWS Content under the AWS Customer Agreement, or the relevant written agreement between you and AWS (whichever applies). You should not use this AWS Content in your production accounts, or on production or other critical data. You are responsible for testing, securing, and optimizing the AWS Content, such as sample code, as appropriate for production grade use based on your specific quality control practices and standards. Deploying AWS Content may incur AWS charges for creating or using AWS chargeable resources, such as running Amazon EC2 instances or using Amazon S3 storage.
Did you find what you were looking for today?
Let us know so we can improve the quality of the content on our pages