Introducing Amazon SageMaker Neo
Amazon SageMaker Neo lets customers train models once, and run them anywhere with up to 2X improvement in performance. Applications running on connected devices at the edge are particularly sensitive to performance of machine learning models. They require low latency decisions, and are often deployed across a broad number of different hardware platforms. Amazon SageMaker Neo compiles models for specific hardware platforms, optimizing their performance automatically, allowing them to run at up to twice the performance, without any loss in accuracy. As a result, developers no longer need to spend time hand tuning their trained models for each and every hardware platform (saving time and expense). SageMaker Neo supports hardware platforms from NVIDIA, Intel, Xilinx, Cadence, and Arm, and popular frameworks such as Tensorflow, Apache MXNet, and PyTorch.
Amazon SageMaker Neo is generally available today in the N. Virginia, Oregon, Ohio, and Ireland AWS regions. For more details, please check out the product pages.