AWS Deep Learning Base Qualcomm AMI (Amazon Linux 2)

This document describes the latest changes, additions, known issues, and fixes for Deep Learning Base Qualcomm AMI (Amazon Linux 2).

Release Date: November 16, 2023
Created On: November 15, 2023
Last Updated: April 18, 2024

For help getting started, please see the AWS Deep Learning AMI Developer Guide.

AMI Name format: Deep Learning Base Qualcomm AMI (Amazon Linux 2) ${YYYY-MM-DD}

The AMI includes the following:

  • Supported AWS Service: EC2
  • Operating System: Amazon Linux 2
  • Compute Architecture: x86
  • Linux Kernel: 5.10.210-201.852.amzn2.x86_64
  • SDK Location: /opt/qai-sdk
  • QTI Utils Location: /opt/qti-aic
  • Platform SDK Version: 1.12.0.88
  • Apps SDK Version: 1.12.0.87
  • EBS volume type: gp3
  • Python: python3.8
  • Supported EC2 Instances: dl2q
  • Query AMI-ID with AWS CLI (example region is us-east-1): 
    • aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning Base Qualcomm AMI (Amazon Linux 2) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text

Notice 

[4/12/24] Audit Package Removal

  • DLAMI’s released between March 26,2024 (2024-03-26) and April 12, 2024 (2024-04-12) were shipped without the audit package. If you require this specific package for your logging and monitoring needs, please migrate your workflows to the latest DLAMI in order to consume those with the audit package installed.

QAIC Environment:

  • By default, the qaic-pytools are not enabled through the Qualcomm AI100 Apps SDK. In order to enable and create the qaic pip environment qaic-env please run the following commands:
echo 'yes' | bash /opt/qai-sdk/qaic-apps-*/uninstall.sh
cd /opt/qai-sdk/qaic-apps-*/
sudo sed -i "s/python3 -V/python3.8 -V/g" install.sh
./install.sh --enable-qaic-pytools

 

Version 20240314

Release Date: 2024-03-14

AMI Name

Deep Learning Base Qualcomm AMI (Amazon Linux 2) 20240314

Added

  • AI 100 Platform SDK updated from version 1.10.0.200 to version 1.12.0.88
  • AI 100 Apps SDK updated from version 1.10.0.193 to version 1.12.0.87
  • SDK Version 1.12 adds support for transformer decoder models such as Llama-2 and Starcoder

Version 20240110

Release Date: 2024-01-10

AMI Name

Deep Learning Base Qualcomm AMI (Amazon Linux 2) 20240103

Added

  • Qualcomm AI 100 Platform image upgraded to 1.10.0.200

Version 20231115

Release Date: 2023-11-15

AMI Name

Deep Learning Base Qualcomm AMI (Amazon Linux 2) 20231115

Added