AI Suite AI Server

Deploy AI Suite AI Server 2.5.0 to an existing Amazon EKS cluster with Helm 3.19 or later.

Prerequisites:

• The AWS account has subscribed to this product, and the AWS CLI is configured for that account.
• kubectl is configured for the target EKS cluster.
• The EKS node IAM role can pull subscribed images from Amazon ECR.
• You have an AI Suite Commercial license GUID.
• You have generated separate gateway-client and gateway-to-worker key stores as described at https://softwaretailor.com/docs/ai-server/index.htm .

Create the namespace and protected Kubernetes Secrets. Replace the paths and placeholder value; do not commit the license or raw keys to source control.

kubectl create namespace aisuite kubectl -n aisuite create secret generic aisuite-license \ --from-literal=key='<AI_SUITE_LICENSE_GUID>' kubectl -n aisuite create secret generic aisuite-gateway-client-keys \ --from-file=server-keys.json=./gateway/credentials/server-keys.json kubectl -n aisuite create secret generic aisuite-worker-keys \ --from-file=server-keys.json=./worker/credentials/server-keys.json

Create a local aisuite-values.yaml. The worker token is the raw value associated with the key in the worker key store; it is not the hashed value stored in server-keys.json.

license: existingSecret: aisuite-license gateway: existingClientKeysSecret: aisuite-gateway-client-keys pool: dnsDiscovery: enabled: true workerToken: '<RAW_GATEWAY_TO_WORKER_KEY>' worker: existingKeysSecret: aisuite-worker-keys engine: stub

Authenticate Helm to AWS Marketplace ECR, then pull and install the subscribed chart. The ECR authorization token is valid for 12 hours.

aws ecr get-login-password --region us-east-1 \ | helm registry login --username AWS --password-stdin \ 709825985650.dkr.ecr.us-east-1.amazonaws.com helm pull oci://709825985650.dkr.ecr.us-east-1.amazonaws.com/software-tailor/aisuite-helm \ --version 0.1.4 helm install aisuite ./aisuite-helm-0.1.4.tgz \ --namespace aisuite -f ./aisuite-values.yaml

Wait for the deployment, then verify health through a temporary local port forward:

kubectl -n aisuite rollout status deployment/aisuite-aisuite-gateway kubectl -n aisuite rollout status statefulset/aisuite-aisuite-worker kubectl -n aisuite port-forward service/aisuite-aisuite-gateway 8080:8080 curl http://127.0.0.1:8080/livez curl http://127.0.0.1:8080/readyz

The default stub engine validates the installation without a GPU or model download. For real inference, change worker.engine, storage, node selection, and GPU settings in the values file. The gateway is a private ClusterIP; add a TLS-terminating ingress or private load balancer before allowing client traffic. The software contacts registration.softwaretailor.com for BYOL seat activation unless license.registrationUrl is set to an empty value for an air-gapped deployment.

The chart's packaged values.yaml documents every configurable parameter. Common settings include gateway and worker replicas/resources, persistence, node selection, GPU scheduling, routing, autoscaling, probes, and NetworkPolicy. AWS Marketplace regionalizes the two image repositories and tags from gateway.image and worker.image; keep those Marketplace-provided image values so every container is pulled from the subscribed product rather than an external registry.