Overview
Dot Cool's American Reference Record - Annual Tester evaluates buyer-supplied AI answers against versioned American reference records. The scoring software runs as a Linux container in the buyer's AWS account. Five test layers cover geographic comparisons, official figures, American usage, facilities and agriculture, and selected county facts. The initial release contains 6,862 questions and 2,457 retained facts, with source provenance, schemas and reproducible scoring.
Buyers retain their model responses and run the supplied scorer against the identified release. Results preserve complete denominators and distinguish correct, incorrect, missing, invalid and abstained responses under each layer's stated protocol. The dated reference records retain geography, measures, units, observation periods, source releases and successful check dates. Additional accepted releases issued during the term are separately versioned.
The Annual Tester is USD $700,000, paid upfront for 12 months from entitlement start, for evaluation and grounding. Keep America's figures attached to their meanings - and keep both current.
Highlights
- 6,862 questions across five versioned test layers, with 2,457 retained reference facts and source provenance.
- Buyer-run container software produces reproducible item-level scoring from supplied response files in the buyer's AWS account.
- USD $700,000 upfront for a 12-month Annual Tester license, including additional accepted releases issued during the term.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
Dimension | Description | Cost/12 months |
|---|---|---|
Annual Tester - 12 months | One 12-month license for the Annual Tester scoring software and the versioned five-layer reference packet, including additional accepted releases issued during the term. USD $700,000 paid upfront. | $700,000.00 |
Vendor refund policy
For a material delivery defect, contact licensing@america.cool within 30 days with reproduction details. Dot Cool may correct or replace the delivery within 30 days after receipt. If the material failure cannot be remedied, the affected order may be terminated and a refund requested for its undelivered portion through AWS Marketplace. Model scores or later revisions to clearly dated sources do not create a refund right. Mandatory law and AWS Marketplace requirements apply.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Amazon ECS ARM64 - enforced task-role licensing
- Amazon ECS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
Enforce ECS task-role-only licensing in executable code using the AWS SDK container metadata provider. Static keys, shared profiles and external credential endpoints cannot authenticate this product. Native ECS checkout, scoring and check-in verified for this image. Reference packet, questions, records, evaluator keys, scoring method, approved agreement and USD 700,000 upfront / 12-month price are unchanged. Purchases and renewals are through AWS Marketplace.
Additional details
Usage instructions
Purchase the Annual Tester contract in AWS Marketplace. Price: USD 700,000 upfront for 12 months. Orders, payments and renewals stay in AWS Marketplace. Support: licensing@america.cool (product support only).
-
Use Amazon ECS with an ARM64 Linux EC2 container instance in your cluster. This image is ARM64, not x86_64. Begin with 1 vCPU and 2 GiB memory. AWS infrastructure charges depend on your configuration and are separate from the software price.
-
In IAM, create or select a task role trusted by ecs-tasks.amazonaws.com. Its license policy is: {"Version":"2012-10-17","Statement":[{"Effect":"Allow","Action":["license-manager:CheckoutLicense","license-manager:CheckInLicense"],"Resource":"*"}]} Set this role as taskRoleArn below. The separate executionRoleArn must permit ECR authorization and image pulls from the Marketplace repository, and CloudWatch logging if configured. IAM roles are configured in the buyer's AWS account; ECS supplies the runtime role automatically. The executable uses only the ECS container metadata provider. It has no static-key, shared-profile or seller-login authentication path.
-
Image: 709825985650.dkr.ecr.us-east-1.amazonaws.com/dot-cool-l-l-c/arr-annual-tester:ecs-role-only-20261028-arm64 Verified digest: sha256:260dc5dd0e32cb58187e2d8ed771b396a9bafff1d69ab90a67d062bc237cf1e2 Use this exact Marketplace image in all deployments. No third-party image or seller-operated service is needed. Allow HTTPS to AWS License Manager in us-east-1 and the ECR/logging endpoints used by the task; no inbound application port is needed.
-
Prepare /opt/arr/input/responses.jsonl on the ECS container instance, readable by UID 10001. Each line is {"id":"original-question-id","answerId":"exact-option-entityId"}. Use encrypted storage and mount only this input directory. An empty file is a valid deployment test: it reports all 233 current-facts questions as missing, not correct answers.
-
In ECS > Task definitions > Create new task definition > Create with JSON, paste this template and replace TASK_ROLE_ARN and EXECUTION_ROLE_ARN with the roles from step 2. Retain your account's normal logging configuration if desired: {"family":"arr-annual-tester","networkMode":"bridge","requiresCompatibilities":["EC2"],"cpu":"1024","memory":"2048","runtimePlatform":{"cpuArchitecture":"ARM64","operatingSystemFamily":"LINUX"},"taskRoleArn":"TASK_ROLE_ARN","executionRoleArn":"EXECUTION_ROLE_ARN","volumes":[{"name":"input","host":{"sourcePath":"/opt/arr/input"}}],"containerDefinitions":[{"name":"tester","image":"709825985650.dkr.ecr.us-east-1.amazonaws.com/dot-cool-l-l-c/arr-annual-tester:ecs-role-only-20261028-arm64","essential":true,"user":"10001:10001","readonlyRootFilesystem":true,"command":["score","current-facts-v1","/input/responses.jsonl"],"mountPoints":[{"sourceVolume":"input","containerPath":"/input","readOnly":true}]}]}
-
Choose your cluster > Tasks > Run new task, select EC2 and this task definition. Successful jobs exit 0 and emit a JSON report to stdout (and configured logs). Licensed scoring checks out annual_tester, scores, and checks it back in. A licensing failure exits nonzero before scoring. Jobs are bounded to two minutes. If EcsTaskRoleRequired appears, check taskRoleArn; do not replace it with another authentication method.
-
Command ["info"] reports the packet version and counts. The packet is /app/_packet: manifest.json, schemas, questions, retained records, evaluator-only answer keys and score.mjs. Keep evaluator keys and scorer separate from model-facing questions/grounding records. Other scoring layers: scale-v1, language-v1, making-growing-v1, county-facts-v1.
-
Stop completed tasks; retain manifests, inputs and reports in buyer-controlled encrypted storage with appropriate log retention. Upgrade by selecting a new immutable image explicitly. Check EC2/ECS capacity quotas before launch. No response-file contents are sent to Dot Cool. The complete corpus is excluded.
Support
Vendor support
Contact licensing@america.cool for software setup, license access, release manifests, schemas, provenance and scoring reproduction. Dot Cool provides email support for the licensed tester.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products

