Listing Thumbnail

    American Reference Record - Annual Tester

     Info
    Deployed on AWS
    Dot Cool scores AI response files against versioned American reference records. The Annual Tester runs in the buyer's AWS account with reproducible results and a 12-month license.

    Overview

    Dot Cool's American Reference Record - Annual Tester evaluates buyer-supplied AI answers against versioned American reference records. The scoring software runs as a Linux container in the buyer's AWS account. Five test layers cover geographic comparisons, official figures, American usage, facilities and agriculture, and selected county facts. The initial release contains 6,862 questions and 2,457 retained facts, with source provenance, schemas and reproducible scoring.

    Buyers retain their model responses and run the supplied scorer against the identified release. Results preserve complete denominators and distinguish correct, incorrect, missing, invalid and abstained responses under each layer's stated protocol. The dated reference records retain geography, measures, units, observation periods, source releases and successful check dates. Additional accepted releases issued during the term are separately versioned.

    The Annual Tester is USD $700,000, paid upfront for 12 months from entitlement start, for evaluation and grounding. Keep America's figures attached to their meanings - and keep both current.

    Highlights

    • 6,862 questions across five versioned test layers, with 2,457 retained reference facts and source provenance.
    • Buyer-run container software produces reproducible item-level scoring from supplied response files in the buyer's AWS account.
    • USD $700,000 upfront for a 12-month Annual Tester license, including additional accepted releases issued during the term.

    Details

    Delivery method

    Supported services

    Delivery option
    Amazon ECS ARM64 - enforced task-role licensing

    Latest version

    Operating system
    Linux

    Deployed on AWS
    New

    Introducing multi-product solutions

    You can now purchase comprehensive solutions tailored to use cases and industries.

    Multi-product solutions

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    American Reference Record - Annual Tester

     Info
    Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    12-month contract (1)

     Info
    Dimension
    Description
    Cost/12 months
    Annual Tester - 12 months
    One 12-month license for the Annual Tester scoring software and the versioned five-layer reference packet, including additional accepted releases issued during the term. USD $700,000 paid upfront.
    $700,000.00

    Vendor refund policy

    For a material delivery defect, contact licensing@america.cool  within 30 days with reproduction details. Dot Cool may correct or replace the delivery within 30 days after receipt. If the material failure cannot be remedied, the affected order may be terminated and a refund requested for its undelivered portion through AWS Marketplace. Model scores or later revisions to clearly dated sources do not create a refund right. Mandatory law and AWS Marketplace requirements apply.

    How can we make this page better?

    Tell us how we can improve this page, or report an issue with this product.
    Tell us how we can improve this page, or report an issue with this product.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Amazon ECS ARM64 - enforced task-role licensing

    Supported services: Learn more 
    • Amazon ECS
    Container image

    Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.

    Version release notes

    Enforce ECS task-role-only licensing in executable code using the AWS SDK container metadata provider. Static keys, shared profiles and external credential endpoints cannot authenticate this product. Native ECS checkout, scoring and check-in verified for this image. Reference packet, questions, records, evaluator keys, scoring method, approved agreement and USD 700,000 upfront / 12-month price are unchanged. Purchases and renewals are through AWS Marketplace.

    Additional details

    Usage instructions

    Purchase the Annual Tester contract in AWS Marketplace. Price: USD 700,000 upfront for 12 months. Orders, payments and renewals stay in AWS Marketplace. Support: licensing@america.cool  (product support only).

    1. Use Amazon ECS with an ARM64 Linux EC2 container instance in your cluster. This image is ARM64, not x86_64. Begin with 1 vCPU and 2 GiB memory. AWS infrastructure charges depend on your configuration and are separate from the software price.

    2. In IAM, create or select a task role trusted by ecs-tasks.amazonaws.com. Its license policy is: {"Version":"2012-10-17","Statement":[{"Effect":"Allow","Action":["license-manager:CheckoutLicense","license-manager:CheckInLicense"],"Resource":"*"}]} Set this role as taskRoleArn below. The separate executionRoleArn must permit ECR authorization and image pulls from the Marketplace repository, and CloudWatch logging if configured. IAM roles are configured in the buyer's AWS account; ECS supplies the runtime role automatically. The executable uses only the ECS container metadata provider. It has no static-key, shared-profile or seller-login authentication path.

    3. Image: 709825985650.dkr.ecr.us-east-1.amazonaws.com/dot-cool-l-l-c/arr-annual-tester:ecs-role-only-20261028-arm64 Verified digest: sha256:260dc5dd0e32cb58187e2d8ed771b396a9bafff1d69ab90a67d062bc237cf1e2 Use this exact Marketplace image in all deployments. No third-party image or seller-operated service is needed. Allow HTTPS to AWS License Manager in us-east-1 and the ECR/logging endpoints used by the task; no inbound application port is needed.

    4. Prepare /opt/arr/input/responses.jsonl on the ECS container instance, readable by UID 10001. Each line is {"id":"original-question-id","answerId":"exact-option-entityId"}. Use encrypted storage and mount only this input directory. An empty file is a valid deployment test: it reports all 233 current-facts questions as missing, not correct answers.

    5. In ECS > Task definitions > Create new task definition > Create with JSON, paste this template and replace TASK_ROLE_ARN and EXECUTION_ROLE_ARN with the roles from step 2. Retain your account's normal logging configuration if desired: {"family":"arr-annual-tester","networkMode":"bridge","requiresCompatibilities":["EC2"],"cpu":"1024","memory":"2048","runtimePlatform":{"cpuArchitecture":"ARM64","operatingSystemFamily":"LINUX"},"taskRoleArn":"TASK_ROLE_ARN","executionRoleArn":"EXECUTION_ROLE_ARN","volumes":[{"name":"input","host":{"sourcePath":"/opt/arr/input"}}],"containerDefinitions":[{"name":"tester","image":"709825985650.dkr.ecr.us-east-1.amazonaws.com/dot-cool-l-l-c/arr-annual-tester:ecs-role-only-20261028-arm64","essential":true,"user":"10001:10001","readonlyRootFilesystem":true,"command":["score","current-facts-v1","/input/responses.jsonl"],"mountPoints":[{"sourceVolume":"input","containerPath":"/input","readOnly":true}]}]}

    6. Choose your cluster > Tasks > Run new task, select EC2 and this task definition. Successful jobs exit 0 and emit a JSON report to stdout (and configured logs). Licensed scoring checks out annual_tester, scores, and checks it back in. A licensing failure exits nonzero before scoring. Jobs are bounded to two minutes. If EcsTaskRoleRequired appears, check taskRoleArn; do not replace it with another authentication method.

    7. Command ["info"] reports the packet version and counts. The packet is /app/_packet: manifest.json, schemas, questions, retained records, evaluator-only answer keys and score.mjs. Keep evaluator keys and scorer separate from model-facing questions/grounding records. Other scoring layers: scale-v1, language-v1, making-growing-v1, county-facts-v1.

    8. Stop completed tasks; retain manifests, inputs and reports in buyer-controlled encrypted storage with appropriate log retention. Upgrade by selecting a new immutable image explicitly. Check EC2/ECS capacity quotas before launch. No response-file contents are sent to Dot Cool. The complete corpus is excluded.

    Support

    Vendor support

    Contact licensing@america.cool  for software setup, license access, release manifests, schemas, provenance and scoring reproduction. Dot Cool provides email support for the licensed tester.

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 reviews
    No customer reviews yet
    Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.