Contextualized chunk embedding models are novel neural networks that encode not only the chunks own content, but also capture the contextual information from the full document into numerical vectors. They are a crucial building block for semantic search/retrieval systems and retrieval-augmented generation (RAG) and are responsible for the retrieval quality.
voyage-context-3 is a contextualized chunk embedding model that produces vectors for chunks that capture the full document context without any manual metadata and context augmentation, leading to higher retrieval accuracies than with or without augmentation. On chunk-level and document-level retrieval tasks, voyage-context-3 outperforms OpenAI-v3-large by 14.24% and 7.89%, Cohere-v4 by 12.56% and 5.64%, Jina-v3 late chunking by 23.66% and 20.54%, and contextual retrieval by 6.76% and 2.40%, respectively. Enabled by Matryoshka learning and quantization-aware training, voyage-context-3 supports embeddings in 2048, 1024, 512, and 256 dimensions, with multiple quantization options.
Contextualized chunk embedding model that produces vectors for chunks that capture the full document context without any manual metadata and context augmentation, leading to higher retrieval accuracies than with or without augmentation.
Supports embeddings of 2048, 1024, 512, and 256 dimensions and offers multiple embedding quantization, including float (32-bit floating point), int8 (8-bit signed integer), uint8 (8-bit unsigned integer), binary (bit-packed int8), and ubinary (bit-packed uint8).
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
You pay by the hour for running this embedding model on your chosen AWS instance. Pricing scales with instance size and family. Larger sizes (2xlarge through 48xlarge) across the g5, g6, g7e, p5, and p4de GPU families carry different hourly rates. Most instances run in real-time mode, which keeps a persistent API endpoint for request-by-request inference. The ml.g5.2xlarge also offers batch mode, which processes bulk datasets in finite jobs. Your total hourly cost combines software and infrastructure charges. You deploy in your own account, so you pick the instance that fits your workload.
Top-of-mind questions for buyers
What does one host hour cover, and what makes up my total hourly cost?
You are billed per hour that a model instance runs. Each host hour combines two charges: software pricing for model usage and infrastructure pricing for the AWS instance. Both meter at hourly rates. The total is the sum of these two charges, and rates vary by instance type and region.
How does real-time mode differ from batch mode for billing?
Real-time mode keeps a persistent API endpoint running for request-by-request inference, so charges accrue for as long as the endpoint stays active. Batch mode runs finite jobs that process bulk datasets and then stop. Real-time suits steady request traffic; batch suits one-time bulk processing.
Does canceling my subscription stop charges on running endpoints?
No. Canceling your subscription does not terminate existing real-time inference endpoints or batch transform jobs. Active endpoints keep accruing hourly charges until you delete them through the SageMaker console or Studio. To stop costs, shut down endpoints you no longer need.
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
Add support for ml.p5.48xlarge (H100), ml.p4de.24xlarge (A100-80GB), and RTX Pro 6000 Blackwell (ml.g7e.2xlarge/4xlarge/8xlarge/12xlarge/24xlarge/48xlarge) instance types. Remove support for ml.g5.xlarge (A10) and ml.g6.xlarge (L4) instance types due to out-of-memory errors experienced on these instance sizes.
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
inputs (List[List[string]]) - A list of lists, where each inner list contains a query, a document, or document chunks to be vectorized.
input_type (string, optional, default = null) - The role of the input: query, document, or null.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
A state-of-the-art legal embedding model optimized for semantic search, RAG, and document classification, ranked first on the Massive Legal Embedding Benchmark.
A state-of-the-art reranking model optimized for legal RAG, research, and classification, ranked first on Legal RAG Bench and the Massive Legal Embedding Benchmark (MLEB).
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.