Contextualized chunk embedding models are novel neural networks that encode not only the chunks own content, but also capture the contextual information from the full document into numerical vectors. They are a crucial building block for semantic search/retrieval systems and retrieval-augmented generation (RAG) and are responsible for the retrieval quality.
voyage-context-3 is a contextualized chunk embedding model that produces vectors for chunks that capture the full document context without any manual metadata and context augmentation, leading to higher retrieval accuracies than with or without augmentation. On chunk-level and document-level retrieval tasks, voyage-context-3 outperforms OpenAI-v3-large by 14.24% and 7.89%, Cohere-v4 by 12.56% and 5.64%, Jina-v3 late chunking by 23.66% and 20.54%, and contextual retrieval by 6.76% and 2.40%, respectively. Enabled by Matryoshka learning and quantization-aware training, voyage-context-3 supports embeddings in 2048, 1024, 512, and 256 dimensions, with multiple quantization options.
Contextualized chunk embedding model that produces vectors for chunks that capture the full document context without any manual metadata and context augmentation, leading to higher retrieval accuracies than with or without augmentation.
Supports embeddings of 2048, 1024, 512, and 256 dimensions and offers multiple embedding quantization, including float (32-bit floating point), int8 (8-bit signed integer), uint8 (8-bit unsigned integer), binary (bit-packed int8), and ubinary (bit-packed uint8).
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
You pay by the host hour for running this embedding model on GPU instances in your own account. Pricing scales with the instance type you choose, across the g5, g6, g7e, p4de, and p5 families, from 2xlarge up to 48xlarge sizes. Larger instances carry more compute and a different hourly rate. Most options run in real-time mode, which keeps a persistent API endpoint available. The ml.g5.2xlarge also offers a batch mode for bulk processing of datasets. Your total hourly cost combines this software rate with the separate AWS infrastructure charge.
Top-of-mind questions for buyers
What does the hourly software rate cover, and what else will appear on my bill?
The software rate covers model usage on a per-host-hour basis. On top of that, you pay the separate AWS infrastructure charge for the GPU instance itself. Your total hourly cost is the sum of both. Rates vary by deployment type, instance type, and region.
How does the batch mode on ml.g5.2xlarge differ from the real-time options for billing?
Real-time mode keeps a persistent API endpoint running for request-by-request inference, and you pay per host hour while it stays active. Batch mode runs a finite job that processes a dataset and writes results to a file, so it meters only the job's run time.
Do charges stop if I cancel my subscription or stop using the model?
Canceling your subscription does not terminate running endpoints or batch jobs. Real-time endpoints keep accruing charges until you delete them through SageMaker. To avoid unexpected costs, remove endpoints you no longer need. Batch jobs stop charging once the finite job completes.
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
Add support for ml.p5.48xlarge (H100), ml.p4de.24xlarge (A100-80GB), and RTX Pro 6000 Blackwell (ml.g7e.2xlarge/4xlarge/8xlarge/12xlarge/24xlarge/48xlarge) instance types. Remove support for ml.g5.xlarge (A10) and ml.g6.xlarge (L4) instance types due to out-of-memory errors experienced on these instance sizes.
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
inputs (List[List[string]]) - A list of lists, where each inner list contains a query, a document, or document chunks to be vectorized.
input_type (string, optional, default = null) - The role of the input: query, document, or null.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.