Overview
Contextualized chunk embedding models are novel neural networks that encode not only the chunks own content, but also capture the contextual information from the full document into numerical vectors. They are a crucial building block for semantic search/retrieval systems and retrieval-augmented generation (RAG) and are responsible for the retrieval quality.
voyage-context-3 is a contextualized chunk embedding model that produces vectors for chunks that capture the full document context without any manual metadata and context augmentation, leading to higher retrieval accuracies than with or without augmentation. On chunk-level and document-level retrieval tasks, voyage-context-3 outperforms OpenAI-v3-large by 14.24% and 7.89%, Cohere-v4 by 12.56% and 5.64%, Jina-v3 late chunking by 23.66% and 20.54%, and contextual retrieval by 6.76% and 2.40%, respectively. Enabled by Matryoshka learning and quantization-aware training, voyage-context-3 supports embeddings in 2048, 1024, 512, and 256 dimensions, with multiple quantization options.
Learn more about voyage-context-3 here: https://blog.voyageai.com/2025/07/23/voyage-context-3/
Highlights
- Contextualized chunk embedding model that produces vectors for chunks that capture the full document context without any manual metadata and context augmentation, leading to higher retrieval accuracies than with or without augmentation.
- Supports embeddings of 2048, 1024, 512, and 256 dimensions and offers multiple embedding quantization, including float (32-bit floating point), int8 (8-bit signed integer), uint8 (8-bit unsigned integer), binary (bit-packed int8), and ubinary (bit-packed uint8).
- 32K token context length.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
Free trial
Dimension | Description | Cost/host/hour |
|---|---|---|
ml.g5.2xlarge Inference (Batch) Recommended | Model inference on the ml.g5.2xlarge instance type, batch mode | $4.06 |
ml.g6.2xlarge Inference (Real-Time) Recommended | Model inference on the ml.g6.2xlarge instance type, real-time mode | $2.44 |
ml.g5.xlarge Inference (Real-Time) | Model inference on the ml.g5.xlarge instance type, real-time mode | $2.82 |
ml.g5.2xlarge Inference (Real-Time) | Model inference on the ml.g5.2xlarge instance type, real-time mode | $4.06 |
ml.g5.4xlarge Inference (Real-Time) | Model inference on the ml.g5.4xlarge instance type, real-time mode | $3.03 |
ml.g5.8xlarge Inference (Real-Time) | Model inference on the ml.g5.8xlarge instance type, real-time mode | $6.12 |
ml.g6.xlarge Inference (Real-Time) | Model inference on the ml.g6.xlarge instance type, real-time mode | $2.25 |
ml.g6.4xlarge Inference (Real-Time) | Model inference on the ml.g6.4xlarge instance type, real-time mode | $3.31 |
ml.g6.8xlarge Inference (Real-Time) | Model inference on the ml.g6.8xlarge instance type, real-time mode | $5.04 |
Vendor refund policy
Refunds are processed according to the EULA. For assistance, contact aws-marketplace@mongodb.com
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Amazon SageMaker model
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Version release notes
MongoDB is excited to announce the initial release of voyage-context-3
Additional details
Inputs
- Summary
- inputs (List[List[string]]) - A list of lists, where each inner list contains a query, a document, or document chunks to be vectorized.
- input_type (string, optional, default = null) - The role of the input: query, document, or null.
- output_dimension (int, optional, default = 1024) - Supported dimensions: 2048, 1024, 512, 256.
- output_dtype (string, optional, default ="float") - Data type for embeddings: float, int8, uint8, binary, or ubinary.
- encoding_format (string, optional, default = null) - Format in which the embeddings are encoded, other options: base64.
- id (string, optional, default = null) - Batch request ID.
- Limitations for input type
- Max List Length: 1,000. Max Chunks Per Input: 16,000. Max Tokens: 120,000 total tokens per request
- Input MIME type
- application/json
Input data descriptions
The following table describes supported input data fields for real-time inference and batch transform.
Field name | Description | Constraints | Required |
|---|---|---|---|
inputs | A list of lists, where each inner list contains a query, a document, or document chunks to be vectorized. | Type: List[List[string]]. Max List Length: 1,000. Max Chunks Per Input: 16,000. Max Tokens: 120,000 total tokens per request | Yes |
input_type | The role of the input: query, document, or null. | Default value: null Type: string | No |
output_dimension | Supported dimensions: 2048, 1024, 512, 256. | Default value: 1024 Type: int | No |
output_dtype | Data type for embeddings: float, int8, uint8, binary, or ubinary. | Default value: "float" Type: string | No |
encoding_format | Format in which the embeddings are encoded, other options: base64. | Default value: null Type: string | No |
id | Batch request ID | - | No |
Resources
Vendor resources
Support
Vendor support
Please email us at aws-marketplace@mongodb.com for inquiries and customer support.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products

