Text embedding models are neural networks that transform texts into numerical vectors. They are a crucial building block for semantic search/retrieval systems and retrieval-augmented generation (RAG) and are responsible for the retrieval quality.
voyage-4-lite is a lightweight, general-purpose embedding model optimized for low latency and cost. Enabled by Matryoshka learning and quantization-aware training, voyage-4-lite supports embeddings in 2048, 1024, 512, and 256 dimensions, with multiple quantization options.
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
You pay an hourly rate tied to the AWS instance you run the model on. Most dimensions cover real-time inference, where a persistent endpoint handles request-by-request inference. One dimension covers batch mode on the ml.g5.2xlarge instance, which runs finite jobs for bulk processing. Hourly cost rises with instance size, moving from ml.g5 and ml.g6 GPU types up through the larger ml.p4d, ml.p4de, and ml.p5 types. You choose the instance and deployment mode that fit your workload. Cost scales with how many hours each instance runs.
Top-of-mind questions for buyers
What makes up my total hourly cost for running this model?
Your total hourly cost is the sum of software pricing and infrastructure pricing. Software pricing covers model usage. Infrastructure pricing covers the AWS instance. Both are billed at an hourly rate and vary by deployment type, instance type, and region.
How do real-time inference and batch inference differ for billing?
Real-time inference runs a persistent, managed endpoint for request-by-request processing, so charges accrue while the endpoint stays active. Batch mode on ml.g5.2xlarge runs a finite transform job for bulk processing, writing results to a file. Charges stop when the job finishes.
Am I charged after I cancel my subscription?
Canceling your subscription does not terminate existing real-time endpoints or batch jobs. Active real-time endpoints keep accruing hourly charges until you delete them through SageMaker Studio or the SageMaker console. Delete endpoints you no longer need to avoid unexpected charges.
docs.voyageai.com
Helpful?
Vendor refund policy
Refunds to be processed under the conditions specified in EULA. Please contact aws-marketplace@mongodb.com for further assistance
How can we make this page better?
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
MongoDB is excited to announce the initial release of voyage-4-lite
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
input (string or List[string]) – A single string or a list of strings (max 1,000 items).
input_type (string, optional, default = null) – The role of the input: query, document, or null.
truncation (bool, optional, default = true) – Whether to truncate inputs to fit context limits.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.