Listing Thumbnail

    TwelveLabs Multimodal Foundation Models

     Info
    Sold by: Twelve Labs 
    Deployed on AWS
    Twelve Labs provides the most powerful video foundation models for developers and enterprises. Bring human like video understanding via our easy to use APIs. Start building today!

    Overview

    Twelve Labs multimodal foundation models create powerful vector embeddings that enable downstream applications. Our Marengo model understands video natively and is able to identify and interpret movements, actions, objects, individuals, sounds, on-screen text, and spoken words just like humans, enabling high-precision semantic search. Our Pegasus model is able to provide state of the art video-to-text generation enabling a variety of use cases across industries. Built by developers, for developers, our APIs give access to our state-of-the-art multimodal foundation models which enable a variety of use cases across industries, including:

    • Powerful semantic search: Find the exact moment you need within any video using natural language queries instead of tags or metadata
    • Video-to-text generation: Create deep analyses, video specific Q&A, or general highlight generation for any video content
    • Zero-shot classification: Use natural language to create your custom taxonomy, facilitating accurate and efficient video classification tailored to your unique use case
    • Intuitive integration: Embed our models for video understanding into your application in just a few API calls
    • Rapid result retrieval: Receive your results within seconds
    • Scalability: Our cloud-native distributed infrastructure seamlessly processes thousands of concurrent requests

    Highlights

    • Bring human-like video understanding to any application with any video data
    • Create rich vector embeddings from videos to power downstream tasks such as Search, Generate, and Classify
    • Useful across industries and use cases including media and entertainment, security, automotive, advertising, and more

    Details

    Delivery method

    Deployed on AWS
    New

    Introducing multi-product solutions

    You can now purchase comprehensive solutions tailored to use cases and industries.

    Multi-product solutions

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    TwelveLabs Multimodal Foundation Models

     Info
    Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    12-month contract (1)

     Info
    Dimension
    Cost/12 months
    Total services consumed
    $0.033

    Vendor refund policy

    Please contact support@twelvelabs.io  or your Sales representative.

    How can we make this page better?

    We'd like to hear your feedback and ideas on how to improve this page.
    We'd like to hear your feedback and ideas on how to improve this page.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Software as a Service (SaaS)

    SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.

    Resources

    Support

    Vendor support

    Please reach out to support@twelvelabs.io  for all your queries. Enterprise Support is available from Monday to Friday.

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Product comparison

     Info
    Updated weekly

    Accolades

     Info
    Top
    10
    In Embedding/Feature Extraction, Content Creation, Video
    Top
    10
    In Classification-Video

    Overview

     Info
    AI generated from product descriptions
    Multimodal Foundation Models
    Native video understanding models (Marengo and Pegasus) that process and interpret movements, actions, objects, individuals, sounds, on-screen text, and spoken words from video content
    Vector Embedding Generation
    Creation of rich vector embeddings from video data to enable downstream applications including semantic search, text generation, and classification tasks
    Semantic Video Search
    Natural language-based video search capability that identifies and retrieves specific moments within videos without requiring tags or metadata
    Video-to-Text Generation
    State-of-the-art video analysis and transcription functionality that generates deep analyses, video-specific question-answering, and highlight generation from video content
    Scalable Cloud Infrastructure
    Cloud-native distributed infrastructure capable of processing thousands of concurrent requests with result retrieval within seconds
    Frame-by-Frame Video Analysis
    Automatically analyzes every video frame-by-frame at 10x faster than real time speed using AI to identify and tag brands, objects, content categories, people, brand safety flags, spoken words, and text.
    Multi-Language Caption and Translation
    Automatically generates captions and translates video content into more than 100 languages with in-video search capability.
    Interactive Video Overlay and Monetization
    Enables addition of interactive video overlays, shoppable links, and contextual targeting with AI-driven automated campaigns for video content merchandising.
    Collaborative Video Workspace
    Provides team collaboration features including video upload, chapter creation, clip sharing, timestamp-based commenting, and AI-generated highlights with ChatGPT-generated intelligence recaps.
    Centralized Video Analytics and Performance Insights
    Delivers centralized analytics dashboard and performance metrics for measuring video engagement and content effectiveness.
    Multimodal AI Metadata Generation
    Patented multimodal AI system that analyzes speech, visuals, and context to automatically generate enriched metadata at the moment level across video content
    Natural Language Search Capability
    Plain language search functionality that returns precise shots and scenes rather than file-level results, enabling moment-level discovery across video archives
    Real-time Preview and Clipping
    Instant preview and clipping functionality that allows users to export specific moments from video content without manual scrubbing
    Content Management System Integration
    Seamless integration with existing Media Asset Management systems, storage solutions, and professional editing tools without requiring replacement of current infrastructure
    Centralized Multi-Source Content Access
    Unified platform that centralizes access to video content across archives, live streams, and existing systems at enterprise scale

    Contract

     Info
    Standard contract
    No

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 reviews
    No customer reviews yet
    Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.