Listing Thumbnail

    DevOpser Flask with OpenAI, AWS Secrets Manager, and Redis Integration

     Info
    Sold by: DevOpser 
    AWS Free Tier
    This product has charges associated with it for integration and support of OpenAI API and AWS Secrets Manager. Redis leverages the community edition. Accelerate your AI development with our pre-configured AMI, featuring seamless OpenAI and AWS Secrets Manager integration. Designed for Flask applications, it ensures secure development with streamlined environment setup so you can be up and running in a matter of minutes.
    Listing Thumbnail

    DevOpser Flask with OpenAI, AWS Secrets Manager, and Redis Integration

     Info
    Sold by: DevOpser 

    Overview

    This is a repackaged open source software product wherein additional charges apply for integration and support of OpenAI API (https://openai.com/api/pricing/ ) and AWS Secrets Manager (https://aws.amazon.com/secrets-manager/pricing/ ). Our AMI provides a robust development environment for AI enabled Flask applications, seamlessly integrated with OpenAI and AWS Secrets Manager. Redis leverages the community edition. This setup is designed to be a secure development environment: in the demo application that comes pre-installed, secrets are retrieved at runtime and stored as environment variables, ensuring compliance with NIST Cybersecurity Framework (CSF) best practices. This approach enhances security and simplifies secret management. Start developing AI applications immediately with pre-configured environments tailored for OpenAI integration, including a pre-baked demo application for rapid prototyping.

    Highlights

    • Instantly Get Up and Running: Start developing immediately with pre-configured environments tailored for OpenAI integration. The AMI includes an OpenAI-enabled Flask application installed in the home directory. Simply add your Secret Names as variables in the .env file, initiate the Flask application, and quickly start building your own AI application.
    • Secure Development with Remote SSH: Use this AMI as a remote development environment to enable secure, efficient AI application development from anywhere.
    • Protect Your Secrets: Benefit from built-in AWS Secrets Manager integration to safeguard your sensitive information effortlessly.

    Details

    Sold by

    Delivery method

    Delivery option
    64-bit (x86) Amazon Machine Image (AMI)

    Latest version

    Operating system
    AmazonLinux 2023

    Typical total price

    This estimate is based on use of the seller's recommended configuration (t3.large) in the US East (N. Virginia) Region. View pricing details

    $0.153/hour

    Pricing

    DevOpser Flask with OpenAI, AWS Secrets Manager, and Redis Integration

     Info
    Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Usage costs (11)

     Info
    Instance type
    Product cost/hour
    EC2 cost/hour
    Total/hour
    t3.micro
    AWS Free Tier
    $0.07
    $0.01
    $0.08
    t3.medium
    $0.07
    $0.042
    $0.112
    t3.large
    Recommended
    $0.07
    $0.083
    $0.153
    m5.large
    $0.07
    $0.096
    $0.166
    m5.xlarge
    $0.07
    $0.192
    $0.262
    c5.large
    $0.07
    $0.085
    $0.155
    c5.xlarge
    $0.07
    $0.17
    $0.24
    c5d.large
    $0.07
    $0.096
    $0.166
    r5.large
    $0.07
    $0.126
    $0.196
    r5.xlarge
    $0.07
    $0.252
    $0.322

    Additional AWS infrastructure costs

    Type
    Cost
    EBS General Purpose SSD (gp2) volumes
    $0.10/per GB/month of provisioned storage

    Vendor refund policy

    For hourly billed AMIs, refunds are not offered as usage is billed in arrears. For monthly or annual subscriptions, refunds may be considered on a case-by-case basis, with cancellation required before the next billing cycle to avoid charges. Contact our support team for issues or billing errors. AWS Marketplace support may issue refunds if the AMI does not function as described or for billing errors. We aim for customer satisfaction and will work to resolve any issues promptly.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    64-bit (x86) Amazon Machine Image (AMI)

    Amazon Machine Image (AMI)

    An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.

    Version release notes

    Version 2.0.1 - Scalable Performant AI Application

    • Boto package has been updated.
    • Multi threaded multi worker coherent chat has been enabled by levergaing redis cache to enable stateless workers to pick up the entire chat history. Please see the deployment guide for guidance on how many users and threads to use based on the number of cores your instance type has.

    Security Updates

    • resolved several high and medium CVEs - remaining 2 CVEs in Amazon Inspector are a scanning error due to legacy version folders continuing to exist - please see the deployment guide for details about how to remove these false alerts if desired.

    Base Update: The AMI is now based on Amazon Linux 2023 to address various CVEs. Ensured the Baked in Demo App is region agnostic, added in a new ENV variable for the region.

    Security Enhancements:

    Removal of Unauthorized Passwords and Keys: Ensures no authorized passwords, authentication keys, key pairs, security keys, or other credentials are present in the AMI. The build script includes a provisioner to delete any pre-configured authorized keys.

    Administrator Control and Root Functions: Users can gain administrator control and perform root functions via sudo access.

    Disabling Password-Based Remote Logins: Password-based authentication is disabled, allowing only key-based authentication. This is configured by updating the sshd_configfile.

    Key Pair Association on Instance Creation: Allows users to associate a new key pair upon instance creation. Existing keys are removed to ensure secure association.

    Additional Security Measures: Malware Scanner: chkrootkitis installed and run to check for rootkits. Security Scan: Lynisperforms a comprehensive security audit. Service and Cleanup: The sshdservice is reloaded, and unnecessary files and logs are removed. Root Login Disabled: The root account is locked to prevent direct login attempts.

    These measures ensure the AMI meets stringent security requirements for the AWS Marketplace, providing a secure and controllable environment for end-users.

    New Features

    • Pre-Configured Environment: The AMI comes with a fully configured environment for Flask applications integrated with OpenAI and AWS Secrets Manager, enabling rapid development and deployment.
    • Security Enhancements: Integrated AWS Secrets Manager for secure management of sensitive information, ensuring compliance with NIST CSF best practices.
    • Pre-Installed Dependencies: Includes Docker, Python 3.11, Flask, AWS CLI, and necessary Python packages for seamless integration and development with OpenAI API.

    Demo Application Enhancements This is an implementation of OpenAI Python quickstart for chat-basic: https://github.com/openai/openai-quickstart-python/tree/master  that has been modified in the following ways:

    • sticky sessions + redis "- clear" button
    • DevOpser Logo
    • Prometheus instrumentation at /metrics
    • Use of AWS Secrets Manager at runtime for ENV variables for enhanced security
    • healthcheck at /health

    Known Issues

    • Rate Limiting on OpenAI API: Users must prepay for OpenAI usage to avoid rate-limiting errors. Please see the deployment guide for instructions.
    • Amazon Inspector Reporting False Positives: Upgraded packages may still be reported as unmitigated by Amazon Inspector until the folder for the outdated version is removed. Follow the manual instructions here: https://docs.google.com/document/d/1PM0Y1GvacPKwxlviu35_gT9VuWujwemOYjv9ySUw_N0/edit#heading=h.lsjmdcd302pl  ** Markdown output** The output of the demo app is currently just a string - work is in progress to implement Markdown formatting per industry standard in AI apps ** Synchronous requests** These are limiting performance of the app - looking into async requests to further improve performance and scalability.

    Documentation

    • Comprehensive deployment guide available for setting up, managing, and scaling the AMI.
    • Step-by-step instructions for secure secret management and compliance with security standards.

    Additional Notes

    • Cost Model: this service is billed hourly.
    • Sizing Recommendations: A t3.large enables the app to launch more quickly. The alrger the instance the more quickly the app with launch.

    For detailed instructions and further information, please refer to the Deployment Guide.

    Additional details

    Usage instructions

    Please see the following section of the deployment guide: https://docs.google.com/document/d/1PM0Y1GvacPKwxlviu35_gT9VuWujwemOYjv9ySUw_N0/edit#heading=h.3pp0yuwfthsk 

    Or you can use the Terraform openaiflask-quickstart module: https://github.com/DevOpser-io/openaiflask-quickstart  (main will deploy a production set up, dev will deploy a single server with the AMI with everything done per the deployment guidelines)

    Resources

    Vendor resources

    Support

    Vendor support

    In case of any issues or questions, please email info@devopser.io 

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 AWS reviews
    No customer reviews yet
    Be the first to write a review for this product.