Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”
Sign in
Sign in
or
Create a new account
About
Categories
Delivery Methods
Solutions
Resources
 Your Saved List Become a Channel Partner Sell in AWS Marketplace Amazon Web Services Home Help

GPT-2 - Text generation

Inmatura

Reviews from AWS Marketplace

1 AWS reviews
  • 5 star
    0
  • 4 star
    1
  • 3 star
    0
  • 2 star
    0
  • 1 star
    0
Sort by
Filter by

    Farshad

How to perform batch inference in Sagemaker?

  • January 18, 2021
  • Review verified by AWS Marketplace

Hi Daniel,
I'm using the GPT-2 model shared by you. I want to get synthetic texts from multiple input texts, using batch inference API of AWS Sagemaker. There is a github repo that contains a batch inference API on only one input text. Do you know how to do batch inference on multiple input texts?

https://github.com/aws/amazon-sagemaker-examples/blob/master/aws_marketplace/using_model_packages/creative-writing-using-gpt-2-text-generation/creative-writing-using-gpt-2-text-generation.ipynb

Best,
Farshad

showing 1 - 1