How to perform batch inference in Sagemaker?
Hi Daniel,
I'm using the GPT-2 model shared by you. I want to get synthetic texts from multiple input texts, using batch inference API of AWS Sagemaker. There is a github repo that contains a batch inference API on only one input text. Do you know how to do batch inference on multiple input texts?
https://github.com/aws/amazon-sagemaker-examples/blob/master/aws_marketplace/using_model_packages/creative-writing-using-gpt-2-text-generation/creative-writing-using-gpt-2-text-generation.ipynb
Best,
Farshad
- Leave a Comment |
- Mark review as helpful
showing 1 - 1