AI Prompt

As a function for Prompt Engineering, you can search not only for Prompts shared through the Gallery dashboard, but also for various Prompt templates by type. Easily change LLMs on the screen to provide a variety of experimental environments

AI Service

It provides a gallery-type dashboard to make it easy to search and grasp the details of the generated AI service, and it is possible to immediately provide an independent environment that enables no-code service development. In the development environment, each functional component is connected in a flow method to enable easy development and examination

LLMOps

It provides owned LLM management function for use in the company's internal controlled environment and operating environment for stable serving, and provides fine-tuning function to secure LLM optimized for business It provides Instruction Tuning and DPO learning techniques, and provides LoRA, IA3, and Full Fine Tuning methods as tuning methods.

Evaluation

Provides evaluation function for each evaluation type (dataset) of fine-tuned model. On the leaderboard screen, you can check the score and ranking by model/evaluation type.

Observablity

In order to improve the stability of service operation and service quality, it provides a function that can grasp the operation status at a glance and quickly identify issues (performance, accuracy, error)

AWS marketplace products related to this service :

- EKS(Elastic Kubernetes Service)

A fully-managed, certified Kubernetes service that provides a scalable, highly-available control plane for Kubernetes workloads

- ECR(Elastic Container Registry)

A fully managed container registry offering high-performance hosting to which application images and artifacts are deployed and stored

- RDS

RDS is an easy-to-manage relational database service optimized for total cost of ownership and scalable on demand

- EC2 Compute Service

A service for running and managing virtual servers, providing secure, resizable compute capacity in the cloud

- ElastiCache

A fully managed Redis OSS and Memcached-compatible service delivering real-time, cost-optimized performance for modern applications

- EFS

A scalable fully managed elastic NFS file system for AWS compute instances