Sold by: ABEJA inc.
Open data
|
Deployed on AWS
A large Japanese language corpus created through preprocessing Common Crawl data
Overview
A large Japanese language corpus created through preprocessing Common Crawl data
Features and programs
Open Data Sponsorship Program
This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.
Pricing
This is a publicly available data set. No subscription is required.
Legal
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
AWS Data Exchange (ADX)
AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.
Open data resources
Available with or without an AWS account.
- How to use
- To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more
- Description
- Text corpus
- Resource type
- S3 bucket
- Amazon Resource Name (ARN)
- arn:aws:s3:::abeja-cc-ja
- AWS region
- ap-northeast-1
- AWS CLI access (No AWS account required)
- aws s3 ls --no-sign-request s3://abeja-cc-ja/
Resources
Vendor resources
Support
Managed By
How to cite
ABEJA CC JA was accessed on DATE from https://registry.opendata.aws/abeja-cc-ja .
License
This data is available for anyone to use under the Common Crawl Terms of Use
Similar products
The ABEJA Mixtral-8x7B-v0.1-japanese model is specifically designed and optimized for the Japanese language.
ABEJA, as an AWS Machine Learning Competency Partner, is driving a digital platform business that provides end-to-end AI implementation support, including generative AI, and operations based on the ABEJA Platform. The following is an outline of the professional services available through AWS Marketplace.