Sold by: ABEJA inc.
Open data
|
Deployed on AWS
A large Japanese language corpus created through preprocessing Common Crawl data
Overview
A large Japanese language corpus created through preprocessing Common Crawl data
Features and programs
Open Data Sponsorship Program
This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.
Pricing
This is a publicly available data set. No subscription is required.
Legal
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
AWS Data Exchange (ADX)
AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.
Open data resources
Available with or without an AWS account.
- How to use
- To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more
- Description
- Text corpus
- Resource type
- S3 bucket
- Amazon Resource Name (ARN)
- arn:aws:s3:::abeja-cc-ja
- AWS region
- ap-northeast-1
- AWS CLI access (No AWS account required)
- aws s3 ls --no-sign-request s3://abeja-cc-ja/
Resources
Vendor resources
Support
Managed By
How to cite
ABEJA CC JA was accessed on DATE from https://registry.opendata.aws/abeja-cc-ja .
License
This data is available for anyone to use under the Common Crawl Terms of Use
Similar products
The ABEJA Mixtral-8x7B-v0.1-japanese model is specifically designed and optimized for the Japanese language.
ABEJA, as an AWS Machine Learning Competency Partner, is driving a digital platform business that provides end-to-end AI implementation support, including generative AI, and operations based on the ABEJA Platform. The following is an outline of the professional services available through AWS Marketplace.
Easily connect to Acumatica from AWS Glue
This is a repackaged open source software product wherein additional charges apply for hardening, security configuration, and setup support.
Jaeger is the CNCF-graduated distributed tracing platform, shipped here as a single self-contained Go binary that runs the collector, query service and web UI together (all-in-one). This Lynxroute build is hardened and ready out of the box: an nginx TLS perimeter with HTTP basic auth generated at first boot, the query UI bound to loopback, persistent local Badger storage, OTLP ingest on dedicated ports, UFW firewall pre-configured, and a CIS Level 1 hardened Ubuntu 24.04 LTS base.
Apache-2.0 license - fully auditable, no vendor lock-in.