
Sold by: Works Applications
Open data
|
Deployed on AWS
Japanese dictionaries and pre-trained models (word embeddings and language models) for natural language processing.
[SudachiDict](https://github.com/WorksApplications/SudachiDict) is the dictionary for a Japanese tokenizer (morphological analyzer) [Sudachi](https://github.com/WorksApplications/Sudachi).
[chiVe](https://github.com/WorksApplications/chiVe) is Japanese pretrained word embeddings (word vectors), trained using the ultra-large-scale web corpus NWJC by National Institute for Japanese Language and Linguistics, analyzed by Sudachi.
[chiTra](https://github.com/WorksApplications/SudachiTra) is a library for using large-scale pre-trained language models with the Japanese tokenizer SudachiPy.
Overview
Japanese dictionaries and pre-trained models (word embeddings and language models) for natural language processing. SudachiDict is the dictionary for a Japanese tokenizer (morphological analyzer) Sudachi . chiVe is Japanese pretrained word embeddings (word vectors), trained using the ultra-large-scale web corpus NWJC by National Institute for Japanese Language and Linguistics, analyzed by Sudachi. chiTra is a library for using large-scale pre-trained language models with the Japanese tokenizer SudachiPy.
Features and programs
Open Data Sponsorship Program
This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.
Pricing
This is a publicly available data set. No subscription is required.
How can we make this page better?
We'd like to hear your feedback and ideas on how to improve this page.
Legal
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
AWS Data Exchange (ADX)
AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.
Open data resources
Available with or without an AWS account.
- How to use
- To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more
- Description
- SudachiDict: Binary format of the mophological analysis dictionaries chiVe: Pretrained word embedding in various formats
- Resource type
- S3 bucket
- Amazon Resource Name (ARN)
- arn:aws:s3:::sudachi
- AWS region
- ap-northeast-1
- AWS CLI access (No AWS account required)
- aws s3 ls --no-sign-request s3://sudachi/
- Description
- Cloudfront CDN mirror
- Resource type
- CloudFront distribution
- Resource link
- d2ej7fkh96fzlu.cloudfront.net
- AWS region
- ap-northeast-1