Listing Thumbnail

    Sudachi Language Resources

     Info
    Open data
    |
    Deployed on AWS
    Japanese dictionaries and pre-trained models (word embeddings and language models) for natural language processing. [SudachiDict](https://github.com/WorksApplications/SudachiDict) is the dictionary for a Japanese tokenizer (morphological analyzer) [Sudachi](https://github.com/WorksApplications/Sudachi). [chiVe](https://github.com/WorksApplications/chiVe) is Japanese pretrained word embeddings (word vectors), trained using the ultra-large-scale web corpus NWJC by National Institute for Japanese Language and Linguistics, analyzed by Sudachi. [chiTra](https://github.com/WorksApplications/SudachiTra) is a library for using large-scale pre-trained language models with the Japanese tokenizer SudachiPy.

    Overview

    Japanese dictionaries and pre-trained models (word embeddings and language models) for natural language processing. SudachiDict  is the dictionary for a Japanese tokenizer (morphological analyzer) Sudachi . chiVe  is Japanese pretrained word embeddings (word vectors), trained using the ultra-large-scale web corpus NWJC by National Institute for Japanese Language and Linguistics, analyzed by Sudachi. chiTra  is a library for using large-scale pre-trained language models with the Japanese tokenizer SudachiPy.

    Features and programs

    Open Data Sponsorship Program

    This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.

    Pricing

    This is a publicly available data set. No subscription is required.

    How can we make this page better?

    We'd like to hear your feedback and ideas on how to improve this page.
    We'd like to hear your feedback and ideas on how to improve this page.

    Legal

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    AWS Data Exchange (ADX)

    AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.

    Open data resources

    Available with or without an AWS account.

    How to use
    To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more 
    Description
    SudachiDict: Binary format of the mophological analysis dictionaries chiVe: Pretrained word embedding in various formats
    Resource type
    S3 bucket
    Amazon Resource Name (ARN)
    arn:aws:s3:::sudachi
    AWS region
    ap-northeast-1
    AWS CLI access (No AWS account required)
    aws s3 ls --no-sign-request s3://sudachi/
    Description
    Cloudfront CDN mirror
    Resource type
    CloudFront distribution
    AWS region
    ap-northeast-1

    Resources

    Support

    How to cite

    Sudachi Language Resources was accessed on DATE from https://registry.opendata.aws/sudachi .

    License

    Apache-2.0

    Similar products