Sold by: Moravian University Computer Science
Open data
|
Deployed on AWS
The regulations.gov website allows users to view proposed rules and supporting documents for the federal rule-making process. In addition, users can post and view comments about those proposed rules. The site contains about 27 million pieces of text and binary data, but the API that provides access only allows a user to obtain one thousand items per hour. As a result, it would take approximately 3 years to download all the data.
Mirrulations (MIRRor of regULATIONS.gov) is a system that uses a collection of donated API keys to create a mirror of the data. In addition, for each pdf in the dataset the system extracts available text and stores it as a separate text file. It has successfully downloaded all historic data and continues to run and collect data each hour.
This data is valuable for data journalism. As a public record of the rule-making process, it contains insights into the workings of federal agencies. This dataset provides a single text corpus of the federal rule-m[...]
Overview
The regulations.gov website allows users to view proposed rules and supporting documents for the federal rule-making process. In addition, users can post and view comments about those proposed rules. The site contains about 27 million pieces of text and binary data, but the API that provides access only allows a user to obtain one thousand items per hour. As a result, it would take approximately 3 years to download all the data. Mirrulations (MIRRor of regULATIONS.gov) is a system that uses a collection of donated API keys to create a mirror of the data. In addition, for each pdf in the dataset the system extracts available text and stores it as a separate text file. It has successfully downloaded all historic data and continues to run and collect data each hour. This data is valuable for data journalism. As a public record of the rule-making process, it contains insights into the workings of federal agencies. This dataset provides a single text corpus of the federal rule-making process.
Features and programs
Open Data Sponsorship Program
This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.
Pricing
This is a publicly available data set. No subscription is required.
Legal
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
AWS Data Exchange (ADX)
AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.
Open data resources
Available with or without an AWS account.
- How to use
- To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more
- Description
- Mirrulations dataset
- Resource type
- S3 bucket
- Amazon Resource Name (ARN)
- arn:aws:s3:::mirrulations
- AWS region
- us-east-1
- AWS CLI access (No AWS account required)
- aws s3 ls --no-sign-request s3://mirrulations/
Resources
Vendor resources
Support
Contact
Managed By
How to cite
mirrulations was accessed on DATE from https://registry.opendata.aws/mirrulations .