Big Data on AWS
Drive innovation through data, with scalable services for data collection, storage, integration, analytics and collaboration.
Big Data: end to end
“Big Data” refers to a collection of tools, techniques and technologies for working with data productively, at any scale. The tools to support data collection, computation along with collaboration and sharing are all available in a couple of clicks, with Amazon Web Services.
Built for data. Designed for humans.
It feels like everything generates data today, from your customers on social networks, to the instances running your web applications. Amazon Web Services makes it easy to provision the storage, computation and database services you need to turn that data into information for your business.We have data transfer services which can move big data into and out of the cloud quickly such as AWS Direct Connect and our Import/Export service. Furthermore, all inbound data traffic into AWS is free. The choice is yours on AWS: you can choose to use a service to fit a specific use case or architect an end- to-end solution interconnecting several of our big data services with your own tools and solutions.
Big data collection and analysis in real time.
Amazon Kinesis is a managed service for real-time processing of streaming big data. Amazon Kinesis supports data throughput from megabytes to gigabytes of data per second and can scale seamlessly to handle streams from hundreds of thousands different sources. Designed to provide for high availability and durability in cost-effective manner, you can now focus on making sense of your data which will enable you to make better decisions faster and at lower costs.
Petabyte scale data warehousing for all.
Amazon Redshift provides a fast, fully managed, petabyte-scale data warehouse for less than $1000 per terabyte per year. Amazon Redshift delivers fast query and I/O performance for virtually any size dataset by using columnar storage technology and parallelizing and distributing queries across multiple nodes. In just a few minutes, you can easily provision a fully managed data warehouse with automated backups and built-in encryption. Plug in easily with your existing business intelligence tools.
Hadoop all the way down.
Amazon Elastic MapReduce provides a managed, easy to use analytics platform built around the powerful Hadoop framework. Focus on your map/reduce queries and take advantage of the broad ecosystem of Hadoop tools, while deploying to a high scale, secure infrastructure platform.
Solid state, at your service.
NoSQL data stores benefit greatly from the speed of solid state drives. DynamoDB uses them by default, but if you are using alternatives from the AWS Marketplace, such as Cassandra or MongoDB, accelerate your access with on-demand access to terabytes of solid state storage, with the High I/O instance class.
How fast could your project go with another 1000 instances? How about 10,000? The Amazon Spot Market, integrated into Amazon Elastic MapReduce, lets you choose your own price for the computing resources you need. That means you can choose your own balance of cost and performance, overclocking your analytics when you need to, or reducing costs significantly.
A growing family of datasets, ready to roll.
Many of the datasets you need are already available on the AWS Cloud, as part of the Amazon Public Datasets program. So whether you’re looking to mine the Common Crawl open web corpus, or align some genomes, AWS provides the data, the services and the infrastructure you need to get up and running.
How can data drive your business forward?
Dealing with large number of application or web logs can often feel like finding a needle in a haystack. Storing those logs in Amazon S3 and driving analytics with Amazon Elastic MapReduce provides a low cost, high performance, easy way to sift through terabytes of data. You’ll find the greater insight into your customer usage and operations opens new doors to respond quickly to changing market conditions.
Learn how to increase the click-through rates of your advertising, or drive better engagement in your social game world by gaining insight into your customers. Integrating data from various sources to help drive more relevant search results, better placed ads or balance your in-game economy.
Whether you need to recommend ‘books that other people bought’, or deliver more accurate suggestions for investment based on market performance, recommendation engines can take your existing and historical data and drive new business opportunities and features.