AWS Startups Blog

Tag: Big Data

From Zero to EKS with Terraform and Helm

At Aledade, we perform ETL on the healthcare data of millions of patients from thousands of different sources, and the primary tool we leverage is the workflow management tool Airflow. Because the amount of data we process is growing exponentially, we have quickly outgrown the ability to scale our dockerized Airflow deploy horizontally. We decided to move Airflow into Kubernetes to take advantage of their native support for scaling pods up and down, as needed, to handle tasks. With zero experience running a Kubernetes cluster, EKS allowed us to get up and running rapidly. Here is how we did it.

An Ocean of Data: Talking With Datameer’s Claudine Lagerholm

Oceans are made for exploration. That seems to be the subtext of the evocatively named Datameer, which uses Meer, the German word for ocean, to position itself in juxtaposition with data lakes. The name Datameer hints at the immensity and power of data, which shapes lives today in much the same way that ocean currents shaped those in previous centuries. It also hints at the sheer inscrutability of data. For most people, being presented with raw data and asked to interpret it is as bewildering as being presented with a view of a flat sea and told to list statistics about local fish populations. That’s where Datameer comes in.

Forget Silicon Valley, for Farmer’s Business Network, the Real Proving Grounds for Machine Learning are Out in the Fields

If you live at a distance from farm country, agriculture might seem like an unchanging industry, built around traditional methods and relatively low-tech tools. Even a Google Image search primarily brings up pictures of tractors plowing through fields. However, the economic risks of agriculture actually force farmers to be early adopters of new technology.

Rebuilding Puerto Rico’s Healthcare Infrastructure in the Cloud

Despite being a U.S. territory, Puerto Rico’s healthcare landscape is vastly different from the mainland. Federal funding for Medicare and Medicaid is 40-50% lower than the average U.S. state, creating financial strains for hospitals and providers managing those patients. Federal incentives for using electronic medical records are also far lower, with many hospitals and clinics choosing to stay on paper. At Health Gorilla, we’re committed to making interoperability actionable in real-world clinical practice.

Exploring Data Science With Explorium’s Or Tamir

“My career has been around startups all the way,” says Or Tamir, co-founder and COO of Explorium. “This is something I’ve always wanted to do.” Because startups have composed the foundation and the scaffolding of Tamir’s career, he views the fact he ended up co-founding and helming a project like Explorium as almost inevitable. In a way, it was a logical next step: “co-founder” and “COO” were two of the only job roles in the world of startups that Tamir hadn’t yet tackled.