Tag: Technical Use Cases

Containers are a critical part of SuperAwesome’s infrastructure. They allowed SuperAwesome to grow very rapidly without losing focus of our goals. Sometimes, some really simple changes can save you money, a simpler infrastructure, a better developer experience, and reduce maintenance.

At Aledade, we perform ETL on the healthcare data of millions of patients from thousands of different sources, and the primary tool we leverage is the workflow management tool Airflow. Because the amount of data we process is growing exponentially, we have quickly outgrown the ability to scale our dockerized Airflow deploy horizontally. We decided to move Airflow into Kubernetes to take advantage of their native support for scaling pods up and down, as needed, to handle tasks. With zero experience running a Kubernetes cluster, EKS allowed us to get up and running rapidly. Here is how we did it.

At END. we’re constantly working to improve the way our engineering department operates. Our goal is simple: to empower the team so they can get stuff done without obstruction or interference. Anything to make things easier, faster, more reliable—and if that means tinkering with some new technology along the way, even better. Until recently, deployments were one of the biggest pain points for our engineers and with a two-person DevOps team we inevitably became a massive bottleneck when it came to go-live. We knew we needed to find a better way of doing things, and as existing AWS users, AWS Fargate seemed like the natural way forward.

Yotam Spenser, Head of Data Engineering at WalkMe, discusses the nature of the WalkMe Insights product offering, some of the challenges that arose as they developed this technology, and how they came to a solution. 

As an SAP Operations Manager you need to ensure that IT systems are operating at maximum efficiency and in a Known Good State.

Since CANDIS manages a service center of trained professionals that extract data from uploaded documents and annotate them with relevant financial metadata, our data scientists had access to a growing dataset they can experiment with.

When it comes to transforming floods of raw data into clear, decisive business intelligence, Periscope Data remains on the cutting edge. To keep their commitment to their consumers, Periscope Data has developed a machine learning solution that leverages Amazon SageMaker as a core part of its machine learning workflow.

Most security solutions used by enterprises today emphasize a traditional network approach. Today’s modern organizations prize agility and transformation as underlying principles of their IT infrastructures. These enterprises that use the cloud to drive an innovative, agile business and technology agenda must adopt a security strategy that uses cloud principles to address cloud issues.

ipdata Founder Jonathan Kosgei covers how he built a highly scalable API with low latency globally on AWS API Gateway and how his company handled Authorization, Rate Limiting, High Availability, and DDoS protection.

Guest post by Tomaz Berisa, Cofounder and CTO at Gencove We have been working hard to scale low-pass sequencing at Gencove and ran into a few computational scalability constraints. This is an overview of how we got around them and the resulting architecture, complete with infrastructure templates and code. Sequencing the first human genome in […]