Success Stories / Software & Internet
2024
Kiwify reduces video transcoding costs by 70% with AWS infrastructure
Kiwify migrated its video encoding process to AWS, using an internally developed encoder and focusing 100% its processing on GPU spot instances.
Overview | Opportunity | Solution | Benefits | AWS Services
70%
reduction in video coding costs
80%
reduction in video coding time
162%
growth in CDN outputs
100%
of the video conversion process running on GPU Spot instances
Overview
Founded in 2001, Kiwify is a web-based course sharing platform that allows content creators to share courses and mentoring online. This business model has led the company to grow to almost 200 employees, supporting more than 29 thousand content creators and reaching 25 million students.
Today, 99% of the courses offered by Kiwify include video learning, making the video encoding process critical. This process involves compressing video files so that they become lighter and can be transmitted over the internet with quality and without consuming many bandwidth resources. The process is performed using compression algorithms, which remove redundant information and optimize coding.
Opportunity | Seeking more availability
According to Kiwify's DevOps engineer, Fernando Silva, until recently, this process was carried out on another streaming platform. However, the company went offline on two occasions, taking down the courses held on the platform. “We have around eight thousand videos running daily. That’s why we started to explore how to solve this,” says Fernando Silvia. At the time, the company was already an AWS customer and contacted the vendor to seek alternatives.
Solution | Innovating in the use of spot Instances
After carrying out several proofs of concept, Kiwify decided to develop its own encoder, which would be processed on Amazon EC2 spot instances using Intel CPUs. “We spent about a month carrying out tests before making this choice. We tested with spot and without spot to check the level of breakage and analyzed all of the numbers”, she recalls.
Although the use of CPU initially solved the problem, the joint work between AWS and Kiwify demonstrated that migrating processing to NVIDIA GPU-accelerated instances could bring even more performance and further cost reduction. Using NVIDIA L4 instances specifically, working with Amazon Elastic Kubernetes Service (Amazon EKS) and AWS Karpenter, Silva’s team was able to increase parallel processing leveraging GPU-accelerated EC2 spot instances, resulting in performance 12 times faster than that obtained with EC2 instances without acceleration.
With this result, in February the company decided to add GPU-accelerated EC2 spot instances to its processing, a project that was supported by NVIDIA. Today, Kiwify uses around 400 Spot GPU instances monthly, which, together with EC2 Spot instances without acceleration, process a volume of videos that can vary from 6 thousand to 12 thousand per day. In addition to its coding operations, Kiwify has 12 PB of data awaiting migration from the old platform to AWS.
Our issues ceased after migrating 100% to AWS. For the customer, what matters are the videos on the air”
Fernando Silva
Kiwify DevOps Engineer
Benefits | Reducing costs and gaining agility
With the implementation of GPU spot instances, Kiwify has reported a series of operational gains. Regarding content creators, the conversion of videos - which previously could take 30 minutes to 2 hours - is now done in a maximum of 20 minutes, drastically reducing new customer onboarding times.
“The AWS infrastructure also brought us stability. We started using spot instances in December and so far we haven't had any downtime,” Silva points out. The executive also points out that CDN (Content Delivery Network) output has grown 162% since January, with no increase in company costs. “Our issues ended after migrating 100% to AWS. For the customer, what matters is that the CDN is on the air and we've never had problems at this point,” he says.
Silva points out that all these benefits were obtained alongside a 70% reduction in costs compared to the model they adopted previously. “Since January, our client base has doubled and we have maintained video encoding costs. This result came with the use of spot, which allowed us to optimize processing and costs,” he says.
About Kiwify
Created in 2020, Kiwify is a platform that allows the development and sharing of knowledge online. Today, the company has more than 190 employees, serving more than 29 thousand content creators and around 25 million students.
AWS Services
Amazon EC2 Spot Instances
Amazon EC2 spot instances allow you to take advantage of unused EC2 capacity in the AWS Cloud and are available at up to 90% off demand prices.
AWS Karpenter
Karpenter was designed to provision new EC2 instances and program Kubernetes pods in less than a minute. Karpenter dynamically chooses the EC2 instance types that best suit what Kubernetes pods need with minimal configuration and no additional AWS infrastructure.
Amazon EKS
Amazon Elastic Kubernetes Service is a managed Kubernetes service for running Kubernetes in the AWS cloud and on-premises datacenters.
Get Started
Organizations of all sizes across all industries are transforming their businesses and delivering on their missions every day using AWS. Contact our experts and start your own AWS journey today.