By Rahul Miglani , VP Engineering , DevOps
What did they Do?
More than 1.3 Crores people were watching India vs Pakistan game live without any lag, buffering or frame loss. They prepared for this event & made a lot of efforts in managing user traffic & load where other applications from the shared resource pool are also trying to pull cloud resources. Big applause to Hotstar’s DevOps team who managed to live stream the match to 10 crore people.
Hotstar deployed AWS Elastic Compute instances of type c5 9Xlarge which consists of 36 CPUs & 72 GB RAM & has 10 Gbps of network bandwidth. Thousands of EC2 servers were managed along with S3 storage for data storing regionally. Big thumbs-up for CDN partner Akamai for providing seamless content delivery for nearest end-users to reduce the latency & enhance watching experience.
To simulate & mimic the huge traffic load hotstar DevOps team spun up a large number of EC2 instances running at 75% utilization.
Team started to follow a simple load testing model in which they hit endpoints with a certain ratio of requests per second keeping in mind some users already have signed up & some will newly sign up. Then to mimic the event, the team made simulation scripts & ran on AWS infrastructure for 2-3 crores users.
Automation & Scaling
Auto Scaling is done on two models: traffic-based-scaling & Ladder based scaling. With increasing number of requests more resources added in the pool & to reduce delay team has pre-provisioned buffer. It helped to handle unexpected traffic spikes without delay or disruption.