•1 min read•from InfoQ
Netflix Moves Toward Open Source Flink Autoscaler for 30,000+ Streaming Jobs
Netflix is moving toward the open-source Apache Flink Autoscaler for more than 30,000 streaming jobs across multiple AWS regions. The operator-level approach addresses limitations of Netflix’s cluster level autoscaler for complex, stateful pipelines. Netflix reports a 58% reduction in annualized Flink compute expenditure for one team, saving approximately $1.1 million annually.
By Leela KumiliWant to read more?
Check out the full article on the original site
Tagged with
#Apache Flink
#Flink Autoscaler
#Streaming Jobs
#Open Source
#Autoscaling
#AWS
#Netflix
#Stateful Pipelines
#Operator-Level
#Cluster Level
#Compute Expenditure
#Cloud Computing
#Data Streaming
#Real-time Processing
#Pipelines
#Resource Management
#Cost Optimization
#Infrastructure
#Regions
#Scalability