•1 min read•from InfoQ
Slack Eliminates SSH in EMR Pipelines, Migrates 700+ Jobs to Rest-Based Architecture
Slack modernized its data platform by replacing SSH based execution in Amazon EMR pipelines with a REST driven orchestration layer called Quarry. The migration covered 700 plus Airflow operators, improving security, reliability, and observability while eliminating direct SSH access across production clusters and enabling a server side job lifecycle model.
By Leela KumiliWant to read more?
Check out the full article on the original site
Tagged with
#cloud-based spreadsheet applications
#big data management in spreadsheets
#generative AI for data analysis
#conversational data analysis
#AI-driven spreadsheet solutions
#Excel alternatives for data analysis
#real-time data collaboration
#financial modeling with spreadsheets
#intelligent data visualization
#data visualization tools
#enterprise data management
#big data performance
#data analysis tools
#data cleaning solutions
#rows.com
#Slack
#EMR
#Amazon EMR
#REST
#Quarry