Slack Eliminates SSH in EMR Pipelines, Migrates 700+ Jobs to Rest-Based Architecture
Summary
Slack replaced SSH-based execution in its EMR pipelines with a REST-based orchestration layer. The change moved more than 700 Airflow operators to a centralized submission model and removed direct SSH access to production clusters. Slack made the migration across eight data regions to improve security, reliability, and observability. The rollout completed over three quarters without downtime for critical workloads and also set up future work such as Spark on Kubernetes preparation.
Classifications
industries
No industries detected
applications
General BI
AskAI Classifications
Labels
SaaS
Collaboration Software
Workflow Automation
Linked Companies
Slack
$100M to $250M