Alibaba Cloud E-MapReduce

E-MapReduce is Alibaba Cloud's managed platform for the open-source big data stack — Hadoop, Hive, Spark, StarRocks, Doris, Presto and Trino — running on ECS, on Kubernetes, or serverless. I led the product experience.

Most of that work is the unglamorous middle of the funnel: picking a cluster shape without a wiki open in the next tab, scaling one while jobs are running, and reading back what a running cluster is actually doing. A console for infrastructure is judged on how confidently someone can do something irreversible, so a large share of the design effort goes into the moments right before a destructive action, and into making the state of the system legible enough that the action is obviously right.

I wrote up what I learned about that in more detail in 10 Essential Details for Enhancing Cloud Computing User Experience.