
Ramiro Álvarez
I’m a Staff Platform Engineer at Empathy.co. I mostly manage Kubernetes Clusters, CI/CD orchestration, Elasticsearch, MongoDB and try to break things on AWS, GCP and Azure.
Running Apache Spark on Kubernetes
Using Spark on K8s to overcome dependency on cloud providers
For the last few weeks, I’ve been deploying a Spark cluster on Kubernetes (K8s).
I want to share the challenges, architecture and solution details I’ve
discovered with you.
Challenges
At Empathy, all code running in production must be
Running Apache Flink on Kubernetes
During the last weeks, I was deploying a Flink cluster on Kubernetes cluster.
I’d like to share the challenges, architecture, Kubernetes deployment, solution
details and the journey on this article
Challenges
At Empathy, all code running in Production must be cloud agnostic. Empathy had a
cloud dependency regarding Dataflow