I’m a Staff Platform Engineer at Empathy.co. I mostly manage Kubernetes Clusters, CI/CD orchestration, Elasticsearch, MongoDB and try to break things on AWS, GCP and Azure.
FinOps, short for Cloud Financial Operations, helps teams optimise cloud costs to get the most value for their projects. Teams adopt best practices and a collaborative culture to manage cloud operations with greater financial accountability: balancing cost, speed and quality. When your teams have problems managing their cloud costs, following
Motivation This article is an overview of the path we followed to migrate Spark Workloads to Kubernetes and to avoid EMR dependency. EMR was an important support tool at Empathy.co [https://empathy.co/] to orchestrate Spark workloads, but once the workloads became more complex, the use of EMR also
Using Spark on K8s to overcome dependency on cloud providers For the last few weeks, I’ve been deploying a Spark cluster on Kubernetes (K8s). I want to share the challenges, architecture and solution details I’ve discovered with you. Challenges At Empathy, all code running in production must be
During the last weeks, I was deploying a Flink cluster on Kubernetes cluster. I’d like to share the challenges, architecture, Kubernetes deployment, solution details and the journey on this article Challenges At Empathy, all code running in Production must be cloud agnostic. Empathy had a cloud dependency regarding Dataflow