Senior Software Engineer, Data- Remote

The Cloud AutoScaling team is dedicated to implementing robust vertical and horizontal auto-scaling capabilities within the ClickHouse cloud environment. We seek exceptional software engineers to develop and maintain the auto-scaling infrastructure to transform ClickHouse into a fully functional serverless database solution. Collaborating closely with the core database team, we are actively working on evolving ClickHouse into a cloud-native database system. Additionally, we engage with other cloud teams to drive continuous improvements in cloud infrastructure for enhanced performance and scalability.

What will you do?

• Build a cutting-edge Cloud Native platform on top of the public cloud.
• Improve the metrics pipeline and build algorithms to generate better autoscaling statistics and recommendations.
• Work on the autoscale and Kubernetes operator to support seamless Vertical and Horizontal Auto-scaling.
• Work closely with our ClickHouse core development team and other data plane teams, partnering with them to support auto-scaling use cases as well as other internal infrastructure improvements.
• Architecting and building a robust, scalable, and highly available distributed infrastructure

About you:

• You have 5+ years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems.
• Hands-on experience building and estimating statistical models and time-series forecasting with large-scale, real-world datasets.
• Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent.
• Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools).
• You are passionate about solving data problems at Scale.
• Expertise with a public cloud provider (AWS, GCP, Azure) and their infrastructure as a service offering (e.g., EC2).
• You have excellent communication skills and the ability to work well within and across engineering teams.
• You are a strong problem solver and have solid production debugging skills.

Bonus Points:

• Software development experience in Go, C/C++, Java, or similar.
• Experience developing cloud infrastructure services, preferably with Kubernetes.
• You are a full-cycle developer with strong ownership and experience building and operating high-scale, distributed systems across the full software life cycle.

#LI-Remote

#J-18808-Ljbffr