Observability Tooling Data Engineer

Sepal

United States

United States

Postuler Maintenant

À propos

Join Sepal AI, where we build cutting-edge evaluations for AI based on real-world software systems. We are currently seeking a passionate Data Engineer with at least 3 years of experience and a strong systems mindset to help develop innovative evaluation environments for AI in high-throughput log analysis contexts. Your Responsibilities: Design and execute advanced analytical schemas and pipelines utilizing top-tier tools such as BigQuery, ClickHouse, Snowflake, and Redshift. Work with complex, distributed queries across extensive log and telemetry datasets. Develop and manage synthetic datasets that replicate real-world DevOps, observability, or cloud infrastructure logs. Enhance and optimize distributed query execution plans to minimize timeouts and decrease over-scanning. Who You Are: Possess 3+ years of experience in data engineering or backend systems roles. Have deep expertise in analytical databases and OLAP engines with a strong focus on large-scale query optimization, schema design, and performance tuning. Experienced with log ingestion pipelines (e.g., FluentBit, Logstash, Vector) and schema design for observability systems. Exhibit strong SQL skills, capable of identifying performance issues and recognizing inefficient query patterns. Bonus:
Familiarity with Python, Docker, or synthetic data generation is a plus. Compensation: $50 - 85/hr based on experience. This role offers remote, flexible hours and is expected to last for 5-6 weeks.

United States

Compétences linguistiques

English

Avis aux utilisateurs

Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.

Postuler Maintenant