QA Lead Data Engineering - Long Term ContractRootshell Enterprise Technologies • United States
Cette offre d'emploi n'est plus disponible
QA Lead Data Engineering - Long Term Contract
Rootshell Enterprise Technologies
- United States
- United States
À propos
Long Term Contract
We are seeking a highly skilled
QA Lead - Data Engineering
to define and implement robust QA strategies, automated testing frameworks, and data quality assurance processes. The ideal candidate will have expertise in
Google Cloud Platform (GCP), Databricks, ETL pipelines, SQL, Python scripting, and CI/CD workflows . This role requires a strong understanding of data governance, data validation, and test automation to ensure high-quality data engineering solutions.
QA Strategy and Leadership:
* Define and implement robust OA strategies, methodologies, and processes for data engineering projects.
* Lead and mentor a team of QA engineers, ensuring alignment with best practices and project goals.
* Collaborate with stakeholders to understand data quality requirements and translate them into test plans and case
Testing Frameworks and Automation:
* Develop and maintain automated testing frameworks for ETL pipelines, data lakes, and data ware holises on Google cloud platform, Databricks, and related services.
* Design data validation and verification processes to ensure the accuracy and consistency of data across pipelines.
* Automate regression, performance, and integration testing to minimize manual efforts.
Data Quality Assurance:
* Conduct root cause analysis for data quality issues and drive corrective actions.
* Ensure compliance with data governance policies and data security best practices.
* Develop data profiling and monitoring dashboards using tools like Google
* Monitor, Power BI, or custom solutions.
Technical Skills and Qualifications:
* GCP Expertise: Proficient in GCP, Dataflow, BigQuery, Cloud composer, and google Storage services.
* Databricks: Experience with Spark-based data engineering workflows, including Delta Lake.
* Testing Tools & Frameworks: Strong experience with tools like PyTest, dbt (data build tool), or similar testing frame works for data pipelines.
* SQL and Scripting: Advanced SQL skills for data validation with Python proficiency for automation.
* Big data Knowledge: Knowledge of Big Data processing and distributed computing. Understand the importance data modeling concepts
* CI/CD: Knowledge of CI/CD pipelines on or GitHub Actions, focusing on data engineering workflows.
* Data Governance: Familiarity with data governance tools and concepts such as metadata management, lineage, and data cataloging.
* Communication: Excellent communications skills, with the ability to synthesize, simplify and explain complex problems to different tunes of audience including executives
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.