Lead Data Engineer

Diverse Lynx

United States

United States

Find similar jobs

About

Job Description Lead Data Engineer - Snowflake, DBT and Qlik • Design, develop, and maintain robust and scalable data transformation pipelines using dbt on the Snowflake platform. • DBT Macro Development to Create and utilize Jinja-based DBT macros to promote code reusability, modularity, and dynamic SQL generation within DBT projects. • Data Transformation & Orchestration to Implement and manage data transformation pipelines using DBT, integrating with various data sources and ensuring efficient data flow. • Utilize advanced dbt concepts, including macros, materializations (e.g., incremental, view, table), snapshots, and configurations to build efficient data models. • Write highly optimized and complex SQL queries for data manipulation, cleaning, aggregation, and transformation within dbt models. • Implement and enforce best practices for dbt project structure, version control (Git), documentation, and testing. • Collaborate with data analysts, engineers, and business stakeholders to understand data requirements and translate them into effective data models (e.g., star schema, snowflake schema). • Design and implement logical and physical data models within dbt to support analytical and reporting needs. • Leverage Snowflake features and functionalities for performance optimization, including virtual warehouses, clustering, caching, and query optimization. • Manage and optimize data ingestion and integration processes from various sources into Snowflake. • Ensure data quality, integrity, and lineage throughout the data transformation process. • Implement and maintain DBT tests to ensure data quality, integrity, and adherence to business rules. • Implement and maintain data governance policies and procedures within the dbt environment. • Develop and execute automated tests for dbt models to ensure data accuracy and reliability.
Required Skills: • Proven hands-on experience with dbt in a production environment, including extensive use of macros and advanced modeling techniques. • Expert-level proficiency in SQL for data querying, manipulation, and transformation. • Strong experience with Snowflake, including performance tuning and optimization. • Solid understanding of data warehousing concepts and ETL/ELT processes. • Experience with version control systems, particularly Git. • Familiarity with data modeling principles (star schema, snowflake schema).
Salary Range- $100,000-$110,000 a year
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

United States

Languages

English

Notice for Users

This job was posted by one of our partners. You can view the original job source here.

Find similar jobs