This job offer is no longer available
Data Engineer with strong Data Analyst skills
Q1 Technologies, Inc
- United States
- United States
About
Key Qualifications
MUST HAVE:
•
Hands-on experience with writing Complex queries using – Joins, Self Joins, Views, Materialized Views, Cursor also Recursive, use of GROUP BY, PARTITION BY functions / SQL Performance tuning
•
Hands-on experience with ETL and Dimensional Data Modelling – Slowly Changing Dimensions (SCD – Type 1, 2, 3)
o
Good understanding of concepts like schema types, table types - fact-dimension etc. like how to design a dimension vs fact, design considerations factored etc.
•
Proficiency in Python scripting/programming – using Pandas, PyParsing, Airflow.
o
Pandas, Tableau server modules, Numpy, Datetime, Apache Airflow related modules, APIs
o
Setting up Python scripts on DataLab, scheduling processes, connecting with DataLake (S3 etc )
o
Data Pipeline automation
o
Strong Python programming skills
o
Apache Kafka and Python (using client libraries like Confluent's librdkafka or kafka-python; to send (produce) and receive (consume) messages from Kafka topics.
o
Experience building streaming applications, data pipelines, and microservices etc.)
•
Good understanding on Snowflake Architecture - experience with designing and building solutions.
o
Architecture, design aspects, performance tuning, time travel, warehouse concepts - scaling, clustering, micro-partitioning
o
Experience with SnowSQL, Snowpipe
•
Good to Have - Experience with Snowflake performance optimization techniques
•
Experience with Vertica, Singlestore
•
Lead Experience - Experience interacting with business and independently develop and lead data projects. Collaborating with Offshore and owning overall project delivery.
•
Actively participating in discussions with business to understand requirements, perform thorough impact analysis and provide suitable solutions.
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.