Senior Azure Data Engineer

Our client is looking for a Senior Data Engineer to join their team. This individual will be working on the clients merchandising initiative. You will be responsible for designing, building, and managing data pipelines that collect, process, and analyze data from various stores across different time zones. The client will utilize this data to provide future promotions and discounts to their clients moving forward. Responsibilities of this individual are shown below: Prototype, build, deploy and manage data engineering pipelines using Azure Data Factory, Databricks/Spark, Azure Synapse/DW, Azure Analysis Services, and other tools Write complex SQL queries to extract, transform, and load data from various sources Work with distributed data solutions, storage systems and columnar databases Contribute to design and creation of high-quality solutions that meet business requirements and follow best practices Work with other data engineers, business intelligence and machine learning experts to solve real-life, challenging business problems using data and analytics Familiarize with Continuous Integration/Continuous Deployment, & Git Follow Agile development methods like Scrum or Kanban

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Required Skills & Experience

7+ years of experience working as a Data Engineer 3+ years of relevant professional experience Azure, specifically with Azure SQL DW/Synapse, Azure Tabular, Azure Data Factory, Azure Functions, Azure Containers 3+ years of experience working with Databricks 3+ years of experience working SSMS 3+ years of experience working with PySpark Extensive experience working with SQL - specifically writing complex SQL queries Must have experience working in a retail environment Deep experience with data engineering, big data and analytical technologies using Azure cloud-based data platforms Knowledge of distributed data solutions, storage systems and columnar databases Familiarity with Continuous Integration/Continuous Deployment Knowledge about Agile development methods like Scrum or Kanban

Nice to Have Skills & Experience

Experience working with Python Experience working with Docker DevOps experience Experience scripting with either Powershell or Bash Any experience working with Power BI

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.