Senior Data Engineer - Spark/Pyspark and TSQL

................

For our international client in Basel, we are looking for an experienced, motivated and open-minded Senior Data Engineer - Spark/Pyspark and TSQL.

You will support a project team working on the migration of an on-prem DWH (MSSQL) to the Microsoft Fabric environment (Lakehouse/Data Product Architecture).

Your Tasks:

• Migration of the existing on-premises data warehouse (MSSQL) to the Microsoft Fabric environment (lakehouse/data product architecture)
• Design and development of (source-aligned and consumer-aligned) data products in Microsoft Fabric based on a Medaillon Lakehouse architecture.
• Migration of the transformation logic from TSQL Stored Procedures to Pyspark Notebooks
• Data migration from the onprem data warehouse to Microsoft Onelake (delta format)
• Development and optimisation of data pipelines with Spark/PySpark
• Creation of semantic models, reports and dashboards in Power BI
• Optional use of additional Azure components such as Azure Databricks, Azure Data Factory and Azure SQL Database to expand the migration and transformation processes

Your Profil:

• Bachelor or Master in Computer Science or Engineering or similar
• 5+ years of experience in the BI and DWH fields
• Proven experience and seniority with Spark/Pyspark and TSQL
• Experience with some or all of the following:
  • Spark/SparkSQL
  • Microsoft Fabric Lakehouse and/or Notebooks
  • PowerBI Semantic Models, PowerBI Reports & Dashboards
  • Azure Databricks, Azure Data Factory, Azure SQL Database
• Motivated and dedicated personality with strong communication skills
• Analytical and structured mindset, solution-oriented, and excellent problem-solving skills
• Fluent in English, German is a plus