Sr. Data Engineer

Job Title: Data Engineer (Python | Databricks)

Location:
Hybrid in Minneapolis (Must be Local to Minnesota)

Duration:
6+ Month Contract –
Right to Hire / Contract-to-Hire

Work Authorization:
USC Only

Job Summary

We are seeking a highly skilled
Data Engineer
with
strong Python and Databricks experience
to design, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate will work closely with business partners and technical teams to support data-driven decision-making in a hybrid cloud environment.

Key Responsibilities

• Design, develop, and maintain scalable
  data pipelines
  using
  Python, Databricks, and Spark
• Build and optimize
  ETL/ELT processes
  for batch and distributed data processing
• Develop data models using
  Star, Snowflake, and normalized schemas
• Work with structured and semi-structured data formats (Parquet, Delta, JSON, CSV, Avro)
• Perform
  data profiling, validation, and quality checks
  to ensure data accuracy
• Write and optimize complex
  SQL and PySpark SQL
  queries
• Collaborate with cross-functional teams including business users, analysts, and DevOps
• Support CI/CD pipelines, version control, and automated testing
• Participate in Agile/Scrum ceremonies and contribute to continuous improvement

Required Qualifications

• Bachelor's degree in Computer Science, Data Science, Statistics, Mathematics, Engineering, or related field (or equivalent experience)
• 2+ years of hands-on Data Engineering experience
• Strong proficiency in Python
  for data processing, automation, and analytics
• Strong experience with Databricks and Apache Spark
• 2+ years of SQL experience
  (PL/SQL, PySpark SQL, or similar)
• Experience with
  CI/CD pipelines
  and
  Git-based version control
• Solid understanding of
  data modeling techniques
  (Star/Snowflake schemas, 3NF)
• Experience working with modern
  data processing techniques
  (batch, partitioned, distributed)
• Strong analytical, problem-solving, and data profiling skills
• Excellent communication skills and ability to work with diverse teams
• Self-driven, detail-oriented, and highly motivated

Preferred / Nice-to-Have Skills

• Experience with
  Oracle ERP
• Knowledge of
  healthcare operations
• Understanding of
  basic accounting principles
• Experience in
  Agile/Scrum
  environments
• Experience in
  hybrid cloud architectures
  (on-prem + cloud)
• Hands-on experience with
  Oracle, SQL Server
• SQL performance tuning (queries, stored procedures, triggers)
• Python libraries:
  NumPy, Pandas, Matplotlib
  , Jupyter Notebooks
• Experience with
  Azure services
  :
• Azure Data Factory
• Azure Synapse
• Azure Databricks
• Azure Purview
• Power BI / PowerApps
• Familiarity with
  NoSQL databases
  (MongoDB preferred)
• Strong experience with
  Power BI data models
  , Power Query, and DAX
• Exposure to CI/CD, continuous testing, and site reliability engineering