Data Engineer
Akaasa Technologies
- Madison, Wisconsin, United States
- Madison, Wisconsin, United States
Über
Pyspark
Azure Data Factory
Github
Snowflake
Role Summary Senior, hands on data engineering contractor to support Modern data platform delivery across Health Payer Domains. This role requires independent ownership of end to end data pipelines using modern cloud and Lakehouse architecture. This is a hit the ground running role with minimal ramp up.
Key Responsibilities
Design, build, and operate end to end data pipelines
Source ingestion ? transformation ? analytics ready datasets
Develop transformations and data models using SQL and Python
Implement automated data quality checks and validations
Follow Git based development
Collaborate with business/domain stakeholders on data rules and definitions
Ensure solutions are secure, auditable, reliable, and supportable
Produce clear technical documentation and operational notes
Required Technologies (Must Have) Candidates must have strong, recent hands on experience with most of the following:
Languages
SQL
Python (PySpark preferred)
Data Platforms / Storage
Cloud data platforms (Azure preferred; AWS/GCP acceptable)
Azure Data Lake Storage Gen2 (ADLS Gen2) or equivalent
Object storage based data lakes
Parquet format
Lakehouse concepts (Iceberg and/or Delta)
Transformation & Modeling
dbt (dbt Core and/or dbt Cloud)
Source Control, GitOps & CI/CD
GitHub
Pull request based development
CI/CD pipelines (GitHub Actions or equivalent)
Compute (one or more)
Snowflake
Microsoft Fabric
Databricks
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.