This job offer is no longer available
About
Senior Data Engineer position in Charlotte Hybrid (4 days onsite, 1 day remote). 6 months extending. 2 Openings - 40-65/hr based on experience level. This position is for a Senior AWS Data Engineer working on a Master Data Management (MDM) project. The goal of the project is to create a single, trusted view of business data by cleaning up duplicate and inconsistent information from multiple sources. Youll be building scalable data pipelines on AWS, improving data quality, and working on advanced features like entity resolution and machine learning-assisted matching. Itll be a hands-on role where youll own production-grade pipelines and work with large datasets. If you enjoy solving complex data challenges and making systems more efficient, this is a great fit. Responsibilities
Build and maintain data pipelines on AWS Develop ETL jobs using AWS Glue (PySpark) and Amazon EMR Orchestrate workflows using Apache Airflow Support full and incremental data processing Implement data matching, deduplication, and entity resolution Monitor, troubleshoot, and support production pipelines Partner with analytics and business teams
Must Haves
6+ years in AWS data engineering experience Python and PySpark development Hands-on with AWS Glue and Amazon EMR Experience using Apache Airflow Strong SQL skills Experience working with large datasets Familiarity with ML concepts for data quality or matching
Nice to have
Experience with entity resolution, fuzzy matching, or deduplication Experience with AWS Entity Resolution Experience in Business MDM programs
Seniority level
Mid-Senior level Employment type
Full-time Job function
Information Technology Industries
Advertising Services Referrals increase your chances of interviewing at ExecutivePlacements.com by 2x #J-18808-Ljbffr
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.