Data Engineer
Applied Resource Group
- Atlanta, Georgia, United States
- Atlanta, Georgia, United States
À propos
The ideal candidate will have a strong understanding of AWS data architecture, experience working with large datasets, and the ability to build reliable data pipelines that enable business intelligence and analytics teams.
Key Responsibilities
Design, develop, and maintain ETL pipelines using AWS Glue and PySpark to process and transform large datasets.
Build scalable data solutions within the AWS cloud ecosystem, ensuring performance, reliability, and efficiency.
Integrate data from multiple sources into Amazon Redshift and other data storage solutions.
Optimize and manage data transformation workflows for high-volume data processing.
Develop and maintain Python-based ETL scripts and data pipelines.
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.
Ensure data quality, governance, and consistency across the data platform.
Monitor and troubleshoot AWS Glue jobs and data pipeline performance.
Implement best practices for data modeling, partitioning, and performance optimization.
Support continuous improvements to the data platform architecture and ETL processes.
Required Qualifications
3+ years of experience in Data Engineering or similar role
Hands‑on experience with AWS Glue for ETL development
Strong programming skills in Python and PySpark
Experience working with Amazon Redshift
Solid understanding of ETL processes and data transformation frameworks
Experience designing and building data pipelines in AWS
Familiarity with AWS architecture and services (S3, IAM, Lambda, CloudWatch, etc.)
Experience working with structured and semi‑structured data
Knowledge of SQL and relational databases
Preferred Qualifications
Experience with data lake architectures
Familiarity with Apache Spark ecosystem
Experience with data orchestration tools (Airflow, Step Functions, etc.)
Understanding of CI/CD pipelines for data engineering
Experience supporting analytics or business intelligence platforms
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.