Data Engineer
ATS Staffing
- Phoenix, Arizona, United States
- Phoenix, Arizona, United States
Über
Lead the design and development of robust ETL/ELT data pipelines, ensuring efficient data ingestion, processing, and transformation from diverse sources into AWS data warehouses and data lakes, including batch and streaming data and formats such as JSON, CSV, Parquet, and Avro. Architect, build, and optimize scalable data architectures, including data lakes (e.g., S3, Delta Lake, Iceberg) and data warehouses (e.g., Redshift, Snowflake) on AWS, ensuring optimal performance and data accessibility. Collaborate closely with data scientists, analysts, and other stakeholders to understand data requirements, design appropriate data models and schemas, and deliver tailored data solutions that enable data-driven decision-making. Implement advanced data quality and governance practices, ensuring data accuracy, consistency, and compliance with relevant regulations. Optimize data retrieval and develop dashboards and reports using various tools, leveraging deep understanding of data warehousing and analytics concepts. Mentor and guide junior data engineers, fostering a culture of technical excellence and continuous improvement within the team. Proactively identify and resolve operational issues, troubleshoot complex data pipeline failures, and implement recommendations for system improvements.
Required Experience and Skills
68 years of hands-on experience as a Data Engineer, with a strong focus on AWS cloud services for data solutions. Expertise in designing, developing, optimizing, and troubleshooting complex data pipelines, leveraging AWS services like Glue, Lambda, EMR, S3, Redshift, Athena, Kinesis, Step Functions, DynamoDB, and Lake Formation. Proficiency in programming languages such as Python (including PySpark) and SQL (including advanced SQL, PL/SQL, query tuning), with the ability to write and optimize complex queries and scripts for data manipulation and transformation. Experience with big data technologies like Apache Spark, Hadoop, Kafka, and potentially real-time streaming platforms like Kinesis or Flink. In-depth knowledge of data modeling techniques, including relational and dimensional (star schema, snowflake schema), and schema design for data warehouses and data lakes. Experience with containerization technologies like Docker and Kubernetes for scalable deployments. Strong understanding of data security and compliance principles and best practices. Familiarity with DevOps practices for managing data infrastructure and CI/CD pipelines using tools like AWS CodePipeline, Jenkins, or others. Demonstrated experience in supporting ML/AI projects, including deploying pipelines for feature engineering and model inference. Excellent problem-solving, analytical, and communication skills, with the ability to collaborate effectively with cross-functional teams and stakeholders. Experience with version control systems like Git.
Educational Background and Certifications
Bachelors degree in Computer Science, Information Systems, or a related field is typically required or preferred. Masters degree preferred. AWS certifications such as AWS Certified Data Analytics Specialty or AWS Certified Solutions Architect Associate are a plus.
Desired Soft Skills
Strong communication and collaboration skills to interact with various stakeholders. Ability to mentor and support junior team members. Strong analytical and problem-solving skills, with a focus on data quality and operational efficiency. Ability to adapt and thrive in a fast-paced, agile environment.
Work Authorization
Must be authorized to work in the United States and hold a valid passport.
Travel
This position requires frequent travel, up to 50%. Most travel is outside the local area and overnight, with some international travel.
At our client you can look forward to:
Operating with some of the brightest minds in the hotel software industry. Receiving global exposure. Benefitting from continuous learning programs. Performance-based career growth. Competitive compensation that includes fixed compensation, variable compensation based on achieving set goals, company-paid employee benefits, vacation, sick and personal leave, and a company-matched 401(k).
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.