Dieses Stellenangebot ist nicht mehr verfügbar
Über
Interview Process: 2 rounds (virtual)- 1st is 30 minute technical with his lead, 2nd is cultural with HM.
Mission: To join the Information Security organization and be responsible for data ingestion, transformation, provisioning, and consumption.
Day to Day: An employer is looking to add a Data Engineer to their team in either Charlotte (Uptown location), Phoenix (Chandler location), or Dallas (Westlake, TX 76262) on a 3 days onsite, 2 days remote basis. This person will be joining the Information Security organization and be responsible for data ingestion, transformation, provisioning, and consumption. They will build and maintain scalable and efficient data pipelines to support data processing and analytics, develop and manage ETL processes to integrate data from various sources into a central repository, and use Apache Airflow to create and manage complex workflows and ensure timely execution of data jobs. They will optimize data processing workflows and database queries for performance and scalability, monitor data pipelines and systems to ensure reliability, data quality, and performance, and also create and maintain comprehensive documentation for data processes, workflows, and systems. Additionally, strong communication and collaboration skills are a "must" since they will work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Must haves: 5+ years of Data Engineering experience Hands-on experience with Apache Airflow for workflow orchestration Proficiency in Hadoop ecosystem (HDFS, Hive, MapReduce, etc.) Advanced skills in Python for data processing and ETL tasks Strong experience with PySpark for large-scale data processing Deep understanding of relational databases (e.g., MySQL, PostgreSQL) and SQL Experience with Git and GitHub for version control and collaboration
Plusses: Experience working in a GCP environment (client is currently on-prem but looking to get into the cloud)
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.