Über
Job Description We are seeking an experienced PySpark/Python Data Engineer to design, develop, and optimize scalable data processing solutions. The ideal candidate will have strong hands-on expertise in PySpark, Python, ETL development, and distributed data processing environments. This role involves building high-performance data pipelines, ensuring data quality, and collaborating with cross-functional teams to support enterprise data initiatives. Must Have Technical/Functional Skills
Strong hands-on experience with PySpark (Spark SQL, DataFrame API) Advanced Python programming skills with focus on data processing and performance optimization Expertise in ETL/ELT design patterns and data pipeline architecture Strong SQL skills for data transformation and analysis Experience working in distributed data processing environments Knowledge of data quality, debugging, and performance tuning techniques Key Skills PySpark, Spark SQL, DataFrame API, Python, ETL, ELT, SQL, Data Engineering, Data Pipelines, Distributed Computing, AWS, S3, Glue, EMR, Airflow, Snowflake, Git, CI/CD, Data Warehousing Role Summary The Data Engineer will be responsible for developing and maintaining scalable ETL/ELT pipelines using PySpark and Python, optimizing data processing workloads, and ensuring reliable delivery of enterprise data solutions in production environments. Key Responsibilities
Design, develop, and maintain ETL/ELT pipelines using PySpark Build optimized and scalable transformations using Spark SQL and DataFrames Develop reusable Python-based data processing components Ensure data quality, integrity, and performance across pipelines Troubleshoot, debug, and optimize PySpark jobs Collaborate with Data Analysts, Architects, and DevOps teams Support CI/CD implementation and deployment workflows Monitor and troubleshoot production data workloads
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.