Lead Data Engineer (Snowflake, AWS, StreamSets)
Apexon
- Frisco, Texas, United States
- Frisco, Texas, United States
Über
Lead Data Engineer
to lead data migration and modernization initiatives for multiple client environments. The primary focus of this role will be migrating data from
AWS S3 to Snowflake
using
StreamSets , while ensuring scalable, reliable, and secure data movement.
The ideal candidate will have strong hands‑on expertise in
Snowflake, StreamSets, Python , and cloud engineering concepts, along with the ability to lead technical delivery across client‑facing data engineering engagements.
This is a
fully onsite role based in Dallas, Texas , requiring the selected candidate to work from the office
5 days per week .
Key Responsibilities
Lead migration initiatives for multiple clients, moving data from
AWS S3 to Snowflake
using
StreamSets .
Design, develop, and maintain scalable batch and near‑real‑time data pipelines using
StreamSets
and Python.
Assess existing client data environments, identify migration dependencies, and define implementation plans.
Build reusable ingestion frameworks to support efficient and repeatable migration across client projects.
Validate data completeness, accuracy, schema mapping, and reconciliation during migration.
Build and optimize data models, ingestion frameworks, and transformation workflows in
Snowflake .
Drive Snowflake performance optimization, workload tuning, and cost management.
Implement monitoring, error handling, audit logging, and data quality controls.
Apply cloud engineering concepts while designing resilient, secure, and scalable data solutions.
Collaborate with client stakeholders, architects, product owners, analysts, and engineering teams.
Mentor data engineers, conduct code reviews, and provide technical direction.
Troubleshoot production issues and lead root‑cause analysis and preventive‑action initiatives.
Ensure compliance with data governance, security, and access‑control standards.
Contribute to release planning, effort estimation, risk management, and delivery tracking.
Mandatory Technical Skills
Strong hands‑on experience with
Snowflake , including data loading, data modelling, query optimization, performance tuning, resource monitoring, cost optimization, and role‑based access control.
Practical experience with
StreamSets
for building and managing data ingestion and migration pipelines.
Strong programming skills in
Python
for data processing, automation, validation, and pipeline development.
Solid understanding of
cloud engineering concepts , including scalable architecture, storage and compute patterns, identity and access management, security, monitoring, fault tolerance, and cost optimization.
Strong knowledge of SQL and data engineering fundamentals.
Experience with ETL/ELT design patterns and data integration frameworks.
Understanding of data migration best practices, including schema mapping, reconciliation, data validation, and cutover planning.
Understanding of data quality, observability, and production support practices.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.