Lead Data Engineer (Snowflake, AWS, StreamSets)Apexon • Frisco, Texas, United States
Lead Data Engineer (Snowflake, AWS, StreamSets)
Apexon
- Frisco, Texas, United States
- Frisco, Texas, United States
À propos
Lead Data Engineer
to lead data migration and modernization initiatives for multiple client environments. The primary focus of this role will be migrating data from
AWS S3 to Snowflake
using
StreamSets , while ensuring scalable, reliable, and secure data movement.
The ideal candidate will have strong hands‑on expertise in
Snowflake, StreamSets, Python , and cloud engineering concepts, along with the ability to lead technical delivery across client‑facing data engineering engagements.
This is a
fully onsite role based in Dallas, Texas , requiring the selected candidate to work from the office
5 days per week .
Key Responsibilities
Lead migration initiatives for multiple clients, moving data from
AWS S3 to Snowflake
using
StreamSets .
Design, develop, and maintain scalable batch and near‑real‑time data pipelines using
StreamSets
and Python.
Assess existing client data environments, identify migration dependencies, and define implementation plans.
Build reusable ingestion frameworks to support efficient and repeatable migration across client projects.
Validate data completeness, accuracy, schema mapping, and reconciliation during migration.
Build and optimize data models, ingestion frameworks, and transformation workflows in
Snowflake .
Drive Snowflake performance optimization, workload tuning, and cost management.
Implement monitoring, error handling, audit logging, and data quality controls.
Apply cloud engineering concepts while designing resilient, secure, and scalable data solutions.
Collaborate with client stakeholders, architects, product owners, analysts, and engineering teams.
Mentor data engineers, conduct code reviews, and provide technical direction.
Troubleshoot production issues and lead root‑cause analysis and preventive‑action initiatives.
Ensure compliance with data governance, security, and access‑control standards.
Contribute to release planning, effort estimation, risk management, and delivery tracking.
Mandatory Technical Skills
Strong hands‑on experience with
Snowflake , including data loading, data modelling, query optimization, performance tuning, resource monitoring, cost optimization, and role‑based access control.
Practical experience with
StreamSets
for building and managing data ingestion and migration pipelines.
Strong programming skills in
Python
for data processing, automation, validation, and pipeline development.
Solid understanding of
cloud engineering concepts , including scalable architecture, storage and compute patterns, identity and access management, security, monitoring, fault tolerance, and cost optimization.
Strong knowledge of SQL and data engineering fundamentals.
Experience with ETL/ELT design patterns and data integration frameworks.
Understanding of data migration best practices, including schema mapping, reconciliation, data validation, and cutover planning.
Understanding of data quality, observability, and production support practices.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.