À propos
Location: Dallas, TX (Remote)
Experience: 8-12 Years
Summary: Lead the design, development, and optimization of large-scale, secure, and high-performance data pipelines across batch, real-time, and event-driven systems. Partner with cross-functional teams to deliver analytics, reporting, and ML-ready datasets.
Key Responsibilities:
Architect, build, and optimize batch and real-time data pipelines for enterprise-scale systems Integrate datasets from databases, files, APIs, and event streams (Kafka/Kinesis) Ensure data quality, scalability, reliability, and performance across pipelines Prepare curated datasets for analytics, reporting, and ML models Implement data security (access control, encryption, masking) and governance practices Monitor, troubleshoot, and tune data infrastructure for optimal efficiency Collaborate closely with data scientists, architects, and business teams to define data solutions Introduce best practices, mentor engineers, and drive data engineering standards
Mandatory Skills (with Experience):
Data Engineering (Overall): 8-12 years Python / Java / Spark: 6-10 years (strong coding) SQL & NoSQL Databases: 6-10 years (RDS, Redshift, DynamoDB, Synapse, BigQuery, MongoDB) Batch & Streaming Systems: 5-8 years (Kafka/Kinesis/event-driven systems) Cloud Experience: 5-8 years across AWS, Azure, GCP (minimum two clouds) APIs & Messaging Systems: 4-6 years (REST, event-driven architectures) Large-scale Dataset Engineering: 5-8 years (performance optimization) Graph Databases: 1-2 years (Neptune, RDF4j) Vector Databases: 1-2 years (Pinecone, FAISS) Data Security: 3-5 years (encryption, access control, masking)
Soft Skills:
Strong problem-solving & analytical thinking Excellent communication across technical & business teams High ownership, adaptability, and collaborative mindset
Nice to Have:
Domain knowledge: Insurance, Banking, Mortgage Containers & CI/CD: Docker, Kubernetes Streaming tools: Kafka, Kinesis (advanced usage) Exposure to NLP and data segmentation Experience with data visualization tools
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.