Senior Data Engineer
100 CRC Insurance Group, LLC
- Dallas, Texas, United States
- Dallas, Texas, United States
About
Design and develop data pipelines using Databricks Lakehouse architecture, including ingestion, transformation, and orchestration layers. Implement Medallion architecture (Bronze, Silver, Gold layers) and manage data lineage, quality, and governance using Unity Catalog. Drive adoption of best practices for data governance, metadata management, and cost optimization. Mentor and guide junior engineers, ensuring adherence to coding standards and architectural principles. Collaborate with cross‑functional teams (data scientists, analysts, business stakeholders) to translate requirements into technical solutions. Automate workflows for data ingestion and transformation using Databricks Jobs and orchestration tools. Monitor and troubleshoot performance issues across pipelines and clusters. Implement robust data security measures, including encryption, access controls, and auditing. Stay current with emerging technologies and recommend improvements to enhance scalability and efficiency. Required Qualifications
Senior Data Engineer with over 3 years of Databricks expertise. Strong hands‑on experience with Spark (PySpark or Spark SQL), Delta Lake, and Lakehouse architecture. Proficiency in Unity Catalog, Python, and SQL for data engineering workflows. Databricks Certified Data Engineer Professional (or equivalent) is mandatory. Experience with CI/CD practices and infrastructure‑as‑code. English fluency required. 1st shift work (United States) preferred. Preferred Qualifications
Experience with DBT for transformation and dependency management. AWS or Azure certifications, such as Azure Data Engineer Associate. Knowledge of data governance frameworks and observability tools. Exposure to machine learning pipelines and MLflow. Benefits
Eligible full‑time teammates enjoy access to medical, dental, vision, life, disability, and AD&D insurance; tax‑advantaged savings accounts; and a 401(k) plan with company match. CRC Group also offers generous paid time off programs, including company holidays, vacation and sick days, new parent leave, and more. Eligible positions may also qualify for restricted stock units and/or a deferred compensation plan. Equal Opportunity Employer
CRC Group supports a diverse workforce and is an Equal Opportunity Employer that does not discriminate on the basis of race, gender, color, religion, citizenship or national origin, age, sexual orientation, gender identity, disability, veteran status or other classification protected by law. CRC Group is a Drug Free Workplace. EEO is the Law. Pay Transparency Nondiscrimination Provision. E‑Verify.
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.